2026-04-27 07:53:56 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-04-27 07:53:56 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-04-27 07:53:56 [auto1.fr] INFO: Starting spider auto1.fr
2026-04-27 07:53:56 [scrapy.addons] INFO: Enabled addons:
[]
2026-04-27 07:53:56 [asyncio] DEBUG: Using selector: EpollSelector
2026-04-27 07:53:56 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-04-27 07:53:56 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-04-27 07:53:56 [scrapy.extensions.telnet] INFO: Telnet Password: edb9cacebcffa87a
2026-04-27 07:53:56 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-04-27 07:53:56 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.fr/2026-04-27T07_53_51.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-04-27 07:53:56 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-04-27 07:53:56 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-04-27 07:53:56 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-04-27 07:53:56 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-04-27 07:53:56 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-04-27 07:53:56 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2026-04-27 07:53:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-04-27 07:53:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2107
2026-04-27 07:53:57 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-04-27 07:53:57 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-04-27 07:53:57 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-04-27 07:53:57 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-04-27 07:53:57 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-04-27 07:53:57 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-04-27 07:53:57 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-04-27 07:53:57 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-04-27 07:53:57 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-04-27 07:53:57 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-04-27 07:53:57 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-04-27 07:53:57 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-04-27 07:53:57 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-04-27 07:53:57 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-04-27 07:53:57 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-04-27 07:53:57 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-04-27 07:53:57 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-04-27 07:53:57 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-04-27 07:53:57 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-04-27 07:53:57 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-04-27 07:53:57 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-04-27 07:53:59 [common.geocoding.geonames_geocoder] INFO: GeoNames geocoder loaded: 9 files, 94519 postal codes, 171568 cities
2026-04-27 07:53:59 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-27 07:53:59 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.geocoding_pipeline.GeocodingPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-04-27 07:53:59 [scrapy.core.engine] INFO: Spider opened
2026-04-27 07:53:59 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-04-27 07:53:59 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6025
2026-04-27 07:53:59 [scrapy.extensions.memusage] INFO: Peak memory usage is 341MiB
2026-04-27 07:53:59 [scrapy-playwright] INFO: Starting download handler
2026-04-27 07:53:59 [scrapy-playwright] INFO: Starting download handler
2026-04-27 07:54:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-04-27 07:54:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-04-27 07:54:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-04-27 07:54:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-04-27 07:54:09 [auto1.fr] INFO: Channel: 24h | Page: 0 | totalHits: 4713 | hits on page: 40
2026-04-27 07:54:09 [auto1.fr] INFO: Found listing with ID: NN14660
2026-04-27 07:54:09 [auto1.fr] INFO: Scrape type for NN14660: 1
2026-04-27 07:54:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:09 [auto1.fr] INFO: Found listing with ID: JH31546
2026-04-27 07:54:09 [auto1.fr] INFO: Scrape type for JH31546: 1
2026-04-27 07:54:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:09 [auto1.fr] INFO: Found listing with ID: DZ81947
2026-04-27 07:54:09 [auto1.fr] INFO: Scrape type for DZ81947: 1
2026-04-27 07:54:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:09 [auto1.fr] INFO: Found listing with ID: CF30196
2026-04-27 07:54:09 [auto1.fr] INFO: Scrape type for CF30196: 1
2026-04-27 07:54:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:09 [auto1.fr] INFO: Found listing with ID: KN31501
2026-04-27 07:54:09 [auto1.fr] INFO: Scrape type for KN31501: 1
2026-04-27 07:54:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:09 [auto1.fr] INFO: Found listing with ID: LK06376
2026-04-27 07:54:09 [auto1.fr] INFO: Scrape type for LK06376: 1
2026-04-27 07:54:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:09 [auto1.fr] INFO: Found listing with ID: KN14760
2026-04-27 07:54:09 [auto1.fr] INFO: Scrape type for KN14760: 1
2026-04-27 07:54:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:09 [auto1.fr] INFO: Found listing with ID: ST87878
2026-04-27 07:54:09 [auto1.fr] INFO: Scrape type for ST87878: 1
2026-04-27 07:54:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:09 [auto1.fr] INFO: Found listing with ID: YF75391
2026-04-27 07:54:09 [auto1.fr] INFO: Scrape type for YF75391: 1
2026-04-27 07:54:09 [auto1.fr] INFO: Found listing with ID: VG92697
2026-04-27 07:54:09 [auto1.fr] INFO: Scrape type for VG92697: 1
2026-04-27 07:54:09 [auto1.fr] INFO: Found listing with ID: ZA42646
2026-04-27 07:54:09 [auto1.fr] INFO: Scrape type for ZA42646: 1
2026-04-27 07:54:09 [auto1.fr] INFO: Found listing with ID: JC07782
2026-04-27 07:54:09 [auto1.fr] INFO: Scrape type for JC07782: 1
2026-04-27 07:54:09 [auto1.fr] INFO: Found listing with ID: SD98356
2026-04-27 07:54:09 [auto1.fr] INFO: Scrape type for SD98356: 1
2026-04-27 07:54:09 [auto1.fr] INFO: Found listing with ID: GD64881
2026-04-27 07:54:09 [auto1.fr] INFO: Scrape type for GD64881: 2
2026-04-27 07:54:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 81d79949-a795-514f-8d94-d85b6a21e10a with identifier: GD64881
2026-04-27 07:54:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81d79949-a795-514f-8d94-d85b6a21e10a with scrape type 2
2026-04-27 07:54:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 81d79949-a795-514f-8d94-d85b6a21e10a with scrape type 2
2026-04-27 07:54:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 81d79949-a795-514f-8d94-d85b6a21e10a, identifier: GD64881
2026-04-27 07:54:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 81d79949-a795-514f-8d94-d85b6a21e10a with identifier: GD64881
2026-04-27 07:54:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-27 07:54:10 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=yellow HTTP/1.1" 200 None
2026-04-27 07:54:10 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-27 07:54:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-27 07:54:10 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-04-27 07:54:10 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-27 07:54:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 81d79949-a795-514f-8d94-d85b6a21e10a with identifier: GD64881
2026-04-27 07:54:10 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 81d79949-a795-514f-8d94-d85b6a21e10a with identifier: GD64881 to the API
2026-04-27 07:54:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:10 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 95,
 'expiration_date': '2026-04-28T15:03:02Z',
 'fuel_type': 'petrol',
 'id': '81d79949-a795-514f-8d94-d85b6a21e10a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GD64881',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Citroen',
 'model': 'DS3',
 'odometer': 112736,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2011-09-27',
 'seller_name': None,
 'title': 'Citroen DS3 1.4 VTi Chic',
 'transmission': 'manual',
 'trim': 'Chic',
 'year': 2011}
2026-04-27 07:54:11 [auto1.fr] INFO: Saving data for GD64881: {'auction_closing_time': 1777388582.0, 'created_time': 1777020440.654472, 'has_photos': True, 'last_price_update_time': 1777276451.007777}
2026-04-27 07:54:11 [auto1.fr] INFO: Found listing with ID: XB02112
2026-04-27 07:54:11 [auto1.fr] INFO: Scrape type for XB02112: 1
2026-04-27 07:54:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NN14660/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:11 [auto1.fr] INFO: Found listing with ID: SS46159
2026-04-27 07:54:11 [auto1.fr] INFO: Scrape type for SS46159: 1
2026-04-27 07:54:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:11 [auto1.fr] INFO: Found listing with ID: RN69245
2026-04-27 07:54:11 [auto1.fr] INFO: Scrape type for RN69245: 1
2026-04-27 07:54:11 [auto1.fr] INFO: Found listing with ID: AT92488
2026-04-27 07:54:11 [auto1.fr] INFO: Scrape type for AT92488: 1
2026-04-27 07:54:11 [auto1.fr] INFO: Found listing with ID: BL55245
2026-04-27 07:54:11 [auto1.fr] INFO: Scrape type for BL55245: 1
2026-04-27 07:54:11 [auto1.fr] INFO: Found listing with ID: CU39401
2026-04-27 07:54:11 [auto1.fr] INFO: Scrape type for CU39401: 1
2026-04-27 07:54:11 [auto1.fr] INFO: Found listing with ID: KU94506
2026-04-27 07:54:11 [auto1.fr] INFO: Scrape type for KU94506: 1
2026-04-27 07:54:11 [auto1.fr] INFO: Found listing with ID: JR90965
2026-04-27 07:54:11 [auto1.fr] INFO: Scrape type for JR90965: 1
2026-04-27 07:54:11 [auto1.fr] INFO: Channel: 24h | Page: 1 | totalHits: 4714 | hits on page: 40
2026-04-27 07:54:11 [auto1.fr] INFO: Found listing with ID: HM67583
2026-04-27 07:54:11 [auto1.fr] INFO: Scrape type for HM67583: 1
2026-04-27 07:54:11 [auto1.fr] INFO: Found listing with ID: DL16043
2026-04-27 07:54:11 [auto1.fr] INFO: Scrape type for DL16043: 1
2026-04-27 07:54:11 [auto1.fr] INFO: Found listing with ID: KR77136
2026-04-27 07:54:11 [auto1.fr] INFO: Scrape type for KR77136: 1
2026-04-27 07:54:11 [auto1.fr] INFO: Found listing with ID: NN14660
2026-04-27 07:54:11 [auto1.fr] INFO: Found listing with ID: TK52688
2026-04-27 07:54:11 [auto1.fr] INFO: Scrape type for TK52688: 1
2026-04-27 07:54:11 [scrapy.dupefilters] DEBUG: Filtered duplicate request: <GET https://www.auto1.com/v1/car-details-view/NN14660/cdb8adcc-312b-4040-b112-4a289f3f9b07> - no more duplicates will be shown (see DUPEFILTER_DEBUG to show all duplicates)
2026-04-27 07:54:11 [auto1.fr] INFO: Found listing with ID: JH31546
2026-04-27 07:54:11 [auto1.fr] INFO: Found listing with ID: ZH79722
2026-04-27 07:54:11 [auto1.fr] INFO: Scrape type for ZH79722: 1
2026-04-27 07:54:11 [auto1.fr] INFO: Found listing with ID: DZ81947
2026-04-27 07:54:11 [auto1.fr] INFO: Found listing with ID: PR21978
2026-04-27 07:54:11 [auto1.fr] INFO: Scrape type for PR21978: 1
2026-04-27 07:54:11 [auto1.fr] INFO: Found listing with ID: CF30196
2026-04-27 07:54:11 [auto1.fr] INFO: Found listing with ID: CY19379
2026-04-27 07:54:11 [auto1.fr] INFO: Scrape type for CY19379: 1
2026-04-27 07:54:11 [auto1.fr] INFO: Found listing with ID: KN31501
2026-04-27 07:54:11 [auto1.fr] INFO: Found listing with ID: JC67510
2026-04-27 07:54:11 [auto1.fr] INFO: Scrape type for JC67510: 1
2026-04-27 07:54:11 [auto1.fr] INFO: Found listing with ID: LK06376
2026-04-27 07:54:11 [auto1.fr] INFO: Found listing with ID: ET06456
2026-04-27 07:54:11 [auto1.fr] INFO: Scrape type for ET06456: 1
2026-04-27 07:54:11 [auto1.fr] INFO: Found listing with ID: KN14760
2026-04-27 07:54:11 [auto1.fr] INFO: Found listing with ID: HK73119
2026-04-27 07:54:11 [auto1.fr] INFO: Scrape type for HK73119: 1
2026-04-27 07:54:11 [auto1.fr] INFO: Found listing with ID: ST87878
2026-04-27 07:54:11 [auto1.fr] INFO: Found listing with ID: WR40640
2026-04-27 07:54:11 [auto1.fr] INFO: Scrape type for WR40640: 1
2026-04-27 07:54:11 [auto1.fr] INFO: Found listing with ID: YF75391
2026-04-27 07:54:11 [auto1.fr] INFO: Found listing with ID: TA18701
2026-04-27 07:54:11 [auto1.fr] INFO: Scrape type for TA18701: 1
2026-04-27 07:54:11 [auto1.fr] INFO: Found listing with ID: VG92697
2026-04-27 07:54:11 [auto1.fr] INFO: Found listing with ID: TK49070
2026-04-27 07:54:11 [auto1.fr] INFO: Scrape type for TK49070: 2
2026-04-27 07:54:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70daf9d1-f540-5087-931f-2451c3aebda2 with identifier: TK49070
2026-04-27 07:54:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70daf9d1-f540-5087-931f-2451c3aebda2 with scrape type 2
2026-04-27 07:54:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 70daf9d1-f540-5087-931f-2451c3aebda2 with scrape type 2
2026-04-27 07:54:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 70daf9d1-f540-5087-931f-2451c3aebda2, identifier: TK49070
2026-04-27 07:54:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 70daf9d1-f540-5087-931f-2451c3aebda2 with identifier: TK49070
2026-04-27 07:54:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-27 07:54:11 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-04-27 07:54:11 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-27 07:54:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-27 07:54:11 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-04-27 07:54:12 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-27 07:54:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 70daf9d1-f540-5087-931f-2451c3aebda2 with identifier: TK49070
2026-04-27 07:54:12 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 70daf9d1-f540-5087-931f-2451c3aebda2 with identifier: TK49070 to the API
2026-04-27 07:54:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:12 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-04-28T15:52:16Z',
 'fuel_type': 'diesel',
 'id': '70daf9d1-f540-5087-931f-2451c3aebda2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TK49070',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Toyota',
 'model': 'Verso',
 'odometer': 217539,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2014-12-08',
 'seller_name': None,
 'title': 'Toyota Verso 1.6 D-4D Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2014}
2026-04-27 07:54:12 [auto1.fr] INFO: Saving data for TK49070: {'auction_closing_time': 1777391536.0, 'created_time': 1777024607.441742, 'has_photos': True, 'last_price_update_time': 1777276452.379424}
2026-04-27 07:54:12 [auto1.fr] INFO: Found listing with ID: ZA42646
2026-04-27 07:54:12 [auto1.fr] INFO: Found listing with ID: ML55257
2026-04-27 07:54:12 [auto1.fr] INFO: Scrape type for ML55257: 1
2026-04-27 07:54:12 [auto1.fr] INFO: Found listing with ID: JC07782
2026-04-27 07:54:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KN14760/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KN31501/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:12 [auto1.fr] INFO: Found listing with ID: UX62413
2026-04-27 07:54:12 [auto1.fr] INFO: Scrape type for UX62413: 1
2026-04-27 07:54:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CF30196/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LK06376/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DZ81947/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JH31546/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YF75391/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ST87878/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:12 [auto1.fr] INFO: Found listing with ID: SD98356
2026-04-27 07:54:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:12 [auto1.fr] INFO: Found listing with ID: UV91216
2026-04-27 07:54:12 [auto1.fr] INFO: Scrape type for UV91216: 2
2026-04-27 07:54:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae85a0d7-d7af-5421-8a63-2d12bc866bf4 with identifier: UV91216
2026-04-27 07:54:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae85a0d7-d7af-5421-8a63-2d12bc866bf4 with scrape type 2
2026-04-27 07:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ae85a0d7-d7af-5421-8a63-2d12bc866bf4 with scrape type 2
2026-04-27 07:54:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ae85a0d7-d7af-5421-8a63-2d12bc866bf4, identifier: UV91216
2026-04-27 07:54:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ae85a0d7-d7af-5421-8a63-2d12bc866bf4 with identifier: UV91216
2026-04-27 07:54:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-27 07:54:12 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-04-27 07:54:12 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-27 07:54:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ae85a0d7-d7af-5421-8a63-2d12bc866bf4 with identifier: UV91216
2026-04-27 07:54:12 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ae85a0d7-d7af-5421-8a63-2d12bc866bf4 with identifier: UV91216 to the API
2026-04-27 07:54:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:13 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 102,
 'expiration_date': '2026-04-28T15:40:15Z',
 'fuel_type': 'diesel',
 'id': 'ae85a0d7-d7af-5421-8a63-2d12bc866bf4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UV91216',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Volkswagen',
 'model': 'T4 Caravelle',
 'odometer': 323759,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2000-02-06',
 'seller_name': None,
 'title': 'Volkswagen T4 Caravelle 2.5 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2000}
2026-04-27 07:54:13 [auto1.fr] INFO: Saving data for UV91216: {'auction_closing_time': 1777390815.0, 'created_time': 1777020097.883465, 'has_photos': True, 'last_price_update_time': 1777276453.167332}
2026-04-27 07:54:13 [auto1.fr] INFO: Found listing with ID: GD64881
2026-04-27 07:54:13 [auto1.fr] INFO: Scrape type for GD64881: 0
2026-04-27 07:54:13 [auto1.fr] INFO: Found listing with ID: XB02112
2026-04-27 07:54:13 [auto1.fr] INFO: Found listing with ID: SA02986
2026-04-27 07:54:13 [auto1.fr] INFO: Scrape type for SA02986: 1
2026-04-27 07:54:13 [auto1.fr] INFO: Found listing with ID: SS46159
2026-04-27 07:54:13 [auto1.fr] INFO: Found listing with ID: CN92978
2026-04-27 07:54:13 [auto1.fr] INFO: Scrape type for CN92978: 1
2026-04-27 07:54:13 [auto1.fr] INFO: Found listing with ID: RN69245
2026-04-27 07:54:13 [auto1.fr] INFO: Found listing with ID: VJ16113
2026-04-27 07:54:13 [auto1.fr] INFO: Scrape type for VJ16113: 1
2026-04-27 07:54:13 [auto1.fr] INFO: Found listing with ID: AT92488
2026-04-27 07:54:13 [auto1.fr] INFO: Found listing with ID: BL55245
2026-04-27 07:54:13 [auto1.fr] INFO: Found listing with ID: CU39401
2026-04-27 07:54:13 [auto1.fr] INFO: Found listing with ID: KU94506
2026-04-27 07:54:13 [auto1.fr] INFO: Found listing with ID: JR90965
2026-04-27 07:54:13 [auto1.fr] INFO: Found listing with ID: HM67583
2026-04-27 07:54:13 [auto1.fr] INFO: Found listing with ID: KR77136
2026-04-27 07:54:13 [auto1.fr] INFO: Found listing with ID: TK52688
2026-04-27 07:54:13 [auto1.fr] INFO: Found listing with ID: ZH79722
2026-04-27 07:54:13 [auto1.fr] INFO: Found listing with ID: PR21978
2026-04-27 07:54:13 [auto1.fr] INFO: Found listing with ID: CY19379
2026-04-27 07:54:13 [auto1.fr] INFO: Found listing with ID: JC67510
2026-04-27 07:54:13 [auto1.fr] INFO: Found listing with ID: ET06456
2026-04-27 07:54:13 [auto1.fr] INFO: Found listing with ID: HK73119
2026-04-27 07:54:13 [auto1.fr] INFO: Found listing with ID: WR40640
2026-04-27 07:54:13 [auto1.fr] INFO: Found listing with ID: TA18701
2026-04-27 07:54:13 [auto1.fr] INFO: Found listing with ID: TK49070
2026-04-27 07:54:13 [auto1.fr] INFO: Scrape type for TK49070: 0
2026-04-27 07:54:13 [auto1.fr] INFO: Found listing with ID: ML55257
2026-04-27 07:54:13 [auto1.fr] INFO: Found listing with ID: UX62413
2026-04-27 07:54:13 [auto1.fr] INFO: Found listing with ID: UV91216
2026-04-27 07:54:13 [auto1.fr] INFO: Scrape type for UV91216: 0
2026-04-27 07:54:13 [auto1.fr] INFO: Found listing with ID: SA02986
2026-04-27 07:54:13 [auto1.fr] INFO: Found listing with ID: CN92978
2026-04-27 07:54:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RN69245/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SD98356/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AT92488/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VG92697/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JC07782/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XB02112/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZA42646/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SS46159/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ML55257/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WR40640/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HK73119/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TA18701/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UX62413/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CY19379/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JC67510/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ST87878> (referer: https://www.auto1.com/v1/car-details-view/ST87878/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e79f5f2d-882f-599f-bd9c-1bf57a9015b5 with identifier: ST87878
2026-04-27 07:54:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e79f5f2d-882f-599f-bd9c-1bf57a9015b5 with scrape type 1
2026-04-27 07:54:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e79f5f2d-882f-599f-bd9c-1bf57a9015b5
2026-04-27 07:54:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/f5/80f50f58c2dd7a24153e0a86a605b3e1/pa/ST87878_719e326a48f98864e4e4246eb1ba47fa.jpg not downloaded yet
2026-04-27 07:54:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/f5/80f50f58c2dd7a24153e0a86a605b3e1/pa/ST87878_13216ace9df9ed4297216ded9ba57136.jpg not downloaded yet
2026-04-27 07:54:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JH31546> (referer: https://www.auto1.com/v1/car-details-view/JH31546/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/f5/80f50f58c2dd7a24153e0a86a605b3e1/pa/ST87878_1faf4fb242baf177039fb4a901173bc4.jpg not downloaded yet
2026-04-27 07:54:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/f5/80f50f58c2dd7a24153e0a86a605b3e1/pa/ST87878_844dbc306007aad353395c447c213239.jpg not downloaded yet
2026-04-27 07:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/f5/80f50f58c2dd7a24153e0a86a605b3e1/pa/ST87878_4c4690b221c5340500c58c4e2841b0dc.jpg not downloaded yet
2026-04-27 07:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/f5/80f50f58c2dd7a24153e0a86a605b3e1/pa/ST87878_bb4ef10fb7271c6e06de0a01dd362be6.jpg not downloaded yet
2026-04-27 07:54:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YF75391> (referer: https://www.auto1.com/v1/car-details-view/YF75391/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/f5/80f50f58c2dd7a24153e0a86a605b3e1/pa/ST87878_bcf384a72b361a59e8525ab3f91abbf8.jpg not downloaded yet
2026-04-27 07:54:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/f5/80f50f58c2dd7a24153e0a86a605b3e1/pa/ST87878_89e0d056e033d02e237c7d6157a34d3e.jpg not downloaded yet
2026-04-27 07:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/f5/80f50f58c2dd7a24153e0a86a605b3e1/pa/ST87878_73e35c6ecb6789e73aa585f3eb118526.jpg not downloaded yet
2026-04-27 07:54:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 118bae87-5815-5188-99a4-e835fe74f496 with identifier: JH31546
2026-04-27 07:54:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 118bae87-5815-5188-99a4-e835fe74f496 with scrape type 1
2026-04-27 07:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 118bae87-5815-5188-99a4-e835fe74f496
2026-04-27 07:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/7d/fc7d2b0da8d51d24eb9a616211e1fc3b/pa/JH31546_a536fe134fa9eda64432ee1b78a684fc.jpg not downloaded yet
2026-04-27 07:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/f5/80f50f58c2dd7a24153e0a86a605b3e1/pa/ST87878_bdf02c568742b0956feae9eba5caf8e2.jpg not downloaded yet
2026-04-27 07:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/7d/fc7d2b0da8d51d24eb9a616211e1fc3b/pa/JH31546_8103a3f3dbb42c68897855a6b64db07d.jpg not downloaded yet
2026-04-27 07:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/7d/fc7d2b0da8d51d24eb9a616211e1fc3b/pa/JH31546_d9191654f7171f14aba56e28d0943e01.jpg not downloaded yet
2026-04-27 07:54:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5fa53457-6660-57e0-841c-925c8ec219a0 with identifier: YF75391
2026-04-27 07:54:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5fa53457-6660-57e0-841c-925c8ec219a0 with scrape type 1
2026-04-27 07:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 5fa53457-6660-57e0-841c-925c8ec219a0
2026-04-27 07:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/e4/b6e49c0f84af029932654e7ec6a5037b/pa/YF75391_e447961653cf906a2e751d9e0b032777.jpg not downloaded yet
2026-04-27 07:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/7d/fc7d2b0da8d51d24eb9a616211e1fc3b/pa/JH31546_c6a21d562cb1c3de23edc046d51fc961.jpg not downloaded yet
2026-04-27 07:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/e4/b6e49c0f84af029932654e7ec6a5037b/pa/YF75391_3a0e1f8defa678438fc9e3f83409e220.jpg not downloaded yet
2026-04-27 07:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/7d/fc7d2b0da8d51d24eb9a616211e1fc3b/pa/JH31546_d9ce5685392957af68da7b3d41d24c7c.jpg not downloaded yet
2026-04-27 07:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/e4/b6e49c0f84af029932654e7ec6a5037b/pa/YF75391_37fad7ab4f953a6643c44096a94c439d.jpg not downloaded yet
2026-04-27 07:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/7d/fc7d2b0da8d51d24eb9a616211e1fc3b/pa/JH31546_ddee527b25e7f1f5fde4f1921ad542ce.jpg not downloaded yet
2026-04-27 07:54:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DZ81947> (referer: https://www.auto1.com/v1/car-details-view/DZ81947/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LK06376> (referer: https://www.auto1.com/v1/car-details-view/LK06376/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/e4/b6e49c0f84af029932654e7ec6a5037b/pa/YF75391_6819c451111f18ea8c2e0c9aebc9b0dd.jpg not downloaded yet
2026-04-27 07:54:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/7d/fc7d2b0da8d51d24eb9a616211e1fc3b/pa/JH31546_b1e4247d2f97bded36704a84f37f4126.jpg not downloaded yet
2026-04-27 07:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/e4/b6e49c0f84af029932654e7ec6a5037b/pa/YF75391_d5888c927eb270fd9c3e8a1b84d80b22.jpg not downloaded yet
2026-04-27 07:54:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XB02112> (referer: https://www.auto1.com/v1/car-details-view/XB02112/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/7d/fc7d2b0da8d51d24eb9a616211e1fc3b/pa/JH31546_417c374d25364fd47917bb977a9fde6a.jpg not downloaded yet
2026-04-27 07:54:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/e4/b6e49c0f84af029932654e7ec6a5037b/pa/YF75391_011398e16c01c1cd18a9aff8e23060c5.jpg not downloaded yet
2026-04-27 07:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/7d/fc7d2b0da8d51d24eb9a616211e1fc3b/pa/JH31546_4f112717638022f3ff021f7b1502be93.jpg not downloaded yet
2026-04-27 07:54:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/f5/80f50f58c2dd7a24153e0a86a605b3e1/pa/ST87878_bb4ef10fb7271c6e06de0a01dd362be6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/7d/fc7d2b0da8d51d24eb9a616211e1fc3b/pa/JH31546_d7558a862106cb7439f14d81ba695508.jpg not downloaded yet
2026-04-27 07:54:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 522a9e1a-96ad-52ce-b85c-10a91d20ee51 with identifier: DZ81947
2026-04-27 07:54:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 522a9e1a-96ad-52ce-b85c-10a91d20ee51 with scrape type 1
2026-04-27 07:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 522a9e1a-96ad-52ce-b85c-10a91d20ee51
2026-04-27 07:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/a5/23a513bc56061f1f5b101fc2dd45bf81/pa/DZ81947_fdce1327073f7992645bc1f6ad464221.jpg not downloaded yet
2026-04-27 07:54:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8f32245-5789-5979-ac68-bfebe34ceb75 with identifier: LK06376
2026-04-27 07:54:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8f32245-5789-5979-ac68-bfebe34ceb75 with scrape type 1
2026-04-27 07:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e8f32245-5789-5979-ac68-bfebe34ceb75
2026-04-27 07:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/cf/56cffaa1cfd9c73b12ab4ed974b66846/pa/LK06376_3b57da7d9aaedde8759319a7c290c1be.jpg not downloaded yet
2026-04-27 07:54:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/f5/80f50f58c2dd7a24153e0a86a605b3e1/pa/ST87878_13216ace9df9ed4297216ded9ba57136.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/a5/23a513bc56061f1f5b101fc2dd45bf81/pa/DZ81947_d85f9cb1750154148101e3158aadffd2.jpg not downloaded yet
2026-04-27 07:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/cf/56cffaa1cfd9c73b12ab4ed974b66846/pa/LK06376_c7440066582c3ec71af2682d4dd6887d.jpg not downloaded yet
2026-04-27 07:54:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VJ16113/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/a5/23a513bc56061f1f5b101fc2dd45bf81/pa/DZ81947_8639ec2539cec5ca6ab473620ed91b01.jpg not downloaded yet
2026-04-27 07:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/cf/56cffaa1cfd9c73b12ab4ed974b66846/pa/LK06376_b2677b7343298da624c93bdb6809f996.jpg not downloaded yet
2026-04-27 07:54:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 35eb078b-9e97-5b63-b9c0-67eb0572a3d5 with identifier: XB02112
2026-04-27 07:54:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35eb078b-9e97-5b63-b9c0-67eb0572a3d5 with scrape type 1
2026-04-27 07:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 35eb078b-9e97-5b63-b9c0-67eb0572a3d5
2026-04-27 07:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/26/f326b82c3ac29d9bab3681d3d194aceb/pa/XB02112_c9f561db2009786d41759d471a545ee1.jpg not downloaded yet
2026-04-27 07:54:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-04-27 07:54:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 36f195bf-b061-498b-bebd-997f7853af90
2026-04-27 07:54:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438dd5650>
2026-04-27 07:54:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-04-27 07:54:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2093
2026-04-27 07:54:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxdev.blob.core.windows.net:443
2026-04-27 07:54:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e79f5f2d-882f-599f-bd9c-1bf57a9015b5/e79f5f2d-882f-599f-bd9c-1bf57a9015b5_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:54:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/f5/80f50f58c2dd7a24153e0a86a605b3e1/pa/ST87878_bb4ef10fb7271c6e06de0a01dd362be6.jpg saved to cache
2026-04-27 07:54:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e79f5f2d-882f-599f-bd9c-1bf57a9015b5
2026-04-27 07:54:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/7d/fc7d2b0da8d51d24eb9a616211e1fc3b/pa/JH31546_d9ce5685392957af68da7b3d41d24c7c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/cf/56cffaa1cfd9c73b12ab4ed974b66846/pa/LK06376_3b57da7d9aaedde8759319a7c290c1be.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/e4/b6e49c0f84af029932654e7ec6a5037b/pa/YF75391_011398e16c01c1cd18a9aff8e23060c5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/a5/23a513bc56061f1f5b101fc2dd45bf81/pa/DZ81947_1409c64c237a9c0bba0fdd20f8e2dc57.jpg not downloaded yet
2026-04-27 07:54:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/cf/56cffaa1cfd9c73b12ab4ed974b66846/pa/LK06376_c52862408fd8575827cc12131b2bd62f.jpg not downloaded yet
2026-04-27 07:54:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/e4/b6e49c0f84af029932654e7ec6a5037b/pa/YF75391_37fad7ab4f953a6643c44096a94c439d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/26/f326b82c3ac29d9bab3681d3d194aceb/pa/XB02112_9daf1990d48ff506474451aee11bb4aa.jpg not downloaded yet
2026-04-27 07:54:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/a5/23a513bc56061f1f5b101fc2dd45bf81/pa/DZ81947_626b6c035c4264daf6aef2d22f6ae3b4.jpg not downloaded yet
2026-04-27 07:54:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/cf/56cffaa1cfd9c73b12ab4ed974b66846/pa/LK06376_606e1ca9cb2904de982db2ec9d1b9b7f.jpg not downloaded yet
2026-04-27 07:54:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ET06456/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JC07782> (referer: https://www.auto1.com/v1/car-details-view/JC07782/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d31c10>
2026-04-27 07:54:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e79f5f2d-882f-599f-bd9c-1bf57a9015b5/e79f5f2d-882f-599f-bd9c-1bf57a9015b5_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/f5/80f50f58c2dd7a24153e0a86a605b3e1/pa/ST87878_13216ace9df9ed4297216ded9ba57136.jpg saved to cache
2026-04-27 07:54:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e79f5f2d-882f-599f-bd9c-1bf57a9015b5
2026-04-27 07:54:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/26/f326b82c3ac29d9bab3681d3d194aceb/pa/XB02112_7a608f710c7812ebb5cc444e016c04a9.jpg not downloaded yet
2026-04-27 07:54:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/a5/23a513bc56061f1f5b101fc2dd45bf81/pa/DZ81947_a647e629878d8537f5478acc1b0167b4.jpg not downloaded yet
2026-04-27 07:54:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/cf/56cffaa1cfd9c73b12ab4ed974b66846/pa/LK06376_bf1e4958e26e8f6f0d587900777b20c0.jpg not downloaded yet
2026-04-27 07:54:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SS46159> (referer: https://www.auto1.com/v1/car-details-view/SS46159/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/7d/fc7d2b0da8d51d24eb9a616211e1fc3b/pa/JH31546_b1e4247d2f97bded36704a84f37f4126.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/26/f326b82c3ac29d9bab3681d3d194aceb/pa/XB02112_76a2b5ec7bae7bb8200b312e90c7ff90.jpg not downloaded yet
2026-04-27 07:54:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/cf/56cffaa1cfd9c73b12ab4ed974b66846/pa/LK06376_b2677b7343298da624c93bdb6809f996.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/a5/23a513bc56061f1f5b101fc2dd45bf81/pa/DZ81947_a026f3db001f054b3491bb629f0180d2.jpg not downloaded yet
2026-04-27 07:54:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/cf/56cffaa1cfd9c73b12ab4ed974b66846/pa/LK06376_519d8d956ace8bd501db59eed9c6c83a.jpg not downloaded yet
2026-04-27 07:54:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438cebc50>
2026-04-27 07:54:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_118bae87-5815-5188-99a4-e835fe74f496/118bae87-5815-5188-99a4-e835fe74f496_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:54:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/7d/fc7d2b0da8d51d24eb9a616211e1fc3b/pa/JH31546_d9ce5685392957af68da7b3d41d24c7c.jpg saved to cache
2026-04-27 07:54:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 118bae87-5815-5188-99a4-e835fe74f496
2026-04-27 07:54:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a7ff10>
2026-04-27 07:54:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8f32245-5789-5979-ac68-bfebe34ceb75/e8f32245-5789-5979-ac68-bfebe34ceb75_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/cf/56cffaa1cfd9c73b12ab4ed974b66846/pa/LK06376_3b57da7d9aaedde8759319a7c290c1be.jpg saved to cache
2026-04-27 07:54:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e8f32245-5789-5979-ac68-bfebe34ceb75
2026-04-27 07:54:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a91150>
2026-04-27 07:54:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fa53457-6660-57e0-841c-925c8ec219a0/5fa53457-6660-57e0-841c-925c8ec219a0_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:54:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/e4/b6e49c0f84af029932654e7ec6a5037b/pa/YF75391_011398e16c01c1cd18a9aff8e23060c5.jpg saved to cache
2026-04-27 07:54:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5fa53457-6660-57e0-841c-925c8ec219a0
2026-04-27 07:54:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a83550>
2026-04-27 07:54:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fa53457-6660-57e0-841c-925c8ec219a0/5fa53457-6660-57e0-841c-925c8ec219a0_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/e4/b6e49c0f84af029932654e7ec6a5037b/pa/YF75391_37fad7ab4f953a6643c44096a94c439d.jpg saved to cache
2026-04-27 07:54:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5fa53457-6660-57e0-841c-925c8ec219a0
2026-04-27 07:54:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/26/f326b82c3ac29d9bab3681d3d194aceb/pa/XB02112_c9f561db2009786d41759d471a545ee1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/26/f326b82c3ac29d9bab3681d3d194aceb/pa/XB02112_5b50319d131194beb170465ba763f456.jpg not downloaded yet
2026-04-27 07:54:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ML55257> (referer: https://www.auto1.com/v1/car-details-view/ML55257/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9fc7ebb-4dab-5408-803a-e3e3e01e4608 with identifier: JC07782
2026-04-27 07:54:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9fc7ebb-4dab-5408-803a-e3e3e01e4608 with scrape type 1
2026-04-27 07:54:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d9fc7ebb-4dab-5408-803a-e3e3e01e4608
2026-04-27 07:54:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/41/4d41a843d7fe4dbf1480e42fee5201cc/pa/JC07782_94ce427c3283e80ab8562651a13a2024.jpg not downloaded yet
2026-04-27 07:54:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/a5/23a513bc56061f1f5b101fc2dd45bf81/pa/DZ81947_d85f9cb1750154148101e3158aadffd2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/a5/23a513bc56061f1f5b101fc2dd45bf81/pa/DZ81947_8639ec2539cec5ca6ab473620ed91b01.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/a5/23a513bc56061f1f5b101fc2dd45bf81/pa/DZ81947_f3fea18a63bdaef0c05d5e58488c9148.jpg not downloaded yet
2026-04-27 07:54:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/cf/56cffaa1cfd9c73b12ab4ed974b66846/pa/LK06376_8f9d28a22eecc2cfdeab99ec90c29464.jpg not downloaded yet
2026-04-27 07:54:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WR40640> (referer: https://www.auto1.com/v1/car-details-view/WR40640/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZA42646> (referer: https://www.auto1.com/v1/car-details-view/ZA42646/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8add49ec-4174-5d8d-ae40-de2af2b3476e with identifier: SS46159
2026-04-27 07:54:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8add49ec-4174-5d8d-ae40-de2af2b3476e with scrape type 1
2026-04-27 07:54:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8add49ec-4174-5d8d-ae40-de2af2b3476e
2026-04-27 07:54:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/9a/f69a585bee2db2e33a8e6c259ab85f06/pa/SS46159_64620978af954f1dbcc812c67d446ee5.jpg not downloaded yet
2026-04-27 07:54:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a9cbd0>
2026-04-27 07:54:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_118bae87-5815-5188-99a4-e835fe74f496/118bae87-5815-5188-99a4-e835fe74f496_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:54:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/7d/fc7d2b0da8d51d24eb9a616211e1fc3b/pa/JH31546_b1e4247d2f97bded36704a84f37f4126.jpg saved to cache
2026-04-27 07:54:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 118bae87-5815-5188-99a4-e835fe74f496
2026-04-27 07:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/26/f326b82c3ac29d9bab3681d3d194aceb/pa/XB02112_c4dd375565f93294c931bb697e27f73e.jpg not downloaded yet
2026-04-27 07:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/41/4d41a843d7fe4dbf1480e42fee5201cc/pa/JC07782_dd9650af8d6afb51f1c242d869cbad9d.jpg not downloaded yet
2026-04-27 07:54:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438cc4090>
2026-04-27 07:54:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8f32245-5789-5979-ac68-bfebe34ceb75/e8f32245-5789-5979-ac68-bfebe34ceb75_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/cf/56cffaa1cfd9c73b12ab4ed974b66846/pa/LK06376_b2677b7343298da624c93bdb6809f996.jpg saved to cache
2026-04-27 07:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e8f32245-5789-5979-ac68-bfebe34ceb75
2026-04-27 07:54:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/26/f326b82c3ac29d9bab3681d3d194aceb/pa/XB02112_7a608f710c7812ebb5cc444e016c04a9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/a5/23a513bc56061f1f5b101fc2dd45bf81/pa/DZ81947_ac8973e322212efe4ec89642154acb93.jpg not downloaded yet
2026-04-27 07:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/cf/56cffaa1cfd9c73b12ab4ed974b66846/pa/LK06376_01b1a3c2ea2123a65d334b2519785638.jpg not downloaded yet
2026-04-27 07:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/9a/f69a585bee2db2e33a8e6c259ab85f06/pa/SS46159_6307bdaec5abe85bc238774d84353661.jpg not downloaded yet
2026-04-27 07:54:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/cf/56cffaa1cfd9c73b12ab4ed974b66846/pa/LK06376_bf1e4958e26e8f6f0d587900777b20c0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/41/4d41a843d7fe4dbf1480e42fee5201cc/pa/JC07782_86919b5e769cbb43c1b09128ac056147.jpg not downloaded yet
2026-04-27 07:54:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438f91a90>
2026-04-27 07:54:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35eb078b-9e97-5b63-b9c0-67eb0572a3d5/35eb078b-9e97-5b63-b9c0-67eb0572a3d5_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/26/f326b82c3ac29d9bab3681d3d194aceb/pa/XB02112_c9f561db2009786d41759d471a545ee1.jpg saved to cache
2026-04-27 07:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 35eb078b-9e97-5b63-b9c0-67eb0572a3d5
2026-04-27 07:54:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5ce9a97-2010-5e49-9d94-9572d74d6438 with identifier: ML55257
2026-04-27 07:54:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5ce9a97-2010-5e49-9d94-9572d74d6438 with scrape type 1
2026-04-27 07:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f5ce9a97-2010-5e49-9d94-9572d74d6438
2026-04-27 07:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/32/0132a521be2d768c9ab2b6d5b8af4d26/pa/ML55257_835e71bd3e87e985823771d5060aa818.jpg not downloaded yet
2026-04-27 07:54:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c219d0>
2026-04-27 07:54:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_522a9e1a-96ad-52ce-b85c-10a91d20ee51/522a9e1a-96ad-52ce-b85c-10a91d20ee51_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/a5/23a513bc56061f1f5b101fc2dd45bf81/pa/DZ81947_d85f9cb1750154148101e3158aadffd2.jpg saved to cache
2026-04-27 07:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 522a9e1a-96ad-52ce-b85c-10a91d20ee51
2026-04-27 07:54:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c99890>
2026-04-27 07:54:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_522a9e1a-96ad-52ce-b85c-10a91d20ee51/522a9e1a-96ad-52ce-b85c-10a91d20ee51_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/a5/23a513bc56061f1f5b101fc2dd45bf81/pa/DZ81947_8639ec2539cec5ca6ab473620ed91b01.jpg saved to cache
2026-04-27 07:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 522a9e1a-96ad-52ce-b85c-10a91d20ee51
2026-04-27 07:54:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/cf/56cffaa1cfd9c73b12ab4ed974b66846/pa/LK06376_c7440066582c3ec71af2682d4dd6887d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/a5/23a513bc56061f1f5b101fc2dd45bf81/pa/DZ81947_9704f6a09356626bcc3f7a09036a1c11.jpg not downloaded yet
2026-04-27 07:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/cf/56cffaa1cfd9c73b12ab4ed974b66846/pa/LK06376_51e64059a8a64f860b9dc8c6911cbe4b.jpg not downloaded yet
2026-04-27 07:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/9a/f69a585bee2db2e33a8e6c259ab85f06/pa/SS46159_e6ffe822aef3bb1baa4f69131f7303d1.jpg not downloaded yet
2026-04-27 07:54:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/cf/56cffaa1cfd9c73b12ab4ed974b66846/pa/LK06376_519d8d956ace8bd501db59eed9c6c83a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/41/4d41a843d7fe4dbf1480e42fee5201cc/pa/JC07782_fb25395879b01e62efea3352bd97d5d9.jpg not downloaded yet
2026-04-27 07:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/32/0132a521be2d768c9ab2b6d5b8af4d26/pa/ML55257_2c0c4bcf18486d02e480d306dc003b50.jpg not downloaded yet
2026-04-27 07:54:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/41/4d41a843d7fe4dbf1480e42fee5201cc/pa/JC07782_94ce427c3283e80ab8562651a13a2024.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/a5/23a513bc56061f1f5b101fc2dd45bf81/pa/DZ81947_a026f3db001f054b3491bb629f0180d2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/26/f326b82c3ac29d9bab3681d3d194aceb/pa/XB02112_76a2b5ec7bae7bb8200b312e90c7ff90.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/9a/f69a585bee2db2e33a8e6c259ab85f06/pa/SS46159_fbd808e91a1babe8b189ea5ed83289af.jpg not downloaded yet
2026-04-27 07:54:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0409d58-790c-54fd-9021-3383c8e18e93 with identifier: WR40640
2026-04-27 07:54:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0409d58-790c-54fd-9021-3383c8e18e93 with scrape type 1
2026-04-27 07:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c0409d58-790c-54fd-9021-3383c8e18e93
2026-04-27 07:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/8d/4c8df727c8dea8f043b89c5eb620ed7c/pa/WR40640_fd9276213f627b034fd1d2f7815742ed.jpg not downloaded yet
2026-04-27 07:54:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 981df65c-9972-55cb-abfb-91160af7f8c7 with identifier: ZA42646
2026-04-27 07:54:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 981df65c-9972-55cb-abfb-91160af7f8c7 with scrape type 1
2026-04-27 07:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 981df65c-9972-55cb-abfb-91160af7f8c7
2026-04-27 07:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/b0/e9b034a33d8d55048411535b1eb993e2/pa/ZA42646_3d4654ff58793c11ee0b7e7215de966e.jpg not downloaded yet
2026-04-27 07:54:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a2bb50>
2026-04-27 07:54:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35eb078b-9e97-5b63-b9c0-67eb0572a3d5/35eb078b-9e97-5b63-b9c0-67eb0572a3d5_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/26/f326b82c3ac29d9bab3681d3d194aceb/pa/XB02112_7a608f710c7812ebb5cc444e016c04a9.jpg saved to cache
2026-04-27 07:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 35eb078b-9e97-5b63-b9c0-67eb0572a3d5
2026-04-27 07:54:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c60bd0>
2026-04-27 07:54:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8f32245-5789-5979-ac68-bfebe34ceb75/e8f32245-5789-5979-ac68-bfebe34ceb75_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/cf/56cffaa1cfd9c73b12ab4ed974b66846/pa/LK06376_bf1e4958e26e8f6f0d587900777b20c0.jpg saved to cache
2026-04-27 07:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e8f32245-5789-5979-ac68-bfebe34ceb75
2026-04-27 07:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/41/4d41a843d7fe4dbf1480e42fee5201cc/pa/JC07782_6aeb2b954f19e568503fca6ca128c686.jpg not downloaded yet
2026-04-27 07:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/32/0132a521be2d768c9ab2b6d5b8af4d26/pa/ML55257_6198ba63536cf2bc6d8953aa150b5a73.jpg not downloaded yet
2026-04-27 07:54:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/cf/56cffaa1cfd9c73b12ab4ed974b66846/pa/LK06376_606e1ca9cb2904de982db2ec9d1b9b7f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/41/4d41a843d7fe4dbf1480e42fee5201cc/pa/JC07782_dd9650af8d6afb51f1c242d869cbad9d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/9a/f69a585bee2db2e33a8e6c259ab85f06/pa/SS46159_0504084fd8b7c1dc219906766a07b865.jpg not downloaded yet
2026-04-27 07:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/8d/4c8df727c8dea8f043b89c5eb620ed7c/pa/WR40640_8c07d191217c14845937475f71164cb8.jpg not downloaded yet
2026-04-27 07:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/b0/e9b034a33d8d55048411535b1eb993e2/pa/ZA42646_a5d6e0fc46ad311f5d2958991914be9a.jpg not downloaded yet
2026-04-27 07:54:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/26/f326b82c3ac29d9bab3681d3d194aceb/pa/XB02112_c4dd375565f93294c931bb697e27f73e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/41/4d41a843d7fe4dbf1480e42fee5201cc/pa/JC07782_5e5988ecf1f205620db8ffa6e97b1b1f.jpg not downloaded yet
2026-04-27 07:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/32/0132a521be2d768c9ab2b6d5b8af4d26/pa/ML55257_08439875d8d4aed6173c34e1d7dabc02.jpg not downloaded yet
2026-04-27 07:54:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c5df50>
2026-04-27 07:54:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8f32245-5789-5979-ac68-bfebe34ceb75/e8f32245-5789-5979-ac68-bfebe34ceb75_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/cf/56cffaa1cfd9c73b12ab4ed974b66846/pa/LK06376_c7440066582c3ec71af2682d4dd6887d.jpg saved to cache
2026-04-27 07:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e8f32245-5789-5979-ac68-bfebe34ceb75
2026-04-27 07:54:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438164d10>
2026-04-27 07:54:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8f32245-5789-5979-ac68-bfebe34ceb75/e8f32245-5789-5979-ac68-bfebe34ceb75_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/cf/56cffaa1cfd9c73b12ab4ed974b66846/pa/LK06376_519d8d956ace8bd501db59eed9c6c83a.jpg saved to cache
2026-04-27 07:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e8f32245-5789-5979-ac68-bfebe34ceb75
2026-04-27 07:54:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ea8c90>
2026-04-27 07:54:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9fc7ebb-4dab-5408-803a-e3e3e01e4608/d9fc7ebb-4dab-5408-803a-e3e3e01e4608_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/41/4d41a843d7fe4dbf1480e42fee5201cc/pa/JC07782_94ce427c3283e80ab8562651a13a2024.jpg saved to cache
2026-04-27 07:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d9fc7ebb-4dab-5408-803a-e3e3e01e4608
2026-04-27 07:54:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ce9910>
2026-04-27 07:54:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_522a9e1a-96ad-52ce-b85c-10a91d20ee51/522a9e1a-96ad-52ce-b85c-10a91d20ee51_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/a5/23a513bc56061f1f5b101fc2dd45bf81/pa/DZ81947_a026f3db001f054b3491bb629f0180d2.jpg saved to cache
2026-04-27 07:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 522a9e1a-96ad-52ce-b85c-10a91d20ee51
2026-04-27 07:54:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d3a190>
2026-04-27 07:54:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35eb078b-9e97-5b63-b9c0-67eb0572a3d5/35eb078b-9e97-5b63-b9c0-67eb0572a3d5_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/26/f326b82c3ac29d9bab3681d3d194aceb/pa/XB02112_76a2b5ec7bae7bb8200b312e90c7ff90.jpg saved to cache
2026-04-27 07:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 35eb078b-9e97-5b63-b9c0-67eb0572a3d5
2026-04-27 07:54:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/a5/23a513bc56061f1f5b101fc2dd45bf81/pa/DZ81947_a647e629878d8537f5478acc1b0167b4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/9a/f69a585bee2db2e33a8e6c259ab85f06/pa/SS46159_e6ffe822aef3bb1baa4f69131f7303d1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/9a/f69a585bee2db2e33a8e6c259ab85f06/pa/SS46159_5a0050eee89a3ee107f02a81b67d2808.jpg not downloaded yet
2026-04-27 07:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/8d/4c8df727c8dea8f043b89c5eb620ed7c/pa/WR40640_c99ffbc241b4ca8770a303fa5fa8a8cb.jpg not downloaded yet
2026-04-27 07:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/b0/e9b034a33d8d55048411535b1eb993e2/pa/ZA42646_e261b61c0b4abc7f825fb5da336bf719.jpg not downloaded yet
2026-04-27 07:54:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AT92488> (referer: https://www.auto1.com/v1/car-details-view/AT92488/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/cf/56cffaa1cfd9c73b12ab4ed974b66846/pa/LK06376_51e64059a8a64f860b9dc8c6911cbe4b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/41/4d41a843d7fe4dbf1480e42fee5201cc/pa/JC07782_ebbe3f1879b98e35fdf24eab49fc878a.jpg not downloaded yet
2026-04-27 07:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/32/0132a521be2d768c9ab2b6d5b8af4d26/pa/ML55257_20c852498c7e7f6fc89f72256c9b6029.jpg not downloaded yet
2026-04-27 07:54:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/9a/f69a585bee2db2e33a8e6c259ab85f06/pa/SS46159_6307bdaec5abe85bc238774d84353661.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/9a/f69a585bee2db2e33a8e6c259ab85f06/pa/SS46159_6493bc96b6d1d169057d0d1f782367fd.jpg not downloaded yet
2026-04-27 07:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/8d/4c8df727c8dea8f043b89c5eb620ed7c/pa/WR40640_cc2bb29a27b0f21c1351f3193f8a09fe.jpg not downloaded yet
2026-04-27 07:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/b0/e9b034a33d8d55048411535b1eb993e2/pa/ZA42646_d509c89b85b6210e6eaaf656c1a42331.jpg not downloaded yet
2026-04-27 07:54:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c87e90>
2026-04-27 07:54:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8f32245-5789-5979-ac68-bfebe34ceb75/e8f32245-5789-5979-ac68-bfebe34ceb75_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/cf/56cffaa1cfd9c73b12ab4ed974b66846/pa/LK06376_606e1ca9cb2904de982db2ec9d1b9b7f.jpg saved to cache
2026-04-27 07:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e8f32245-5789-5979-ac68-bfebe34ceb75
2026-04-27 07:54:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438183b10>
2026-04-27 07:54:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9fc7ebb-4dab-5408-803a-e3e3e01e4608/d9fc7ebb-4dab-5408-803a-e3e3e01e4608_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/41/4d41a843d7fe4dbf1480e42fee5201cc/pa/JC07782_dd9650af8d6afb51f1c242d869cbad9d.jpg saved to cache
2026-04-27 07:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d9fc7ebb-4dab-5408-803a-e3e3e01e4608
2026-04-27 07:54:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438169c10>
2026-04-27 07:54:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35eb078b-9e97-5b63-b9c0-67eb0572a3d5/35eb078b-9e97-5b63-b9c0-67eb0572a3d5_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/26/f326b82c3ac29d9bab3681d3d194aceb/pa/XB02112_c4dd375565f93294c931bb697e27f73e.jpg saved to cache
2026-04-27 07:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 35eb078b-9e97-5b63-b9c0-67eb0572a3d5
2026-04-27 07:54:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/a5/23a513bc56061f1f5b101fc2dd45bf81/pa/DZ81947_626b6c035c4264daf6aef2d22f6ae3b4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/32/0132a521be2d768c9ab2b6d5b8af4d26/pa/ML55257_835e71bd3e87e985823771d5060aa818.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/41/4d41a843d7fe4dbf1480e42fee5201cc/pa/JC07782_cc18007fcdeebea75030d673f50a3752.jpg not downloaded yet
2026-04-27 07:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/32/0132a521be2d768c9ab2b6d5b8af4d26/pa/ML55257_187a42afc6bf6a3061191dd76c2bd16a.jpg not downloaded yet
2026-04-27 07:54:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/b0/e9b034a33d8d55048411535b1eb993e2/pa/ZA42646_3d4654ff58793c11ee0b7e7215de966e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/41/4d41a843d7fe4dbf1480e42fee5201cc/pa/JC07782_6aeb2b954f19e568503fca6ca128c686.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/32/0132a521be2d768c9ab2b6d5b8af4d26/pa/ML55257_6198ba63536cf2bc6d8953aa150b5a73.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/9a/f69a585bee2db2e33a8e6c259ab85f06/pa/SS46159_e986aa4040d26290aa7e1b53c3e5813b.jpg not downloaded yet
2026-04-27 07:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/8d/4c8df727c8dea8f043b89c5eb620ed7c/pa/WR40640_b2b8553313aa17b438ea527e89706029.jpg not downloaded yet
2026-04-27 07:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/b0/e9b034a33d8d55048411535b1eb993e2/pa/ZA42646_3ca64cd15b5f6ba934e79aa97f9bc664.jpg not downloaded yet
2026-04-27 07:54:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/a5/23a513bc56061f1f5b101fc2dd45bf81/pa/DZ81947_9704f6a09356626bcc3f7a09036a1c11.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/41/4d41a843d7fe4dbf1480e42fee5201cc/pa/JC07782_6353ba1924f6e06d06b539adc091975d.jpg not downloaded yet
2026-04-27 07:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/32/0132a521be2d768c9ab2b6d5b8af4d26/pa/ML55257_34265d84ece033c9c5e74e0bbeddbd93.jpg not downloaded yet
2026-04-27 07:54:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VJ16113> (referer: https://www.auto1.com/v1/car-details-view/VJ16113/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JC67510> (referer: https://www.auto1.com/v1/car-details-view/JC67510/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a83e50>
2026-04-27 07:54:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_522a9e1a-96ad-52ce-b85c-10a91d20ee51/522a9e1a-96ad-52ce-b85c-10a91d20ee51_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/a5/23a513bc56061f1f5b101fc2dd45bf81/pa/DZ81947_a647e629878d8537f5478acc1b0167b4.jpg saved to cache
2026-04-27 07:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 522a9e1a-96ad-52ce-b85c-10a91d20ee51
2026-04-27 07:54:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438e158d0>
2026-04-27 07:54:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8add49ec-4174-5d8d-ae40-de2af2b3476e/8add49ec-4174-5d8d-ae40-de2af2b3476e_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/9a/f69a585bee2db2e33a8e6c259ab85f06/pa/SS46159_e6ffe822aef3bb1baa4f69131f7303d1.jpg saved to cache
2026-04-27 07:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8add49ec-4174-5d8d-ae40-de2af2b3476e
2026-04-27 07:54:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75078e29-eaf5-5182-b3ae-f50cd5990366 with identifier: AT92488
2026-04-27 07:54:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75078e29-eaf5-5182-b3ae-f50cd5990366 with scrape type 1
2026-04-27 07:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 75078e29-eaf5-5182-b3ae-f50cd5990366
2026-04-27 07:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/de/fbde1c70edb92c31fac601f3601d9c0a/pa/AT92488_aad7a1bd3f9f5e0ef479d5fb9aa7a8f4.jpg not downloaded yet
2026-04-27 07:54:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438137550>
2026-04-27 07:54:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8f32245-5789-5979-ac68-bfebe34ceb75/e8f32245-5789-5979-ac68-bfebe34ceb75_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/cf/56cffaa1cfd9c73b12ab4ed974b66846/pa/LK06376_51e64059a8a64f860b9dc8c6911cbe4b.jpg saved to cache
2026-04-27 07:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e8f32245-5789-5979-ac68-bfebe34ceb75
2026-04-27 07:54:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143819ef50>
2026-04-27 07:54:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8add49ec-4174-5d8d-ae40-de2af2b3476e/8add49ec-4174-5d8d-ae40-de2af2b3476e_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/9a/f69a585bee2db2e33a8e6c259ab85f06/pa/SS46159_6307bdaec5abe85bc238774d84353661.jpg saved to cache
2026-04-27 07:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8add49ec-4174-5d8d-ae40-de2af2b3476e
2026-04-27 07:54:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/b0/e9b034a33d8d55048411535b1eb993e2/pa/ZA42646_a5d6e0fc46ad311f5d2958991914be9a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/8d/4c8df727c8dea8f043b89c5eb620ed7c/pa/WR40640_8c07d191217c14845937475f71164cb8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/9a/f69a585bee2db2e33a8e6c259ab85f06/pa/SS46159_14c0e680607fc7c783f7eaa67313038f.jpg not downloaded yet
2026-04-27 07:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/8d/4c8df727c8dea8f043b89c5eb620ed7c/pa/WR40640_7e7b8a64e9289adf0f66051aff77f572.jpg not downloaded yet
2026-04-27 07:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/b0/e9b034a33d8d55048411535b1eb993e2/pa/ZA42646_a7a4e83842cb3db0d27b01f54eef4e15.jpg not downloaded yet
2026-04-27 07:54:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/b0/e9b034a33d8d55048411535b1eb993e2/pa/ZA42646_e261b61c0b4abc7f825fb5da336bf719.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/41/4d41a843d7fe4dbf1480e42fee5201cc/pa/JC07782_01d0cd4e0c89c6fbdc5bb04b194a274c.jpg not downloaded yet
2026-04-27 07:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/32/0132a521be2d768c9ab2b6d5b8af4d26/pa/ML55257_a24df0a70d5c6e485aab1f5befe2d6db.jpg not downloaded yet
2026-04-27 07:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/de/fbde1c70edb92c31fac601f3601d9c0a/pa/AT92488_e6518e5a1d3b0b95f1c0d1068aeb2ffa.jpg not downloaded yet
2026-04-27 07:54:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/9a/f69a585bee2db2e33a8e6c259ab85f06/pa/SS46159_5a0050eee89a3ee107f02a81b67d2808.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/8d/4c8df727c8dea8f043b89c5eb620ed7c/pa/WR40640_c99ffbc241b4ca8770a303fa5fa8a8cb.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/9a/f69a585bee2db2e33a8e6c259ab85f06/pa/SS46159_38b0af492e2ec048af823c81c3128874.jpg not downloaded yet
2026-04-27 07:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/8d/4c8df727c8dea8f043b89c5eb620ed7c/pa/WR40640_36bdaaf9ff8d5552eec5c6a38bf85625.jpg not downloaded yet
2026-04-27 07:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/b0/e9b034a33d8d55048411535b1eb993e2/pa/ZA42646_8bca77975c37f547ee6c4b53a7d5eac7.jpg not downloaded yet
2026-04-27 07:54:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a3c690>
2026-04-27 07:54:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_522a9e1a-96ad-52ce-b85c-10a91d20ee51/522a9e1a-96ad-52ce-b85c-10a91d20ee51_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/a5/23a513bc56061f1f5b101fc2dd45bf81/pa/DZ81947_626b6c035c4264daf6aef2d22f6ae3b4.jpg saved to cache
2026-04-27 07:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 522a9e1a-96ad-52ce-b85c-10a91d20ee51
2026-04-27 07:54:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c58310>
2026-04-27 07:54:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5ce9a97-2010-5e49-9d94-9572d74d6438/f5ce9a97-2010-5e49-9d94-9572d74d6438_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/32/0132a521be2d768c9ab2b6d5b8af4d26/pa/ML55257_835e71bd3e87e985823771d5060aa818.jpg saved to cache
2026-04-27 07:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f5ce9a97-2010-5e49-9d94-9572d74d6438
2026-04-27 07:54:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b1a750>
2026-04-27 07:54:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_981df65c-9972-55cb-abfb-91160af7f8c7/981df65c-9972-55cb-abfb-91160af7f8c7_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/b0/e9b034a33d8d55048411535b1eb993e2/pa/ZA42646_3d4654ff58793c11ee0b7e7215de966e.jpg saved to cache
2026-04-27 07:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 981df65c-9972-55cb-abfb-91160af7f8c7
2026-04-27 07:54:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b7cf50>
2026-04-27 07:54:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9fc7ebb-4dab-5408-803a-e3e3e01e4608/d9fc7ebb-4dab-5408-803a-e3e3e01e4608_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:54:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/41/4d41a843d7fe4dbf1480e42fee5201cc/pa/JC07782_6aeb2b954f19e568503fca6ca128c686.jpg saved to cache
2026-04-27 07:54:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d9fc7ebb-4dab-5408-803a-e3e3e01e4608
2026-04-27 07:54:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14478dafd0>
2026-04-27 07:54:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5ce9a97-2010-5e49-9d94-9572d74d6438/f5ce9a97-2010-5e49-9d94-9572d74d6438_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/32/0132a521be2d768c9ab2b6d5b8af4d26/pa/ML55257_6198ba63536cf2bc6d8953aa150b5a73.jpg saved to cache
2026-04-27 07:54:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f5ce9a97-2010-5e49-9d94-9572d74d6438
2026-04-27 07:54:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a29a90>
2026-04-27 07:54:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_522a9e1a-96ad-52ce-b85c-10a91d20ee51/522a9e1a-96ad-52ce-b85c-10a91d20ee51_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:54:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/a5/23a513bc56061f1f5b101fc2dd45bf81/pa/DZ81947_9704f6a09356626bcc3f7a09036a1c11.jpg saved to cache
2026-04-27 07:54:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 522a9e1a-96ad-52ce-b85c-10a91d20ee51
2026-04-27 07:54:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57b35460-f8ef-5381-ba8b-bcb32a452802 with identifier: VJ16113
2026-04-27 07:54:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57b35460-f8ef-5381-ba8b-bcb32a452802 with scrape type 1
2026-04-27 07:54:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 57b35460-f8ef-5381-ba8b-bcb32a452802
2026-04-27 07:54:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/df/c7df5a0a2599f74c3523befa55c04061/pa/VJ16113_e7c08a6666227019a84d44b5ff3a19fd.jpg not downloaded yet
2026-04-27 07:54:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed731cf7-b4aa-5782-9e74-7b36eae36861 with identifier: JC67510
2026-04-27 07:54:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed731cf7-b4aa-5782-9e74-7b36eae36861 with scrape type 1
2026-04-27 07:54:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ed731cf7-b4aa-5782-9e74-7b36eae36861
2026-04-27 07:54:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/b4/99b429f1255a640c623fb8818adbb54b/pa/JC67510_46082f2ccbe81cc232bdab2dcaa13337.jpg not downloaded yet
2026-04-27 07:54:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/32/0132a521be2d768c9ab2b6d5b8af4d26/pa/ML55257_20c852498c7e7f6fc89f72256c9b6029.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/32/0132a521be2d768c9ab2b6d5b8af4d26/pa/ML55257_81b9b653fd3c38f24919e071a13e54a6.jpg not downloaded yet
2026-04-27 07:54:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/de/fbde1c70edb92c31fac601f3601d9c0a/pa/AT92488_db3d71dba57fc8d2c6c0079b876b3e8d.jpg not downloaded yet
2026-04-27 07:54:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/41/4d41a843d7fe4dbf1480e42fee5201cc/pa/JC07782_ebbe3f1879b98e35fdf24eab49fc878a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/b0/e9b034a33d8d55048411535b1eb993e2/pa/ZA42646_d509c89b85b6210e6eaaf656c1a42331.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/8d/4c8df727c8dea8f043b89c5eb620ed7c/pa/WR40640_0389bb0bd96ef6811f45ab6bcc34cca1.jpg not downloaded yet
2026-04-27 07:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/b0/e9b034a33d8d55048411535b1eb993e2/pa/ZA42646_b40b0b5cd8dc7ad04cd6980c8471f7ef.jpg not downloaded yet
2026-04-27 07:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/df/c7df5a0a2599f74c3523befa55c04061/pa/VJ16113_dedddef558a09becdaaee8e1b31d60c2.jpg not downloaded yet
2026-04-27 07:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/b4/99b429f1255a640c623fb8818adbb54b/pa/JC67510_56d85f74fccb2a688e1fbd060e45e1c9.jpg not downloaded yet
2026-04-27 07:54:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1447a063d0>
2026-04-27 07:54:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_981df65c-9972-55cb-abfb-91160af7f8c7/981df65c-9972-55cb-abfb-91160af7f8c7_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/b0/e9b034a33d8d55048411535b1eb993e2/pa/ZA42646_a5d6e0fc46ad311f5d2958991914be9a.jpg saved to cache
2026-04-27 07:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 981df65c-9972-55cb-abfb-91160af7f8c7
2026-04-27 07:54:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ec3950>
2026-04-27 07:54:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0409d58-790c-54fd-9021-3383c8e18e93/c0409d58-790c-54fd-9021-3383c8e18e93_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/8d/4c8df727c8dea8f043b89c5eb620ed7c/pa/WR40640_8c07d191217c14845937475f71164cb8.jpg saved to cache
2026-04-27 07:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c0409d58-790c-54fd-9021-3383c8e18e93
2026-04-27 07:54:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/41/4d41a843d7fe4dbf1480e42fee5201cc/pa/JC07782_cc18007fcdeebea75030d673f50a3752.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/b0/e9b034a33d8d55048411535b1eb993e2/pa/ZA42646_3ca64cd15b5f6ba934e79aa97f9bc664.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/32/0132a521be2d768c9ab2b6d5b8af4d26/pa/ML55257_5f74c1b057b05a61caad97f518d76906.jpg not downloaded yet
2026-04-27 07:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/de/fbde1c70edb92c31fac601f3601d9c0a/pa/AT92488_22b67108ce97c686976a652f881ce2ed.jpg not downloaded yet
2026-04-27 07:54:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ET06456> (referer: https://www.auto1.com/v1/car-details-view/ET06456/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VG92697> (referer: https://www.auto1.com/v1/car-details-view/VG92697/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143801f610>
2026-04-27 07:54:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_981df65c-9972-55cb-abfb-91160af7f8c7/981df65c-9972-55cb-abfb-91160af7f8c7_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/b0/e9b034a33d8d55048411535b1eb993e2/pa/ZA42646_e261b61c0b4abc7f825fb5da336bf719.jpg saved to cache
2026-04-27 07:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 981df65c-9972-55cb-abfb-91160af7f8c7
2026-04-27 07:54:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143804c790>
2026-04-27 07:54:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8add49ec-4174-5d8d-ae40-de2af2b3476e/8add49ec-4174-5d8d-ae40-de2af2b3476e_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/9a/f69a585bee2db2e33a8e6c259ab85f06/pa/SS46159_5a0050eee89a3ee107f02a81b67d2808.jpg saved to cache
2026-04-27 07:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8add49ec-4174-5d8d-ae40-de2af2b3476e
2026-04-27 07:54:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c62010>
2026-04-27 07:54:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0409d58-790c-54fd-9021-3383c8e18e93/c0409d58-790c-54fd-9021-3383c8e18e93_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/8d/4c8df727c8dea8f043b89c5eb620ed7c/pa/WR40640_c99ffbc241b4ca8770a303fa5fa8a8cb.jpg saved to cache
2026-04-27 07:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c0409d58-790c-54fd-9021-3383c8e18e93
2026-04-27 07:54:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/9a/f69a585bee2db2e33a8e6c259ab85f06/pa/SS46159_e986aa4040d26290aa7e1b53c3e5813b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/8d/4c8df727c8dea8f043b89c5eb620ed7c/pa/WR40640_cc2bb29a27b0f21c1351f3193f8a09fe.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/8d/4c8df727c8dea8f043b89c5eb620ed7c/pa/WR40640_b2b8553313aa17b438ea527e89706029.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/8d/4c8df727c8dea8f043b89c5eb620ed7c/pa/WR40640_d6b6936a246ba482b5ebff13ef8e26ac.jpg not downloaded yet
2026-04-27 07:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/b0/e9b034a33d8d55048411535b1eb993e2/pa/ZA42646_2667ba9aae1db3c73333f3c7e4a03aa5.jpg not downloaded yet
2026-04-27 07:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/df/c7df5a0a2599f74c3523befa55c04061/pa/VJ16113_c069be281c420d3c70e1073de3790085.jpg not downloaded yet
2026-04-27 07:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/b4/99b429f1255a640c623fb8818adbb54b/pa/JC67510_3d71a3155223acdba66423e9a1139504.jpg not downloaded yet
2026-04-27 07:54:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/9a/f69a585bee2db2e33a8e6c259ab85f06/pa/SS46159_6493bc96b6d1d169057d0d1f782367fd.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/b0/e9b034a33d8d55048411535b1eb993e2/pa/ZA42646_a7a4e83842cb3db0d27b01f54eef4e15.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/de/fbde1c70edb92c31fac601f3601d9c0a/pa/AT92488_24b14fbe4aaf09c2320f279b84a2826e.jpg not downloaded yet
2026-04-27 07:54:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d46c90>
2026-04-27 07:54:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5ce9a97-2010-5e49-9d94-9572d74d6438/f5ce9a97-2010-5e49-9d94-9572d74d6438_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/32/0132a521be2d768c9ab2b6d5b8af4d26/pa/ML55257_20c852498c7e7f6fc89f72256c9b6029.jpg saved to cache
2026-04-27 07:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f5ce9a97-2010-5e49-9d94-9572d74d6438
2026-04-27 07:54:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380e3550>
2026-04-27 07:54:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9fc7ebb-4dab-5408-803a-e3e3e01e4608/d9fc7ebb-4dab-5408-803a-e3e3e01e4608_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/41/4d41a843d7fe4dbf1480e42fee5201cc/pa/JC07782_ebbe3f1879b98e35fdf24eab49fc878a.jpg saved to cache
2026-04-27 07:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d9fc7ebb-4dab-5408-803a-e3e3e01e4608
2026-04-27 07:54:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c80450>
2026-04-27 07:54:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_981df65c-9972-55cb-abfb-91160af7f8c7/981df65c-9972-55cb-abfb-91160af7f8c7_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/b0/e9b034a33d8d55048411535b1eb993e2/pa/ZA42646_d509c89b85b6210e6eaaf656c1a42331.jpg saved to cache
2026-04-27 07:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 981df65c-9972-55cb-abfb-91160af7f8c7
2026-04-27 07:54:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/32/0132a521be2d768c9ab2b6d5b8af4d26/pa/ML55257_187a42afc6bf6a3061191dd76c2bd16a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/8d/4c8df727c8dea8f043b89c5eb620ed7c/pa/WR40640_18acf83f4c19426d233e7fd1ea181738.jpg not downloaded yet
2026-04-27 07:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/b0/e9b034a33d8d55048411535b1eb993e2/pa/ZA42646_5ed7b75b2f8bde4f8b9778c416006fe0.jpg not downloaded yet
2026-04-27 07:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/df/c7df5a0a2599f74c3523befa55c04061/pa/VJ16113_80df54b2e4d42971dfc6ca588ef8dfd2.jpg not downloaded yet
2026-04-27 07:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/b4/99b429f1255a640c623fb8818adbb54b/pa/JC67510_379a0725cddf1f059ddb664040a3cf22.jpg not downloaded yet
2026-04-27 07:54:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d47b10>
2026-04-27 07:54:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9fc7ebb-4dab-5408-803a-e3e3e01e4608/d9fc7ebb-4dab-5408-803a-e3e3e01e4608_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/41/4d41a843d7fe4dbf1480e42fee5201cc/pa/JC07782_cc18007fcdeebea75030d673f50a3752.jpg saved to cache
2026-04-27 07:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d9fc7ebb-4dab-5408-803a-e3e3e01e4608
2026-04-27 07:54:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d08390>
2026-04-27 07:54:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_981df65c-9972-55cb-abfb-91160af7f8c7/981df65c-9972-55cb-abfb-91160af7f8c7_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/b0/e9b034a33d8d55048411535b1eb993e2/pa/ZA42646_3ca64cd15b5f6ba934e79aa97f9bc664.jpg saved to cache
2026-04-27 07:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 981df65c-9972-55cb-abfb-91160af7f8c7
2026-04-27 07:54:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8652baf2-15f4-5ffc-abf6-7cd5c81af25b with identifier: ET06456
2026-04-27 07:54:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8652baf2-15f4-5ffc-abf6-7cd5c81af25b with scrape type 1
2026-04-27 07:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8652baf2-15f4-5ffc-abf6-7cd5c81af25b
2026-04-27 07:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/d4/1dd4d76a39e3cf9c6b3b81c7bf053b6f/pa/ET06456_fbdbbe6566085a32834613adaab5def7.jpg not downloaded yet
2026-04-27 07:54:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 611a89d0-f437-5b2b-ba4f-2cf63d63f31c with identifier: VG92697
2026-04-27 07:54:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 611a89d0-f437-5b2b-ba4f-2cf63d63f31c with scrape type 1
2026-04-27 07:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 611a89d0-f437-5b2b-ba4f-2cf63d63f31c
2026-04-27 07:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/60/e0608e829c10e4861239521e3f670c9f/pa/VG92697_ca9df582e1d077f93bf01f59302c56cd.jpg not downloaded yet
2026-04-27 07:54:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/b4/99b429f1255a640c623fb8818adbb54b/pa/JC67510_46082f2ccbe81cc232bdab2dcaa13337.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/df/c7df5a0a2599f74c3523befa55c04061/pa/VJ16113_e7c08a6666227019a84d44b5ff3a19fd.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/9a/f69a585bee2db2e33a8e6c259ab85f06/pa/SS46159_14c0e680607fc7c783f7eaa67313038f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/de/fbde1c70edb92c31fac601f3601d9c0a/pa/AT92488_2f234222bcd613836e89c12b0f1cad19.jpg not downloaded yet
2026-04-27 07:54:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/8d/4c8df727c8dea8f043b89c5eb620ed7c/pa/WR40640_7e7b8a64e9289adf0f66051aff77f572.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/de/fbde1c70edb92c31fac601f3601d9c0a/pa/AT92488_e6518e5a1d3b0b95f1c0d1068aeb2ffa.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/df/c7df5a0a2599f74c3523befa55c04061/pa/VJ16113_20f925b9b46c0983a6d0e6e5d9b69598.jpg not downloaded yet
2026-04-27 07:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/b4/99b429f1255a640c623fb8818adbb54b/pa/JC67510_d0002b4581cf83ebb1f4921380f35b09.jpg not downloaded yet
2026-04-27 07:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/d4/1dd4d76a39e3cf9c6b3b81c7bf053b6f/pa/ET06456_1acf141df332d6e6e630dcb82f292439.jpg not downloaded yet
2026-04-27 07:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/60/e0608e829c10e4861239521e3f670c9f/pa/VG92697_aaabb614994b9cff15a059fc48ef0547.jpg not downloaded yet
2026-04-27 07:54:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438092150>
2026-04-27 07:54:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8add49ec-4174-5d8d-ae40-de2af2b3476e/8add49ec-4174-5d8d-ae40-de2af2b3476e_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/9a/f69a585bee2db2e33a8e6c259ab85f06/pa/SS46159_e986aa4040d26290aa7e1b53c3e5813b.jpg saved to cache
2026-04-27 07:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8add49ec-4174-5d8d-ae40-de2af2b3476e
2026-04-27 07:54:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143805e910>
2026-04-27 07:54:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0409d58-790c-54fd-9021-3383c8e18e93/c0409d58-790c-54fd-9021-3383c8e18e93_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/8d/4c8df727c8dea8f043b89c5eb620ed7c/pa/WR40640_cc2bb29a27b0f21c1351f3193f8a09fe.jpg saved to cache
2026-04-27 07:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c0409d58-790c-54fd-9021-3383c8e18e93
2026-04-27 07:54:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143808ea10>
2026-04-27 07:54:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0409d58-790c-54fd-9021-3383c8e18e93/c0409d58-790c-54fd-9021-3383c8e18e93_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/8d/4c8df727c8dea8f043b89c5eb620ed7c/pa/WR40640_b2b8553313aa17b438ea527e89706029.jpg saved to cache
2026-04-27 07:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c0409d58-790c-54fd-9021-3383c8e18e93
2026-04-27 07:54:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143806fe10>
2026-04-27 07:54:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8add49ec-4174-5d8d-ae40-de2af2b3476e/8add49ec-4174-5d8d-ae40-de2af2b3476e_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/9a/f69a585bee2db2e33a8e6c259ab85f06/pa/SS46159_6493bc96b6d1d169057d0d1f782367fd.jpg saved to cache
2026-04-27 07:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8add49ec-4174-5d8d-ae40-de2af2b3476e
2026-04-27 07:54:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143801aad0>
2026-04-27 07:54:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_981df65c-9972-55cb-abfb-91160af7f8c7/981df65c-9972-55cb-abfb-91160af7f8c7_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/b0/e9b034a33d8d55048411535b1eb993e2/pa/ZA42646_a7a4e83842cb3db0d27b01f54eef4e15.jpg saved to cache
2026-04-27 07:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 981df65c-9972-55cb-abfb-91160af7f8c7
2026-04-27 07:54:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/32/0132a521be2d768c9ab2b6d5b8af4d26/pa/ML55257_81b9b653fd3c38f24919e071a13e54a6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/de/fbde1c70edb92c31fac601f3601d9c0a/pa/AT92488_db3d71dba57fc8d2c6c0079b876b3e8d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/b4/99b429f1255a640c623fb8818adbb54b/pa/JC67510_56d85f74fccb2a688e1fbd060e45e1c9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/df/c7df5a0a2599f74c3523befa55c04061/pa/VJ16113_35a8586a247eb7e32fb656db6ce9a095.jpg not downloaded yet
2026-04-27 07:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/b4/99b429f1255a640c623fb8818adbb54b/pa/JC67510_7235ae545e27a3a4b310b882360f4d95.jpg not downloaded yet
2026-04-27 07:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/d4/1dd4d76a39e3cf9c6b3b81c7bf053b6f/pa/ET06456_0e45b809f8983782f3e801969ff5bf10.jpg not downloaded yet
2026-04-27 07:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/60/e0608e829c10e4861239521e3f670c9f/pa/VG92697_b442d263bfe9a9e82922de2ae0f44fb6.jpg not downloaded yet
2026-04-27 07:54:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-04-27 07:54:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-04-27 07:54:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-04-27 07:54:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-04-27 07:54:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-04-27 07:54:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438091550>
2026-04-27 07:54:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5ce9a97-2010-5e49-9d94-9572d74d6438/f5ce9a97-2010-5e49-9d94-9572d74d6438_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/32/0132a521be2d768c9ab2b6d5b8af4d26/pa/ML55257_187a42afc6bf6a3061191dd76c2bd16a.jpg saved to cache
2026-04-27 07:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f5ce9a97-2010-5e49-9d94-9572d74d6438
2026-04-27 07:54:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438145e90>
2026-04-27 07:54:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed731cf7-b4aa-5782-9e74-7b36eae36861/ed731cf7-b4aa-5782-9e74-7b36eae36861_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/b4/99b429f1255a640c623fb8818adbb54b/pa/JC67510_46082f2ccbe81cc232bdab2dcaa13337.jpg saved to cache
2026-04-27 07:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ed731cf7-b4aa-5782-9e74-7b36eae36861
2026-04-27 07:54:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438afb750>
2026-04-27 07:54:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57b35460-f8ef-5381-ba8b-bcb32a452802/57b35460-f8ef-5381-ba8b-bcb32a452802_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/df/c7df5a0a2599f74c3523befa55c04061/pa/VJ16113_e7c08a6666227019a84d44b5ff3a19fd.jpg saved to cache
2026-04-27 07:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 57b35460-f8ef-5381-ba8b-bcb32a452802
2026-04-27 07:54:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14381472d0>
2026-04-27 07:54:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8add49ec-4174-5d8d-ae40-de2af2b3476e/8add49ec-4174-5d8d-ae40-de2af2b3476e_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/9a/f69a585bee2db2e33a8e6c259ab85f06/pa/SS46159_14c0e680607fc7c783f7eaa67313038f.jpg saved to cache
2026-04-27 07:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8add49ec-4174-5d8d-ae40-de2af2b3476e
2026-04-27 07:54:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14381d4b90>
2026-04-27 07:54:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0409d58-790c-54fd-9021-3383c8e18e93/c0409d58-790c-54fd-9021-3383c8e18e93_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/8d/4c8df727c8dea8f043b89c5eb620ed7c/pa/WR40640_7e7b8a64e9289adf0f66051aff77f572.jpg saved to cache
2026-04-27 07:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c0409d58-790c-54fd-9021-3383c8e18e93
2026-04-27 07:54:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438145450>
2026-04-27 07:54:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75078e29-eaf5-5182-b3ae-f50cd5990366/75078e29-eaf5-5182-b3ae-f50cd5990366_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/de/fbde1c70edb92c31fac601f3601d9c0a/pa/AT92488_e6518e5a1d3b0b95f1c0d1068aeb2ffa.jpg saved to cache
2026-04-27 07:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 75078e29-eaf5-5182-b3ae-f50cd5990366
2026-04-27 07:54:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/b4/99b429f1255a640c623fb8818adbb54b/pa/JC67510_3d71a3155223acdba66423e9a1139504.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/df/c7df5a0a2599f74c3523befa55c04061/pa/VJ16113_09b6a6541c876a354d33644cb83eaa9e.jpg not downloaded yet
2026-04-27 07:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/b4/99b429f1255a640c623fb8818adbb54b/pa/JC67510_bf41498e637c5b4ae7ced29d8c977cc4.jpg not downloaded yet
2026-04-27 07:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/d4/1dd4d76a39e3cf9c6b3b81c7bf053b6f/pa/ET06456_e192bc0eb77d41f24cca21b1e15d0582.jpg not downloaded yet
2026-04-27 07:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/60/e0608e829c10e4861239521e3f670c9f/pa/VG92697_357c3339fdc334c99b2b9bec012db324.jpg not downloaded yet
2026-04-27 07:54:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/de/fbde1c70edb92c31fac601f3601d9c0a/pa/AT92488_22b67108ce97c686976a652f881ce2ed.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/b0/e9b034a33d8d55048411535b1eb993e2/pa/ZA42646_8bca77975c37f547ee6c4b53a7d5eac7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/32/0132a521be2d768c9ab2b6d5b8af4d26/pa/ML55257_5f74c1b057b05a61caad97f518d76906.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/8d/4c8df727c8dea8f043b89c5eb620ed7c/pa/WR40640_0389bb0bd96ef6811f45ab6bcc34cca1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/b0/e9b034a33d8d55048411535b1eb993e2/pa/ZA42646_b40b0b5cd8dc7ad04cd6980c8471f7ef.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/df/c7df5a0a2599f74c3523befa55c04061/pa/VJ16113_dedddef558a09becdaaee8e1b31d60c2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/df/c7df5a0a2599f74c3523befa55c04061/pa/VJ16113_136e8ba995ea6ebd8524c99015e4daf6.jpg not downloaded yet
2026-04-27 07:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/b4/99b429f1255a640c623fb8818adbb54b/pa/JC67510_bec01be49203ebfbee6875e4bf927d1f.jpg not downloaded yet
2026-04-27 07:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/d4/1dd4d76a39e3cf9c6b3b81c7bf053b6f/pa/ET06456_5f958ff47e351428fcb766b641579acc.jpg not downloaded yet
2026-04-27 07:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/60/e0608e829c10e4861239521e3f670c9f/pa/VG92697_4cd70d9fb2255a1b282ed437bc25d7fe.jpg not downloaded yet
2026-04-27 07:54:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c3d250>
2026-04-27 07:54:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5ce9a97-2010-5e49-9d94-9572d74d6438/f5ce9a97-2010-5e49-9d94-9572d74d6438_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/32/0132a521be2d768c9ab2b6d5b8af4d26/pa/ML55257_81b9b653fd3c38f24919e071a13e54a6.jpg saved to cache
2026-04-27 07:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f5ce9a97-2010-5e49-9d94-9572d74d6438
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438125910>
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75078e29-eaf5-5182-b3ae-f50cd5990366/75078e29-eaf5-5182-b3ae-f50cd5990366_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/de/fbde1c70edb92c31fac601f3601d9c0a/pa/AT92488_db3d71dba57fc8d2c6c0079b876b3e8d.jpg saved to cache
2026-04-27 07:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 75078e29-eaf5-5182-b3ae-f50cd5990366
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b438d0>
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed731cf7-b4aa-5782-9e74-7b36eae36861/ed731cf7-b4aa-5782-9e74-7b36eae36861_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/b4/99b429f1255a640c623fb8818adbb54b/pa/JC67510_56d85f74fccb2a688e1fbd060e45e1c9.jpg saved to cache
2026-04-27 07:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ed731cf7-b4aa-5782-9e74-7b36eae36861
2026-04-27 07:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/df/c7df5a0a2599f74c3523befa55c04061/pa/VJ16113_324f5e7e5509010a00a32e2dc41faca2.jpg not downloaded yet
2026-04-27 07:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/b4/99b429f1255a640c623fb8818adbb54b/pa/JC67510_7fa3466821d2b64f9137988f4548fb5c.jpg not downloaded yet
2026-04-27 07:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/d4/1dd4d76a39e3cf9c6b3b81c7bf053b6f/pa/ET06456_c14c93c8c9d6b678a7b5334716031eaf.jpg not downloaded yet
2026-04-27 07:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/60/e0608e829c10e4861239521e3f670c9f/pa/VG92697_75f21c9756b1290f5b3050bd9d8b3568.jpg not downloaded yet
2026-04-27 07:54:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/d4/1dd4d76a39e3cf9c6b3b81c7bf053b6f/pa/ET06456_fbdbbe6566085a32834613adaab5def7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/b4/99b429f1255a640c623fb8818adbb54b/pa/JC67510_379a0725cddf1f059ddb664040a3cf22.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/df/c7df5a0a2599f74c3523befa55c04061/pa/VJ16113_dd700f75703f47e525da8ee9ed96dddf.jpg not downloaded yet
2026-04-27 07:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/b4/99b429f1255a640c623fb8818adbb54b/pa/JC67510_ab1e5deab4071a91551442dad1532e1e.jpg not downloaded yet
2026-04-27 07:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/d4/1dd4d76a39e3cf9c6b3b81c7bf053b6f/pa/ET06456_1f1aa4396b93f0bc915cfba9fbd5c533.jpg not downloaded yet
2026-04-27 07:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/60/e0608e829c10e4861239521e3f670c9f/pa/VG92697_dbcb2ab0902aa3c5ddfbf016057294f7.jpg not downloaded yet
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ac7450>
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed731cf7-b4aa-5782-9e74-7b36eae36861/ed731cf7-b4aa-5782-9e74-7b36eae36861_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/b4/99b429f1255a640c623fb8818adbb54b/pa/JC67510_3d71a3155223acdba66423e9a1139504.jpg saved to cache
2026-04-27 07:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ed731cf7-b4aa-5782-9e74-7b36eae36861
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438e4fa90>
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75078e29-eaf5-5182-b3ae-f50cd5990366/75078e29-eaf5-5182-b3ae-f50cd5990366_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/de/fbde1c70edb92c31fac601f3601d9c0a/pa/AT92488_22b67108ce97c686976a652f881ce2ed.jpg saved to cache
2026-04-27 07:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 75078e29-eaf5-5182-b3ae-f50cd5990366
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b7c7d0>
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_981df65c-9972-55cb-abfb-91160af7f8c7/981df65c-9972-55cb-abfb-91160af7f8c7_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/b0/e9b034a33d8d55048411535b1eb993e2/pa/ZA42646_8bca77975c37f547ee6c4b53a7d5eac7.jpg saved to cache
2026-04-27 07:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 981df65c-9972-55cb-abfb-91160af7f8c7
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b1b7d0>
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5ce9a97-2010-5e49-9d94-9572d74d6438/f5ce9a97-2010-5e49-9d94-9572d74d6438_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/32/0132a521be2d768c9ab2b6d5b8af4d26/pa/ML55257_5f74c1b057b05a61caad97f518d76906.jpg saved to cache
2026-04-27 07:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f5ce9a97-2010-5e49-9d94-9572d74d6438
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438bc6f10>
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0409d58-790c-54fd-9021-3383c8e18e93/c0409d58-790c-54fd-9021-3383c8e18e93_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/8d/4c8df727c8dea8f043b89c5eb620ed7c/pa/WR40640_0389bb0bd96ef6811f45ab6bcc34cca1.jpg saved to cache
2026-04-27 07:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c0409d58-790c-54fd-9021-3383c8e18e93
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438fc1050>
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_981df65c-9972-55cb-abfb-91160af7f8c7/981df65c-9972-55cb-abfb-91160af7f8c7_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/b0/e9b034a33d8d55048411535b1eb993e2/pa/ZA42646_b40b0b5cd8dc7ad04cd6980c8471f7ef.jpg saved to cache
2026-04-27 07:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 981df65c-9972-55cb-abfb-91160af7f8c7
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438dd9210>
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57b35460-f8ef-5381-ba8b-bcb32a452802/57b35460-f8ef-5381-ba8b-bcb32a452802_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/df/c7df5a0a2599f74c3523befa55c04061/pa/VJ16113_dedddef558a09becdaaee8e1b31d60c2.jpg saved to cache
2026-04-27 07:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 57b35460-f8ef-5381-ba8b-bcb32a452802
2026-04-27 07:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/d4/1dd4d76a39e3cf9c6b3b81c7bf053b6f/pa/ET06456_fa36e24ea6c2132e6627283ccb1c7aba.jpg not downloaded yet
2026-04-27 07:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/60/e0608e829c10e4861239521e3f670c9f/pa/VG92697_356e589368a9bbd13c7413efc8f61c2c.jpg not downloaded yet
2026-04-27 07:54:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/60/e0608e829c10e4861239521e3f670c9f/pa/VG92697_ca9df582e1d077f93bf01f59302c56cd.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/de/fbde1c70edb92c31fac601f3601d9c0a/pa/AT92488_2f234222bcd613836e89c12b0f1cad19.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/df/c7df5a0a2599f74c3523befa55c04061/pa/VJ16113_80df54b2e4d42971dfc6ca588ef8dfd2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/60/e0608e829c10e4861239521e3f670c9f/pa/VG92697_b442d263bfe9a9e82922de2ae0f44fb6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/60/e0608e829c10e4861239521e3f670c9f/pa/VG92697_aaabb614994b9cff15a059fc48ef0547.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/b0/e9b034a33d8d55048411535b1eb993e2/pa/ZA42646_5ed7b75b2f8bde4f8b9778c416006fe0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/8d/4c8df727c8dea8f043b89c5eb620ed7c/pa/WR40640_18acf83f4c19426d233e7fd1ea181738.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/d4/1dd4d76a39e3cf9c6b3b81c7bf053b6f/pa/ET06456_8de96b00af8f4e1955317dbe88a889a1.jpg not downloaded yet
2026-04-27 07:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/60/e0608e829c10e4861239521e3f670c9f/pa/VG92697_0ca7fbf2bc797dc5163221e60bf897a2.jpg not downloaded yet
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380a9350>
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8652baf2-15f4-5ffc-abf6-7cd5c81af25b/8652baf2-15f4-5ffc-abf6-7cd5c81af25b_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/d4/1dd4d76a39e3cf9c6b3b81c7bf053b6f/pa/ET06456_fbdbbe6566085a32834613adaab5def7.jpg saved to cache
2026-04-27 07:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8652baf2-15f4-5ffc-abf6-7cd5c81af25b
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380ac7d0>
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed731cf7-b4aa-5782-9e74-7b36eae36861/ed731cf7-b4aa-5782-9e74-7b36eae36861_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/b4/99b429f1255a640c623fb8818adbb54b/pa/JC67510_379a0725cddf1f059ddb664040a3cf22.jpg saved to cache
2026-04-27 07:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ed731cf7-b4aa-5782-9e74-7b36eae36861
2026-04-27 07:54:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/60/e0608e829c10e4861239521e3f670c9f/pa/VG92697_357c3339fdc334c99b2b9bec012db324.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/d4/1dd4d76a39e3cf9c6b3b81c7bf053b6f/pa/ET06456_d028423d51e83c1354ba7f5887ddd25d.jpg not downloaded yet
2026-04-27 07:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/60/e0608e829c10e4861239521e3f670c9f/pa/VG92697_a699075a0c44db8074471ed52820a3e6.jpg not downloaded yet
2026-04-27 07:54:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-04-27 07:54:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-04-27 07:54:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-04-27 07:54:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-04-27 07:54:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143809f6d0>
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_611a89d0-f437-5b2b-ba4f-2cf63d63f31c/611a89d0-f437-5b2b-ba4f-2cf63d63f31c_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/60/e0608e829c10e4861239521e3f670c9f/pa/VG92697_ca9df582e1d077f93bf01f59302c56cd.jpg saved to cache
2026-04-27 07:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 611a89d0-f437-5b2b-ba4f-2cf63d63f31c
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143808eb10>
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75078e29-eaf5-5182-b3ae-f50cd5990366/75078e29-eaf5-5182-b3ae-f50cd5990366_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/de/fbde1c70edb92c31fac601f3601d9c0a/pa/AT92488_2f234222bcd613836e89c12b0f1cad19.jpg saved to cache
2026-04-27 07:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 75078e29-eaf5-5182-b3ae-f50cd5990366
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380e0c10>
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57b35460-f8ef-5381-ba8b-bcb32a452802/57b35460-f8ef-5381-ba8b-bcb32a452802_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/df/c7df5a0a2599f74c3523befa55c04061/pa/VJ16113_80df54b2e4d42971dfc6ca588ef8dfd2.jpg saved to cache
2026-04-27 07:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 57b35460-f8ef-5381-ba8b-bcb32a452802
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143803bd90>
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_611a89d0-f437-5b2b-ba4f-2cf63d63f31c/611a89d0-f437-5b2b-ba4f-2cf63d63f31c_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/60/e0608e829c10e4861239521e3f670c9f/pa/VG92697_b442d263bfe9a9e82922de2ae0f44fb6.jpg saved to cache
2026-04-27 07:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 611a89d0-f437-5b2b-ba4f-2cf63d63f31c
2026-04-27 07:54:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438acdc90>
2026-04-27 07:54:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_611a89d0-f437-5b2b-ba4f-2cf63d63f31c/611a89d0-f437-5b2b-ba4f-2cf63d63f31c_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/60/e0608e829c10e4861239521e3f670c9f/pa/VG92697_aaabb614994b9cff15a059fc48ef0547.jpg saved to cache
2026-04-27 07:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 611a89d0-f437-5b2b-ba4f-2cf63d63f31c
2026-04-27 07:54:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ffa6d0>
2026-04-27 07:54:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_981df65c-9972-55cb-abfb-91160af7f8c7/981df65c-9972-55cb-abfb-91160af7f8c7_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/b0/e9b034a33d8d55048411535b1eb993e2/pa/ZA42646_5ed7b75b2f8bde4f8b9778c416006fe0.jpg saved to cache
2026-04-27 07:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 981df65c-9972-55cb-abfb-91160af7f8c7
2026-04-27 07:54:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380517d0>
2026-04-27 07:54:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0409d58-790c-54fd-9021-3383c8e18e93/c0409d58-790c-54fd-9021-3383c8e18e93_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/8d/4c8df727c8dea8f043b89c5eb620ed7c/pa/WR40640_18acf83f4c19426d233e7fd1ea181738.jpg saved to cache
2026-04-27 07:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c0409d58-790c-54fd-9021-3383c8e18e93
2026-04-27 07:54:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/b4/99b429f1255a640c623fb8818adbb54b/pa/JC67510_7235ae545e27a3a4b310b882360f4d95.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/b4/99b429f1255a640c623fb8818adbb54b/pa/JC67510_bf41498e637c5b4ae7ced29d8c977cc4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/d4/1dd4d76a39e3cf9c6b3b81c7bf053b6f/pa/ET06456_0e45b809f8983782f3e801969ff5bf10.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/60/e0608e829c10e4861239521e3f670c9f/pa/VG92697_4cd70d9fb2255a1b282ed437bc25d7fe.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/d4/1dd4d76a39e3cf9c6b3b81c7bf053b6f/pa/ET06456_e192bc0eb77d41f24cca21b1e15d0582.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/60/e0608e829c10e4861239521e3f670c9f/pa/VG92697_75f21c9756b1290f5b3050bd9d8b3568.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/df/c7df5a0a2599f74c3523befa55c04061/pa/VJ16113_09b6a6541c876a354d33644cb83eaa9e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1439c46cd0>
2026-04-27 07:54:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_611a89d0-f437-5b2b-ba4f-2cf63d63f31c/611a89d0-f437-5b2b-ba4f-2cf63d63f31c_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/60/e0608e829c10e4861239521e3f670c9f/pa/VG92697_357c3339fdc334c99b2b9bec012db324.jpg saved to cache
2026-04-27 07:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 611a89d0-f437-5b2b-ba4f-2cf63d63f31c
2026-04-27 07:54:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/d4/1dd4d76a39e3cf9c6b3b81c7bf053b6f/pa/ET06456_1f1aa4396b93f0bc915cfba9fbd5c533.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/b4/99b429f1255a640c623fb8818adbb54b/pa/JC67510_ab1e5deab4071a91551442dad1532e1e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/df/c7df5a0a2599f74c3523befa55c04061/pa/VJ16113_dd700f75703f47e525da8ee9ed96dddf.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/60/e0608e829c10e4861239521e3f670c9f/pa/VG92697_dbcb2ab0902aa3c5ddfbf016057294f7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438127b10>
2026-04-27 07:54:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed731cf7-b4aa-5782-9e74-7b36eae36861/ed731cf7-b4aa-5782-9e74-7b36eae36861_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/b4/99b429f1255a640c623fb8818adbb54b/pa/JC67510_7235ae545e27a3a4b310b882360f4d95.jpg saved to cache
2026-04-27 07:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ed731cf7-b4aa-5782-9e74-7b36eae36861
2026-04-27 07:54:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/60/e0608e829c10e4861239521e3f670c9f/pa/VG92697_356e589368a9bbd13c7413efc8f61c2c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/d4/1dd4d76a39e3cf9c6b3b81c7bf053b6f/pa/ET06456_fa36e24ea6c2132e6627283ccb1c7aba.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/d4/1dd4d76a39e3cf9c6b3b81c7bf053b6f/pa/ET06456_c14c93c8c9d6b678a7b5334716031eaf.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/60/e0608e829c10e4861239521e3f670c9f/pa/VG92697_0ca7fbf2bc797dc5163221e60bf897a2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a5a6d0>
2026-04-27 07:54:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed731cf7-b4aa-5782-9e74-7b36eae36861/ed731cf7-b4aa-5782-9e74-7b36eae36861_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/b4/99b429f1255a640c623fb8818adbb54b/pa/JC67510_bf41498e637c5b4ae7ced29d8c977cc4.jpg saved to cache
2026-04-27 07:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ed731cf7-b4aa-5782-9e74-7b36eae36861
2026-04-27 07:54:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b7fe10>
2026-04-27 07:54:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8652baf2-15f4-5ffc-abf6-7cd5c81af25b/8652baf2-15f4-5ffc-abf6-7cd5c81af25b_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/d4/1dd4d76a39e3cf9c6b3b81c7bf053b6f/pa/ET06456_0e45b809f8983782f3e801969ff5bf10.jpg saved to cache
2026-04-27 07:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8652baf2-15f4-5ffc-abf6-7cd5c81af25b
2026-04-27 07:54:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438faf3d0>
2026-04-27 07:54:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_611a89d0-f437-5b2b-ba4f-2cf63d63f31c/611a89d0-f437-5b2b-ba4f-2cf63d63f31c_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/60/e0608e829c10e4861239521e3f670c9f/pa/VG92697_4cd70d9fb2255a1b282ed437bc25d7fe.jpg saved to cache
2026-04-27 07:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 611a89d0-f437-5b2b-ba4f-2cf63d63f31c
2026-04-27 07:54:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14381aecd0>
2026-04-27 07:54:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8652baf2-15f4-5ffc-abf6-7cd5c81af25b/8652baf2-15f4-5ffc-abf6-7cd5c81af25b_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/d4/1dd4d76a39e3cf9c6b3b81c7bf053b6f/pa/ET06456_e192bc0eb77d41f24cca21b1e15d0582.jpg saved to cache
2026-04-27 07:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8652baf2-15f4-5ffc-abf6-7cd5c81af25b
2026-04-27 07:54:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143adb2990>
2026-04-27 07:54:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_611a89d0-f437-5b2b-ba4f-2cf63d63f31c/611a89d0-f437-5b2b-ba4f-2cf63d63f31c_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/60/e0608e829c10e4861239521e3f670c9f/pa/VG92697_75f21c9756b1290f5b3050bd9d8b3568.jpg saved to cache
2026-04-27 07:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 611a89d0-f437-5b2b-ba4f-2cf63d63f31c
2026-04-27 07:54:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438fc1010>
2026-04-27 07:54:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57b35460-f8ef-5381-ba8b-bcb32a452802/57b35460-f8ef-5381-ba8b-bcb32a452802_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/df/c7df5a0a2599f74c3523befa55c04061/pa/VJ16113_09b6a6541c876a354d33644cb83eaa9e.jpg saved to cache
2026-04-27 07:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 57b35460-f8ef-5381-ba8b-bcb32a452802
2026-04-27 07:54:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/b4/99b429f1255a640c623fb8818adbb54b/pa/JC67510_7fa3466821d2b64f9137988f4548fb5c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/60/e0608e829c10e4861239521e3f670c9f/pa/VG92697_a699075a0c44db8074471ed52820a3e6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/d4/1dd4d76a39e3cf9c6b3b81c7bf053b6f/pa/ET06456_d028423d51e83c1354ba7f5887ddd25d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143804f610>
2026-04-27 07:54:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8652baf2-15f4-5ffc-abf6-7cd5c81af25b/8652baf2-15f4-5ffc-abf6-7cd5c81af25b_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/d4/1dd4d76a39e3cf9c6b3b81c7bf053b6f/pa/ET06456_1f1aa4396b93f0bc915cfba9fbd5c533.jpg saved to cache
2026-04-27 07:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8652baf2-15f4-5ffc-abf6-7cd5c81af25b
2026-04-27 07:54:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438039810>
2026-04-27 07:54:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed731cf7-b4aa-5782-9e74-7b36eae36861/ed731cf7-b4aa-5782-9e74-7b36eae36861_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/b4/99b429f1255a640c623fb8818adbb54b/pa/JC67510_ab1e5deab4071a91551442dad1532e1e.jpg saved to cache
2026-04-27 07:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ed731cf7-b4aa-5782-9e74-7b36eae36861
2026-04-27 07:54:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14381ae0d0>
2026-04-27 07:54:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57b35460-f8ef-5381-ba8b-bcb32a452802/57b35460-f8ef-5381-ba8b-bcb32a452802_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/df/c7df5a0a2599f74c3523befa55c04061/pa/VJ16113_dd700f75703f47e525da8ee9ed96dddf.jpg saved to cache
2026-04-27 07:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 57b35460-f8ef-5381-ba8b-bcb32a452802
2026-04-27 07:54:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/d4/1dd4d76a39e3cf9c6b3b81c7bf053b6f/pa/ET06456_8de96b00af8f4e1955317dbe88a889a1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/b4/99b429f1255a640c623fb8818adbb54b/pa/JC67510_bec01be49203ebfbee6875e4bf927d1f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438060590>
2026-04-27 07:54:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_611a89d0-f437-5b2b-ba4f-2cf63d63f31c/611a89d0-f437-5b2b-ba4f-2cf63d63f31c_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/60/e0608e829c10e4861239521e3f670c9f/pa/VG92697_dbcb2ab0902aa3c5ddfbf016057294f7.jpg saved to cache
2026-04-27 07:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 611a89d0-f437-5b2b-ba4f-2cf63d63f31c
2026-04-27 07:54:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143805f0d0>
2026-04-27 07:54:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_611a89d0-f437-5b2b-ba4f-2cf63d63f31c/611a89d0-f437-5b2b-ba4f-2cf63d63f31c_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/60/e0608e829c10e4861239521e3f670c9f/pa/VG92697_356e589368a9bbd13c7413efc8f61c2c.jpg saved to cache
2026-04-27 07:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 611a89d0-f437-5b2b-ba4f-2cf63d63f31c
2026-04-27 07:54:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a65a10>
2026-04-27 07:54:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8652baf2-15f4-5ffc-abf6-7cd5c81af25b/8652baf2-15f4-5ffc-abf6-7cd5c81af25b_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/d4/1dd4d76a39e3cf9c6b3b81c7bf053b6f/pa/ET06456_fa36e24ea6c2132e6627283ccb1c7aba.jpg saved to cache
2026-04-27 07:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8652baf2-15f4-5ffc-abf6-7cd5c81af25b
2026-04-27 07:54:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143805fe50>
2026-04-27 07:54:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8652baf2-15f4-5ffc-abf6-7cd5c81af25b/8652baf2-15f4-5ffc-abf6-7cd5c81af25b_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/d4/1dd4d76a39e3cf9c6b3b81c7bf053b6f/pa/ET06456_c14c93c8c9d6b678a7b5334716031eaf.jpg saved to cache
2026-04-27 07:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8652baf2-15f4-5ffc-abf6-7cd5c81af25b
2026-04-27 07:54:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d3acd0>
2026-04-27 07:54:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_611a89d0-f437-5b2b-ba4f-2cf63d63f31c/611a89d0-f437-5b2b-ba4f-2cf63d63f31c_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/60/e0608e829c10e4861239521e3f670c9f/pa/VG92697_0ca7fbf2bc797dc5163221e60bf897a2.jpg saved to cache
2026-04-27 07:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 611a89d0-f437-5b2b-ba4f-2cf63d63f31c
2026-04-27 07:54:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/b4/99b429f1255a640c623fb8818adbb54b/pa/JC67510_d0002b4581cf83ebb1f4921380f35b09.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/d4/1dd4d76a39e3cf9c6b3b81c7bf053b6f/pa/ET06456_5f958ff47e351428fcb766b641579acc.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/df/c7df5a0a2599f74c3523befa55c04061/pa/VJ16113_324f5e7e5509010a00a32e2dc41faca2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143805ca10>
2026-04-27 07:54:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed731cf7-b4aa-5782-9e74-7b36eae36861/ed731cf7-b4aa-5782-9e74-7b36eae36861_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/b4/99b429f1255a640c623fb8818adbb54b/pa/JC67510_7fa3466821d2b64f9137988f4548fb5c.jpg saved to cache
2026-04-27 07:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ed731cf7-b4aa-5782-9e74-7b36eae36861
2026-04-27 07:54:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143808fc50>
2026-04-27 07:54:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_611a89d0-f437-5b2b-ba4f-2cf63d63f31c/611a89d0-f437-5b2b-ba4f-2cf63d63f31c_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/60/e0608e829c10e4861239521e3f670c9f/pa/VG92697_a699075a0c44db8074471ed52820a3e6.jpg saved to cache
2026-04-27 07:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 611a89d0-f437-5b2b-ba4f-2cf63d63f31c
2026-04-27 07:54:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 611a89d0-f437-5b2b-ba4f-2cf63d63f31c, skipping ID generation
2026-04-27 07:54:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 611a89d0-f437-5b2b-ba4f-2cf63d63f31c with scrape type 1
2026-04-27 07:54:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 611a89d0-f437-5b2b-ba4f-2cf63d63f31c sending to next pipeline
2026-04-27 07:54:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 611a89d0-f437-5b2b-ba4f-2cf63d63f31c, identifier: VG92697
2026-04-27 07:54:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14478e2d90>
2026-04-27 07:54:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8652baf2-15f4-5ffc-abf6-7cd5c81af25b/8652baf2-15f4-5ffc-abf6-7cd5c81af25b_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/d4/1dd4d76a39e3cf9c6b3b81c7bf053b6f/pa/ET06456_d028423d51e83c1354ba7f5887ddd25d.jpg saved to cache
2026-04-27 07:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8652baf2-15f4-5ffc-abf6-7cd5c81af25b
2026-04-27 07:54:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/df/c7df5a0a2599f74c3523befa55c04061/pa/VJ16113_136e8ba995ea6ebd8524c99015e4daf6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/d4/1dd4d76a39e3cf9c6b3b81c7bf053b6f/pa/ET06456_1acf141df332d6e6e630dcb82f292439.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/df/c7df5a0a2599f74c3523befa55c04061/pa/VJ16113_35a8586a247eb7e32fb656db6ce9a095.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 611a89d0-f437-5b2b-ba4f-2cf63d63f31c with identifier: VG92697
2026-04-27 07:54:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-27 07:54:26 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-04-27 07:54:26 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-27 07:54:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 611a89d0-f437-5b2b-ba4f-2cf63d63f31c with identifier: VG92697
2026-04-27 07:54:26 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 611a89d0-f437-5b2b-ba4f-2cf63d63f31c with identifier: VG92697 to the API
2026-04-27 07:54:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:26 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge0/60/e0608e829c10e4861239521e3f670c9f/pa/VG92697_a699075a0c44db8074471ed52820a3e6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'category': None,
 'city': 'Ingré',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2026-04-28T15:09:30Z',
 'fuel_type': 'petrol',
 'id': '611a89d0-f437-5b2b-ba4f-2cf63d63f31c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 47.92,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VG92697',
 'listing': 'auction',
 'location': 'FR, Ingré',
 'location_confidence': 'geocoded',
 'longitude': 1.8278,
 'make': 'DS Automobiles',
 'model': 'DS3',
 'odometer': 119450,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_611a89d0-f437-5b2b-ba4f-2cf63d63f31c/611a89d0-f437-5b2b-ba4f-2cf63d63f31c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 508880,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/60/e0608e829c10e4861239521e3f670c9f/pa/VG92697_ca9df582e1d077f93bf01f59302c56cd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_611a89d0-f437-5b2b-ba4f-2cf63d63f31c/611a89d0-f437-5b2b-ba4f-2cf63d63f31c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74365,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/60/e0608e829c10e4861239521e3f670c9f/pa/VG92697_aaabb614994b9cff15a059fc48ef0547.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_611a89d0-f437-5b2b-ba4f-2cf63d63f31c/611a89d0-f437-5b2b-ba4f-2cf63d63f31c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74670,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/60/e0608e829c10e4861239521e3f670c9f/pa/VG92697_b442d263bfe9a9e82922de2ae0f44fb6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_611a89d0-f437-5b2b-ba4f-2cf63d63f31c/611a89d0-f437-5b2b-ba4f-2cf63d63f31c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61583,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/60/e0608e829c10e4861239521e3f670c9f/pa/VG92697_357c3339fdc334c99b2b9bec012db324.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_611a89d0-f437-5b2b-ba4f-2cf63d63f31c/611a89d0-f437-5b2b-ba4f-2cf63d63f31c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67337,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/60/e0608e829c10e4861239521e3f670c9f/pa/VG92697_4cd70d9fb2255a1b282ed437bc25d7fe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_611a89d0-f437-5b2b-ba4f-2cf63d63f31c/611a89d0-f437-5b2b-ba4f-2cf63d63f31c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74094,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/60/e0608e829c10e4861239521e3f670c9f/pa/VG92697_75f21c9756b1290f5b3050bd9d8b3568.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_611a89d0-f437-5b2b-ba4f-2cf63d63f31c/611a89d0-f437-5b2b-ba4f-2cf63d63f31c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60730,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/60/e0608e829c10e4861239521e3f670c9f/pa/VG92697_dbcb2ab0902aa3c5ddfbf016057294f7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_611a89d0-f437-5b2b-ba4f-2cf63d63f31c/611a89d0-f437-5b2b-ba4f-2cf63d63f31c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81020,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/60/e0608e829c10e4861239521e3f670c9f/pa/VG92697_356e589368a9bbd13c7413efc8f61c2c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_611a89d0-f437-5b2b-ba4f-2cf63d63f31c/611a89d0-f437-5b2b-ba4f-2cf63d63f31c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79199,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/60/e0608e829c10e4861239521e3f670c9f/pa/VG92697_0ca7fbf2bc797dc5163221e60bf897a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_611a89d0-f437-5b2b-ba4f-2cf63d63f31c/611a89d0-f437-5b2b-ba4f-2cf63d63f31c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59757,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/60/e0608e829c10e4861239521e3f670c9f/pa/VG92697_a699075a0c44db8074471ed52820a3e6.jpg',
             'Width': 800}],
 'postal_code': '45140',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Loiret',
 'province_code': 'FR-45',
 'region': 'Centre-Val de Loire',
 'region_code': 'FR-24',
 'registration_date': '2017-05-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS Automobiles DS3 1.2 PureTech Chic Connected',
 'transmission': 'automatic',
 'trim': 'Chic Connected',
 'year': 2017}
2026-04-27 07:54:26 [auto1.fr] INFO: Saving data for VG92697: {'created_time': 1777276466.89235, 'last_price_update_time': 1777276466.892362, 'has_photos': True, 'auction_closing_time': 1777388970.0}
2026-04-27 07:54:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14381cca10>
2026-04-27 07:54:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8652baf2-15f4-5ffc-abf6-7cd5c81af25b/8652baf2-15f4-5ffc-abf6-7cd5c81af25b_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/d4/1dd4d76a39e3cf9c6b3b81c7bf053b6f/pa/ET06456_8de96b00af8f4e1955317dbe88a889a1.jpg saved to cache
2026-04-27 07:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8652baf2-15f4-5ffc-abf6-7cd5c81af25b
2026-04-27 07:54:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c8d1d0>
2026-04-27 07:54:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed731cf7-b4aa-5782-9e74-7b36eae36861/ed731cf7-b4aa-5782-9e74-7b36eae36861_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/b4/99b429f1255a640c623fb8818adbb54b/pa/JC67510_bec01be49203ebfbee6875e4bf927d1f.jpg saved to cache
2026-04-27 07:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ed731cf7-b4aa-5782-9e74-7b36eae36861
2026-04-27 07:54:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/de/fbde1c70edb92c31fac601f3601d9c0a/pa/AT92488_24b14fbe4aaf09c2320f279b84a2826e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/df/c7df5a0a2599f74c3523befa55c04061/pa/VJ16113_20f925b9b46c0983a6d0e6e5d9b69598.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/8d/4c8df727c8dea8f043b89c5eb620ed7c/pa/WR40640_d6b6936a246ba482b5ebff13ef8e26ac.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/b0/e9b034a33d8d55048411535b1eb993e2/pa/ZA42646_2667ba9aae1db3c73333f3c7e4a03aa5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/df/c7df5a0a2599f74c3523befa55c04061/pa/VJ16113_c069be281c420d3c70e1073de3790085.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438e163d0>
2026-04-27 07:54:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed731cf7-b4aa-5782-9e74-7b36eae36861/ed731cf7-b4aa-5782-9e74-7b36eae36861_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:54:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/b4/99b429f1255a640c623fb8818adbb54b/pa/JC67510_d0002b4581cf83ebb1f4921380f35b09.jpg saved to cache
2026-04-27 07:54:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ed731cf7-b4aa-5782-9e74-7b36eae36861
2026-04-27 07:54:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ed731cf7-b4aa-5782-9e74-7b36eae36861, skipping ID generation
2026-04-27 07:54:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed731cf7-b4aa-5782-9e74-7b36eae36861 with scrape type 1
2026-04-27 07:54:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ed731cf7-b4aa-5782-9e74-7b36eae36861 sending to next pipeline
2026-04-27 07:54:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ed731cf7-b4aa-5782-9e74-7b36eae36861, identifier: JC67510
2026-04-27 07:54:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438e2e410>
2026-04-27 07:54:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8652baf2-15f4-5ffc-abf6-7cd5c81af25b/8652baf2-15f4-5ffc-abf6-7cd5c81af25b_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:54:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/d4/1dd4d76a39e3cf9c6b3b81c7bf053b6f/pa/ET06456_5f958ff47e351428fcb766b641579acc.jpg saved to cache
2026-04-27 07:54:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8652baf2-15f4-5ffc-abf6-7cd5c81af25b
2026-04-27 07:54:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143801a290>
2026-04-27 07:54:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57b35460-f8ef-5381-ba8b-bcb32a452802/57b35460-f8ef-5381-ba8b-bcb32a452802_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:54:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/df/c7df5a0a2599f74c3523befa55c04061/pa/VJ16113_324f5e7e5509010a00a32e2dc41faca2.jpg saved to cache
2026-04-27 07:54:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 57b35460-f8ef-5381-ba8b-bcb32a452802
2026-04-27 07:54:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a1fad0>
2026-04-27 07:54:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57b35460-f8ef-5381-ba8b-bcb32a452802/57b35460-f8ef-5381-ba8b-bcb32a452802_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:54:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/df/c7df5a0a2599f74c3523befa55c04061/pa/VJ16113_136e8ba995ea6ebd8524c99015e4daf6.jpg saved to cache
2026-04-27 07:54:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 57b35460-f8ef-5381-ba8b-bcb32a452802
2026-04-27 07:54:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380ebd10>
2026-04-27 07:54:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8652baf2-15f4-5ffc-abf6-7cd5c81af25b/8652baf2-15f4-5ffc-abf6-7cd5c81af25b_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/d4/1dd4d76a39e3cf9c6b3b81c7bf053b6f/pa/ET06456_1acf141df332d6e6e630dcb82f292439.jpg saved to cache
2026-04-27 07:54:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8652baf2-15f4-5ffc-abf6-7cd5c81af25b
2026-04-27 07:54:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8652baf2-15f4-5ffc-abf6-7cd5c81af25b, skipping ID generation
2026-04-27 07:54:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8652baf2-15f4-5ffc-abf6-7cd5c81af25b with scrape type 1
2026-04-27 07:54:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8652baf2-15f4-5ffc-abf6-7cd5c81af25b sending to next pipeline
2026-04-27 07:54:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8652baf2-15f4-5ffc-abf6-7cd5c81af25b, identifier: ET06456
2026-04-27 07:54:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c7d450>
2026-04-27 07:54:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57b35460-f8ef-5381-ba8b-bcb32a452802/57b35460-f8ef-5381-ba8b-bcb32a452802_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:54:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/df/c7df5a0a2599f74c3523befa55c04061/pa/VJ16113_35a8586a247eb7e32fb656db6ce9a095.jpg saved to cache
2026-04-27 07:54:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 57b35460-f8ef-5381-ba8b-bcb32a452802
2026-04-27 07:54:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ed731cf7-b4aa-5782-9e74-7b36eae36861 with identifier: JC67510
2026-04-27 07:54:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ed731cf7-b4aa-5782-9e74-7b36eae36861 with identifier: JC67510
2026-04-27 07:54:27 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ed731cf7-b4aa-5782-9e74-7b36eae36861 with identifier: JC67510 to the API
2026-04-27 07:54:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:27 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img99/b4/99b429f1255a640c623fb8818adbb54b/pa/JC67510_d0002b4581cf83ebb1f4921380f35b09.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'category': None,
 'city': 'Marseille',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 110,
 'expiration_date': '2026-04-28T15:31:32Z',
 'fuel_type': 'diesel',
 'id': 'ed731cf7-b4aa-5782-9e74-7b36eae36861',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 43.2969,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JC67510',
 'listing': 'auction',
 'location': 'FR, Marseille',
 'location_confidence': 'geocoded',
 'longitude': 5.3811,
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 236615,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ed731cf7-b4aa-5782-9e74-7b36eae36861/ed731cf7-b4aa-5782-9e74-7b36eae36861_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62717,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/b4/99b429f1255a640c623fb8818adbb54b/pa/JC67510_46082f2ccbe81cc232bdab2dcaa13337.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ed731cf7-b4aa-5782-9e74-7b36eae36861/ed731cf7-b4aa-5782-9e74-7b36eae36861_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53954,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/b4/99b429f1255a640c623fb8818adbb54b/pa/JC67510_56d85f74fccb2a688e1fbd060e45e1c9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ed731cf7-b4aa-5782-9e74-7b36eae36861/ed731cf7-b4aa-5782-9e74-7b36eae36861_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55062,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/b4/99b429f1255a640c623fb8818adbb54b/pa/JC67510_3d71a3155223acdba66423e9a1139504.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ed731cf7-b4aa-5782-9e74-7b36eae36861/ed731cf7-b4aa-5782-9e74-7b36eae36861_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49254,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/b4/99b429f1255a640c623fb8818adbb54b/pa/JC67510_379a0725cddf1f059ddb664040a3cf22.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ed731cf7-b4aa-5782-9e74-7b36eae36861/ed731cf7-b4aa-5782-9e74-7b36eae36861_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57074,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/b4/99b429f1255a640c623fb8818adbb54b/pa/JC67510_d0002b4581cf83ebb1f4921380f35b09.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ed731cf7-b4aa-5782-9e74-7b36eae36861/ed731cf7-b4aa-5782-9e74-7b36eae36861_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62497,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/b4/99b429f1255a640c623fb8818adbb54b/pa/JC67510_7235ae545e27a3a4b310b882360f4d95.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ed731cf7-b4aa-5782-9e74-7b36eae36861/ed731cf7-b4aa-5782-9e74-7b36eae36861_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53379,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/b4/99b429f1255a640c623fb8818adbb54b/pa/JC67510_bf41498e637c5b4ae7ced29d8c977cc4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ed731cf7-b4aa-5782-9e74-7b36eae36861/ed731cf7-b4aa-5782-9e74-7b36eae36861_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60125,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/b4/99b429f1255a640c623fb8818adbb54b/pa/JC67510_bec01be49203ebfbee6875e4bf927d1f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ed731cf7-b4aa-5782-9e74-7b36eae36861/ed731cf7-b4aa-5782-9e74-7b36eae36861_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61271,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/b4/99b429f1255a640c623fb8818adbb54b/pa/JC67510_7fa3466821d2b64f9137988f4548fb5c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ed731cf7-b4aa-5782-9e74-7b36eae36861/ed731cf7-b4aa-5782-9e74-7b36eae36861_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55062,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/b4/99b429f1255a640c623fb8818adbb54b/pa/JC67510_ab1e5deab4071a91551442dad1532e1e.jpg',
             'Width': 800}],
 'postal_code': '13000',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Bouches-du-Rhône',
 'province_code': 'FR-13',
 'region': "Provence-Alpes-Côte d'Azur",
 'region_code': 'FR-93',
 'registration_date': '2016-04-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Comfortline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2016}
2026-04-27 07:54:27 [auto1.fr] INFO: Saving data for JC67510: {'created_time': 1777276467.964419, 'last_price_update_time': 1777276467.964431, 'has_photos': True, 'auction_closing_time': 1777390292.0}
2026-04-27 07:54:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8652baf2-15f4-5ffc-abf6-7cd5c81af25b with identifier: ET06456
2026-04-27 07:54:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8652baf2-15f4-5ffc-abf6-7cd5c81af25b with identifier: ET06456
2026-04-27 07:54:28 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 8652baf2-15f4-5ffc-abf6-7cd5c81af25b with identifier: ET06456 to the API
2026-04-27 07:54:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:28 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1d/d4/1dd4d76a39e3cf9c6b3b81c7bf053b6f/pa/ET06456_1acf141df332d6e6e630dcb82f292439.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'city': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 110,
 'expiration_date': '2026-04-28T15:46:33Z',
 'fuel_type': 'diesel',
 'id': '8652baf2-15f4-5ffc-abf6-7cd5c81af25b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ET06456',
 'listing': 'auction',
 'location': 'FR',
 'location_confidence': None,
 'longitude': None,
 'make': 'Toyota',
 'model': 'Verso',
 'odometer': 141035,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8652baf2-15f4-5ffc-abf6-7cd5c81af25b/8652baf2-15f4-5ffc-abf6-7cd5c81af25b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75241,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/d4/1dd4d76a39e3cf9c6b3b81c7bf053b6f/pa/ET06456_fbdbbe6566085a32834613adaab5def7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8652baf2-15f4-5ffc-abf6-7cd5c81af25b/8652baf2-15f4-5ffc-abf6-7cd5c81af25b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76199,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/d4/1dd4d76a39e3cf9c6b3b81c7bf053b6f/pa/ET06456_1acf141df332d6e6e630dcb82f292439.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8652baf2-15f4-5ffc-abf6-7cd5c81af25b/8652baf2-15f4-5ffc-abf6-7cd5c81af25b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74310,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/d4/1dd4d76a39e3cf9c6b3b81c7bf053b6f/pa/ET06456_0e45b809f8983782f3e801969ff5bf10.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8652baf2-15f4-5ffc-abf6-7cd5c81af25b/8652baf2-15f4-5ffc-abf6-7cd5c81af25b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71513,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/d4/1dd4d76a39e3cf9c6b3b81c7bf053b6f/pa/ET06456_e192bc0eb77d41f24cca21b1e15d0582.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8652baf2-15f4-5ffc-abf6-7cd5c81af25b/8652baf2-15f4-5ffc-abf6-7cd5c81af25b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77654,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/d4/1dd4d76a39e3cf9c6b3b81c7bf053b6f/pa/ET06456_5f958ff47e351428fcb766b641579acc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8652baf2-15f4-5ffc-abf6-7cd5c81af25b/8652baf2-15f4-5ffc-abf6-7cd5c81af25b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85638,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/d4/1dd4d76a39e3cf9c6b3b81c7bf053b6f/pa/ET06456_c14c93c8c9d6b678a7b5334716031eaf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8652baf2-15f4-5ffc-abf6-7cd5c81af25b/8652baf2-15f4-5ffc-abf6-7cd5c81af25b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74989,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/d4/1dd4d76a39e3cf9c6b3b81c7bf053b6f/pa/ET06456_1f1aa4396b93f0bc915cfba9fbd5c533.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8652baf2-15f4-5ffc-abf6-7cd5c81af25b/8652baf2-15f4-5ffc-abf6-7cd5c81af25b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73216,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/d4/1dd4d76a39e3cf9c6b3b81c7bf053b6f/pa/ET06456_fa36e24ea6c2132e6627283ccb1c7aba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8652baf2-15f4-5ffc-abf6-7cd5c81af25b/8652baf2-15f4-5ffc-abf6-7cd5c81af25b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73296,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/d4/1dd4d76a39e3cf9c6b3b81c7bf053b6f/pa/ET06456_8de96b00af8f4e1955317dbe88a889a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8652baf2-15f4-5ffc-abf6-7cd5c81af25b/8652baf2-15f4-5ffc-abf6-7cd5c81af25b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73767,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/d4/1dd4d76a39e3cf9c6b3b81c7bf053b6f/pa/ET06456_d028423d51e83c1354ba7f5887ddd25d.jpg',
             'Width': 800}],
 'postal_code': None,
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2017-12-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Verso 1.6 D-4D Design',
 'transmission': 'manual',
 'trim': 'Design',
 'year': 2017}
2026-04-27 07:54:28 [auto1.fr] INFO: Saving data for ET06456: {'created_time': 1777276468.370528, 'last_price_update_time': 1777276468.370542, 'has_photos': True, 'auction_closing_time': 1777391193.0}
2026-04-27 07:54:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/9a/f69a585bee2db2e33a8e6c259ab85f06/pa/SS46159_38b0af492e2ec048af823c81c3128874.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/8d/4c8df727c8dea8f043b89c5eb620ed7c/pa/WR40640_36bdaaf9ff8d5552eec5c6a38bf85625.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/41/4d41a843d7fe4dbf1480e42fee5201cc/pa/JC07782_01d0cd4e0c89c6fbdc5bb04b194a274c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/32/0132a521be2d768c9ab2b6d5b8af4d26/pa/ML55257_34265d84ece033c9c5e74e0bbeddbd93.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/de/fbde1c70edb92c31fac601f3601d9c0a/pa/AT92488_aad7a1bd3f9f5e0ef479d5fb9aa7a8f4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/32/0132a521be2d768c9ab2b6d5b8af4d26/pa/ML55257_a24df0a70d5c6e485aab1f5befe2d6db.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/32/0132a521be2d768c9ab2b6d5b8af4d26/pa/ML55257_08439875d8d4aed6173c34e1d7dabc02.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/41/4d41a843d7fe4dbf1480e42fee5201cc/pa/JC07782_6353ba1924f6e06d06b539adc091975d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14474bb810>
2026-04-27 07:54:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75078e29-eaf5-5182-b3ae-f50cd5990366/75078e29-eaf5-5182-b3ae-f50cd5990366_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/de/fbde1c70edb92c31fac601f3601d9c0a/pa/AT92488_24b14fbe4aaf09c2320f279b84a2826e.jpg saved to cache
2026-04-27 07:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 75078e29-eaf5-5182-b3ae-f50cd5990366
2026-04-27 07:54:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380ea410>
2026-04-27 07:54:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57b35460-f8ef-5381-ba8b-bcb32a452802/57b35460-f8ef-5381-ba8b-bcb32a452802_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/df/c7df5a0a2599f74c3523befa55c04061/pa/VJ16113_20f925b9b46c0983a6d0e6e5d9b69598.jpg saved to cache
2026-04-27 07:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 57b35460-f8ef-5381-ba8b-bcb32a452802
2026-04-27 07:54:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143808d650>
2026-04-27 07:54:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0409d58-790c-54fd-9021-3383c8e18e93/c0409d58-790c-54fd-9021-3383c8e18e93_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/8d/4c8df727c8dea8f043b89c5eb620ed7c/pa/WR40640_d6b6936a246ba482b5ebff13ef8e26ac.jpg saved to cache
2026-04-27 07:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c0409d58-790c-54fd-9021-3383c8e18e93
2026-04-27 07:54:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b1e9d0>
2026-04-27 07:54:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_981df65c-9972-55cb-abfb-91160af7f8c7/981df65c-9972-55cb-abfb-91160af7f8c7_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/b0/e9b034a33d8d55048411535b1eb993e2/pa/ZA42646_2667ba9aae1db3c73333f3c7e4a03aa5.jpg saved to cache
2026-04-27 07:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 981df65c-9972-55cb-abfb-91160af7f8c7
2026-04-27 07:54:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 981df65c-9972-55cb-abfb-91160af7f8c7, skipping ID generation
2026-04-27 07:54:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 981df65c-9972-55cb-abfb-91160af7f8c7 with scrape type 1
2026-04-27 07:54:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 981df65c-9972-55cb-abfb-91160af7f8c7 sending to next pipeline
2026-04-27 07:54:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 981df65c-9972-55cb-abfb-91160af7f8c7, identifier: ZA42646
2026-04-27 07:54:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143adb2f50>
2026-04-27 07:54:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57b35460-f8ef-5381-ba8b-bcb32a452802/57b35460-f8ef-5381-ba8b-bcb32a452802_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/df/c7df5a0a2599f74c3523befa55c04061/pa/VJ16113_c069be281c420d3c70e1073de3790085.jpg saved to cache
2026-04-27 07:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 57b35460-f8ef-5381-ba8b-bcb32a452802
2026-04-27 07:54:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 57b35460-f8ef-5381-ba8b-bcb32a452802, skipping ID generation
2026-04-27 07:54:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57b35460-f8ef-5381-ba8b-bcb32a452802 with scrape type 1
2026-04-27 07:54:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 57b35460-f8ef-5381-ba8b-bcb32a452802 sending to next pipeline
2026-04-27 07:54:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 57b35460-f8ef-5381-ba8b-bcb32a452802, identifier: VJ16113
2026-04-27 07:54:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 981df65c-9972-55cb-abfb-91160af7f8c7 with identifier: ZA42646
2026-04-27 07:54:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 981df65c-9972-55cb-abfb-91160af7f8c7 with identifier: ZA42646
2026-04-27 07:54:29 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 981df65c-9972-55cb-abfb-91160af7f8c7 with identifier: ZA42646 to the API
2026-04-27 07:54:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:29 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge9/b0/e9b034a33d8d55048411535b1eb993e2/pa/ZA42646_2667ba9aae1db3c73333f3c7e4a03aa5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 179,
 'category': None,
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '3.0L',
 'engine_horse_power': 313,
 'expiration_date': '2026-04-28T15:39:06Z',
 'fuel_type': 'diesel',
 'id': '981df65c-9972-55cb-abfb-91160af7f8c7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZA42646',
 'listing': 'auction',
 'location': 'FR',
 'location_confidence': None,
 'longitude': None,
 'make': 'Audi',
 'model': 'SQ5',
 'odometer': 223246,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_981df65c-9972-55cb-abfb-91160af7f8c7/981df65c-9972-55cb-abfb-91160af7f8c7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60395,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/b0/e9b034a33d8d55048411535b1eb993e2/pa/ZA42646_3d4654ff58793c11ee0b7e7215de966e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_981df65c-9972-55cb-abfb-91160af7f8c7/981df65c-9972-55cb-abfb-91160af7f8c7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56350,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/b0/e9b034a33d8d55048411535b1eb993e2/pa/ZA42646_a5d6e0fc46ad311f5d2958991914be9a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_981df65c-9972-55cb-abfb-91160af7f8c7/981df65c-9972-55cb-abfb-91160af7f8c7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57981,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/b0/e9b034a33d8d55048411535b1eb993e2/pa/ZA42646_e261b61c0b4abc7f825fb5da336bf719.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_981df65c-9972-55cb-abfb-91160af7f8c7/981df65c-9972-55cb-abfb-91160af7f8c7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50910,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/b0/e9b034a33d8d55048411535b1eb993e2/pa/ZA42646_d509c89b85b6210e6eaaf656c1a42331.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_981df65c-9972-55cb-abfb-91160af7f8c7/981df65c-9972-55cb-abfb-91160af7f8c7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56650,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/b0/e9b034a33d8d55048411535b1eb993e2/pa/ZA42646_3ca64cd15b5f6ba934e79aa97f9bc664.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_981df65c-9972-55cb-abfb-91160af7f8c7/981df65c-9972-55cb-abfb-91160af7f8c7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55563,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/b0/e9b034a33d8d55048411535b1eb993e2/pa/ZA42646_a7a4e83842cb3db0d27b01f54eef4e15.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_981df65c-9972-55cb-abfb-91160af7f8c7/981df65c-9972-55cb-abfb-91160af7f8c7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58405,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/b0/e9b034a33d8d55048411535b1eb993e2/pa/ZA42646_8bca77975c37f547ee6c4b53a7d5eac7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_981df65c-9972-55cb-abfb-91160af7f8c7/981df65c-9972-55cb-abfb-91160af7f8c7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110016,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/b0/e9b034a33d8d55048411535b1eb993e2/pa/ZA42646_b40b0b5cd8dc7ad04cd6980c8471f7ef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_981df65c-9972-55cb-abfb-91160af7f8c7/981df65c-9972-55cb-abfb-91160af7f8c7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85370,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/b0/e9b034a33d8d55048411535b1eb993e2/pa/ZA42646_2667ba9aae1db3c73333f3c7e4a03aa5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_981df65c-9972-55cb-abfb-91160af7f8c7/981df65c-9972-55cb-abfb-91160af7f8c7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80125,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/b0/e9b034a33d8d55048411535b1eb993e2/pa/ZA42646_5ed7b75b2f8bde4f8b9778c416006fe0.jpg',
             'Width': 800}],
 'postal_code': None,
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2014-09-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi SQ5 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2014}
2026-04-27 07:54:29 [auto1.fr] INFO: Saving data for ZA42646: {'created_time': 1777276469.306158, 'last_price_update_time': 1777276469.306169, 'has_photos': True, 'auction_closing_time': 1777390746.0}
2026-04-27 07:54:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 57b35460-f8ef-5381-ba8b-bcb32a452802 with identifier: VJ16113
2026-04-27 07:54:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-27 07:54:29 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-04-27 07:54:29 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-27 07:54:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 57b35460-f8ef-5381-ba8b-bcb32a452802 with identifier: VJ16113
2026-04-27 07:54:29 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 57b35460-f8ef-5381-ba8b-bcb32a452802 with identifier: VJ16113 to the API
2026-04-27 07:54:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:29 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc7/df/c7df5a0a2599f74c3523befa55c04061/pa/VJ16113_c069be281c420d3c70e1073de3790085.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'category': None,
 'city': 'CASTELNAU D’ESTRETEFONDS',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 110,
 'expiration_date': '2026-04-28T15:07:21Z',
 'fuel_type': 'diesel',
 'id': '57b35460-f8ef-5381-ba8b-bcb32a452802',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 43.7837,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VJ16113',
 'listing': 'auction',
 'location': 'FR, CASTELNAU D’ESTRETEFONDS',
 'location_confidence': 'geocoded',
 'longitude': 1.359,
 'make': 'Renault',
 'model': 'Kadjar',
 'odometer': 230290,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_57b35460-f8ef-5381-ba8b-bcb32a452802/57b35460-f8ef-5381-ba8b-bcb32a452802_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75079,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/df/c7df5a0a2599f74c3523befa55c04061/pa/VJ16113_e7c08a6666227019a84d44b5ff3a19fd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_57b35460-f8ef-5381-ba8b-bcb32a452802/57b35460-f8ef-5381-ba8b-bcb32a452802_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75467,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/df/c7df5a0a2599f74c3523befa55c04061/pa/VJ16113_dedddef558a09becdaaee8e1b31d60c2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_57b35460-f8ef-5381-ba8b-bcb32a452802/57b35460-f8ef-5381-ba8b-bcb32a452802_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83961,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/df/c7df5a0a2599f74c3523befa55c04061/pa/VJ16113_c069be281c420d3c70e1073de3790085.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_57b35460-f8ef-5381-ba8b-bcb32a452802/57b35460-f8ef-5381-ba8b-bcb32a452802_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70939,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/df/c7df5a0a2599f74c3523befa55c04061/pa/VJ16113_80df54b2e4d42971dfc6ca588ef8dfd2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_57b35460-f8ef-5381-ba8b-bcb32a452802/57b35460-f8ef-5381-ba8b-bcb32a452802_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78867,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/df/c7df5a0a2599f74c3523befa55c04061/pa/VJ16113_20f925b9b46c0983a6d0e6e5d9b69598.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_57b35460-f8ef-5381-ba8b-bcb32a452802/57b35460-f8ef-5381-ba8b-bcb32a452802_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84372,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/df/c7df5a0a2599f74c3523befa55c04061/pa/VJ16113_35a8586a247eb7e32fb656db6ce9a095.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_57b35460-f8ef-5381-ba8b-bcb32a452802/57b35460-f8ef-5381-ba8b-bcb32a452802_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69052,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/df/c7df5a0a2599f74c3523befa55c04061/pa/VJ16113_09b6a6541c876a354d33644cb83eaa9e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_57b35460-f8ef-5381-ba8b-bcb32a452802/57b35460-f8ef-5381-ba8b-bcb32a452802_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87417,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/df/c7df5a0a2599f74c3523befa55c04061/pa/VJ16113_136e8ba995ea6ebd8524c99015e4daf6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_57b35460-f8ef-5381-ba8b-bcb32a452802/57b35460-f8ef-5381-ba8b-bcb32a452802_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68177,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/df/c7df5a0a2599f74c3523befa55c04061/pa/VJ16113_324f5e7e5509010a00a32e2dc41faca2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_57b35460-f8ef-5381-ba8b-bcb32a452802/57b35460-f8ef-5381-ba8b-bcb32a452802_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60432,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/df/c7df5a0a2599f74c3523befa55c04061/pa/VJ16113_dd700f75703f47e525da8ee9ed96dddf.jpg',
             'Width': 800}],
 'postal_code': '31620',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Haute-Garonne',
 'province_code': 'FR-31',
 'region': 'Occitanie',
 'region_code': 'FR-76',
 'registration_date': '2016-12-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Kadjar 1.5 dCi Energy Business Edition',
 'transmission': 'automatic',
 'trim': 'Business Edition',
 'year': 2016}
2026-04-27 07:54:30 [auto1.fr] INFO: Saving data for VJ16113: {'created_time': 1777276470.03797, 'last_price_update_time': 1777276470.037987, 'has_photos': True, 'auction_closing_time': 1777388841.0}
2026-04-27 07:54:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/9a/f69a585bee2db2e33a8e6c259ab85f06/pa/SS46159_0504084fd8b7c1dc219906766a07b865.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/41/4d41a843d7fe4dbf1480e42fee5201cc/pa/JC07782_5e5988ecf1f205620db8ffa6e97b1b1f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/9a/f69a585bee2db2e33a8e6c259ab85f06/pa/SS46159_fbd808e91a1babe8b189ea5ed83289af.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/cf/56cffaa1cfd9c73b12ab4ed974b66846/pa/LK06376_01b1a3c2ea2123a65d334b2519785638.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/41/4d41a843d7fe4dbf1480e42fee5201cc/pa/JC07782_fb25395879b01e62efea3352bd97d5d9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/41/4d41a843d7fe4dbf1480e42fee5201cc/pa/JC07782_86919b5e769cbb43c1b09128ac056147.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/8d/4c8df727c8dea8f043b89c5eb620ed7c/pa/WR40640_fd9276213f627b034fd1d2f7815742ed.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380e8310>
2026-04-27 07:54:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8add49ec-4174-5d8d-ae40-de2af2b3476e/8add49ec-4174-5d8d-ae40-de2af2b3476e_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/9a/f69a585bee2db2e33a8e6c259ab85f06/pa/SS46159_38b0af492e2ec048af823c81c3128874.jpg saved to cache
2026-04-27 07:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8add49ec-4174-5d8d-ae40-de2af2b3476e
2026-04-27 07:54:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438bbd1d0>
2026-04-27 07:54:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0409d58-790c-54fd-9021-3383c8e18e93/c0409d58-790c-54fd-9021-3383c8e18e93_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/8d/4c8df727c8dea8f043b89c5eb620ed7c/pa/WR40640_36bdaaf9ff8d5552eec5c6a38bf85625.jpg saved to cache
2026-04-27 07:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c0409d58-790c-54fd-9021-3383c8e18e93
2026-04-27 07:54:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143808c250>
2026-04-27 07:54:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9fc7ebb-4dab-5408-803a-e3e3e01e4608/d9fc7ebb-4dab-5408-803a-e3e3e01e4608_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/41/4d41a843d7fe4dbf1480e42fee5201cc/pa/JC07782_01d0cd4e0c89c6fbdc5bb04b194a274c.jpg saved to cache
2026-04-27 07:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d9fc7ebb-4dab-5408-803a-e3e3e01e4608
2026-04-27 07:54:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143add6450>
2026-04-27 07:54:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5ce9a97-2010-5e49-9d94-9572d74d6438/f5ce9a97-2010-5e49-9d94-9572d74d6438_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/32/0132a521be2d768c9ab2b6d5b8af4d26/pa/ML55257_34265d84ece033c9c5e74e0bbeddbd93.jpg saved to cache
2026-04-27 07:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f5ce9a97-2010-5e49-9d94-9572d74d6438
2026-04-27 07:54:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438abb9d0>
2026-04-27 07:54:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75078e29-eaf5-5182-b3ae-f50cd5990366/75078e29-eaf5-5182-b3ae-f50cd5990366_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/de/fbde1c70edb92c31fac601f3601d9c0a/pa/AT92488_aad7a1bd3f9f5e0ef479d5fb9aa7a8f4.jpg saved to cache
2026-04-27 07:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 75078e29-eaf5-5182-b3ae-f50cd5990366
2026-04-27 07:54:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 75078e29-eaf5-5182-b3ae-f50cd5990366, skipping ID generation
2026-04-27 07:54:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75078e29-eaf5-5182-b3ae-f50cd5990366 with scrape type 1
2026-04-27 07:54:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 75078e29-eaf5-5182-b3ae-f50cd5990366 sending to next pipeline
2026-04-27 07:54:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 75078e29-eaf5-5182-b3ae-f50cd5990366, identifier: AT92488
2026-04-27 07:54:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b96d10>
2026-04-27 07:54:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5ce9a97-2010-5e49-9d94-9572d74d6438/f5ce9a97-2010-5e49-9d94-9572d74d6438_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/32/0132a521be2d768c9ab2b6d5b8af4d26/pa/ML55257_a24df0a70d5c6e485aab1f5befe2d6db.jpg saved to cache
2026-04-27 07:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f5ce9a97-2010-5e49-9d94-9572d74d6438
2026-04-27 07:54:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380a86d0>
2026-04-27 07:54:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5ce9a97-2010-5e49-9d94-9572d74d6438/f5ce9a97-2010-5e49-9d94-9572d74d6438_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/32/0132a521be2d768c9ab2b6d5b8af4d26/pa/ML55257_08439875d8d4aed6173c34e1d7dabc02.jpg saved to cache
2026-04-27 07:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f5ce9a97-2010-5e49-9d94-9572d74d6438
2026-04-27 07:54:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143820d050>
2026-04-27 07:54:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9fc7ebb-4dab-5408-803a-e3e3e01e4608/d9fc7ebb-4dab-5408-803a-e3e3e01e4608_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/41/4d41a843d7fe4dbf1480e42fee5201cc/pa/JC07782_6353ba1924f6e06d06b539adc091975d.jpg saved to cache
2026-04-27 07:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d9fc7ebb-4dab-5408-803a-e3e3e01e4608
2026-04-27 07:54:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 75078e29-eaf5-5182-b3ae-f50cd5990366 with identifier: AT92488
2026-04-27 07:54:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-27 07:54:30 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-04-27 07:54:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-27 07:54:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 75078e29-eaf5-5182-b3ae-f50cd5990366 with identifier: AT92488
2026-04-27 07:54:30 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 75078e29-eaf5-5182-b3ae-f50cd5990366 with identifier: AT92488 to the API
2026-04-27 07:54:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:31 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgfb/de/fbde1c70edb92c31fac601f3601d9c0a/pa/AT92488_aad7a1bd3f9f5e0ef479d5fb9aa7a8f4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 174,
 'category': None,
 'city': 'Seynod',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 4',
 'engine': '1.8L',
 'engine_horse_power': 160,
 'expiration_date': '2026-04-28T15:51:37Z',
 'fuel_type': 'petrol',
 'id': '75078e29-eaf5-5182-b3ae-f50cd5990366',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 45.8855,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AT92488',
 'listing': 'auction',
 'location': 'FR, Seynod',
 'location_confidence': 'geocoded',
 'longitude': 6.0883,
 'make': 'Audi',
 'model': 'A3',
 'odometer': 206124,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_75078e29-eaf5-5182-b3ae-f50cd5990366/75078e29-eaf5-5182-b3ae-f50cd5990366_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96559,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/de/fbde1c70edb92c31fac601f3601d9c0a/pa/AT92488_aad7a1bd3f9f5e0ef479d5fb9aa7a8f4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_75078e29-eaf5-5182-b3ae-f50cd5990366/75078e29-eaf5-5182-b3ae-f50cd5990366_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83222,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/de/fbde1c70edb92c31fac601f3601d9c0a/pa/AT92488_e6518e5a1d3b0b95f1c0d1068aeb2ffa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_75078e29-eaf5-5182-b3ae-f50cd5990366/75078e29-eaf5-5182-b3ae-f50cd5990366_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72060,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/de/fbde1c70edb92c31fac601f3601d9c0a/pa/AT92488_db3d71dba57fc8d2c6c0079b876b3e8d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_75078e29-eaf5-5182-b3ae-f50cd5990366/75078e29-eaf5-5182-b3ae-f50cd5990366_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59605,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/de/fbde1c70edb92c31fac601f3601d9c0a/pa/AT92488_22b67108ce97c686976a652f881ce2ed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_75078e29-eaf5-5182-b3ae-f50cd5990366/75078e29-eaf5-5182-b3ae-f50cd5990366_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88274,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/de/fbde1c70edb92c31fac601f3601d9c0a/pa/AT92488_24b14fbe4aaf09c2320f279b84a2826e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_75078e29-eaf5-5182-b3ae-f50cd5990366/75078e29-eaf5-5182-b3ae-f50cd5990366_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40399,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/de/fbde1c70edb92c31fac601f3601d9c0a/pa/AT92488_2f234222bcd613836e89c12b0f1cad19.jpg',
             'Width': 800}],
 'postal_code': '74600',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Haute-Savoie',
 'province_code': 'FR-74',
 'region': 'Auvergne-Rhône-Alpes',
 'region_code': 'FR-84',
 'registration_date': '2008-09-07',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Audi A3 1.8 TFSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2008}
2026-04-27 07:54:31 [auto1.fr] INFO: Saving data for AT92488: {'created_time': 1777276471.783336, 'last_price_update_time': 1777276471.783347, 'has_photos': True, 'auction_closing_time': 1777391497.0}
2026-04-27 07:54:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/cf/56cffaa1cfd9c73b12ab4ed974b66846/pa/LK06376_c52862408fd8575827cc12131b2bd62f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/cf/56cffaa1cfd9c73b12ab4ed974b66846/pa/LK06376_8f9d28a22eecc2cfdeab99ec90c29464.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/9a/f69a585bee2db2e33a8e6c259ab85f06/pa/SS46159_64620978af954f1dbcc812c67d446ee5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/a5/23a513bc56061f1f5b101fc2dd45bf81/pa/DZ81947_f3fea18a63bdaef0c05d5e58488c9148.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/a5/23a513bc56061f1f5b101fc2dd45bf81/pa/DZ81947_ac8973e322212efe4ec89642154acb93.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/26/f326b82c3ac29d9bab3681d3d194aceb/pa/XB02112_5b50319d131194beb170465ba763f456.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/26/f326b82c3ac29d9bab3681d3d194aceb/pa/XB02112_9daf1990d48ff506474451aee11bb4aa.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14381fcb90>
2026-04-27 07:54:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8add49ec-4174-5d8d-ae40-de2af2b3476e/8add49ec-4174-5d8d-ae40-de2af2b3476e_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:54:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/9a/f69a585bee2db2e33a8e6c259ab85f06/pa/SS46159_0504084fd8b7c1dc219906766a07b865.jpg saved to cache
2026-04-27 07:54:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8add49ec-4174-5d8d-ae40-de2af2b3476e
2026-04-27 07:54:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b1cfd0>
2026-04-27 07:54:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9fc7ebb-4dab-5408-803a-e3e3e01e4608/d9fc7ebb-4dab-5408-803a-e3e3e01e4608_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:54:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/41/4d41a843d7fe4dbf1480e42fee5201cc/pa/JC07782_5e5988ecf1f205620db8ffa6e97b1b1f.jpg saved to cache
2026-04-27 07:54:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d9fc7ebb-4dab-5408-803a-e3e3e01e4608
2026-04-27 07:54:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438dca2d0>
2026-04-27 07:54:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8add49ec-4174-5d8d-ae40-de2af2b3476e/8add49ec-4174-5d8d-ae40-de2af2b3476e_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/9a/f69a585bee2db2e33a8e6c259ab85f06/pa/SS46159_fbd808e91a1babe8b189ea5ed83289af.jpg saved to cache
2026-04-27 07:54:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8add49ec-4174-5d8d-ae40-de2af2b3476e
2026-04-27 07:54:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14478dbed0>
2026-04-27 07:54:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8f32245-5789-5979-ac68-bfebe34ceb75/e8f32245-5789-5979-ac68-bfebe34ceb75_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:54:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/cf/56cffaa1cfd9c73b12ab4ed974b66846/pa/LK06376_01b1a3c2ea2123a65d334b2519785638.jpg saved to cache
2026-04-27 07:54:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e8f32245-5789-5979-ac68-bfebe34ceb75
2026-04-27 07:54:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b29b90>
2026-04-27 07:54:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9fc7ebb-4dab-5408-803a-e3e3e01e4608/d9fc7ebb-4dab-5408-803a-e3e3e01e4608_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/41/4d41a843d7fe4dbf1480e42fee5201cc/pa/JC07782_fb25395879b01e62efea3352bd97d5d9.jpg saved to cache
2026-04-27 07:54:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d9fc7ebb-4dab-5408-803a-e3e3e01e4608
2026-04-27 07:54:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143805ce50>
2026-04-27 07:54:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9fc7ebb-4dab-5408-803a-e3e3e01e4608/d9fc7ebb-4dab-5408-803a-e3e3e01e4608_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/41/4d41a843d7fe4dbf1480e42fee5201cc/pa/JC07782_86919b5e769cbb43c1b09128ac056147.jpg saved to cache
2026-04-27 07:54:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d9fc7ebb-4dab-5408-803a-e3e3e01e4608
2026-04-27 07:54:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d9fc7ebb-4dab-5408-803a-e3e3e01e4608, skipping ID generation
2026-04-27 07:54:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9fc7ebb-4dab-5408-803a-e3e3e01e4608 with scrape type 1
2026-04-27 07:54:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d9fc7ebb-4dab-5408-803a-e3e3e01e4608 sending to next pipeline
2026-04-27 07:54:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d9fc7ebb-4dab-5408-803a-e3e3e01e4608, identifier: JC07782
2026-04-27 07:54:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c8e810>
2026-04-27 07:54:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0409d58-790c-54fd-9021-3383c8e18e93/c0409d58-790c-54fd-9021-3383c8e18e93_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/8d/4c8df727c8dea8f043b89c5eb620ed7c/pa/WR40640_fd9276213f627b034fd1d2f7815742ed.jpg saved to cache
2026-04-27 07:54:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c0409d58-790c-54fd-9021-3383c8e18e93
2026-04-27 07:54:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c0409d58-790c-54fd-9021-3383c8e18e93, skipping ID generation
2026-04-27 07:54:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0409d58-790c-54fd-9021-3383c8e18e93 with scrape type 1
2026-04-27 07:54:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c0409d58-790c-54fd-9021-3383c8e18e93 sending to next pipeline
2026-04-27 07:54:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c0409d58-790c-54fd-9021-3383c8e18e93, identifier: WR40640
2026-04-27 07:54:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d9fc7ebb-4dab-5408-803a-e3e3e01e4608 with identifier: JC07782
2026-04-27 07:54:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d9fc7ebb-4dab-5408-803a-e3e3e01e4608 with identifier: JC07782
2026-04-27 07:54:32 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: d9fc7ebb-4dab-5408-803a-e3e3e01e4608 with identifier: JC07782 to the API
2026-04-27 07:54:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:32 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4d/41/4d41a843d7fe4dbf1480e42fee5201cc/pa/JC07782_86919b5e769cbb43c1b09128ac056147.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 89,
 'category': None,
 'city': 'Quincieux',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 95,
 'expiration_date': '2026-04-28T15:28:50Z',
 'fuel_type': 'diesel',
 'id': 'd9fc7ebb-4dab-5408-803a-e3e3e01e4608',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 45.9137,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JC07782',
 'listing': 'auction',
 'location': 'FR, Quincieux',
 'location_confidence': 'geocoded',
 'longitude': 4.777,
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 235643,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d9fc7ebb-4dab-5408-803a-e3e3e01e4608/d9fc7ebb-4dab-5408-803a-e3e3e01e4608_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62848,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/41/4d41a843d7fe4dbf1480e42fee5201cc/pa/JC07782_94ce427c3283e80ab8562651a13a2024.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d9fc7ebb-4dab-5408-803a-e3e3e01e4608/d9fc7ebb-4dab-5408-803a-e3e3e01e4608_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60323,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/41/4d41a843d7fe4dbf1480e42fee5201cc/pa/JC07782_dd9650af8d6afb51f1c242d869cbad9d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d9fc7ebb-4dab-5408-803a-e3e3e01e4608/d9fc7ebb-4dab-5408-803a-e3e3e01e4608_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61433,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/41/4d41a843d7fe4dbf1480e42fee5201cc/pa/JC07782_86919b5e769cbb43c1b09128ac056147.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d9fc7ebb-4dab-5408-803a-e3e3e01e4608/d9fc7ebb-4dab-5408-803a-e3e3e01e4608_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48616,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/41/4d41a843d7fe4dbf1480e42fee5201cc/pa/JC07782_fb25395879b01e62efea3352bd97d5d9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d9fc7ebb-4dab-5408-803a-e3e3e01e4608/d9fc7ebb-4dab-5408-803a-e3e3e01e4608_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62008,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/41/4d41a843d7fe4dbf1480e42fee5201cc/pa/JC07782_6aeb2b954f19e568503fca6ca128c686.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d9fc7ebb-4dab-5408-803a-e3e3e01e4608/d9fc7ebb-4dab-5408-803a-e3e3e01e4608_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56079,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/41/4d41a843d7fe4dbf1480e42fee5201cc/pa/JC07782_5e5988ecf1f205620db8ffa6e97b1b1f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d9fc7ebb-4dab-5408-803a-e3e3e01e4608/d9fc7ebb-4dab-5408-803a-e3e3e01e4608_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54618,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/41/4d41a843d7fe4dbf1480e42fee5201cc/pa/JC07782_ebbe3f1879b98e35fdf24eab49fc878a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d9fc7ebb-4dab-5408-803a-e3e3e01e4608/d9fc7ebb-4dab-5408-803a-e3e3e01e4608_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71892,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/41/4d41a843d7fe4dbf1480e42fee5201cc/pa/JC07782_cc18007fcdeebea75030d673f50a3752.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d9fc7ebb-4dab-5408-803a-e3e3e01e4608/d9fc7ebb-4dab-5408-803a-e3e3e01e4608_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64981,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/41/4d41a843d7fe4dbf1480e42fee5201cc/pa/JC07782_6353ba1924f6e06d06b539adc091975d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d9fc7ebb-4dab-5408-803a-e3e3e01e4608/d9fc7ebb-4dab-5408-803a-e3e3e01e4608_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53967,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/41/4d41a843d7fe4dbf1480e42fee5201cc/pa/JC07782_01d0cd4e0c89c6fbdc5bb04b194a274c.jpg',
             'Width': 800}],
 'postal_code': '69650',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Rhône',
 'province_code': 'FR-69',
 'region': 'Auvergne-Rhône-Alpes',
 'region_code': 'FR-84',
 'registration_date': '2015-07-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Corsa 1.3 CDTI Business Connect ecoFlex',
 'transmission': 'manual',
 'trim': 'Business Connect ecoFlex',
 'year': 2015}
2026-04-27 07:54:33 [auto1.fr] INFO: Saving data for JC07782: {'created_time': 1777276473.017356, 'last_price_update_time': 1777276473.017367, 'has_photos': True, 'auction_closing_time': 1777390130.0}
2026-04-27 07:54:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c0409d58-790c-54fd-9021-3383c8e18e93 with identifier: WR40640
2026-04-27 07:54:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c0409d58-790c-54fd-9021-3383c8e18e93 with identifier: WR40640
2026-04-27 07:54:33 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c0409d58-790c-54fd-9021-3383c8e18e93 with identifier: WR40640 to the API
2026-04-27 07:54:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:33 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4c/8d/4c8df727c8dea8f043b89c5eb620ed7c/pa/WR40640_fd9276213f627b034fd1d2f7815742ed.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 108,
 'category': None,
 'city': 'Boé',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 68,
 'expiration_date': '2026-04-28T15:07:20Z',
 'fuel_type': 'petrol',
 'id': 'c0409d58-790c-54fd-9021-3383c8e18e93',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 44.1602,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WR40640',
 'listing': 'auction',
 'location': 'FR, Boé',
 'location_confidence': 'geocoded',
 'longitude': 0.6281,
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 127150,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c0409d58-790c-54fd-9021-3383c8e18e93/c0409d58-790c-54fd-9021-3383c8e18e93_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104347,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/8d/4c8df727c8dea8f043b89c5eb620ed7c/pa/WR40640_fd9276213f627b034fd1d2f7815742ed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c0409d58-790c-54fd-9021-3383c8e18e93/c0409d58-790c-54fd-9021-3383c8e18e93_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82406,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/8d/4c8df727c8dea8f043b89c5eb620ed7c/pa/WR40640_8c07d191217c14845937475f71164cb8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c0409d58-790c-54fd-9021-3383c8e18e93/c0409d58-790c-54fd-9021-3383c8e18e93_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92171,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/8d/4c8df727c8dea8f043b89c5eb620ed7c/pa/WR40640_c99ffbc241b4ca8770a303fa5fa8a8cb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c0409d58-790c-54fd-9021-3383c8e18e93/c0409d58-790c-54fd-9021-3383c8e18e93_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72557,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/8d/4c8df727c8dea8f043b89c5eb620ed7c/pa/WR40640_cc2bb29a27b0f21c1351f3193f8a09fe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c0409d58-790c-54fd-9021-3383c8e18e93/c0409d58-790c-54fd-9021-3383c8e18e93_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70077,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/8d/4c8df727c8dea8f043b89c5eb620ed7c/pa/WR40640_b2b8553313aa17b438ea527e89706029.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c0409d58-790c-54fd-9021-3383c8e18e93/c0409d58-790c-54fd-9021-3383c8e18e93_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95652,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/8d/4c8df727c8dea8f043b89c5eb620ed7c/pa/WR40640_7e7b8a64e9289adf0f66051aff77f572.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c0409d58-790c-54fd-9021-3383c8e18e93/c0409d58-790c-54fd-9021-3383c8e18e93_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62525,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/8d/4c8df727c8dea8f043b89c5eb620ed7c/pa/WR40640_36bdaaf9ff8d5552eec5c6a38bf85625.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c0409d58-790c-54fd-9021-3383c8e18e93/c0409d58-790c-54fd-9021-3383c8e18e93_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71645,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/8d/4c8df727c8dea8f043b89c5eb620ed7c/pa/WR40640_0389bb0bd96ef6811f45ab6bcc34cca1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c0409d58-790c-54fd-9021-3383c8e18e93/c0409d58-790c-54fd-9021-3383c8e18e93_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95312,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/8d/4c8df727c8dea8f043b89c5eb620ed7c/pa/WR40640_d6b6936a246ba482b5ebff13ef8e26ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c0409d58-790c-54fd-9021-3383c8e18e93/c0409d58-790c-54fd-9021-3383c8e18e93_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81836,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/8d/4c8df727c8dea8f043b89c5eb620ed7c/pa/WR40640_18acf83f4c19426d233e7fd1ea181738.jpg',
             'Width': 800}],
 'postal_code': '47550',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Lot-et-Garonne',
 'province_code': 'FR-47',
 'region': 'Nouvelle-Aquitaine',
 'region_code': 'FR-75',
 'registration_date': '2018-04-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 1.2 PureTech Live',
 'transmission': 'manual',
 'trim': 'Live',
 'year': 2018}
2026-04-27 07:54:33 [auto1.fr] INFO: Saving data for WR40640: {'created_time': 1777276473.376924, 'last_price_update_time': 1777276473.376936, 'has_photos': True, 'auction_closing_time': 1777388840.0}
2026-04-27 07:54:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380e84d0>
2026-04-27 07:54:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8f32245-5789-5979-ac68-bfebe34ceb75/e8f32245-5789-5979-ac68-bfebe34ceb75_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/cf/56cffaa1cfd9c73b12ab4ed974b66846/pa/LK06376_c52862408fd8575827cc12131b2bd62f.jpg saved to cache
2026-04-27 07:54:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e8f32245-5789-5979-ac68-bfebe34ceb75
2026-04-27 07:54:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438adf710>
2026-04-27 07:54:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8f32245-5789-5979-ac68-bfebe34ceb75/e8f32245-5789-5979-ac68-bfebe34ceb75_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:54:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/cf/56cffaa1cfd9c73b12ab4ed974b66846/pa/LK06376_8f9d28a22eecc2cfdeab99ec90c29464.jpg saved to cache
2026-04-27 07:54:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e8f32245-5789-5979-ac68-bfebe34ceb75
2026-04-27 07:54:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e8f32245-5789-5979-ac68-bfebe34ceb75, skipping ID generation
2026-04-27 07:54:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8f32245-5789-5979-ac68-bfebe34ceb75 with scrape type 1
2026-04-27 07:54:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e8f32245-5789-5979-ac68-bfebe34ceb75 sending to next pipeline
2026-04-27 07:54:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e8f32245-5789-5979-ac68-bfebe34ceb75, identifier: LK06376
2026-04-27 07:54:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/32/0132a521be2d768c9ab2b6d5b8af4d26/pa/ML55257_2c0c4bcf18486d02e480d306dc003b50.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/7d/fc7d2b0da8d51d24eb9a616211e1fc3b/pa/JH31546_d7558a862106cb7439f14d81ba695508.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/7d/fc7d2b0da8d51d24eb9a616211e1fc3b/pa/JH31546_4f112717638022f3ff021f7b1502be93.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/7d/fc7d2b0da8d51d24eb9a616211e1fc3b/pa/JH31546_417c374d25364fd47917bb977a9fde6a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/a5/23a513bc56061f1f5b101fc2dd45bf81/pa/DZ81947_fdce1327073f7992645bc1f6ad464221.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/a5/23a513bc56061f1f5b101fc2dd45bf81/pa/DZ81947_1409c64c237a9c0bba0fdd20f8e2dc57.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e8f32245-5789-5979-ac68-bfebe34ceb75 with identifier: LK06376
2026-04-27 07:54:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-27 07:54:33 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=electro HTTP/1.1" 200 None
2026-04-27 07:54:34 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-27 07:54:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e8f32245-5789-5979-ac68-bfebe34ceb75 with identifier: LK06376
2026-04-27 07:54:34 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e8f32245-5789-5979-ac68-bfebe34ceb75 with identifier: LK06376 to the API
2026-04-27 07:54:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:34 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img56/cf/56cffaa1cfd9c73b12ab4ed974b66846/pa/LK06376_8f9d28a22eecc2cfdeab99ec90c29464.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'city': 'Beaucaire',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO N\\/A',
 'engine': '',
 'engine_horse_power': 204,
 'expiration_date': '2026-04-28T15:16:04Z',
 'fuel_type': 'electro',
 'id': 'e8f32245-5789-5979-ac68-bfebe34ceb75',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 43.8081,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LK06376',
 'listing': 'auction',
 'location': 'FR, Beaucaire',
 'location_confidence': 'geocoded',
 'longitude': 4.6442,
 'make': 'MG',
 'model': '4',
 'odometer': 73152,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e8f32245-5789-5979-ac68-bfebe34ceb75/e8f32245-5789-5979-ac68-bfebe34ceb75_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49389,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/cf/56cffaa1cfd9c73b12ab4ed974b66846/pa/LK06376_3b57da7d9aaedde8759319a7c290c1be.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e8f32245-5789-5979-ac68-bfebe34ceb75/e8f32245-5789-5979-ac68-bfebe34ceb75_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53178,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/cf/56cffaa1cfd9c73b12ab4ed974b66846/pa/LK06376_c7440066582c3ec71af2682d4dd6887d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e8f32245-5789-5979-ac68-bfebe34ceb75/e8f32245-5789-5979-ac68-bfebe34ceb75_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50062,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/cf/56cffaa1cfd9c73b12ab4ed974b66846/pa/LK06376_b2677b7343298da624c93bdb6809f996.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e8f32245-5789-5979-ac68-bfebe34ceb75/e8f32245-5789-5979-ac68-bfebe34ceb75_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50923,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/cf/56cffaa1cfd9c73b12ab4ed974b66846/pa/LK06376_c52862408fd8575827cc12131b2bd62f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e8f32245-5789-5979-ac68-bfebe34ceb75/e8f32245-5789-5979-ac68-bfebe34ceb75_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52680,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/cf/56cffaa1cfd9c73b12ab4ed974b66846/pa/LK06376_606e1ca9cb2904de982db2ec9d1b9b7f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e8f32245-5789-5979-ac68-bfebe34ceb75/e8f32245-5789-5979-ac68-bfebe34ceb75_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52758,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/cf/56cffaa1cfd9c73b12ab4ed974b66846/pa/LK06376_bf1e4958e26e8f6f0d587900777b20c0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e8f32245-5789-5979-ac68-bfebe34ceb75/e8f32245-5789-5979-ac68-bfebe34ceb75_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39935,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/cf/56cffaa1cfd9c73b12ab4ed974b66846/pa/LK06376_519d8d956ace8bd501db59eed9c6c83a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e8f32245-5789-5979-ac68-bfebe34ceb75/e8f32245-5789-5979-ac68-bfebe34ceb75_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44026,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/cf/56cffaa1cfd9c73b12ab4ed974b66846/pa/LK06376_8f9d28a22eecc2cfdeab99ec90c29464.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e8f32245-5789-5979-ac68-bfebe34ceb75/e8f32245-5789-5979-ac68-bfebe34ceb75_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46188,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/cf/56cffaa1cfd9c73b12ab4ed974b66846/pa/LK06376_01b1a3c2ea2123a65d334b2519785638.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e8f32245-5789-5979-ac68-bfebe34ceb75/e8f32245-5789-5979-ac68-bfebe34ceb75_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51899,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/cf/56cffaa1cfd9c73b12ab4ed974b66846/pa/LK06376_51e64059a8a64f860b9dc8c6911cbe4b.jpg',
             'Width': 800}],
 'postal_code': '30300',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Gard',
 'province_code': 'FR-30',
 'region': 'Occitanie',
 'region_code': 'FR-76',
 'registration_date': '2023-06-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MG 4 electric drive 150 kW Luxury',
 'transmission': 'automatic',
 'trim': 'Luxury',
 'year': 2023}
2026-04-27 07:54:35 [auto1.fr] INFO: Saving data for LK06376: {'created_time': 1777276475.097225, 'last_price_update_time': 1777276475.097238, 'has_photos': True, 'auction_closing_time': 1777389364.0}
2026-04-27 07:54:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/e4/b6e49c0f84af029932654e7ec6a5037b/pa/YF75391_6819c451111f18ea8c2e0c9aebc9b0dd.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/e4/b6e49c0f84af029932654e7ec6a5037b/pa/YF75391_d5888c927eb270fd9c3e8a1b84d80b22.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14479083d0>
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8add49ec-4174-5d8d-ae40-de2af2b3476e/8add49ec-4174-5d8d-ae40-de2af2b3476e_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/9a/f69a585bee2db2e33a8e6c259ab85f06/pa/SS46159_64620978af954f1dbcc812c67d446ee5.jpg saved to cache
2026-04-27 07:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8add49ec-4174-5d8d-ae40-de2af2b3476e
2026-04-27 07:54:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8add49ec-4174-5d8d-ae40-de2af2b3476e, skipping ID generation
2026-04-27 07:54:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8add49ec-4174-5d8d-ae40-de2af2b3476e with scrape type 1
2026-04-27 07:54:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8add49ec-4174-5d8d-ae40-de2af2b3476e sending to next pipeline
2026-04-27 07:54:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8add49ec-4174-5d8d-ae40-de2af2b3476e, identifier: SS46159
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a1b450>
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_522a9e1a-96ad-52ce-b85c-10a91d20ee51/522a9e1a-96ad-52ce-b85c-10a91d20ee51_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/a5/23a513bc56061f1f5b101fc2dd45bf81/pa/DZ81947_f3fea18a63bdaef0c05d5e58488c9148.jpg saved to cache
2026-04-27 07:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 522a9e1a-96ad-52ce-b85c-10a91d20ee51
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c89f90>
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_522a9e1a-96ad-52ce-b85c-10a91d20ee51/522a9e1a-96ad-52ce-b85c-10a91d20ee51_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/a5/23a513bc56061f1f5b101fc2dd45bf81/pa/DZ81947_ac8973e322212efe4ec89642154acb93.jpg saved to cache
2026-04-27 07:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 522a9e1a-96ad-52ce-b85c-10a91d20ee51
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b29610>
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35eb078b-9e97-5b63-b9c0-67eb0572a3d5/35eb078b-9e97-5b63-b9c0-67eb0572a3d5_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/26/f326b82c3ac29d9bab3681d3d194aceb/pa/XB02112_5b50319d131194beb170465ba763f456.jpg saved to cache
2026-04-27 07:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 35eb078b-9e97-5b63-b9c0-67eb0572a3d5
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1453ccf450>
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35eb078b-9e97-5b63-b9c0-67eb0572a3d5/35eb078b-9e97-5b63-b9c0-67eb0572a3d5_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/26/f326b82c3ac29d9bab3681d3d194aceb/pa/XB02112_9daf1990d48ff506474451aee11bb4aa.jpg saved to cache
2026-04-27 07:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 35eb078b-9e97-5b63-b9c0-67eb0572a3d5
2026-04-27 07:54:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 35eb078b-9e97-5b63-b9c0-67eb0572a3d5, skipping ID generation
2026-04-27 07:54:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35eb078b-9e97-5b63-b9c0-67eb0572a3d5 with scrape type 1
2026-04-27 07:54:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 35eb078b-9e97-5b63-b9c0-67eb0572a3d5 sending to next pipeline
2026-04-27 07:54:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 35eb078b-9e97-5b63-b9c0-67eb0572a3d5, identifier: XB02112
2026-04-27 07:54:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8add49ec-4174-5d8d-ae40-de2af2b3476e with identifier: SS46159
2026-04-27 07:54:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8add49ec-4174-5d8d-ae40-de2af2b3476e with identifier: SS46159
2026-04-27 07:54:35 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 8add49ec-4174-5d8d-ae40-de2af2b3476e with identifier: SS46159 to the API
2026-04-27 07:54:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:35 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf6/9a/f69a585bee2db2e33a8e6c259ab85f06/pa/SS46159_64620978af954f1dbcc812c67d446ee5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'city': 'Haguenau',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-04-28T15:04:29Z',
 'fuel_type': 'diesel',
 'id': '8add49ec-4174-5d8d-ae40-de2af2b3476e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.8156,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SS46159',
 'listing': 'auction',
 'location': 'Haguenau',
 'location_confidence': 'geocoded',
 'longitude': 7.7905,
 'make': 'Audi',
 'model': 'A4',
 'odometer': 231517,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8add49ec-4174-5d8d-ae40-de2af2b3476e/8add49ec-4174-5d8d-ae40-de2af2b3476e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66137,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/9a/f69a585bee2db2e33a8e6c259ab85f06/pa/SS46159_64620978af954f1dbcc812c67d446ee5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8add49ec-4174-5d8d-ae40-de2af2b3476e/8add49ec-4174-5d8d-ae40-de2af2b3476e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70243,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/9a/f69a585bee2db2e33a8e6c259ab85f06/pa/SS46159_6307bdaec5abe85bc238774d84353661.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8add49ec-4174-5d8d-ae40-de2af2b3476e/8add49ec-4174-5d8d-ae40-de2af2b3476e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60610,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/9a/f69a585bee2db2e33a8e6c259ab85f06/pa/SS46159_e6ffe822aef3bb1baa4f69131f7303d1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8add49ec-4174-5d8d-ae40-de2af2b3476e/8add49ec-4174-5d8d-ae40-de2af2b3476e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56547,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/9a/f69a585bee2db2e33a8e6c259ab85f06/pa/SS46159_fbd808e91a1babe8b189ea5ed83289af.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8add49ec-4174-5d8d-ae40-de2af2b3476e/8add49ec-4174-5d8d-ae40-de2af2b3476e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63113,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/9a/f69a585bee2db2e33a8e6c259ab85f06/pa/SS46159_0504084fd8b7c1dc219906766a07b865.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8add49ec-4174-5d8d-ae40-de2af2b3476e/8add49ec-4174-5d8d-ae40-de2af2b3476e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61280,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/9a/f69a585bee2db2e33a8e6c259ab85f06/pa/SS46159_5a0050eee89a3ee107f02a81b67d2808.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8add49ec-4174-5d8d-ae40-de2af2b3476e/8add49ec-4174-5d8d-ae40-de2af2b3476e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55610,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/9a/f69a585bee2db2e33a8e6c259ab85f06/pa/SS46159_6493bc96b6d1d169057d0d1f782367fd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8add49ec-4174-5d8d-ae40-de2af2b3476e/8add49ec-4174-5d8d-ae40-de2af2b3476e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73552,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/9a/f69a585bee2db2e33a8e6c259ab85f06/pa/SS46159_e986aa4040d26290aa7e1b53c3e5813b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8add49ec-4174-5d8d-ae40-de2af2b3476e/8add49ec-4174-5d8d-ae40-de2af2b3476e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65764,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/9a/f69a585bee2db2e33a8e6c259ab85f06/pa/SS46159_14c0e680607fc7c783f7eaa67313038f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8add49ec-4174-5d8d-ae40-de2af2b3476e/8add49ec-4174-5d8d-ae40-de2af2b3476e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53533,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/9a/f69a585bee2db2e33a8e6c259ab85f06/pa/SS46159_38b0af492e2ec048af823c81c3128874.jpg',
             'Width': 800}],
 'postal_code': '67500',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Bas-Rhin',
 'province_code': 'FR-67',
 'region': 'Grand Est',
 'region_code': 'FR-44',
 'registration_date': '2014-07-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2014}
2026-04-27 07:54:35 [auto1.fr] INFO: Saving data for SS46159: {'created_time': 1777276475.889638, 'last_price_update_time': 1777276475.889647, 'has_photos': True, 'auction_closing_time': 1777388669.0}
2026-04-27 07:54:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 35eb078b-9e97-5b63-b9c0-67eb0572a3d5 with identifier: XB02112
2026-04-27 07:54:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 35eb078b-9e97-5b63-b9c0-67eb0572a3d5 with identifier: XB02112
2026-04-27 07:54:36 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 35eb078b-9e97-5b63-b9c0-67eb0572a3d5 with identifier: XB02112 to the API
2026-04-27 07:54:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:36 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf3/26/f326b82c3ac29d9bab3681d3d194aceb/pa/XB02112_9daf1990d48ff506474451aee11bb4aa.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'category': None,
 'city': 'Marseille',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 110,
 'expiration_date': '2026-04-28T15:49:11Z',
 'fuel_type': 'diesel',
 'id': '35eb078b-9e97-5b63-b9c0-67eb0572a3d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 43.2969,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XB02112',
 'listing': 'auction',
 'location': 'FR, Marseille',
 'location_confidence': 'geocoded',
 'longitude': 5.3811,
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 180370,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_35eb078b-9e97-5b63-b9c0-67eb0572a3d5/35eb078b-9e97-5b63-b9c0-67eb0572a3d5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116912,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/26/f326b82c3ac29d9bab3681d3d194aceb/pa/XB02112_c9f561db2009786d41759d471a545ee1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_35eb078b-9e97-5b63-b9c0-67eb0572a3d5/35eb078b-9e97-5b63-b9c0-67eb0572a3d5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95111,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/26/f326b82c3ac29d9bab3681d3d194aceb/pa/XB02112_9daf1990d48ff506474451aee11bb4aa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_35eb078b-9e97-5b63-b9c0-67eb0572a3d5/35eb078b-9e97-5b63-b9c0-67eb0572a3d5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84666,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/26/f326b82c3ac29d9bab3681d3d194aceb/pa/XB02112_7a608f710c7812ebb5cc444e016c04a9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_35eb078b-9e97-5b63-b9c0-67eb0572a3d5/35eb078b-9e97-5b63-b9c0-67eb0572a3d5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85726,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/26/f326b82c3ac29d9bab3681d3d194aceb/pa/XB02112_76a2b5ec7bae7bb8200b312e90c7ff90.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_35eb078b-9e97-5b63-b9c0-67eb0572a3d5/35eb078b-9e97-5b63-b9c0-67eb0572a3d5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 119863,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/26/f326b82c3ac29d9bab3681d3d194aceb/pa/XB02112_5b50319d131194beb170465ba763f456.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_35eb078b-9e97-5b63-b9c0-67eb0572a3d5/35eb078b-9e97-5b63-b9c0-67eb0572a3d5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42695,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/26/f326b82c3ac29d9bab3681d3d194aceb/pa/XB02112_c4dd375565f93294c931bb697e27f73e.jpg',
             'Width': 800}],
 'postal_code': '13000',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Bouches-du-Rhône',
 'province_code': 'FR-13',
 'region': "Provence-Alpes-Côte d'Azur",
 'region_code': 'FR-93',
 'registration_date': '2010-11-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 HDi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2010}
2026-04-27 07:54:36 [auto1.fr] INFO: Saving data for XB02112: {'created_time': 1777276476.26234, 'last_price_update_time': 1777276476.262356, 'has_photos': True, 'auction_closing_time': 1777391351.0}
2026-04-27 07:54:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/7d/fc7d2b0da8d51d24eb9a616211e1fc3b/pa/JH31546_c6a21d562cb1c3de23edc046d51fc961.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/7d/fc7d2b0da8d51d24eb9a616211e1fc3b/pa/JH31546_ddee527b25e7f1f5fde4f1921ad542ce.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/7d/fc7d2b0da8d51d24eb9a616211e1fc3b/pa/JH31546_d9191654f7171f14aba56e28d0943e01.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-04-27 07:54:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-04-27 07:54:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-04-27 07:54:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-04-27 07:54:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a63490>
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5ce9a97-2010-5e49-9d94-9572d74d6438/f5ce9a97-2010-5e49-9d94-9572d74d6438_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/32/0132a521be2d768c9ab2b6d5b8af4d26/pa/ML55257_2c0c4bcf18486d02e480d306dc003b50.jpg saved to cache
2026-04-27 07:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f5ce9a97-2010-5e49-9d94-9572d74d6438
2026-04-27 07:54:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f5ce9a97-2010-5e49-9d94-9572d74d6438, skipping ID generation
2026-04-27 07:54:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5ce9a97-2010-5e49-9d94-9572d74d6438 with scrape type 1
2026-04-27 07:54:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f5ce9a97-2010-5e49-9d94-9572d74d6438 sending to next pipeline
2026-04-27 07:54:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f5ce9a97-2010-5e49-9d94-9572d74d6438, identifier: ML55257
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438075cd0>
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_118bae87-5815-5188-99a4-e835fe74f496/118bae87-5815-5188-99a4-e835fe74f496_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/7d/fc7d2b0da8d51d24eb9a616211e1fc3b/pa/JH31546_d7558a862106cb7439f14d81ba695508.jpg saved to cache
2026-04-27 07:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 118bae87-5815-5188-99a4-e835fe74f496
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438fc1690>
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_118bae87-5815-5188-99a4-e835fe74f496/118bae87-5815-5188-99a4-e835fe74f496_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/7d/fc7d2b0da8d51d24eb9a616211e1fc3b/pa/JH31546_4f112717638022f3ff021f7b1502be93.jpg saved to cache
2026-04-27 07:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 118bae87-5815-5188-99a4-e835fe74f496
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438cc6610>
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_118bae87-5815-5188-99a4-e835fe74f496/118bae87-5815-5188-99a4-e835fe74f496_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/7d/fc7d2b0da8d51d24eb9a616211e1fc3b/pa/JH31546_417c374d25364fd47917bb977a9fde6a.jpg saved to cache
2026-04-27 07:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 118bae87-5815-5188-99a4-e835fe74f496
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143805d1d0>
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_522a9e1a-96ad-52ce-b85c-10a91d20ee51/522a9e1a-96ad-52ce-b85c-10a91d20ee51_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/a5/23a513bc56061f1f5b101fc2dd45bf81/pa/DZ81947_fdce1327073f7992645bc1f6ad464221.jpg saved to cache
2026-04-27 07:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 522a9e1a-96ad-52ce-b85c-10a91d20ee51
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380e0950>
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_522a9e1a-96ad-52ce-b85c-10a91d20ee51/522a9e1a-96ad-52ce-b85c-10a91d20ee51_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/a5/23a513bc56061f1f5b101fc2dd45bf81/pa/DZ81947_1409c64c237a9c0bba0fdd20f8e2dc57.jpg saved to cache
2026-04-27 07:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 522a9e1a-96ad-52ce-b85c-10a91d20ee51
2026-04-27 07:54:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 522a9e1a-96ad-52ce-b85c-10a91d20ee51, skipping ID generation
2026-04-27 07:54:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 522a9e1a-96ad-52ce-b85c-10a91d20ee51 with scrape type 1
2026-04-27 07:54:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 522a9e1a-96ad-52ce-b85c-10a91d20ee51 sending to next pipeline
2026-04-27 07:54:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 522a9e1a-96ad-52ce-b85c-10a91d20ee51, identifier: DZ81947
2026-04-27 07:54:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/7d/fc7d2b0da8d51d24eb9a616211e1fc3b/pa/JH31546_8103a3f3dbb42c68897855a6b64db07d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/e4/b6e49c0f84af029932654e7ec6a5037b/pa/YF75391_e447961653cf906a2e751d9e0b032777.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/e4/b6e49c0f84af029932654e7ec6a5037b/pa/YF75391_3a0e1f8defa678438fc9e3f83409e220.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f5ce9a97-2010-5e49-9d94-9572d74d6438 with identifier: ML55257
2026-04-27 07:54:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f5ce9a97-2010-5e49-9d94-9572d74d6438 with identifier: ML55257
2026-04-27 07:54:36 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f5ce9a97-2010-5e49-9d94-9572d74d6438 with identifier: ML55257 to the API
2026-04-27 07:54:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:37 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img01/32/0132a521be2d768c9ab2b6d5b8af4d26/pa/ML55257_2c0c4bcf18486d02e480d306dc003b50.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'category': None,
 'city': 'Biarritz',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 110,
 'expiration_date': '2026-04-28T15:54:12Z',
 'fuel_type': 'petrol',
 'id': 'f5ce9a97-2010-5e49-9d94-9572d74d6438',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 43.4806,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ML55257',
 'listing': 'auction',
 'location': 'FR, Biarritz',
 'location_confidence': 'geocoded',
 'longitude': -1.5568,
 'make': 'Volkswagen',
 'model': 'T-Cross',
 'odometer': 90294,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f5ce9a97-2010-5e49-9d94-9572d74d6438/f5ce9a97-2010-5e49-9d94-9572d74d6438_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82186,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/32/0132a521be2d768c9ab2b6d5b8af4d26/pa/ML55257_835e71bd3e87e985823771d5060aa818.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f5ce9a97-2010-5e49-9d94-9572d74d6438/f5ce9a97-2010-5e49-9d94-9572d74d6438_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 528075,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img01/32/0132a521be2d768c9ab2b6d5b8af4d26/pa/ML55257_2c0c4bcf18486d02e480d306dc003b50.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f5ce9a97-2010-5e49-9d94-9572d74d6438/f5ce9a97-2010-5e49-9d94-9572d74d6438_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91999,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/32/0132a521be2d768c9ab2b6d5b8af4d26/pa/ML55257_6198ba63536cf2bc6d8953aa150b5a73.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f5ce9a97-2010-5e49-9d94-9572d74d6438/f5ce9a97-2010-5e49-9d94-9572d74d6438_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71422,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/32/0132a521be2d768c9ab2b6d5b8af4d26/pa/ML55257_08439875d8d4aed6173c34e1d7dabc02.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f5ce9a97-2010-5e49-9d94-9572d74d6438/f5ce9a97-2010-5e49-9d94-9572d74d6438_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72781,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/32/0132a521be2d768c9ab2b6d5b8af4d26/pa/ML55257_20c852498c7e7f6fc89f72256c9b6029.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f5ce9a97-2010-5e49-9d94-9572d74d6438/f5ce9a97-2010-5e49-9d94-9572d74d6438_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 377072,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img01/32/0132a521be2d768c9ab2b6d5b8af4d26/pa/ML55257_187a42afc6bf6a3061191dd76c2bd16a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f5ce9a97-2010-5e49-9d94-9572d74d6438/f5ce9a97-2010-5e49-9d94-9572d74d6438_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60562,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/32/0132a521be2d768c9ab2b6d5b8af4d26/pa/ML55257_34265d84ece033c9c5e74e0bbeddbd93.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f5ce9a97-2010-5e49-9d94-9572d74d6438/f5ce9a97-2010-5e49-9d94-9572d74d6438_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88811,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/32/0132a521be2d768c9ab2b6d5b8af4d26/pa/ML55257_a24df0a70d5c6e485aab1f5befe2d6db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f5ce9a97-2010-5e49-9d94-9572d74d6438/f5ce9a97-2010-5e49-9d94-9572d74d6438_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80388,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/32/0132a521be2d768c9ab2b6d5b8af4d26/pa/ML55257_81b9b653fd3c38f24919e071a13e54a6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f5ce9a97-2010-5e49-9d94-9572d74d6438/f5ce9a97-2010-5e49-9d94-9572d74d6438_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47068,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/32/0132a521be2d768c9ab2b6d5b8af4d26/pa/ML55257_5f74c1b057b05a61caad97f518d76906.jpg',
             'Width': 800}],
 'postal_code': '64200',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Pyrénées-Atlantiques',
 'province_code': 'FR-64',
 'region': 'Nouvelle-Aquitaine',
 'region_code': 'FR-75',
 'registration_date': '2022-12-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen T-Cross 1.0 TSI R-Line',
 'transmission': 'manual',
 'trim': 'R-Line',
 'year': 2022}
2026-04-27 07:54:37 [auto1.fr] INFO: Saving data for ML55257: {'created_time': 1777276477.179008, 'last_price_update_time': 1777276477.17902, 'has_photos': True, 'auction_closing_time': 1777391652.0}
2026-04-27 07:54:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 522a9e1a-96ad-52ce-b85c-10a91d20ee51 with identifier: DZ81947
2026-04-27 07:54:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 522a9e1a-96ad-52ce-b85c-10a91d20ee51 with identifier: DZ81947
2026-04-27 07:54:37 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 522a9e1a-96ad-52ce-b85c-10a91d20ee51 with identifier: DZ81947 to the API
2026-04-27 07:54:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:37 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img23/a5/23a513bc56061f1f5b101fc2dd45bf81/pa/DZ81947_1409c64c237a9c0bba0fdd20f8e2dc57.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'category': None,
 'city': 'Loyettes',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.1L',
 'engine_horse_power': 170,
 'expiration_date': '2026-04-28T15:46:40Z',
 'fuel_type': 'diesel',
 'id': '522a9e1a-96ad-52ce-b85c-10a91d20ee51',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 45.7766,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DZ81947',
 'listing': 'auction',
 'location': 'FR, Loyettes',
 'location_confidence': 'geocoded',
 'longitude': 5.2069,
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 191256,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_522a9e1a-96ad-52ce-b85c-10a91d20ee51/522a9e1a-96ad-52ce-b85c-10a91d20ee51_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113120,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img23/a5/23a513bc56061f1f5b101fc2dd45bf81/pa/DZ81947_fdce1327073f7992645bc1f6ad464221.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_522a9e1a-96ad-52ce-b85c-10a91d20ee51/522a9e1a-96ad-52ce-b85c-10a91d20ee51_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 119905,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img23/a5/23a513bc56061f1f5b101fc2dd45bf81/pa/DZ81947_d85f9cb1750154148101e3158aadffd2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_522a9e1a-96ad-52ce-b85c-10a91d20ee51/522a9e1a-96ad-52ce-b85c-10a91d20ee51_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106792,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img23/a5/23a513bc56061f1f5b101fc2dd45bf81/pa/DZ81947_8639ec2539cec5ca6ab473620ed91b01.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_522a9e1a-96ad-52ce-b85c-10a91d20ee51/522a9e1a-96ad-52ce-b85c-10a91d20ee51_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 124878,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img23/a5/23a513bc56061f1f5b101fc2dd45bf81/pa/DZ81947_1409c64c237a9c0bba0fdd20f8e2dc57.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_522a9e1a-96ad-52ce-b85c-10a91d20ee51/522a9e1a-96ad-52ce-b85c-10a91d20ee51_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 134226,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img23/a5/23a513bc56061f1f5b101fc2dd45bf81/pa/DZ81947_626b6c035c4264daf6aef2d22f6ae3b4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_522a9e1a-96ad-52ce-b85c-10a91d20ee51/522a9e1a-96ad-52ce-b85c-10a91d20ee51_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 147057,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img23/a5/23a513bc56061f1f5b101fc2dd45bf81/pa/DZ81947_a647e629878d8537f5478acc1b0167b4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_522a9e1a-96ad-52ce-b85c-10a91d20ee51/522a9e1a-96ad-52ce-b85c-10a91d20ee51_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 119466,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img23/a5/23a513bc56061f1f5b101fc2dd45bf81/pa/DZ81947_a026f3db001f054b3491bb629f0180d2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_522a9e1a-96ad-52ce-b85c-10a91d20ee51/522a9e1a-96ad-52ce-b85c-10a91d20ee51_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105588,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img23/a5/23a513bc56061f1f5b101fc2dd45bf81/pa/DZ81947_f3fea18a63bdaef0c05d5e58488c9148.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_522a9e1a-96ad-52ce-b85c-10a91d20ee51/522a9e1a-96ad-52ce-b85c-10a91d20ee51_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85419,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img23/a5/23a513bc56061f1f5b101fc2dd45bf81/pa/DZ81947_ac8973e322212efe4ec89642154acb93.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_522a9e1a-96ad-52ce-b85c-10a91d20ee51/522a9e1a-96ad-52ce-b85c-10a91d20ee51_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102833,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img23/a5/23a513bc56061f1f5b101fc2dd45bf81/pa/DZ81947_9704f6a09356626bcc3f7a09036a1c11.jpg',
             'Width': 800}],
 'postal_code': '01360',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Ain',
 'province_code': 'FR-01',
 'region': 'Auvergne-Rhône-Alpes',
 'region_code': 'FR-84',
 'registration_date': '2015-11-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 220 CDI BlueTEC Executive',
 'transmission': 'automatic',
 'trim': 'BlueTEC Executive',
 'year': 2015}
2026-04-27 07:54:37 [auto1.fr] INFO: Saving data for DZ81947: {'created_time': 1777276477.566015, 'last_price_update_time': 1777276477.566027, 'has_photos': True, 'auction_closing_time': 1777391200.0}
2026-04-27 07:54:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/7d/fc7d2b0da8d51d24eb9a616211e1fc3b/pa/JH31546_a536fe134fa9eda64432ee1b78a684fc.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/f5/80f50f58c2dd7a24153e0a86a605b3e1/pa/ST87878_bdf02c568742b0956feae9eba5caf8e2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438e56ad0>
2026-04-27 07:54:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fa53457-6660-57e0-841c-925c8ec219a0/5fa53457-6660-57e0-841c-925c8ec219a0_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/e4/b6e49c0f84af029932654e7ec6a5037b/pa/YF75391_6819c451111f18ea8c2e0c9aebc9b0dd.jpg saved to cache
2026-04-27 07:54:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5fa53457-6660-57e0-841c-925c8ec219a0
2026-04-27 07:54:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143817aa50>
2026-04-27 07:54:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fa53457-6660-57e0-841c-925c8ec219a0/5fa53457-6660-57e0-841c-925c8ec219a0_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:54:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/e4/b6e49c0f84af029932654e7ec6a5037b/pa/YF75391_d5888c927eb270fd9c3e8a1b84d80b22.jpg saved to cache
2026-04-27 07:54:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5fa53457-6660-57e0-841c-925c8ec219a0
2026-04-27 07:54:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/f5/80f50f58c2dd7a24153e0a86a605b3e1/pa/ST87878_bcf384a72b361a59e8525ab3f91abbf8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/f5/80f50f58c2dd7a24153e0a86a605b3e1/pa/ST87878_73e35c6ecb6789e73aa585f3eb118526.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/f5/80f50f58c2dd7a24153e0a86a605b3e1/pa/ST87878_89e0d056e033d02e237c7d6157a34d3e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380b90d0>
2026-04-27 07:54:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_118bae87-5815-5188-99a4-e835fe74f496/118bae87-5815-5188-99a4-e835fe74f496_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/7d/fc7d2b0da8d51d24eb9a616211e1fc3b/pa/JH31546_c6a21d562cb1c3de23edc046d51fc961.jpg saved to cache
2026-04-27 07:54:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 118bae87-5815-5188-99a4-e835fe74f496
2026-04-27 07:54:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1447e22190>
2026-04-27 07:54:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_118bae87-5815-5188-99a4-e835fe74f496/118bae87-5815-5188-99a4-e835fe74f496_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:54:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/7d/fc7d2b0da8d51d24eb9a616211e1fc3b/pa/JH31546_ddee527b25e7f1f5fde4f1921ad542ce.jpg saved to cache
2026-04-27 07:54:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 118bae87-5815-5188-99a4-e835fe74f496
2026-04-27 07:54:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d36bd0>
2026-04-27 07:54:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_118bae87-5815-5188-99a4-e835fe74f496/118bae87-5815-5188-99a4-e835fe74f496_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/7d/fc7d2b0da8d51d24eb9a616211e1fc3b/pa/JH31546_d9191654f7171f14aba56e28d0943e01.jpg saved to cache
2026-04-27 07:54:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 118bae87-5815-5188-99a4-e835fe74f496
2026-04-27 07:54:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143809a590>
2026-04-27 07:54:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_118bae87-5815-5188-99a4-e835fe74f496/118bae87-5815-5188-99a4-e835fe74f496_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/7d/fc7d2b0da8d51d24eb9a616211e1fc3b/pa/JH31546_8103a3f3dbb42c68897855a6b64db07d.jpg saved to cache
2026-04-27 07:54:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 118bae87-5815-5188-99a4-e835fe74f496
2026-04-27 07:54:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d37f50>
2026-04-27 07:54:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fa53457-6660-57e0-841c-925c8ec219a0/5fa53457-6660-57e0-841c-925c8ec219a0_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/e4/b6e49c0f84af029932654e7ec6a5037b/pa/YF75391_e447961653cf906a2e751d9e0b032777.jpg saved to cache
2026-04-27 07:54:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5fa53457-6660-57e0-841c-925c8ec219a0
2026-04-27 07:54:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143808e450>
2026-04-27 07:54:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fa53457-6660-57e0-841c-925c8ec219a0/5fa53457-6660-57e0-841c-925c8ec219a0_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/e4/b6e49c0f84af029932654e7ec6a5037b/pa/YF75391_3a0e1f8defa678438fc9e3f83409e220.jpg saved to cache
2026-04-27 07:54:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5fa53457-6660-57e0-841c-925c8ec219a0
2026-04-27 07:54:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5fa53457-6660-57e0-841c-925c8ec219a0, skipping ID generation
2026-04-27 07:54:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5fa53457-6660-57e0-841c-925c8ec219a0 with scrape type 1
2026-04-27 07:54:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5fa53457-6660-57e0-841c-925c8ec219a0 sending to next pipeline
2026-04-27 07:54:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5fa53457-6660-57e0-841c-925c8ec219a0, identifier: YF75391
2026-04-27 07:54:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14478dccd0>
2026-04-27 07:54:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_118bae87-5815-5188-99a4-e835fe74f496/118bae87-5815-5188-99a4-e835fe74f496_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/7d/fc7d2b0da8d51d24eb9a616211e1fc3b/pa/JH31546_a536fe134fa9eda64432ee1b78a684fc.jpg saved to cache
2026-04-27 07:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 118bae87-5815-5188-99a4-e835fe74f496
2026-04-27 07:54:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 118bae87-5815-5188-99a4-e835fe74f496, skipping ID generation
2026-04-27 07:54:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 118bae87-5815-5188-99a4-e835fe74f496 with scrape type 1
2026-04-27 07:54:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 118bae87-5815-5188-99a4-e835fe74f496 sending to next pipeline
2026-04-27 07:54:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 118bae87-5815-5188-99a4-e835fe74f496, identifier: JH31546
2026-04-27 07:54:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438cc5210>
2026-04-27 07:54:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e79f5f2d-882f-599f-bd9c-1bf57a9015b5/e79f5f2d-882f-599f-bd9c-1bf57a9015b5_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/f5/80f50f58c2dd7a24153e0a86a605b3e1/pa/ST87878_bdf02c568742b0956feae9eba5caf8e2.jpg saved to cache
2026-04-27 07:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e79f5f2d-882f-599f-bd9c-1bf57a9015b5
2026-04-27 07:54:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5fa53457-6660-57e0-841c-925c8ec219a0 with identifier: YF75391
2026-04-27 07:54:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5fa53457-6660-57e0-841c-925c8ec219a0 with identifier: YF75391
2026-04-27 07:54:38 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 5fa53457-6660-57e0-841c-925c8ec219a0 with identifier: YF75391 to the API
2026-04-27 07:54:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:38 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb6/e4/b6e49c0f84af029932654e7ec6a5037b/pa/YF75391_3a0e1f8defa678438fc9e3f83409e220.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 179,
 'category': None,
 'city': 'Ambarès-et-Lagrave',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 170,
 'expiration_date': '2026-04-28T15:20:10Z',
 'fuel_type': 'diesel',
 'id': '5fa53457-6660-57e0-841c-925c8ec219a0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 44.9274,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YF75391',
 'listing': 'auction',
 'location': 'FR, Ambarès-et-Lagrave',
 'location_confidence': 'geocoded',
 'longitude': -0.4914,
 'make': 'Audi',
 'model': 'A4',
 'odometer': 284047,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5fa53457-6660-57e0-841c-925c8ec219a0/5fa53457-6660-57e0-841c-925c8ec219a0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75854,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/e4/b6e49c0f84af029932654e7ec6a5037b/pa/YF75391_e447961653cf906a2e751d9e0b032777.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5fa53457-6660-57e0-841c-925c8ec219a0/5fa53457-6660-57e0-841c-925c8ec219a0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85065,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/e4/b6e49c0f84af029932654e7ec6a5037b/pa/YF75391_3a0e1f8defa678438fc9e3f83409e220.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5fa53457-6660-57e0-841c-925c8ec219a0/5fa53457-6660-57e0-841c-925c8ec219a0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86768,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/e4/b6e49c0f84af029932654e7ec6a5037b/pa/YF75391_37fad7ab4f953a6643c44096a94c439d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5fa53457-6660-57e0-841c-925c8ec219a0/5fa53457-6660-57e0-841c-925c8ec219a0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90389,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/e4/b6e49c0f84af029932654e7ec6a5037b/pa/YF75391_6819c451111f18ea8c2e0c9aebc9b0dd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5fa53457-6660-57e0-841c-925c8ec219a0/5fa53457-6660-57e0-841c-925c8ec219a0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113170,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/e4/b6e49c0f84af029932654e7ec6a5037b/pa/YF75391_d5888c927eb270fd9c3e8a1b84d80b22.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5fa53457-6660-57e0-841c-925c8ec219a0/5fa53457-6660-57e0-841c-925c8ec219a0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41823,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/e4/b6e49c0f84af029932654e7ec6a5037b/pa/YF75391_011398e16c01c1cd18a9aff8e23060c5.jpg',
             'Width': 800}],
 'postal_code': '33440',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Gironde',
 'province_code': 'FR-33',
 'region': 'Nouvelle-Aquitaine',
 'region_code': 'FR-75',
 'registration_date': '2007-03-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI quattro Ambition',
 'transmission': 'manual',
 'trim': 'quattro Ambition',
 'year': 2007}
2026-04-27 07:54:38 [auto1.fr] INFO: Saving data for YF75391: {'created_time': 1777276478.721705, 'last_price_update_time': 1777276478.721719, 'has_photos': True, 'auction_closing_time': 1777389610.0}
2026-04-27 07:54:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 118bae87-5815-5188-99a4-e835fe74f496 with identifier: JH31546
2026-04-27 07:54:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 118bae87-5815-5188-99a4-e835fe74f496 with identifier: JH31546
2026-04-27 07:54:38 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 118bae87-5815-5188-99a4-e835fe74f496 with identifier: JH31546 to the API
2026-04-27 07:54:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:38 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgfc/7d/fc7d2b0da8d51d24eb9a616211e1fc3b/pa/JH31546_a536fe134fa9eda64432ee1b78a684fc.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'category': None,
 'city': 'Chantepie',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 95,
 'expiration_date': '2026-04-28T15:56:06Z',
 'fuel_type': 'petrol',
 'id': '118bae87-5815-5188-99a4-e835fe74f496',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.0882,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JH31546',
 'listing': 'auction',
 'location': 'FR, Chantepie',
 'location_confidence': 'geocoded',
 'longitude': -1.6169,
 'make': 'Fiat',
 'model': 'Tipo',
 'odometer': 152086,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_118bae87-5815-5188-99a4-e835fe74f496/118bae87-5815-5188-99a4-e835fe74f496_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68943,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/7d/fc7d2b0da8d51d24eb9a616211e1fc3b/pa/JH31546_a536fe134fa9eda64432ee1b78a684fc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_118bae87-5815-5188-99a4-e835fe74f496/118bae87-5815-5188-99a4-e835fe74f496_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67431,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/7d/fc7d2b0da8d51d24eb9a616211e1fc3b/pa/JH31546_8103a3f3dbb42c68897855a6b64db07d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_118bae87-5815-5188-99a4-e835fe74f496/118bae87-5815-5188-99a4-e835fe74f496_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59641,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/7d/fc7d2b0da8d51d24eb9a616211e1fc3b/pa/JH31546_d9191654f7171f14aba56e28d0943e01.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_118bae87-5815-5188-99a4-e835fe74f496/118bae87-5815-5188-99a4-e835fe74f496_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54190,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/7d/fc7d2b0da8d51d24eb9a616211e1fc3b/pa/JH31546_c6a21d562cb1c3de23edc046d51fc961.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_118bae87-5815-5188-99a4-e835fe74f496/118bae87-5815-5188-99a4-e835fe74f496_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49734,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/7d/fc7d2b0da8d51d24eb9a616211e1fc3b/pa/JH31546_d9ce5685392957af68da7b3d41d24c7c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_118bae87-5815-5188-99a4-e835fe74f496/118bae87-5815-5188-99a4-e835fe74f496_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59039,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/7d/fc7d2b0da8d51d24eb9a616211e1fc3b/pa/JH31546_ddee527b25e7f1f5fde4f1921ad542ce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_118bae87-5815-5188-99a4-e835fe74f496/118bae87-5815-5188-99a4-e835fe74f496_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56483,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/7d/fc7d2b0da8d51d24eb9a616211e1fc3b/pa/JH31546_b1e4247d2f97bded36704a84f37f4126.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_118bae87-5815-5188-99a4-e835fe74f496/118bae87-5815-5188-99a4-e835fe74f496_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64514,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/7d/fc7d2b0da8d51d24eb9a616211e1fc3b/pa/JH31546_417c374d25364fd47917bb977a9fde6a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_118bae87-5815-5188-99a4-e835fe74f496/118bae87-5815-5188-99a4-e835fe74f496_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64763,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/7d/fc7d2b0da8d51d24eb9a616211e1fc3b/pa/JH31546_4f112717638022f3ff021f7b1502be93.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_118bae87-5815-5188-99a4-e835fe74f496/118bae87-5815-5188-99a4-e835fe74f496_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57402,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/7d/fc7d2b0da8d51d24eb9a616211e1fc3b/pa/JH31546_d7558a862106cb7439f14d81ba695508.jpg',
             'Width': 800}],
 'postal_code': '35135',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Ille-et-Vilaine',
 'province_code': 'FR-35',
 'region': 'Bretagne',
 'region_code': 'FR-53',
 'registration_date': '2017-05-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat Tipo 1.4 Tipo',
 'transmission': 'manual',
 'trim': '',
 'year': 2017}
2026-04-27 07:54:39 [auto1.fr] INFO: Saving data for JH31546: {'created_time': 1777276479.101574, 'last_price_update_time': 1777276479.101588, 'has_photos': True, 'auction_closing_time': 1777391766.0}
2026-04-27 07:54:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/f5/80f50f58c2dd7a24153e0a86a605b3e1/pa/ST87878_719e326a48f98864e4e4246eb1ba47fa.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/f5/80f50f58c2dd7a24153e0a86a605b3e1/pa/ST87878_844dbc306007aad353395c447c213239.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/f5/80f50f58c2dd7a24153e0a86a605b3e1/pa/ST87878_4c4690b221c5340500c58c4e2841b0dc.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/f5/80f50f58c2dd7a24153e0a86a605b3e1/pa/ST87878_1faf4fb242baf177039fb4a901173bc4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438084750>
2026-04-27 07:54:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e79f5f2d-882f-599f-bd9c-1bf57a9015b5/e79f5f2d-882f-599f-bd9c-1bf57a9015b5_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/f5/80f50f58c2dd7a24153e0a86a605b3e1/pa/ST87878_bcf384a72b361a59e8525ab3f91abbf8.jpg saved to cache
2026-04-27 07:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e79f5f2d-882f-599f-bd9c-1bf57a9015b5
2026-04-27 07:54:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438085a90>
2026-04-27 07:54:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e79f5f2d-882f-599f-bd9c-1bf57a9015b5/e79f5f2d-882f-599f-bd9c-1bf57a9015b5_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/f5/80f50f58c2dd7a24153e0a86a605b3e1/pa/ST87878_73e35c6ecb6789e73aa585f3eb118526.jpg saved to cache
2026-04-27 07:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e79f5f2d-882f-599f-bd9c-1bf57a9015b5
2026-04-27 07:54:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438e17c90>
2026-04-27 07:54:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e79f5f2d-882f-599f-bd9c-1bf57a9015b5/e79f5f2d-882f-599f-bd9c-1bf57a9015b5_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/f5/80f50f58c2dd7a24153e0a86a605b3e1/pa/ST87878_89e0d056e033d02e237c7d6157a34d3e.jpg saved to cache
2026-04-27 07:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e79f5f2d-882f-599f-bd9c-1bf57a9015b5
2026-04-27 07:54:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438075350>
2026-04-27 07:54:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e79f5f2d-882f-599f-bd9c-1bf57a9015b5/e79f5f2d-882f-599f-bd9c-1bf57a9015b5_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/f5/80f50f58c2dd7a24153e0a86a605b3e1/pa/ST87878_719e326a48f98864e4e4246eb1ba47fa.jpg saved to cache
2026-04-27 07:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e79f5f2d-882f-599f-bd9c-1bf57a9015b5
2026-04-27 07:54:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ba62d0>
2026-04-27 07:54:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e79f5f2d-882f-599f-bd9c-1bf57a9015b5/e79f5f2d-882f-599f-bd9c-1bf57a9015b5_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/f5/80f50f58c2dd7a24153e0a86a605b3e1/pa/ST87878_844dbc306007aad353395c447c213239.jpg saved to cache
2026-04-27 07:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e79f5f2d-882f-599f-bd9c-1bf57a9015b5
2026-04-27 07:54:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438e7ce50>
2026-04-27 07:54:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e79f5f2d-882f-599f-bd9c-1bf57a9015b5/e79f5f2d-882f-599f-bd9c-1bf57a9015b5_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/f5/80f50f58c2dd7a24153e0a86a605b3e1/pa/ST87878_4c4690b221c5340500c58c4e2841b0dc.jpg saved to cache
2026-04-27 07:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e79f5f2d-882f-599f-bd9c-1bf57a9015b5
2026-04-27 07:54:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143803a150>
2026-04-27 07:54:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e79f5f2d-882f-599f-bd9c-1bf57a9015b5/e79f5f2d-882f-599f-bd9c-1bf57a9015b5_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/f5/80f50f58c2dd7a24153e0a86a605b3e1/pa/ST87878_1faf4fb242baf177039fb4a901173bc4.jpg saved to cache
2026-04-27 07:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e79f5f2d-882f-599f-bd9c-1bf57a9015b5
2026-04-27 07:54:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e79f5f2d-882f-599f-bd9c-1bf57a9015b5, skipping ID generation
2026-04-27 07:54:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e79f5f2d-882f-599f-bd9c-1bf57a9015b5 with scrape type 1
2026-04-27 07:54:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e79f5f2d-882f-599f-bd9c-1bf57a9015b5 sending to next pipeline
2026-04-27 07:54:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e79f5f2d-882f-599f-bd9c-1bf57a9015b5, identifier: ST87878
2026-04-27 07:54:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e79f5f2d-882f-599f-bd9c-1bf57a9015b5 with identifier: ST87878
2026-04-27 07:54:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e79f5f2d-882f-599f-bd9c-1bf57a9015b5 with identifier: ST87878
2026-04-27 07:54:39 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e79f5f2d-882f-599f-bd9c-1bf57a9015b5 with identifier: ST87878 to the API
2026-04-27 07:54:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:39 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img80/f5/80f50f58c2dd7a24153e0a86a605b3e1/pa/ST87878_1faf4fb242baf177039fb4a901173bc4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'category': None,
 'city': 'Beaucaire',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 155,
 'expiration_date': '2026-04-28T15:24:26Z',
 'fuel_type': 'petrol',
 'id': 'e79f5f2d-882f-599f-bd9c-1bf57a9015b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 43.8081,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ST87878',
 'listing': 'auction',
 'location': 'FR, Beaucaire',
 'location_confidence': 'geocoded',
 'longitude': 4.6442,
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 130442,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e79f5f2d-882f-599f-bd9c-1bf57a9015b5/e79f5f2d-882f-599f-bd9c-1bf57a9015b5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66417,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/f5/80f50f58c2dd7a24153e0a86a605b3e1/pa/ST87878_719e326a48f98864e4e4246eb1ba47fa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e79f5f2d-882f-599f-bd9c-1bf57a9015b5/e79f5f2d-882f-599f-bd9c-1bf57a9015b5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71753,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/f5/80f50f58c2dd7a24153e0a86a605b3e1/pa/ST87878_13216ace9df9ed4297216ded9ba57136.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e79f5f2d-882f-599f-bd9c-1bf57a9015b5/e79f5f2d-882f-599f-bd9c-1bf57a9015b5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71992,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/f5/80f50f58c2dd7a24153e0a86a605b3e1/pa/ST87878_1faf4fb242baf177039fb4a901173bc4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e79f5f2d-882f-599f-bd9c-1bf57a9015b5/e79f5f2d-882f-599f-bd9c-1bf57a9015b5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68729,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/f5/80f50f58c2dd7a24153e0a86a605b3e1/pa/ST87878_844dbc306007aad353395c447c213239.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e79f5f2d-882f-599f-bd9c-1bf57a9015b5/e79f5f2d-882f-599f-bd9c-1bf57a9015b5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72012,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/f5/80f50f58c2dd7a24153e0a86a605b3e1/pa/ST87878_4c4690b221c5340500c58c4e2841b0dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e79f5f2d-882f-599f-bd9c-1bf57a9015b5/e79f5f2d-882f-599f-bd9c-1bf57a9015b5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70212,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/f5/80f50f58c2dd7a24153e0a86a605b3e1/pa/ST87878_bb4ef10fb7271c6e06de0a01dd362be6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e79f5f2d-882f-599f-bd9c-1bf57a9015b5/e79f5f2d-882f-599f-bd9c-1bf57a9015b5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63367,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/f5/80f50f58c2dd7a24153e0a86a605b3e1/pa/ST87878_bcf384a72b361a59e8525ab3f91abbf8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e79f5f2d-882f-599f-bd9c-1bf57a9015b5/e79f5f2d-882f-599f-bd9c-1bf57a9015b5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75661,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/f5/80f50f58c2dd7a24153e0a86a605b3e1/pa/ST87878_89e0d056e033d02e237c7d6157a34d3e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e79f5f2d-882f-599f-bd9c-1bf57a9015b5/e79f5f2d-882f-599f-bd9c-1bf57a9015b5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68755,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/f5/80f50f58c2dd7a24153e0a86a605b3e1/pa/ST87878_73e35c6ecb6789e73aa585f3eb118526.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e79f5f2d-882f-599f-bd9c-1bf57a9015b5/e79f5f2d-882f-599f-bd9c-1bf57a9015b5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86596,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/f5/80f50f58c2dd7a24153e0a86a605b3e1/pa/ST87878_bdf02c568742b0956feae9eba5caf8e2.jpg',
             'Width': 800}],
 'postal_code': '30300',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Gard',
 'province_code': 'FR-30',
 'region': 'Occitanie',
 'region_code': 'FR-76',
 'registration_date': '2018-07-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 200 Urban',
 'transmission': 'automatic',
 'trim': 'Urban',
 'year': 2018}
2026-04-27 07:54:40 [auto1.fr] INFO: Saving data for ST87878: {'created_time': 1777276480.099251, 'last_price_update_time': 1777276480.099266, 'has_photos': True, 'auction_closing_time': 1777389866.0}
2026-04-27 07:54:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CY19379> (referer: https://www.auto1.com/v1/car-details-view/CY19379/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6229fc14-cb4f-5c50-a11b-bcf1be8c1f2e with identifier: CY19379
2026-04-27 07:54:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6229fc14-cb4f-5c50-a11b-bcf1be8c1f2e with scrape type 1
2026-04-27 07:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6229fc14-cb4f-5c50-a11b-bcf1be8c1f2e
2026-04-27 07:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/ed/4ded2608ed9a75a9297527d23fa3ce1a/pa/CY19379_8bc2ce9c3bfaeccfc84c589096730338.jpg not downloaded yet
2026-04-27 07:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/ed/4ded2608ed9a75a9297527d23fa3ce1a/pa/CY19379_1a3e17ff98e87eb8b352e4e39763258d.jpg not downloaded yet
2026-04-27 07:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/ed/4ded2608ed9a75a9297527d23fa3ce1a/pa/CY19379_d26b56f3321171d7d5763156bb23092a.jpg not downloaded yet
2026-04-27 07:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/ed/4ded2608ed9a75a9297527d23fa3ce1a/pa/CY19379_caa34bd5129475867d3d5f6d33c1b436.jpg not downloaded yet
2026-04-27 07:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/ed/4ded2608ed9a75a9297527d23fa3ce1a/pa/CY19379_2a83f71af67430f6e8c4a9147c730c94.jpg not downloaded yet
2026-04-27 07:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/ed/4ded2608ed9a75a9297527d23fa3ce1a/pa/CY19379_9b1504ea624f7347c8c4d8b733cfccd5.jpg not downloaded yet
2026-04-27 07:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/ed/4ded2608ed9a75a9297527d23fa3ce1a/pa/CY19379_a3ab68e512c44065479bca3f278efd1b.jpg not downloaded yet
2026-04-27 07:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/ed/4ded2608ed9a75a9297527d23fa3ce1a/pa/CY19379_a872d5a49cf84cbd55caa0dc11a847d2.jpg not downloaded yet
2026-04-27 07:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/ed/4ded2608ed9a75a9297527d23fa3ce1a/pa/CY19379_9cf3b728338978fac10a0253004356fb.jpg not downloaded yet
2026-04-27 07:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/ed/4ded2608ed9a75a9297527d23fa3ce1a/pa/CY19379_ebe46cdde076789e4a4ab850f45dd016.jpg not downloaded yet
2026-04-27 07:54:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KN31501> (referer: https://www.auto1.com/v1/car-details-view/KN31501/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TA18701> (referer: https://www.auto1.com/v1/car-details-view/TA18701/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CF30196> (referer: https://www.auto1.com/v1/car-details-view/CF30196/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RN69245> (referer: https://www.auto1.com/v1/car-details-view/RN69245/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6cf21ca6-d13a-5d18-81df-cddd84e82021 with identifier: KN31501
2026-04-27 07:54:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6cf21ca6-d13a-5d18-81df-cddd84e82021 with scrape type 1
2026-04-27 07:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 6cf21ca6-d13a-5d18-81df-cddd84e82021
2026-04-27 07:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/c2/d6c2d7896dd17ebe2e3e9b1263fddee0/pa/KN31501_17e17a8caf225a2093e81d463f4d8b1a.jpg not downloaded yet
2026-04-27 07:54:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/ed/4ded2608ed9a75a9297527d23fa3ce1a/pa/CY19379_a872d5a49cf84cbd55caa0dc11a847d2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/c2/d6c2d7896dd17ebe2e3e9b1263fddee0/pa/KN31501_9f07358c2822bc790838941c0cf1616a.jpg not downloaded yet
2026-04-27 07:54:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UX62413> (referer: https://www.auto1.com/v1/car-details-view/UX62413/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dffe6f5d-7174-54ae-be13-afea5372199a with identifier: TA18701
2026-04-27 07:54:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dffe6f5d-7174-54ae-be13-afea5372199a with scrape type 1
2026-04-27 07:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dffe6f5d-7174-54ae-be13-afea5372199a
2026-04-27 07:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/87/5c8786e1b246e50591f190cd834f1ff0/pa/TA18701_1f3652b7459258cf6e6b8b0092c8a15d.jpg not downloaded yet
2026-04-27 07:54:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90b2f67d-0118-50d1-971c-ecfb12c5f35d with identifier: CF30196
2026-04-27 07:54:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90b2f67d-0118-50d1-971c-ecfb12c5f35d with scrape type 1
2026-04-27 07:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 90b2f67d-0118-50d1-971c-ecfb12c5f35d
2026-04-27 07:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/21/48219a5e653a10f3657840d9ad56a900/pa/CF30196_fdd61aad4d8f69eaff5145fe8975ebd2.jpg not downloaded yet
2026-04-27 07:54:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/ed/4ded2608ed9a75a9297527d23fa3ce1a/pa/CY19379_ebe46cdde076789e4a4ab850f45dd016.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/c2/d6c2d7896dd17ebe2e3e9b1263fddee0/pa/KN31501_a78051e69970803a91ee6d77d8eed5d1.jpg not downloaded yet
2026-04-27 07:54:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/ed/4ded2608ed9a75a9297527d23fa3ce1a/pa/CY19379_a3ab68e512c44065479bca3f278efd1b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/ed/4ded2608ed9a75a9297527d23fa3ce1a/pa/CY19379_9cf3b728338978fac10a0253004356fb.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/87/5c8786e1b246e50591f190cd834f1ff0/pa/TA18701_2443c2a8b85b6b7e2b4623bfd2b7e298.jpg not downloaded yet
2026-04-27 07:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/21/48219a5e653a10f3657840d9ad56a900/pa/CF30196_204525ee14e46736919100954ef6136f.jpg not downloaded yet
2026-04-27 07:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/c2/d6c2d7896dd17ebe2e3e9b1263fddee0/pa/KN31501_355f52daad8d1e9433b17c50d1e242c3.jpg not downloaded yet
2026-04-27 07:54:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KN14760> (referer: https://www.auto1.com/v1/car-details-view/KN14760/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1fc1c075-1786-5ddc-8784-23b7c467a2ab with identifier: RN69245
2026-04-27 07:54:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fc1c075-1786-5ddc-8784-23b7c467a2ab with scrape type 1
2026-04-27 07:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1fc1c075-1786-5ddc-8784-23b7c467a2ab
2026-04-27 07:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/97/1a9718325ae90d2cd93c32fd25a7a03a/pa/RN69245_a53617527320e8a8b46f13e2b351c424.jpg not downloaded yet
2026-04-27 07:54:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380757d0>
2026-04-27 07:54:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6229fc14-cb4f-5c50-a11b-bcf1be8c1f2e/6229fc14-cb4f-5c50-a11b-bcf1be8c1f2e_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/ed/4ded2608ed9a75a9297527d23fa3ce1a/pa/CY19379_a872d5a49cf84cbd55caa0dc11a847d2.jpg saved to cache
2026-04-27 07:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6229fc14-cb4f-5c50-a11b-bcf1be8c1f2e
2026-04-27 07:54:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e5a58bb-a3ba-52d1-9bb4-d6400330411b with identifier: UX62413
2026-04-27 07:54:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e5a58bb-a3ba-52d1-9bb4-d6400330411b with scrape type 1
2026-04-27 07:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9e5a58bb-a3ba-52d1-9bb4-d6400330411b
2026-04-27 07:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/6d/2f6d15472be84c8666df316ceb0417cc/pa/UX62413_9a589f72a11e8279c771ad8269a53407.jpg not downloaded yet
2026-04-27 07:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/87/5c8786e1b246e50591f190cd834f1ff0/pa/TA18701_a40bb663ebe93d70b65a70887b00b854.jpg not downloaded yet
2026-04-27 07:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/21/48219a5e653a10f3657840d9ad56a900/pa/CF30196_a1789e854372bc6d8b102b80b92ba4f5.jpg not downloaded yet
2026-04-27 07:54:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HK73119> (referer: https://www.auto1.com/v1/car-details-view/HK73119/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/c2/d6c2d7896dd17ebe2e3e9b1263fddee0/pa/KN31501_9f07358c2822bc790838941c0cf1616a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/ed/4ded2608ed9a75a9297527d23fa3ce1a/pa/CY19379_9b1504ea624f7347c8c4d8b733cfccd5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/c2/d6c2d7896dd17ebe2e3e9b1263fddee0/pa/KN31501_17e17a8caf225a2093e81d463f4d8b1a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/c2/d6c2d7896dd17ebe2e3e9b1263fddee0/pa/KN31501_59c12fe70d3efc5c7d770ba1a72ae5d5.jpg not downloaded yet
2026-04-27 07:54:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/97/1a9718325ae90d2cd93c32fd25a7a03a/pa/RN69245_adabc13cbab6e37f0204bfc13ef56168.jpg not downloaded yet
2026-04-27 07:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/6d/2f6d15472be84c8666df316ceb0417cc/pa/UX62413_89be0f15a1f15f229083c86bf64e1df8.jpg not downloaded yet
2026-04-27 07:54:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380e1ad0>
2026-04-27 07:54:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6229fc14-cb4f-5c50-a11b-bcf1be8c1f2e/6229fc14-cb4f-5c50-a11b-bcf1be8c1f2e_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/ed/4ded2608ed9a75a9297527d23fa3ce1a/pa/CY19379_ebe46cdde076789e4a4ab850f45dd016.jpg saved to cache
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6229fc14-cb4f-5c50-a11b-bcf1be8c1f2e
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c4f250>
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6229fc14-cb4f-5c50-a11b-bcf1be8c1f2e/6229fc14-cb4f-5c50-a11b-bcf1be8c1f2e_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/ed/4ded2608ed9a75a9297527d23fa3ce1a/pa/CY19379_a3ab68e512c44065479bca3f278efd1b.jpg saved to cache
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6229fc14-cb4f-5c50-a11b-bcf1be8c1f2e
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438016b10>
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6229fc14-cb4f-5c50-a11b-bcf1be8c1f2e/6229fc14-cb4f-5c50-a11b-bcf1be8c1f2e_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/ed/4ded2608ed9a75a9297527d23fa3ce1a/pa/CY19379_9cf3b728338978fac10a0253004356fb.jpg saved to cache
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6229fc14-cb4f-5c50-a11b-bcf1be8c1f2e
2026-04-27 07:54:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/21/48219a5e653a10f3657840d9ad56a900/pa/CF30196_fdd61aad4d8f69eaff5145fe8975ebd2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/87/5c8786e1b246e50591f190cd834f1ff0/pa/TA18701_0abbb0228210cd0e7c7260a8bab07d64.jpg not downloaded yet
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/21/48219a5e653a10f3657840d9ad56a900/pa/CF30196_e53e362dfb87908044252722e2521e8b.jpg not downloaded yet
2026-04-27 07:54:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/87/5c8786e1b246e50591f190cd834f1ff0/pa/TA18701_1f3652b7459258cf6e6b8b0092c8a15d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/c2/d6c2d7896dd17ebe2e3e9b1263fddee0/pa/KN31501_1ab75ec8afc4e1d896254d3d42e38978.jpg not downloaded yet
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/97/1a9718325ae90d2cd93c32fd25a7a03a/pa/RN69245_89298259bba4e1d149a8a8e8340174c9.jpg not downloaded yet
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/6d/2f6d15472be84c8666df316ceb0417cc/pa/UX62413_a8befec21e1f37a4ab43bb8fb3163fec.jpg not downloaded yet
2026-04-27 07:54:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28a4e63d-d8a9-57de-9f2e-297564796408 with identifier: KN14760
2026-04-27 07:54:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28a4e63d-d8a9-57de-9f2e-297564796408 with scrape type 1
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 28a4e63d-d8a9-57de-9f2e-297564796408
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/9b/9d9b3a8e804ea83f9aabf57776688d12/pa/KN14760_c9e3dd5acb6f3186f557b49dbbafc1e4.jpg not downloaded yet
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/87/5c8786e1b246e50591f190cd834f1ff0/pa/TA18701_a32bab225f56d79deb7e81476b6382ff.jpg not downloaded yet
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/21/48219a5e653a10f3657840d9ad56a900/pa/CF30196_fd1701c00ed6af129c89b24395ec9a71.jpg not downloaded yet
2026-04-27 07:54:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc22ffda-38e5-534d-a8c4-9ca8ffc1a407 with identifier: HK73119
2026-04-27 07:54:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc22ffda-38e5-534d-a8c4-9ca8ffc1a407 with scrape type 1
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cc22ffda-38e5-534d-a8c4-9ca8ffc1a407
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/c3/a3c379990e954ca677753367bdfd192c/pa/HK73119_4f5e04dd474f443171feac7fed4a5856.jpg not downloaded yet
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380ef610>
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cf21ca6-d13a-5d18-81df-cddd84e82021/6cf21ca6-d13a-5d18-81df-cddd84e82021_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/c2/d6c2d7896dd17ebe2e3e9b1263fddee0/pa/KN31501_9f07358c2822bc790838941c0cf1616a.jpg saved to cache
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6cf21ca6-d13a-5d18-81df-cddd84e82021
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d85fd0>
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6229fc14-cb4f-5c50-a11b-bcf1be8c1f2e/6229fc14-cb4f-5c50-a11b-bcf1be8c1f2e_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/ed/4ded2608ed9a75a9297527d23fa3ce1a/pa/CY19379_9b1504ea624f7347c8c4d8b733cfccd5.jpg saved to cache
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6229fc14-cb4f-5c50-a11b-bcf1be8c1f2e
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438131990>
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cf21ca6-d13a-5d18-81df-cddd84e82021/6cf21ca6-d13a-5d18-81df-cddd84e82021_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/c2/d6c2d7896dd17ebe2e3e9b1263fddee0/pa/KN31501_17e17a8caf225a2093e81d463f4d8b1a.jpg saved to cache
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6cf21ca6-d13a-5d18-81df-cddd84e82021
2026-04-27 07:54:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/c2/d6c2d7896dd17ebe2e3e9b1263fddee0/pa/KN31501_355f52daad8d1e9433b17c50d1e242c3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/97/1a9718325ae90d2cd93c32fd25a7a03a/pa/RN69245_c942948f305e4cdbc8344915e01dac71.jpg not downloaded yet
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/6d/2f6d15472be84c8666df316ceb0417cc/pa/UX62413_61ca183caf9e55aac39203ee2870ad60.jpg not downloaded yet
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/9b/9d9b3a8e804ea83f9aabf57776688d12/pa/KN14760_529c4ce730911782945a90219690fe22.jpg not downloaded yet
2026-04-27 07:54:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/21/48219a5e653a10f3657840d9ad56a900/pa/CF30196_a1789e854372bc6d8b102b80b92ba4f5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/21/48219a5e653a10f3657840d9ad56a900/pa/CF30196_204525ee14e46736919100954ef6136f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/97/1a9718325ae90d2cd93c32fd25a7a03a/pa/RN69245_a53617527320e8a8b46f13e2b351c424.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/6d/2f6d15472be84c8666df316ceb0417cc/pa/UX62413_9a589f72a11e8279c771ad8269a53407.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/87/5c8786e1b246e50591f190cd834f1ff0/pa/TA18701_f5301ffbf0e77b7c57cdca3fe0740f61.jpg not downloaded yet
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/21/48219a5e653a10f3657840d9ad56a900/pa/CF30196_ba32c68cbd6d4750f4533ba743699a90.jpg not downloaded yet
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/c3/a3c379990e954ca677753367bdfd192c/pa/HK73119_fff040644e6fec674d54a633b89a94cb.jpg not downloaded yet
2026-04-27 07:54:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CN92978/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ca9950>
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90b2f67d-0118-50d1-971c-ecfb12c5f35d/90b2f67d-0118-50d1-971c-ecfb12c5f35d_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/21/48219a5e653a10f3657840d9ad56a900/pa/CF30196_fdd61aad4d8f69eaff5145fe8975ebd2.jpg saved to cache
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 90b2f67d-0118-50d1-971c-ecfb12c5f35d
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438fb12d0>
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dffe6f5d-7174-54ae-be13-afea5372199a/dffe6f5d-7174-54ae-be13-afea5372199a_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/87/5c8786e1b246e50591f190cd834f1ff0/pa/TA18701_1f3652b7459258cf6e6b8b0092c8a15d.jpg saved to cache
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dffe6f5d-7174-54ae-be13-afea5372199a
2026-04-27 07:54:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/87/5c8786e1b246e50591f190cd834f1ff0/pa/TA18701_2443c2a8b85b6b7e2b4623bfd2b7e298.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/97/1a9718325ae90d2cd93c32fd25a7a03a/pa/RN69245_585022383aeee2c7226a1675267be1f9.jpg not downloaded yet
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/6d/2f6d15472be84c8666df316ceb0417cc/pa/UX62413_4df38e0888d248d9886cb55533053000.jpg not downloaded yet
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/9b/9d9b3a8e804ea83f9aabf57776688d12/pa/KN14760_4ad35fe643f49daeac8ee23f33f16a1a.jpg not downloaded yet
2026-04-27 07:54:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/87/5c8786e1b246e50591f190cd834f1ff0/pa/TA18701_01b62fbb95b300ea55624466b5c47c53.jpg not downloaded yet
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/21/48219a5e653a10f3657840d9ad56a900/pa/CF30196_375665c2100200be4b7e834ba5cc78a6.jpg not downloaded yet
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/c3/a3c379990e954ca677753367bdfd192c/pa/HK73119_dcf773e74bd077b7e2623726985f84cb.jpg not downloaded yet
2026-04-27 07:54:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/6d/2f6d15472be84c8666df316ceb0417cc/pa/UX62413_89be0f15a1f15f229083c86bf64e1df8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/97/1a9718325ae90d2cd93c32fd25a7a03a/pa/RN69245_ecf6bce2271a5e4b71dc660c67cc852e.jpg not downloaded yet
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/6d/2f6d15472be84c8666df316ceb0417cc/pa/UX62413_53dfc5ce6d84ac13e056fd09092e0edd.jpg not downloaded yet
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/9b/9d9b3a8e804ea83f9aabf57776688d12/pa/KN14760_a4d9ca7d940069ea712a892c8a993df2.jpg not downloaded yet
2026-04-27 07:54:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SA02986/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZH79722/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380eeb50>
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cf21ca6-d13a-5d18-81df-cddd84e82021/6cf21ca6-d13a-5d18-81df-cddd84e82021_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/c2/d6c2d7896dd17ebe2e3e9b1263fddee0/pa/KN31501_355f52daad8d1e9433b17c50d1e242c3.jpg saved to cache
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6cf21ca6-d13a-5d18-81df-cddd84e82021
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b5a590>
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90b2f67d-0118-50d1-971c-ecfb12c5f35d/90b2f67d-0118-50d1-971c-ecfb12c5f35d_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/21/48219a5e653a10f3657840d9ad56a900/pa/CF30196_a1789e854372bc6d8b102b80b92ba4f5.jpg saved to cache
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 90b2f67d-0118-50d1-971c-ecfb12c5f35d
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438f09d90>
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90b2f67d-0118-50d1-971c-ecfb12c5f35d/90b2f67d-0118-50d1-971c-ecfb12c5f35d_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/21/48219a5e653a10f3657840d9ad56a900/pa/CF30196_204525ee14e46736919100954ef6136f.jpg saved to cache
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 90b2f67d-0118-50d1-971c-ecfb12c5f35d
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438e7abd0>
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fc1c075-1786-5ddc-8784-23b7c467a2ab/1fc1c075-1786-5ddc-8784-23b7c467a2ab_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/97/1a9718325ae90d2cd93c32fd25a7a03a/pa/RN69245_a53617527320e8a8b46f13e2b351c424.jpg saved to cache
2026-04-27 07:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1fc1c075-1786-5ddc-8784-23b7c467a2ab
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438bea610>
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e5a58bb-a3ba-52d1-9bb4-d6400330411b/9e5a58bb-a3ba-52d1-9bb4-d6400330411b_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/6d/2f6d15472be84c8666df316ceb0417cc/pa/UX62413_9a589f72a11e8279c771ad8269a53407.jpg saved to cache
2026-04-27 07:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9e5a58bb-a3ba-52d1-9bb4-d6400330411b
2026-04-27 07:54:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/21/48219a5e653a10f3657840d9ad56a900/pa/CF30196_fd1701c00ed6af129c89b24395ec9a71.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/9b/9d9b3a8e804ea83f9aabf57776688d12/pa/KN14760_c9e3dd5acb6f3186f557b49dbbafc1e4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/87/5c8786e1b246e50591f190cd834f1ff0/pa/TA18701_589e85caa0ff806654fc8e45f7ef0f09.jpg not downloaded yet
2026-04-27 07:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/21/48219a5e653a10f3657840d9ad56a900/pa/CF30196_b8c3ea0da2255c81ede1a83feac62b6e.jpg not downloaded yet
2026-04-27 07:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/c3/a3c379990e954ca677753367bdfd192c/pa/HK73119_81837a100b4790f6dcad8393ef320400.jpg not downloaded yet
2026-04-27 07:54:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/6d/2f6d15472be84c8666df316ceb0417cc/pa/UX62413_61ca183caf9e55aac39203ee2870ad60.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/c3/a3c379990e954ca677753367bdfd192c/pa/HK73119_4f5e04dd474f443171feac7fed4a5856.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/97/1a9718325ae90d2cd93c32fd25a7a03a/pa/RN69245_c1013a972f658f21a735eeb704be9d49.jpg not downloaded yet
2026-04-27 07:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/6d/2f6d15472be84c8666df316ceb0417cc/pa/UX62413_8b80b963189f0a9ff14ed59ca757bc48.jpg not downloaded yet
2026-04-27 07:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/9b/9d9b3a8e804ea83f9aabf57776688d12/pa/KN14760_0783d5ebb349653b3c29a9385a198e54.jpg not downloaded yet
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d32fd0>
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dffe6f5d-7174-54ae-be13-afea5372199a/dffe6f5d-7174-54ae-be13-afea5372199a_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/87/5c8786e1b246e50591f190cd834f1ff0/pa/TA18701_2443c2a8b85b6b7e2b4623bfd2b7e298.jpg saved to cache
2026-04-27 07:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dffe6f5d-7174-54ae-be13-afea5372199a
2026-04-27 07:54:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/87/5c8786e1b246e50591f190cd834f1ff0/pa/TA18701_a32bab225f56d79deb7e81476b6382ff.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/6d/2f6d15472be84c8666df316ceb0417cc/pa/UX62413_a8befec21e1f37a4ab43bb8fb3163fec.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/9b/9d9b3a8e804ea83f9aabf57776688d12/pa/KN14760_529c4ce730911782945a90219690fe22.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/87/5c8786e1b246e50591f190cd834f1ff0/pa/TA18701_999583be2063c497f42fb1fb94e98afd.jpg not downloaded yet
2026-04-27 07:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/21/48219a5e653a10f3657840d9ad56a900/pa/CF30196_6e737ebac1b56e4acf1b3ed19251b029.jpg not downloaded yet
2026-04-27 07:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/c3/a3c379990e954ca677753367bdfd192c/pa/HK73119_679c9ce75a21d13d471199e136225072.jpg not downloaded yet
2026-04-27 07:54:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438fbe290>
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e5a58bb-a3ba-52d1-9bb4-d6400330411b/9e5a58bb-a3ba-52d1-9bb4-d6400330411b_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/6d/2f6d15472be84c8666df316ceb0417cc/pa/UX62413_89be0f15a1f15f229083c86bf64e1df8.jpg saved to cache
2026-04-27 07:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9e5a58bb-a3ba-52d1-9bb4-d6400330411b
2026-04-27 07:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/97/1a9718325ae90d2cd93c32fd25a7a03a/pa/RN69245_57663b56bea804b796c12e80aedadf1d.jpg not downloaded yet
2026-04-27 07:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/6d/2f6d15472be84c8666df316ceb0417cc/pa/UX62413_9cd5cf6c3fb5c1bfa59ac6e93ac9015e.jpg not downloaded yet
2026-04-27 07:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/9b/9d9b3a8e804ea83f9aabf57776688d12/pa/KN14760_66b0bcd1ed55365ef5eade6fa8ba90a9.jpg not downloaded yet
2026-04-27 07:54:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/87/5c8786e1b246e50591f190cd834f1ff0/pa/TA18701_01b62fbb95b300ea55624466b5c47c53.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/87/5c8786e1b246e50591f190cd834f1ff0/pa/TA18701_782be298061881ee4946cc5b627138fc.jpg not downloaded yet
2026-04-27 07:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/21/48219a5e653a10f3657840d9ad56a900/pa/CF30196_a99315d3b7d6aa9e03d178decf9fd981.jpg not downloaded yet
2026-04-27 07:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/c3/a3c379990e954ca677753367bdfd192c/pa/HK73119_2fc980200055ec43c9e704919baa712d.jpg not downloaded yet
2026-04-27 07:54:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KR77136/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DL16043/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d86290>
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90b2f67d-0118-50d1-971c-ecfb12c5f35d/90b2f67d-0118-50d1-971c-ecfb12c5f35d_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/21/48219a5e653a10f3657840d9ad56a900/pa/CF30196_fd1701c00ed6af129c89b24395ec9a71.jpg saved to cache
2026-04-27 07:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 90b2f67d-0118-50d1-971c-ecfb12c5f35d
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c6b4d0>
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28a4e63d-d8a9-57de-9f2e-297564796408/28a4e63d-d8a9-57de-9f2e-297564796408_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/9b/9d9b3a8e804ea83f9aabf57776688d12/pa/KN14760_c9e3dd5acb6f3186f557b49dbbafc1e4.jpg saved to cache
2026-04-27 07:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 28a4e63d-d8a9-57de-9f2e-297564796408
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f144750ddd0>
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e5a58bb-a3ba-52d1-9bb4-d6400330411b/9e5a58bb-a3ba-52d1-9bb4-d6400330411b_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/6d/2f6d15472be84c8666df316ceb0417cc/pa/UX62413_61ca183caf9e55aac39203ee2870ad60.jpg saved to cache
2026-04-27 07:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9e5a58bb-a3ba-52d1-9bb4-d6400330411b
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c6a150>
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc22ffda-38e5-534d-a8c4-9ca8ffc1a407/cc22ffda-38e5-534d-a8c4-9ca8ffc1a407_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/c3/a3c379990e954ca677753367bdfd192c/pa/HK73119_4f5e04dd474f443171feac7fed4a5856.jpg saved to cache
2026-04-27 07:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cc22ffda-38e5-534d-a8c4-9ca8ffc1a407
2026-04-27 07:54:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/21/48219a5e653a10f3657840d9ad56a900/pa/CF30196_375665c2100200be4b7e834ba5cc78a6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/6d/2f6d15472be84c8666df316ceb0417cc/pa/UX62413_4df38e0888d248d9886cb55533053000.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/9b/9d9b3a8e804ea83f9aabf57776688d12/pa/KN14760_4ad35fe643f49daeac8ee23f33f16a1a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/97/1a9718325ae90d2cd93c32fd25a7a03a/pa/RN69245_4bd3109ce82c75a81bf53cbf44389628.jpg not downloaded yet
2026-04-27 07:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/6d/2f6d15472be84c8666df316ceb0417cc/pa/UX62413_83595dc52a7f240d3cd53db67024416c.jpg not downloaded yet
2026-04-27 07:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/9b/9d9b3a8e804ea83f9aabf57776688d12/pa/KN14760_230e34b700727e4bb0f08d41d6d5239a.jpg not downloaded yet
2026-04-27 07:54:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438135450>
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dffe6f5d-7174-54ae-be13-afea5372199a/dffe6f5d-7174-54ae-be13-afea5372199a_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/87/5c8786e1b246e50591f190cd834f1ff0/pa/TA18701_a32bab225f56d79deb7e81476b6382ff.jpg saved to cache
2026-04-27 07:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dffe6f5d-7174-54ae-be13-afea5372199a
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438040090>
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e5a58bb-a3ba-52d1-9bb4-d6400330411b/9e5a58bb-a3ba-52d1-9bb4-d6400330411b_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/6d/2f6d15472be84c8666df316ceb0417cc/pa/UX62413_a8befec21e1f37a4ab43bb8fb3163fec.jpg saved to cache
2026-04-27 07:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9e5a58bb-a3ba-52d1-9bb4-d6400330411b
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438040290>
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28a4e63d-d8a9-57de-9f2e-297564796408/28a4e63d-d8a9-57de-9f2e-297564796408_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/9b/9d9b3a8e804ea83f9aabf57776688d12/pa/KN14760_529c4ce730911782945a90219690fe22.jpg saved to cache
2026-04-27 07:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 28a4e63d-d8a9-57de-9f2e-297564796408
2026-04-27 07:54:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/9b/9d9b3a8e804ea83f9aabf57776688d12/pa/KN14760_a4d9ca7d940069ea712a892c8a993df2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/c3/a3c379990e954ca677753367bdfd192c/pa/HK73119_dcf773e74bd077b7e2623726985f84cb.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/c3/a3c379990e954ca677753367bdfd192c/pa/HK73119_4663fa0122f95303a72420f9914fa5f1.jpg not downloaded yet
2026-04-27 07:54:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/6d/2f6d15472be84c8666df316ceb0417cc/pa/UX62413_53dfc5ce6d84ac13e056fd09092e0edd.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/c3/a3c379990e954ca677753367bdfd192c/pa/HK73119_81837a100b4790f6dcad8393ef320400.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/97/1a9718325ae90d2cd93c32fd25a7a03a/pa/RN69245_1804f9c1f94f267d4b9940f97a2dd81e.jpg not downloaded yet
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/6d/2f6d15472be84c8666df316ceb0417cc/pa/UX62413_d8afd2fbe227eead3768949aec554457.jpg not downloaded yet
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/9b/9d9b3a8e804ea83f9aabf57776688d12/pa/KN14760_84b34d53568f5c96aea59bc244e6dabe.jpg not downloaded yet
2026-04-27 07:54:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PR21978/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b18310>
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dffe6f5d-7174-54ae-be13-afea5372199a/dffe6f5d-7174-54ae-be13-afea5372199a_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/87/5c8786e1b246e50591f190cd834f1ff0/pa/TA18701_01b62fbb95b300ea55624466b5c47c53.jpg saved to cache
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dffe6f5d-7174-54ae-be13-afea5372199a
2026-04-27 07:54:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/21/48219a5e653a10f3657840d9ad56a900/pa/CF30196_b8c3ea0da2255c81ede1a83feac62b6e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/c3/a3c379990e954ca677753367bdfd192c/pa/HK73119_0e158efd2eadc3864d64ac1a8ded4b1f.jpg not downloaded yet
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438dd5e10>
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90b2f67d-0118-50d1-971c-ecfb12c5f35d/90b2f67d-0118-50d1-971c-ecfb12c5f35d_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/21/48219a5e653a10f3657840d9ad56a900/pa/CF30196_375665c2100200be4b7e834ba5cc78a6.jpg saved to cache
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 90b2f67d-0118-50d1-971c-ecfb12c5f35d
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1447b83b90>
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e5a58bb-a3ba-52d1-9bb4-d6400330411b/9e5a58bb-a3ba-52d1-9bb4-d6400330411b_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/6d/2f6d15472be84c8666df316ceb0417cc/pa/UX62413_4df38e0888d248d9886cb55533053000.jpg saved to cache
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9e5a58bb-a3ba-52d1-9bb4-d6400330411b
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438077150>
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28a4e63d-d8a9-57de-9f2e-297564796408/28a4e63d-d8a9-57de-9f2e-297564796408_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/9b/9d9b3a8e804ea83f9aabf57776688d12/pa/KN14760_4ad35fe643f49daeac8ee23f33f16a1a.jpg saved to cache
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 28a4e63d-d8a9-57de-9f2e-297564796408
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/9b/9d9b3a8e804ea83f9aabf57776688d12/pa/KN14760_3f9ba3139590ffbd7ae2d22d2f00a17b.jpg not downloaded yet
2026-04-27 07:54:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/9b/9d9b3a8e804ea83f9aabf57776688d12/pa/KN14760_66b0bcd1ed55365ef5eade6fa8ba90a9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/6d/2f6d15472be84c8666df316ceb0417cc/pa/UX62413_9cd5cf6c3fb5c1bfa59ac6e93ac9015e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/c3/a3c379990e954ca677753367bdfd192c/pa/HK73119_635234cc6820ac41df55d0ce2868cf4d.jpg not downloaded yet
2026-04-27 07:54:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438af0410>
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28a4e63d-d8a9-57de-9f2e-297564796408/28a4e63d-d8a9-57de-9f2e-297564796408_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/9b/9d9b3a8e804ea83f9aabf57776688d12/pa/KN14760_a4d9ca7d940069ea712a892c8a993df2.jpg saved to cache
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 28a4e63d-d8a9-57de-9f2e-297564796408
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438cf3550>
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc22ffda-38e5-534d-a8c4-9ca8ffc1a407/cc22ffda-38e5-534d-a8c4-9ca8ffc1a407_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/c3/a3c379990e954ca677753367bdfd192c/pa/HK73119_dcf773e74bd077b7e2623726985f84cb.jpg saved to cache
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cc22ffda-38e5-534d-a8c4-9ca8ffc1a407
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438170210>
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e5a58bb-a3ba-52d1-9bb4-d6400330411b/9e5a58bb-a3ba-52d1-9bb4-d6400330411b_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/6d/2f6d15472be84c8666df316ceb0417cc/pa/UX62413_53dfc5ce6d84ac13e056fd09092e0edd.jpg saved to cache
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9e5a58bb-a3ba-52d1-9bb4-d6400330411b
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14381bb6d0>
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc22ffda-38e5-534d-a8c4-9ca8ffc1a407/cc22ffda-38e5-534d-a8c4-9ca8ffc1a407_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/c3/a3c379990e954ca677753367bdfd192c/pa/HK73119_81837a100b4790f6dcad8393ef320400.jpg saved to cache
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cc22ffda-38e5-534d-a8c4-9ca8ffc1a407
2026-04-27 07:54:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/21/48219a5e653a10f3657840d9ad56a900/pa/CF30196_a99315d3b7d6aa9e03d178decf9fd981.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/97/1a9718325ae90d2cd93c32fd25a7a03a/pa/RN69245_57663b56bea804b796c12e80aedadf1d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/c3/a3c379990e954ca677753367bdfd192c/pa/HK73119_679c9ce75a21d13d471199e136225072.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/9b/9d9b3a8e804ea83f9aabf57776688d12/pa/KN14760_1e20edf63d2bbed5c416c01098ad5c92.jpg not downloaded yet
2026-04-27 07:54:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438eef010>
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90b2f67d-0118-50d1-971c-ecfb12c5f35d/90b2f67d-0118-50d1-971c-ecfb12c5f35d_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/21/48219a5e653a10f3657840d9ad56a900/pa/CF30196_b8c3ea0da2255c81ede1a83feac62b6e.jpg saved to cache
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 90b2f67d-0118-50d1-971c-ecfb12c5f35d
2026-04-27 07:54:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/c3/a3c379990e954ca677753367bdfd192c/pa/HK73119_2fc980200055ec43c9e704919baa712d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/6d/2f6d15472be84c8666df316ceb0417cc/pa/UX62413_83595dc52a7f240d3cd53db67024416c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/9b/9d9b3a8e804ea83f9aabf57776688d12/pa/KN14760_230e34b700727e4bb0f08d41d6d5239a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/c3/a3c379990e954ca677753367bdfd192c/pa/HK73119_132b551027b3554881f1c5ac763d10dc.jpg not downloaded yet
2026-04-27 07:54:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HM67583/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ca7650>
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28a4e63d-d8a9-57de-9f2e-297564796408/28a4e63d-d8a9-57de-9f2e-297564796408_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:54:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/9b/9d9b3a8e804ea83f9aabf57776688d12/pa/KN14760_66b0bcd1ed55365ef5eade6fa8ba90a9.jpg saved to cache
2026-04-27 07:54:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 28a4e63d-d8a9-57de-9f2e-297564796408
2026-04-27 07:54:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438181dd0>
2026-04-27 07:54:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e5a58bb-a3ba-52d1-9bb4-d6400330411b/9e5a58bb-a3ba-52d1-9bb4-d6400330411b_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:54:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/6d/2f6d15472be84c8666df316ceb0417cc/pa/UX62413_9cd5cf6c3fb5c1bfa59ac6e93ac9015e.jpg saved to cache
2026-04-27 07:54:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9e5a58bb-a3ba-52d1-9bb4-d6400330411b
2026-04-27 07:54:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/97/1a9718325ae90d2cd93c32fd25a7a03a/pa/RN69245_4bd3109ce82c75a81bf53cbf44389628.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438bfc650>
2026-04-27 07:54:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90b2f67d-0118-50d1-971c-ecfb12c5f35d/90b2f67d-0118-50d1-971c-ecfb12c5f35d_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:54:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/21/48219a5e653a10f3657840d9ad56a900/pa/CF30196_a99315d3b7d6aa9e03d178decf9fd981.jpg saved to cache
2026-04-27 07:54:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 90b2f67d-0118-50d1-971c-ecfb12c5f35d
2026-04-27 07:54:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143814a150>
2026-04-27 07:54:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fc1c075-1786-5ddc-8784-23b7c467a2ab/1fc1c075-1786-5ddc-8784-23b7c467a2ab_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:54:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/97/1a9718325ae90d2cd93c32fd25a7a03a/pa/RN69245_57663b56bea804b796c12e80aedadf1d.jpg saved to cache
2026-04-27 07:54:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1fc1c075-1786-5ddc-8784-23b7c467a2ab
2026-04-27 07:54:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d31390>
2026-04-27 07:54:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc22ffda-38e5-534d-a8c4-9ca8ffc1a407/cc22ffda-38e5-534d-a8c4-9ca8ffc1a407_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:54:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/c3/a3c379990e954ca677753367bdfd192c/pa/HK73119_679c9ce75a21d13d471199e136225072.jpg saved to cache
2026-04-27 07:54:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cc22ffda-38e5-534d-a8c4-9ca8ffc1a407
2026-04-27 07:54:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438149d50>
2026-04-27 07:54:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc22ffda-38e5-534d-a8c4-9ca8ffc1a407/cc22ffda-38e5-534d-a8c4-9ca8ffc1a407_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:54:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/c3/a3c379990e954ca677753367bdfd192c/pa/HK73119_2fc980200055ec43c9e704919baa712d.jpg saved to cache
2026-04-27 07:54:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cc22ffda-38e5-534d-a8c4-9ca8ffc1a407
2026-04-27 07:54:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1439c46f50>
2026-04-27 07:54:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e5a58bb-a3ba-52d1-9bb4-d6400330411b/9e5a58bb-a3ba-52d1-9bb4-d6400330411b_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:54:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/6d/2f6d15472be84c8666df316ceb0417cc/pa/UX62413_83595dc52a7f240d3cd53db67024416c.jpg saved to cache
2026-04-27 07:54:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9e5a58bb-a3ba-52d1-9bb4-d6400330411b
2026-04-27 07:54:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143814af90>
2026-04-27 07:54:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28a4e63d-d8a9-57de-9f2e-297564796408/28a4e63d-d8a9-57de-9f2e-297564796408_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:54:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/9b/9d9b3a8e804ea83f9aabf57776688d12/pa/KN14760_230e34b700727e4bb0f08d41d6d5239a.jpg saved to cache
2026-04-27 07:54:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 28a4e63d-d8a9-57de-9f2e-297564796408
2026-04-27 07:54:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/c3/a3c379990e954ca677753367bdfd192c/pa/HK73119_0e158efd2eadc3864d64ac1a8ded4b1f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/c3/a3c379990e954ca677753367bdfd192c/pa/HK73119_4663fa0122f95303a72420f9914fa5f1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/9b/9d9b3a8e804ea83f9aabf57776688d12/pa/KN14760_3f9ba3139590ffbd7ae2d22d2f00a17b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/97/1a9718325ae90d2cd93c32fd25a7a03a/pa/RN69245_1804f9c1f94f267d4b9940f97a2dd81e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/9b/9d9b3a8e804ea83f9aabf57776688d12/pa/KN14760_84b34d53568f5c96aea59bc244e6dabe.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/6d/2f6d15472be84c8666df316ceb0417cc/pa/UX62413_d8afd2fbe227eead3768949aec554457.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/c3/a3c379990e954ca677753367bdfd192c/pa/HK73119_635234cc6820ac41df55d0ce2868cf4d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CN92978> (referer: https://www.auto1.com/v1/car-details-view/CN92978/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c670d0>
2026-04-27 07:54:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fc1c075-1786-5ddc-8784-23b7c467a2ab/1fc1c075-1786-5ddc-8784-23b7c467a2ab_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/97/1a9718325ae90d2cd93c32fd25a7a03a/pa/RN69245_4bd3109ce82c75a81bf53cbf44389628.jpg saved to cache
2026-04-27 07:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1fc1c075-1786-5ddc-8784-23b7c467a2ab
2026-04-27 07:54:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/c3/a3c379990e954ca677753367bdfd192c/pa/HK73119_132b551027b3554881f1c5ac763d10dc.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZH79722> (referer: https://www.auto1.com/v1/car-details-view/ZH79722/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SA02986> (referer: https://www.auto1.com/v1/car-details-view/SA02986/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TK52688/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a93e50>
2026-04-27 07:54:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc22ffda-38e5-534d-a8c4-9ca8ffc1a407/cc22ffda-38e5-534d-a8c4-9ca8ffc1a407_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/c3/a3c379990e954ca677753367bdfd192c/pa/HK73119_0e158efd2eadc3864d64ac1a8ded4b1f.jpg saved to cache
2026-04-27 07:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cc22ffda-38e5-534d-a8c4-9ca8ffc1a407
2026-04-27 07:54:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380ed990>
2026-04-27 07:54:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc22ffda-38e5-534d-a8c4-9ca8ffc1a407/cc22ffda-38e5-534d-a8c4-9ca8ffc1a407_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/c3/a3c379990e954ca677753367bdfd192c/pa/HK73119_4663fa0122f95303a72420f9914fa5f1.jpg saved to cache
2026-04-27 07:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cc22ffda-38e5-534d-a8c4-9ca8ffc1a407
2026-04-27 07:54:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438bd0150>
2026-04-27 07:54:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28a4e63d-d8a9-57de-9f2e-297564796408/28a4e63d-d8a9-57de-9f2e-297564796408_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/9b/9d9b3a8e804ea83f9aabf57776688d12/pa/KN14760_3f9ba3139590ffbd7ae2d22d2f00a17b.jpg saved to cache
2026-04-27 07:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 28a4e63d-d8a9-57de-9f2e-297564796408
2026-04-27 07:54:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438076a90>
2026-04-27 07:54:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fc1c075-1786-5ddc-8784-23b7c467a2ab/1fc1c075-1786-5ddc-8784-23b7c467a2ab_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/97/1a9718325ae90d2cd93c32fd25a7a03a/pa/RN69245_1804f9c1f94f267d4b9940f97a2dd81e.jpg saved to cache
2026-04-27 07:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1fc1c075-1786-5ddc-8784-23b7c467a2ab
2026-04-27 07:54:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438bd2910>
2026-04-27 07:54:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28a4e63d-d8a9-57de-9f2e-297564796408/28a4e63d-d8a9-57de-9f2e-297564796408_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/9b/9d9b3a8e804ea83f9aabf57776688d12/pa/KN14760_84b34d53568f5c96aea59bc244e6dabe.jpg saved to cache
2026-04-27 07:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 28a4e63d-d8a9-57de-9f2e-297564796408
2026-04-27 07:54:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143804b710>
2026-04-27 07:54:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e5a58bb-a3ba-52d1-9bb4-d6400330411b/9e5a58bb-a3ba-52d1-9bb4-d6400330411b_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/6d/2f6d15472be84c8666df316ceb0417cc/pa/UX62413_d8afd2fbe227eead3768949aec554457.jpg saved to cache
2026-04-27 07:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9e5a58bb-a3ba-52d1-9bb4-d6400330411b
2026-04-27 07:54:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/9b/9d9b3a8e804ea83f9aabf57776688d12/pa/KN14760_1e20edf63d2bbed5c416c01098ad5c92.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/97/1a9718325ae90d2cd93c32fd25a7a03a/pa/RN69245_c1013a972f658f21a735eeb704be9d49.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/87/5c8786e1b246e50591f190cd834f1ff0/pa/TA18701_782be298061881ee4946cc5b627138fc.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/21/48219a5e653a10f3657840d9ad56a900/pa/CF30196_6e737ebac1b56e4acf1b3ed19251b029.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/9b/9d9b3a8e804ea83f9aabf57776688d12/pa/KN14760_0783d5ebb349653b3c29a9385a198e54.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/6d/2f6d15472be84c8666df316ceb0417cc/pa/UX62413_8b80b963189f0a9ff14ed59ca757bc48.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/87/5c8786e1b246e50591f190cd834f1ff0/pa/TA18701_999583be2063c497f42fb1fb94e98afd.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438cd5850>
2026-04-27 07:54:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc22ffda-38e5-534d-a8c4-9ca8ffc1a407/cc22ffda-38e5-534d-a8c4-9ca8ffc1a407_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/c3/a3c379990e954ca677753367bdfd192c/pa/HK73119_635234cc6820ac41df55d0ce2868cf4d.jpg saved to cache
2026-04-27 07:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cc22ffda-38e5-534d-a8c4-9ca8ffc1a407
2026-04-27 07:54:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 921844a4-8e81-58ba-8b3e-749be4dca568 with identifier: CN92978
2026-04-27 07:54:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 921844a4-8e81-58ba-8b3e-749be4dca568 with scrape type 1
2026-04-27 07:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 921844a4-8e81-58ba-8b3e-749be4dca568
2026-04-27 07:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/f7/53f7376a6736f646114485ae816cfb0b/pa/CN92978_62b6a544a1f023b8b7445723752c6db6.jpg not downloaded yet
2026-04-27 07:54:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a5b9d0>
2026-04-27 07:54:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc22ffda-38e5-534d-a8c4-9ca8ffc1a407/cc22ffda-38e5-534d-a8c4-9ca8ffc1a407_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/c3/a3c379990e954ca677753367bdfd192c/pa/HK73119_132b551027b3554881f1c5ac763d10dc.jpg saved to cache
2026-04-27 07:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cc22ffda-38e5-534d-a8c4-9ca8ffc1a407
2026-04-27 07:54:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 240e7ce2-87ec-5c8c-9fa7-0377dde90f13 with identifier: ZH79722
2026-04-27 07:54:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 240e7ce2-87ec-5c8c-9fa7-0377dde90f13 with scrape type 1
2026-04-27 07:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 240e7ce2-87ec-5c8c-9fa7-0377dde90f13
2026-04-27 07:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/33/fe339977f194614b82a5e06f7677416b/pa/ZH79722_0da7d2abbf2311a51cd370136a7ef61b.jpg not downloaded yet
2026-04-27 07:54:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a70c0496-bd82-59e0-97a4-a74b79811589 with identifier: SA02986
2026-04-27 07:54:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a70c0496-bd82-59e0-97a4-a74b79811589 with scrape type 1
2026-04-27 07:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a70c0496-bd82-59e0-97a4-a74b79811589
2026-04-27 07:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/42/2742f94a6e5cb7f882081920df20b721/pa/SA02986_b8bf51b0a770cbaa8f057c8a9d68fd26.jpg not downloaded yet
2026-04-27 07:54:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/87/5c8786e1b246e50591f190cd834f1ff0/pa/TA18701_589e85caa0ff806654fc8e45f7ef0f09.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/f7/53f7376a6736f646114485ae816cfb0b/pa/CN92978_c7eeb3c586c6de29d3a73182fdc6fa3b.jpg not downloaded yet
2026-04-27 07:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/33/fe339977f194614b82a5e06f7677416b/pa/ZH79722_2e39b4b17b454c856beada9b82286bd1.jpg not downloaded yet
2026-04-27 07:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/42/2742f94a6e5cb7f882081920df20b721/pa/SA02986_e5eca53bde7132ef455015c0691d0c10.jpg not downloaded yet
2026-04-27 07:54:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/97/1a9718325ae90d2cd93c32fd25a7a03a/pa/RN69245_585022383aeee2c7226a1675267be1f9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/c3/a3c379990e954ca677753367bdfd192c/pa/HK73119_fff040644e6fec674d54a633b89a94cb.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/97/1a9718325ae90d2cd93c32fd25a7a03a/pa/RN69245_ecf6bce2271a5e4b71dc660c67cc852e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/f7/53f7376a6736f646114485ae816cfb0b/pa/CN92978_09507455d79a37880e184e5c591872d9.jpg not downloaded yet
2026-04-27 07:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/33/fe339977f194614b82a5e06f7677416b/pa/ZH79722_e7f7c2aa6fd0a6ef46be56198597e7bd.jpg not downloaded yet
2026-04-27 07:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/42/2742f94a6e5cb7f882081920df20b721/pa/SA02986_0d8aa29a669f7516408a76ab229f736b.jpg not downloaded yet
2026-04-27 07:54:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d310d0>
2026-04-27 07:54:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28a4e63d-d8a9-57de-9f2e-297564796408/28a4e63d-d8a9-57de-9f2e-297564796408_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/9b/9d9b3a8e804ea83f9aabf57776688d12/pa/KN14760_1e20edf63d2bbed5c416c01098ad5c92.jpg saved to cache
2026-04-27 07:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 28a4e63d-d8a9-57de-9f2e-297564796408
2026-04-27 07:54:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438172850>
2026-04-27 07:54:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fc1c075-1786-5ddc-8784-23b7c467a2ab/1fc1c075-1786-5ddc-8784-23b7c467a2ab_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/97/1a9718325ae90d2cd93c32fd25a7a03a/pa/RN69245_c1013a972f658f21a735eeb704be9d49.jpg saved to cache
2026-04-27 07:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1fc1c075-1786-5ddc-8784-23b7c467a2ab
2026-04-27 07:54:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a5b510>
2026-04-27 07:54:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dffe6f5d-7174-54ae-be13-afea5372199a/dffe6f5d-7174-54ae-be13-afea5372199a_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/87/5c8786e1b246e50591f190cd834f1ff0/pa/TA18701_782be298061881ee4946cc5b627138fc.jpg saved to cache
2026-04-27 07:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item dffe6f5d-7174-54ae-be13-afea5372199a
2026-04-27 07:54:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143807ab90>
2026-04-27 07:54:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90b2f67d-0118-50d1-971c-ecfb12c5f35d/90b2f67d-0118-50d1-971c-ecfb12c5f35d_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/21/48219a5e653a10f3657840d9ad56a900/pa/CF30196_6e737ebac1b56e4acf1b3ed19251b029.jpg saved to cache
2026-04-27 07:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 90b2f67d-0118-50d1-971c-ecfb12c5f35d
2026-04-27 07:54:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d310d0>
2026-04-27 07:54:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28a4e63d-d8a9-57de-9f2e-297564796408/28a4e63d-d8a9-57de-9f2e-297564796408_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/9b/9d9b3a8e804ea83f9aabf57776688d12/pa/KN14760_0783d5ebb349653b3c29a9385a198e54.jpg saved to cache
2026-04-27 07:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 28a4e63d-d8a9-57de-9f2e-297564796408
2026-04-27 07:54:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 28a4e63d-d8a9-57de-9f2e-297564796408, skipping ID generation
2026-04-27 07:54:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28a4e63d-d8a9-57de-9f2e-297564796408 with scrape type 1
2026-04-27 07:54:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 28a4e63d-d8a9-57de-9f2e-297564796408 sending to next pipeline
2026-04-27 07:54:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 28a4e63d-d8a9-57de-9f2e-297564796408, identifier: KN14760
2026-04-27 07:54:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14381ecf10>
2026-04-27 07:54:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e5a58bb-a3ba-52d1-9bb4-d6400330411b/9e5a58bb-a3ba-52d1-9bb4-d6400330411b_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/6d/2f6d15472be84c8666df316ceb0417cc/pa/UX62413_8b80b963189f0a9ff14ed59ca757bc48.jpg saved to cache
2026-04-27 07:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9e5a58bb-a3ba-52d1-9bb4-d6400330411b
2026-04-27 07:54:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9e5a58bb-a3ba-52d1-9bb4-d6400330411b, skipping ID generation
2026-04-27 07:54:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e5a58bb-a3ba-52d1-9bb4-d6400330411b with scrape type 1
2026-04-27 07:54:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9e5a58bb-a3ba-52d1-9bb4-d6400330411b sending to next pipeline
2026-04-27 07:54:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 9e5a58bb-a3ba-52d1-9bb4-d6400330411b, identifier: UX62413
2026-04-27 07:54:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380a71d0>
2026-04-27 07:54:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dffe6f5d-7174-54ae-be13-afea5372199a/dffe6f5d-7174-54ae-be13-afea5372199a_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/87/5c8786e1b246e50591f190cd834f1ff0/pa/TA18701_999583be2063c497f42fb1fb94e98afd.jpg saved to cache
2026-04-27 07:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dffe6f5d-7174-54ae-be13-afea5372199a
2026-04-27 07:54:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/21/48219a5e653a10f3657840d9ad56a900/pa/CF30196_ba32c68cbd6d4750f4533ba743699a90.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 28a4e63d-d8a9-57de-9f2e-297564796408 with identifier: KN14760
2026-04-27 07:54:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-27 07:54:47 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-04-27 07:54:48 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-27 07:54:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 28a4e63d-d8a9-57de-9f2e-297564796408 with identifier: KN14760
2026-04-27 07:54:48 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 28a4e63d-d8a9-57de-9f2e-297564796408 with identifier: KN14760 to the API
2026-04-27 07:54:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:48 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img9d/9b/9d9b3a8e804ea83f9aabf57776688d12/pa/KN14760_0783d5ebb349653b3c29a9385a198e54.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 100,
 'category': None,
 'city': 'Allennes-les-Marais',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2026-04-28T15:55:52Z',
 'fuel_type': 'diesel',
 'id': '28a4e63d-d8a9-57de-9f2e-297564796408',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 50.5375,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KN14760',
 'listing': 'auction',
 'location': 'FR, Allennes-les-Marais',
 'location_confidence': 'geocoded',
 'longitude': 2.9536,
 'make': 'Peugeot',
 'model': '308',
 'odometer': 181960,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 18,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_28a4e63d-d8a9-57de-9f2e-297564796408/28a4e63d-d8a9-57de-9f2e-297564796408_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54971,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/9b/9d9b3a8e804ea83f9aabf57776688d12/pa/KN14760_c9e3dd5acb6f3186f557b49dbbafc1e4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_28a4e63d-d8a9-57de-9f2e-297564796408/28a4e63d-d8a9-57de-9f2e-297564796408_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103783,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/9b/9d9b3a8e804ea83f9aabf57776688d12/pa/KN14760_529c4ce730911782945a90219690fe22.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_28a4e63d-d8a9-57de-9f2e-297564796408/28a4e63d-d8a9-57de-9f2e-297564796408_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103060,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/9b/9d9b3a8e804ea83f9aabf57776688d12/pa/KN14760_4ad35fe643f49daeac8ee23f33f16a1a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_28a4e63d-d8a9-57de-9f2e-297564796408/28a4e63d-d8a9-57de-9f2e-297564796408_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34578,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/9b/9d9b3a8e804ea83f9aabf57776688d12/pa/KN14760_a4d9ca7d940069ea712a892c8a993df2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_28a4e63d-d8a9-57de-9f2e-297564796408/28a4e63d-d8a9-57de-9f2e-297564796408_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41145,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/9b/9d9b3a8e804ea83f9aabf57776688d12/pa/KN14760_0783d5ebb349653b3c29a9385a198e54.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_28a4e63d-d8a9-57de-9f2e-297564796408/28a4e63d-d8a9-57de-9f2e-297564796408_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46718,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/9b/9d9b3a8e804ea83f9aabf57776688d12/pa/KN14760_66b0bcd1ed55365ef5eade6fa8ba90a9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_28a4e63d-d8a9-57de-9f2e-297564796408/28a4e63d-d8a9-57de-9f2e-297564796408_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87288,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/9b/9d9b3a8e804ea83f9aabf57776688d12/pa/KN14760_230e34b700727e4bb0f08d41d6d5239a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_28a4e63d-d8a9-57de-9f2e-297564796408/28a4e63d-d8a9-57de-9f2e-297564796408_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111715,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/9b/9d9b3a8e804ea83f9aabf57776688d12/pa/KN14760_84b34d53568f5c96aea59bc244e6dabe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_28a4e63d-d8a9-57de-9f2e-297564796408/28a4e63d-d8a9-57de-9f2e-297564796408_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49399,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/9b/9d9b3a8e804ea83f9aabf57776688d12/pa/KN14760_3f9ba3139590ffbd7ae2d22d2f00a17b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_28a4e63d-d8a9-57de-9f2e-297564796408/28a4e63d-d8a9-57de-9f2e-297564796408_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55595,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/9b/9d9b3a8e804ea83f9aabf57776688d12/pa/KN14760_1e20edf63d2bbed5c416c01098ad5c92.jpg',
             'Width': 800}],
 'postal_code': '59251',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Nord',
 'province_code': 'FR-59',
 'region': 'Hauts-de-France',
 'region_code': 'FR-32',
 'registration_date': '2014-09-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 308 1.6 e-HDi Feline',
 'transmission': 'manual',
 'trim': 'Feline',
 'year': 2014}
2026-04-27 07:54:48 [auto1.fr] INFO: Saving data for KN14760: {'created_time': 1777276488.700417, 'last_price_update_time': 1777276488.70043, 'has_photos': True, 'auction_closing_time': 1777391752.0}
2026-04-27 07:54:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 9e5a58bb-a3ba-52d1-9bb4-d6400330411b with identifier: UX62413
2026-04-27 07:54:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 9e5a58bb-a3ba-52d1-9bb4-d6400330411b with identifier: UX62413
2026-04-27 07:54:48 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 9e5a58bb-a3ba-52d1-9bb4-d6400330411b with identifier: UX62413 to the API
2026-04-27 07:54:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:49 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2f/6d/2f6d15472be84c8666df316ceb0417cc/pa/UX62413_8b80b963189f0a9ff14ed59ca757bc48.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'category': None,
 'city': 'Ambarès-et-Lagrave',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 68,
 'expiration_date': '2026-04-28T15:38:39Z',
 'fuel_type': 'petrol',
 'id': '9e5a58bb-a3ba-52d1-9bb4-d6400330411b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 44.9274,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UX62413',
 'listing': 'auction',
 'location': 'FR, Ambarès-et-Lagrave',
 'location_confidence': 'geocoded',
 'longitude': -0.4914,
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 114967,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9e5a58bb-a3ba-52d1-9bb4-d6400330411b/9e5a58bb-a3ba-52d1-9bb4-d6400330411b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67752,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/6d/2f6d15472be84c8666df316ceb0417cc/pa/UX62413_9a589f72a11e8279c771ad8269a53407.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9e5a58bb-a3ba-52d1-9bb4-d6400330411b/9e5a58bb-a3ba-52d1-9bb4-d6400330411b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68087,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/6d/2f6d15472be84c8666df316ceb0417cc/pa/UX62413_89be0f15a1f15f229083c86bf64e1df8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9e5a58bb-a3ba-52d1-9bb4-d6400330411b/9e5a58bb-a3ba-52d1-9bb4-d6400330411b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72331,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/6d/2f6d15472be84c8666df316ceb0417cc/pa/UX62413_a8befec21e1f37a4ab43bb8fb3163fec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9e5a58bb-a3ba-52d1-9bb4-d6400330411b/9e5a58bb-a3ba-52d1-9bb4-d6400330411b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60329,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/6d/2f6d15472be84c8666df316ceb0417cc/pa/UX62413_61ca183caf9e55aac39203ee2870ad60.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9e5a58bb-a3ba-52d1-9bb4-d6400330411b/9e5a58bb-a3ba-52d1-9bb4-d6400330411b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68493,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/6d/2f6d15472be84c8666df316ceb0417cc/pa/UX62413_4df38e0888d248d9886cb55533053000.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9e5a58bb-a3ba-52d1-9bb4-d6400330411b/9e5a58bb-a3ba-52d1-9bb4-d6400330411b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78546,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/6d/2f6d15472be84c8666df316ceb0417cc/pa/UX62413_53dfc5ce6d84ac13e056fd09092e0edd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9e5a58bb-a3ba-52d1-9bb4-d6400330411b/9e5a58bb-a3ba-52d1-9bb4-d6400330411b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67113,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/6d/2f6d15472be84c8666df316ceb0417cc/pa/UX62413_8b80b963189f0a9ff14ed59ca757bc48.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9e5a58bb-a3ba-52d1-9bb4-d6400330411b/9e5a58bb-a3ba-52d1-9bb4-d6400330411b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85304,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/6d/2f6d15472be84c8666df316ceb0417cc/pa/UX62413_9cd5cf6c3fb5c1bfa59ac6e93ac9015e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9e5a58bb-a3ba-52d1-9bb4-d6400330411b/9e5a58bb-a3ba-52d1-9bb4-d6400330411b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70836,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/6d/2f6d15472be84c8666df316ceb0417cc/pa/UX62413_83595dc52a7f240d3cd53db67024416c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9e5a58bb-a3ba-52d1-9bb4-d6400330411b/9e5a58bb-a3ba-52d1-9bb4-d6400330411b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65207,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/6d/2f6d15472be84c8666df316ceb0417cc/pa/UX62413_d8afd2fbe227eead3768949aec554457.jpg',
             'Width': 800}],
 'postal_code': '33440',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Gironde',
 'province_code': 'FR-33',
 'region': 'Nouvelle-Aquitaine',
 'region_code': 'FR-75',
 'registration_date': '2018-12-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 1.2 PureTech Feel',
 'transmission': 'manual',
 'trim': 'Feel',
 'year': 2018}
2026-04-27 07:54:49 [auto1.fr] INFO: Saving data for UX62413: {'created_time': 1777276489.348613, 'last_price_update_time': 1777276489.348628, 'has_photos': True, 'auction_closing_time': 1777390719.0}
2026-04-27 07:54:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/21/48219a5e653a10f3657840d9ad56a900/pa/CF30196_e53e362dfb87908044252722e2521e8b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/97/1a9718325ae90d2cd93c32fd25a7a03a/pa/RN69245_c942948f305e4cdbc8344915e01dac71.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/c2/d6c2d7896dd17ebe2e3e9b1263fddee0/pa/KN31501_1ab75ec8afc4e1d896254d3d42e38978.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/87/5c8786e1b246e50591f190cd834f1ff0/pa/TA18701_f5301ffbf0e77b7c57cdca3fe0740f61.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/f7/53f7376a6736f646114485ae816cfb0b/pa/CN92978_0a94ac526c52c6abdea93cf7e42c392e.jpg not downloaded yet
2026-04-27 07:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/33/fe339977f194614b82a5e06f7677416b/pa/ZH79722_43d34c12faba384129e4f6cbd3ded813.jpg not downloaded yet
2026-04-27 07:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/42/2742f94a6e5cb7f882081920df20b721/pa/SA02986_fbdf2f206582197509236c6e3ada2f01.jpg not downloaded yet
2026-04-27 07:54:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/97/1a9718325ae90d2cd93c32fd25a7a03a/pa/RN69245_89298259bba4e1d149a8a8e8340174c9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/87/5c8786e1b246e50591f190cd834f1ff0/pa/TA18701_0abbb0228210cd0e7c7260a8bab07d64.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HM67583> (referer: https://www.auto1.com/v1/car-details-view/HM67583/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DL16043> (referer: https://www.auto1.com/v1/car-details-view/DL16043/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KR77136> (referer: https://www.auto1.com/v1/car-details-view/KR77136/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143ade7310>
2026-04-27 07:54:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dffe6f5d-7174-54ae-be13-afea5372199a/dffe6f5d-7174-54ae-be13-afea5372199a_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/87/5c8786e1b246e50591f190cd834f1ff0/pa/TA18701_589e85caa0ff806654fc8e45f7ef0f09.jpg saved to cache
2026-04-27 07:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dffe6f5d-7174-54ae-be13-afea5372199a
2026-04-27 07:54:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ad4610>
2026-04-27 07:54:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fc1c075-1786-5ddc-8784-23b7c467a2ab/1fc1c075-1786-5ddc-8784-23b7c467a2ab_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/97/1a9718325ae90d2cd93c32fd25a7a03a/pa/RN69245_585022383aeee2c7226a1675267be1f9.jpg saved to cache
2026-04-27 07:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1fc1c075-1786-5ddc-8784-23b7c467a2ab
2026-04-27 07:54:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a9d250>
2026-04-27 07:54:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc22ffda-38e5-534d-a8c4-9ca8ffc1a407/cc22ffda-38e5-534d-a8c4-9ca8ffc1a407_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/c3/a3c379990e954ca677753367bdfd192c/pa/HK73119_fff040644e6fec674d54a633b89a94cb.jpg saved to cache
2026-04-27 07:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cc22ffda-38e5-534d-a8c4-9ca8ffc1a407
2026-04-27 07:54:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cc22ffda-38e5-534d-a8c4-9ca8ffc1a407, skipping ID generation
2026-04-27 07:54:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc22ffda-38e5-534d-a8c4-9ca8ffc1a407 with scrape type 1
2026-04-27 07:54:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cc22ffda-38e5-534d-a8c4-9ca8ffc1a407 sending to next pipeline
2026-04-27 07:54:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: cc22ffda-38e5-534d-a8c4-9ca8ffc1a407, identifier: HK73119
2026-04-27 07:54:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1447cbbb90>
2026-04-27 07:54:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fc1c075-1786-5ddc-8784-23b7c467a2ab/1fc1c075-1786-5ddc-8784-23b7c467a2ab_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/97/1a9718325ae90d2cd93c32fd25a7a03a/pa/RN69245_ecf6bce2271a5e4b71dc660c67cc852e.jpg saved to cache
2026-04-27 07:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1fc1c075-1786-5ddc-8784-23b7c467a2ab
2026-04-27 07:54:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/42/2742f94a6e5cb7f882081920df20b721/pa/SA02986_b8bf51b0a770cbaa8f057c8a9d68fd26.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/f7/53f7376a6736f646114485ae816cfb0b/pa/CN92978_bf5e050994bb444510ac5573a4e18f40.jpg not downloaded yet
2026-04-27 07:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/33/fe339977f194614b82a5e06f7677416b/pa/ZH79722_806fe2771bfaa4f80d00e0f2d75ad2fb.jpg not downloaded yet
2026-04-27 07:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/42/2742f94a6e5cb7f882081920df20b721/pa/SA02986_8825c7246611b0f5473edb0f2ea16d33.jpg not downloaded yet
2026-04-27 07:54:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: cc22ffda-38e5-534d-a8c4-9ca8ffc1a407 with identifier: HK73119
2026-04-27 07:54:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: cc22ffda-38e5-534d-a8c4-9ca8ffc1a407 with identifier: HK73119
2026-04-27 07:54:49 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: cc22ffda-38e5-534d-a8c4-9ca8ffc1a407 with identifier: HK73119 to the API
2026-04-27 07:54:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:50 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga3/c3/a3c379990e954ca677753367bdfd192c/pa/HK73119_fff040644e6fec674d54a633b89a94cb.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 108,
 'category': None,
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.0L',
 'engine_horse_power': 68,
 'expiration_date': '2026-04-28T15:03:47Z',
 'fuel_type': 'petrol',
 'id': 'cc22ffda-38e5-534d-a8c4-9ca8ffc1a407',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HK73119',
 'listing': 'auction',
 'location': 'FR',
 'location_confidence': None,
 'longitude': None,
 'make': 'Toyota',
 'model': 'Aygo',
 'odometer': 121798,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 19,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cc22ffda-38e5-534d-a8c4-9ca8ffc1a407/cc22ffda-38e5-534d-a8c4-9ca8ffc1a407_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87506,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/c3/a3c379990e954ca677753367bdfd192c/pa/HK73119_4f5e04dd474f443171feac7fed4a5856.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cc22ffda-38e5-534d-a8c4-9ca8ffc1a407/cc22ffda-38e5-534d-a8c4-9ca8ffc1a407_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86791,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/c3/a3c379990e954ca677753367bdfd192c/pa/HK73119_fff040644e6fec674d54a633b89a94cb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cc22ffda-38e5-534d-a8c4-9ca8ffc1a407/cc22ffda-38e5-534d-a8c4-9ca8ffc1a407_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92486,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/c3/a3c379990e954ca677753367bdfd192c/pa/HK73119_dcf773e74bd077b7e2623726985f84cb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cc22ffda-38e5-534d-a8c4-9ca8ffc1a407/cc22ffda-38e5-534d-a8c4-9ca8ffc1a407_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86864,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/c3/a3c379990e954ca677753367bdfd192c/pa/HK73119_81837a100b4790f6dcad8393ef320400.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cc22ffda-38e5-534d-a8c4-9ca8ffc1a407/cc22ffda-38e5-534d-a8c4-9ca8ffc1a407_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94138,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/c3/a3c379990e954ca677753367bdfd192c/pa/HK73119_679c9ce75a21d13d471199e136225072.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cc22ffda-38e5-534d-a8c4-9ca8ffc1a407/cc22ffda-38e5-534d-a8c4-9ca8ffc1a407_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100410,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/c3/a3c379990e954ca677753367bdfd192c/pa/HK73119_2fc980200055ec43c9e704919baa712d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cc22ffda-38e5-534d-a8c4-9ca8ffc1a407/cc22ffda-38e5-534d-a8c4-9ca8ffc1a407_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86042,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/c3/a3c379990e954ca677753367bdfd192c/pa/HK73119_4663fa0122f95303a72420f9914fa5f1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cc22ffda-38e5-534d-a8c4-9ca8ffc1a407/cc22ffda-38e5-534d-a8c4-9ca8ffc1a407_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97414,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/c3/a3c379990e954ca677753367bdfd192c/pa/HK73119_0e158efd2eadc3864d64ac1a8ded4b1f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cc22ffda-38e5-534d-a8c4-9ca8ffc1a407/cc22ffda-38e5-534d-a8c4-9ca8ffc1a407_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85178,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/c3/a3c379990e954ca677753367bdfd192c/pa/HK73119_635234cc6820ac41df55d0ce2868cf4d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cc22ffda-38e5-534d-a8c4-9ca8ffc1a407/cc22ffda-38e5-534d-a8c4-9ca8ffc1a407_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75095,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/c3/a3c379990e954ca677753367bdfd192c/pa/HK73119_132b551027b3554881f1c5ac763d10dc.jpg',
             'Width': 800}],
 'postal_code': None,
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2008-04-22',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Toyota Aygo 1.0 Up',
 'transmission': 'manual',
 'trim': 'Up',
 'year': 2008}
2026-04-27 07:54:50 [auto1.fr] INFO: Saving data for HK73119: {'created_time': 1777276490.229267, 'last_price_update_time': 1777276490.22928, 'has_photos': True, 'auction_closing_time': 1777388627.0}
2026-04-27 07:54:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/33/fe339977f194614b82a5e06f7677416b/pa/ZH79722_0da7d2abbf2311a51cd370136a7ef61b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c59b90>
2026-04-27 07:54:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90b2f67d-0118-50d1-971c-ecfb12c5f35d/90b2f67d-0118-50d1-971c-ecfb12c5f35d_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/21/48219a5e653a10f3657840d9ad56a900/pa/CF30196_ba32c68cbd6d4750f4533ba743699a90.jpg saved to cache
2026-04-27 07:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 90b2f67d-0118-50d1-971c-ecfb12c5f35d
2026-04-27 07:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/f7/53f7376a6736f646114485ae816cfb0b/pa/CN92978_b23fed3ddff9ea0daf4aaf4c114818cb.jpg not downloaded yet
2026-04-27 07:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/33/fe339977f194614b82a5e06f7677416b/pa/ZH79722_ef8813c0702a9a4c2feef1902738d9ed.jpg not downloaded yet
2026-04-27 07:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/42/2742f94a6e5cb7f882081920df20b721/pa/SA02986_a52c5a6e28ee56d1c8a4bb9956180755.jpg not downloaded yet
2026-04-27 07:54:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ec8110>
2026-04-27 07:54:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90b2f67d-0118-50d1-971c-ecfb12c5f35d/90b2f67d-0118-50d1-971c-ecfb12c5f35d_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/21/48219a5e653a10f3657840d9ad56a900/pa/CF30196_e53e362dfb87908044252722e2521e8b.jpg saved to cache
2026-04-27 07:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 90b2f67d-0118-50d1-971c-ecfb12c5f35d
2026-04-27 07:54:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 90b2f67d-0118-50d1-971c-ecfb12c5f35d, skipping ID generation
2026-04-27 07:54:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90b2f67d-0118-50d1-971c-ecfb12c5f35d with scrape type 1
2026-04-27 07:54:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 90b2f67d-0118-50d1-971c-ecfb12c5f35d sending to next pipeline
2026-04-27 07:54:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 90b2f67d-0118-50d1-971c-ecfb12c5f35d, identifier: CF30196
2026-04-27 07:54:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143809f850>
2026-04-27 07:54:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fc1c075-1786-5ddc-8784-23b7c467a2ab/1fc1c075-1786-5ddc-8784-23b7c467a2ab_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/97/1a9718325ae90d2cd93c32fd25a7a03a/pa/RN69245_c942948f305e4cdbc8344915e01dac71.jpg saved to cache
2026-04-27 07:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1fc1c075-1786-5ddc-8784-23b7c467a2ab
2026-04-27 07:54:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b2b4d0>
2026-04-27 07:54:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cf21ca6-d13a-5d18-81df-cddd84e82021/6cf21ca6-d13a-5d18-81df-cddd84e82021_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:54:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/c2/d6c2d7896dd17ebe2e3e9b1263fddee0/pa/KN31501_1ab75ec8afc4e1d896254d3d42e38978.jpg saved to cache
2026-04-27 07:54:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6cf21ca6-d13a-5d18-81df-cddd84e82021
2026-04-27 07:54:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438bc6010>
2026-04-27 07:54:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dffe6f5d-7174-54ae-be13-afea5372199a/dffe6f5d-7174-54ae-be13-afea5372199a_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:54:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/87/5c8786e1b246e50591f190cd834f1ff0/pa/TA18701_f5301ffbf0e77b7c57cdca3fe0740f61.jpg saved to cache
2026-04-27 07:54:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dffe6f5d-7174-54ae-be13-afea5372199a
2026-04-27 07:54:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438be2450>
2026-04-27 07:54:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fc1c075-1786-5ddc-8784-23b7c467a2ab/1fc1c075-1786-5ddc-8784-23b7c467a2ab_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/97/1a9718325ae90d2cd93c32fd25a7a03a/pa/RN69245_89298259bba4e1d149a8a8e8340174c9.jpg saved to cache
2026-04-27 07:54:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1fc1c075-1786-5ddc-8784-23b7c467a2ab
2026-04-27 07:54:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a4d310>
2026-04-27 07:54:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dffe6f5d-7174-54ae-be13-afea5372199a/dffe6f5d-7174-54ae-be13-afea5372199a_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/87/5c8786e1b246e50591f190cd834f1ff0/pa/TA18701_0abbb0228210cd0e7c7260a8bab07d64.jpg saved to cache
2026-04-27 07:54:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dffe6f5d-7174-54ae-be13-afea5372199a
2026-04-27 07:54:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e02b9e1f-d018-53ad-aee6-3a244deb8367 with identifier: HM67583
2026-04-27 07:54:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e02b9e1f-d018-53ad-aee6-3a244deb8367 with scrape type 1
2026-04-27 07:54:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e02b9e1f-d018-53ad-aee6-3a244deb8367
2026-04-27 07:54:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/8e/e28e2a27623aef4c322549049fcb856a/pa/HM67583_e2bfbe43d317ce682d354f40194c0640.jpg not downloaded yet
2026-04-27 07:54:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4b1e56d-919c-5273-a358-061840a577a1 with identifier: DL16043
2026-04-27 07:54:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4b1e56d-919c-5273-a358-061840a577a1 with scrape type 1
2026-04-27 07:54:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e4b1e56d-919c-5273-a358-061840a577a1
2026-04-27 07:54:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/5a/565a3281898b1ce2e445e105c06e8728/pa/DL16043_d6fdb7fadc02d3700dbffa4f0407bb52.jpg not downloaded yet
2026-04-27 07:54:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb5e3243-f0df-5f0c-9880-1f2580b56834 with identifier: KR77136
2026-04-27 07:54:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb5e3243-f0df-5f0c-9880-1f2580b56834 with scrape type 1
2026-04-27 07:54:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fb5e3243-f0df-5f0c-9880-1f2580b56834
2026-04-27 07:54:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/8d/c38d09bf4b7a258c092b57d3f5b188d5/pa/KR77136_139bdd30c9dd756c081e464c08dfae54.jpg not downloaded yet
2026-04-27 07:54:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/f7/53f7376a6736f646114485ae816cfb0b/pa/CN92978_62b6a544a1f023b8b7445723752c6db6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/42/2742f94a6e5cb7f882081920df20b721/pa/SA02986_e5eca53bde7132ef455015c0691d0c10.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 90b2f67d-0118-50d1-971c-ecfb12c5f35d with identifier: CF30196
2026-04-27 07:54:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 90b2f67d-0118-50d1-971c-ecfb12c5f35d with identifier: CF30196
2026-04-27 07:54:51 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 90b2f67d-0118-50d1-971c-ecfb12c5f35d with identifier: CF30196 to the API
2026-04-27 07:54:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:51 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img48/21/48219a5e653a10f3657840d9ad56a900/pa/CF30196_e53e362dfb87908044252722e2521e8b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 206,
 'category': None,
 'city': 'Loyettes',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '2.2L',
 'engine_horse_power': 160,
 'expiration_date': '2026-04-28T15:17:22Z',
 'fuel_type': 'diesel',
 'id': '90b2f67d-0118-50d1-971c-ecfb12c5f35d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'latitude': 45.7766,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CF30196',
 'listing': 'auction',
 'location': 'FR, Loyettes',
 'location_confidence': 'geocoded',
 'longitude': 5.2069,
 'make': 'Ford',
 'model': 'Ranger',
 'odometer': 184397,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_90b2f67d-0118-50d1-971c-ecfb12c5f35d/90b2f67d-0118-50d1-971c-ecfb12c5f35d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63143,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/21/48219a5e653a10f3657840d9ad56a900/pa/CF30196_fdd61aad4d8f69eaff5145fe8975ebd2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_90b2f67d-0118-50d1-971c-ecfb12c5f35d/90b2f67d-0118-50d1-971c-ecfb12c5f35d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62149,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/21/48219a5e653a10f3657840d9ad56a900/pa/CF30196_204525ee14e46736919100954ef6136f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_90b2f67d-0118-50d1-971c-ecfb12c5f35d/90b2f67d-0118-50d1-971c-ecfb12c5f35d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60951,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/21/48219a5e653a10f3657840d9ad56a900/pa/CF30196_a1789e854372bc6d8b102b80b92ba4f5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_90b2f67d-0118-50d1-971c-ecfb12c5f35d/90b2f67d-0118-50d1-971c-ecfb12c5f35d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50788,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/21/48219a5e653a10f3657840d9ad56a900/pa/CF30196_e53e362dfb87908044252722e2521e8b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_90b2f67d-0118-50d1-971c-ecfb12c5f35d/90b2f67d-0118-50d1-971c-ecfb12c5f35d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58695,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/21/48219a5e653a10f3657840d9ad56a900/pa/CF30196_fd1701c00ed6af129c89b24395ec9a71.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_90b2f67d-0118-50d1-971c-ecfb12c5f35d/90b2f67d-0118-50d1-971c-ecfb12c5f35d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65482,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/21/48219a5e653a10f3657840d9ad56a900/pa/CF30196_ba32c68cbd6d4750f4533ba743699a90.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_90b2f67d-0118-50d1-971c-ecfb12c5f35d/90b2f67d-0118-50d1-971c-ecfb12c5f35d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52224,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/21/48219a5e653a10f3657840d9ad56a900/pa/CF30196_375665c2100200be4b7e834ba5cc78a6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_90b2f67d-0118-50d1-971c-ecfb12c5f35d/90b2f67d-0118-50d1-971c-ecfb12c5f35d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77637,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/21/48219a5e653a10f3657840d9ad56a900/pa/CF30196_b8c3ea0da2255c81ede1a83feac62b6e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_90b2f67d-0118-50d1-971c-ecfb12c5f35d/90b2f67d-0118-50d1-971c-ecfb12c5f35d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60725,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/21/48219a5e653a10f3657840d9ad56a900/pa/CF30196_6e737ebac1b56e4acf1b3ed19251b029.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_90b2f67d-0118-50d1-971c-ecfb12c5f35d/90b2f67d-0118-50d1-971c-ecfb12c5f35d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56474,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/21/48219a5e653a10f3657840d9ad56a900/pa/CF30196_a99315d3b7d6aa9e03d178decf9fd981.jpg',
             'Width': 800}],
 'postal_code': '01360',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Ain',
 'province_code': 'FR-01',
 'region': 'Auvergne-Rhône-Alpes',
 'region_code': 'FR-84',
 'registration_date': '2015-09-28',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Ford Ranger 2.2 TDCi Extrakabine 4x4 XLT',
 'transmission': 'manual',
 'trim': 'Extrakabine 4x4 XLT',
 'year': 2015}
2026-04-27 07:54:51 [auto1.fr] INFO: Saving data for CF30196: {'created_time': 1777276491.779768, 'last_price_update_time': 1777276491.77978, 'has_photos': True, 'auction_closing_time': 1777389442.0}
2026-04-27 07:54:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/f7/53f7376a6736f646114485ae816cfb0b/pa/CN92978_c7eeb3c586c6de29d3a73182fdc6fa3b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/f7/53f7376a6736f646114485ae816cfb0b/pa/CN92978_09507455d79a37880e184e5c591872d9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/33/fe339977f194614b82a5e06f7677416b/pa/ZH79722_2e39b4b17b454c856beada9b82286bd1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/42/2742f94a6e5cb7f882081920df20b721/pa/SA02986_0d8aa29a669f7516408a76ab229f736b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/33/fe339977f194614b82a5e06f7677416b/pa/ZH79722_e7f7c2aa6fd0a6ef46be56198597e7bd.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/42/2742f94a6e5cb7f882081920df20b721/pa/SA02986_1a07a7eeac0802a50c14556f46be1094.jpg not downloaded yet
2026-04-27 07:54:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/8e/e28e2a27623aef4c322549049fcb856a/pa/HM67583_1c2bb4e3a23eb7bd867e2db641c896c9.jpg not downloaded yet
2026-04-27 07:54:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/5a/565a3281898b1ce2e445e105c06e8728/pa/DL16043_127fa1237f953741cd5bd0ae501e6668.jpg not downloaded yet
2026-04-27 07:54:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/8d/c38d09bf4b7a258c092b57d3f5b188d5/pa/KR77136_57c648835d87a1186ab59a2e2e12d8af.jpg not downloaded yet
2026-04-27 07:54:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PR21978> (referer: https://www.auto1.com/v1/car-details-view/PR21978/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14478e2f10>
2026-04-27 07:54:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a70c0496-bd82-59e0-97a4-a74b79811589/a70c0496-bd82-59e0-97a4-a74b79811589_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/42/2742f94a6e5cb7f882081920df20b721/pa/SA02986_b8bf51b0a770cbaa8f057c8a9d68fd26.jpg saved to cache
2026-04-27 07:54:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a70c0496-bd82-59e0-97a4-a74b79811589
2026-04-27 07:54:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438086510>
2026-04-27 07:54:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_240e7ce2-87ec-5c8c-9fa7-0377dde90f13/240e7ce2-87ec-5c8c-9fa7-0377dde90f13_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/33/fe339977f194614b82a5e06f7677416b/pa/ZH79722_0da7d2abbf2311a51cd370136a7ef61b.jpg saved to cache
2026-04-27 07:54:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 240e7ce2-87ec-5c8c-9fa7-0377dde90f13
2026-04-27 07:54:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/97/1a9718325ae90d2cd93c32fd25a7a03a/pa/RN69245_adabc13cbab6e37f0204bfc13ef56168.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SD98356> (referer: https://www.auto1.com/v1/car-details-view/SD98356/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/42/2742f94a6e5cb7f882081920df20b721/pa/SA02986_b0d750c6b4e1d22306251048bcf1a775.jpg not downloaded yet
2026-04-27 07:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/8e/e28e2a27623aef4c322549049fcb856a/pa/HM67583_4e54de82f69a66f352b8ecca7ee28c4e.jpg not downloaded yet
2026-04-27 07:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/5a/565a3281898b1ce2e445e105c06e8728/pa/DL16043_3094581f83e56e45d1955194c77ed33a.jpg not downloaded yet
2026-04-27 07:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/8d/c38d09bf4b7a258c092b57d3f5b188d5/pa/KR77136_433608f520d403794d3b68cdeec08d85.jpg not downloaded yet
2026-04-27 07:54:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TK52688> (referer: https://www.auto1.com/v1/car-details-view/TK52688/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a49390>
2026-04-27 07:54:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_921844a4-8e81-58ba-8b3e-749be4dca568/921844a4-8e81-58ba-8b3e-749be4dca568_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/f7/53f7376a6736f646114485ae816cfb0b/pa/CN92978_62b6a544a1f023b8b7445723752c6db6.jpg saved to cache
2026-04-27 07:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 921844a4-8e81-58ba-8b3e-749be4dca568
2026-04-27 07:54:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d6f090>
2026-04-27 07:54:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a70c0496-bd82-59e0-97a4-a74b79811589/a70c0496-bd82-59e0-97a4-a74b79811589_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/42/2742f94a6e5cb7f882081920df20b721/pa/SA02986_e5eca53bde7132ef455015c0691d0c10.jpg saved to cache
2026-04-27 07:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a70c0496-bd82-59e0-97a4-a74b79811589
2026-04-27 07:54:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438fb48d0>
2026-04-27 07:54:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_921844a4-8e81-58ba-8b3e-749be4dca568/921844a4-8e81-58ba-8b3e-749be4dca568_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/f7/53f7376a6736f646114485ae816cfb0b/pa/CN92978_c7eeb3c586c6de29d3a73182fdc6fa3b.jpg saved to cache
2026-04-27 07:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 921844a4-8e81-58ba-8b3e-749be4dca568
2026-04-27 07:54:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ea8c10>
2026-04-27 07:54:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_921844a4-8e81-58ba-8b3e-749be4dca568/921844a4-8e81-58ba-8b3e-749be4dca568_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/f7/53f7376a6736f646114485ae816cfb0b/pa/CN92978_09507455d79a37880e184e5c591872d9.jpg saved to cache
2026-04-27 07:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 921844a4-8e81-58ba-8b3e-749be4dca568
2026-04-27 07:54:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438f0dbd0>
2026-04-27 07:54:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_240e7ce2-87ec-5c8c-9fa7-0377dde90f13/240e7ce2-87ec-5c8c-9fa7-0377dde90f13_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/33/fe339977f194614b82a5e06f7677416b/pa/ZH79722_2e39b4b17b454c856beada9b82286bd1.jpg saved to cache
2026-04-27 07:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 240e7ce2-87ec-5c8c-9fa7-0377dde90f13
2026-04-27 07:54:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380529d0>
2026-04-27 07:54:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a70c0496-bd82-59e0-97a4-a74b79811589/a70c0496-bd82-59e0-97a4-a74b79811589_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/42/2742f94a6e5cb7f882081920df20b721/pa/SA02986_0d8aa29a669f7516408a76ab229f736b.jpg saved to cache
2026-04-27 07:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a70c0496-bd82-59e0-97a4-a74b79811589
2026-04-27 07:54:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438e2dd90>
2026-04-27 07:54:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_240e7ce2-87ec-5c8c-9fa7-0377dde90f13/240e7ce2-87ec-5c8c-9fa7-0377dde90f13_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/33/fe339977f194614b82a5e06f7677416b/pa/ZH79722_e7f7c2aa6fd0a6ef46be56198597e7bd.jpg saved to cache
2026-04-27 07:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 240e7ce2-87ec-5c8c-9fa7-0377dde90f13
2026-04-27 07:54:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/c2/d6c2d7896dd17ebe2e3e9b1263fddee0/pa/KN31501_59c12fe70d3efc5c7d770ba1a72ae5d5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/8e/e28e2a27623aef4c322549049fcb856a/pa/HM67583_e2bfbe43d317ce682d354f40194c0640.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/42/2742f94a6e5cb7f882081920df20b721/pa/SA02986_66a1896fe4cf2a3ba98e639a675b4615.jpg not downloaded yet
2026-04-27 07:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/8e/e28e2a27623aef4c322549049fcb856a/pa/HM67583_d620947ef3686e9aba009894b5cc4034.jpg not downloaded yet
2026-04-27 07:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/5a/565a3281898b1ce2e445e105c06e8728/pa/DL16043_269a6a2a54fe02a73772418d8897c460.jpg not downloaded yet
2026-04-27 07:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/8d/c38d09bf4b7a258c092b57d3f5b188d5/pa/KR77136_f054bd145897feae580848e7d1f1f986.jpg not downloaded yet
2026-04-27 07:54:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/42/2742f94a6e5cb7f882081920df20b721/pa/SA02986_fbdf2f206582197509236c6e3ada2f01.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/f7/53f7376a6736f646114485ae816cfb0b/pa/CN92978_0a94ac526c52c6abdea93cf7e42c392e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/8d/c38d09bf4b7a258c092b57d3f5b188d5/pa/KR77136_139bdd30c9dd756c081e464c08dfae54.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/5a/565a3281898b1ce2e445e105c06e8728/pa/DL16043_d6fdb7fadc02d3700dbffa4f0407bb52.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/33/fe339977f194614b82a5e06f7677416b/pa/ZH79722_43d34c12faba384129e4f6cbd3ded813.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/87/5c8786e1b246e50591f190cd834f1ff0/pa/TA18701_a40bb663ebe93d70b65a70887b00b854.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/42/2742f94a6e5cb7f882081920df20b721/pa/SA02986_8641ff3f4636bec5874aa7b9e5261e26.jpg not downloaded yet
2026-04-27 07:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/8e/e28e2a27623aef4c322549049fcb856a/pa/HM67583_ee0eb452c2892bb183996aca42d03b19.jpg not downloaded yet
2026-04-27 07:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/5a/565a3281898b1ce2e445e105c06e8728/pa/DL16043_957c2dafb04ba07cdefe6bca3bde00a3.jpg not downloaded yet
2026-04-27 07:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/8d/c38d09bf4b7a258c092b57d3f5b188d5/pa/KR77136_2ff9a080c4f24913b9987e9cd56eb492.jpg not downloaded yet
2026-04-27 07:54:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4cc7290c-894f-5f13-a7d5-45f69b98d3a2 with identifier: PR21978
2026-04-27 07:54:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4cc7290c-894f-5f13-a7d5-45f69b98d3a2 with scrape type 1
2026-04-27 07:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4cc7290c-894f-5f13-a7d5-45f69b98d3a2
2026-04-27 07:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/89/c3893bc2f21b13da2314197f1c95b774/pa/PR21978_592eb5c0c82b2687187cb06daa8d7cce.jpg not downloaded yet
2026-04-27 07:54:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438e05c10>
2026-04-27 07:54:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fc1c075-1786-5ddc-8784-23b7c467a2ab/1fc1c075-1786-5ddc-8784-23b7c467a2ab_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/97/1a9718325ae90d2cd93c32fd25a7a03a/pa/RN69245_adabc13cbab6e37f0204bfc13ef56168.jpg saved to cache
2026-04-27 07:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1fc1c075-1786-5ddc-8784-23b7c467a2ab
2026-04-27 07:54:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1fc1c075-1786-5ddc-8784-23b7c467a2ab, skipping ID generation
2026-04-27 07:54:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fc1c075-1786-5ddc-8784-23b7c467a2ab with scrape type 1
2026-04-27 07:54:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1fc1c075-1786-5ddc-8784-23b7c467a2ab sending to next pipeline
2026-04-27 07:54:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 1fc1c075-1786-5ddc-8784-23b7c467a2ab, identifier: RN69245
2026-04-27 07:54:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a337ac9-a885-5106-a620-c538fe5d548a with identifier: SD98356
2026-04-27 07:54:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a337ac9-a885-5106-a620-c538fe5d548a with scrape type 1
2026-04-27 07:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9a337ac9-a885-5106-a620-c538fe5d548a
2026-04-27 07:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/9f/779fc227974df518885145419d8f7c06/pa/SD98356_b34db0e5e1fa5cd3cdf800bf0605f1df.jpg not downloaded yet
2026-04-27 07:54:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14cb3e3e-3b06-5e7d-98fb-921773407ed3 with identifier: TK52688
2026-04-27 07:54:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14cb3e3e-3b06-5e7d-98fb-921773407ed3 with scrape type 1
2026-04-27 07:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 14cb3e3e-3b06-5e7d-98fb-921773407ed3
2026-04-27 07:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/22/9d2204321b9ed51eb97c7f7c65ba0e19/pa/TK52688_a79da755bfdba62326867b919767c135.jpg not downloaded yet
2026-04-27 07:54:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 1fc1c075-1786-5ddc-8784-23b7c467a2ab with identifier: RN69245
2026-04-27 07:54:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 1fc1c075-1786-5ddc-8784-23b7c467a2ab with identifier: RN69245
2026-04-27 07:54:53 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 1fc1c075-1786-5ddc-8784-23b7c467a2ab with identifier: RN69245 to the API
2026-04-27 07:54:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:53 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1a/97/1a9718325ae90d2cd93c32fd25a7a03a/pa/RN69245_adabc13cbab6e37f0204bfc13ef56168.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 160,
 'category': None,
 'city': 'Le Cellier',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 143,
 'expiration_date': '2026-04-28T15:25:37Z',
 'fuel_type': 'diesel',
 'id': '1fc1c075-1786-5ddc-8784-23b7c467a2ab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 47.3196,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RN69245',
 'listing': 'auction',
 'location': 'FR, Le Cellier',
 'location_confidence': 'geocoded',
 'longitude': -1.3472,
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 246104,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1fc1c075-1786-5ddc-8784-23b7c467a2ab/1fc1c075-1786-5ddc-8784-23b7c467a2ab_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75881,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/97/1a9718325ae90d2cd93c32fd25a7a03a/pa/RN69245_a53617527320e8a8b46f13e2b351c424.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1fc1c075-1786-5ddc-8784-23b7c467a2ab/1fc1c075-1786-5ddc-8784-23b7c467a2ab_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70380,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/97/1a9718325ae90d2cd93c32fd25a7a03a/pa/RN69245_adabc13cbab6e37f0204bfc13ef56168.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1fc1c075-1786-5ddc-8784-23b7c467a2ab/1fc1c075-1786-5ddc-8784-23b7c467a2ab_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67309,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/97/1a9718325ae90d2cd93c32fd25a7a03a/pa/RN69245_89298259bba4e1d149a8a8e8340174c9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1fc1c075-1786-5ddc-8784-23b7c467a2ab/1fc1c075-1786-5ddc-8784-23b7c467a2ab_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52790,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/97/1a9718325ae90d2cd93c32fd25a7a03a/pa/RN69245_c942948f305e4cdbc8344915e01dac71.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1fc1c075-1786-5ddc-8784-23b7c467a2ab/1fc1c075-1786-5ddc-8784-23b7c467a2ab_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81171,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/97/1a9718325ae90d2cd93c32fd25a7a03a/pa/RN69245_585022383aeee2c7226a1675267be1f9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1fc1c075-1786-5ddc-8784-23b7c467a2ab/1fc1c075-1786-5ddc-8784-23b7c467a2ab_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69164,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/97/1a9718325ae90d2cd93c32fd25a7a03a/pa/RN69245_ecf6bce2271a5e4b71dc660c67cc852e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1fc1c075-1786-5ddc-8784-23b7c467a2ab/1fc1c075-1786-5ddc-8784-23b7c467a2ab_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62041,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/97/1a9718325ae90d2cd93c32fd25a7a03a/pa/RN69245_c1013a972f658f21a735eeb704be9d49.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1fc1c075-1786-5ddc-8784-23b7c467a2ab/1fc1c075-1786-5ddc-8784-23b7c467a2ab_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76950,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/97/1a9718325ae90d2cd93c32fd25a7a03a/pa/RN69245_57663b56bea804b796c12e80aedadf1d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1fc1c075-1786-5ddc-8784-23b7c467a2ab/1fc1c075-1786-5ddc-8784-23b7c467a2ab_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84756,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/97/1a9718325ae90d2cd93c32fd25a7a03a/pa/RN69245_4bd3109ce82c75a81bf53cbf44389628.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1fc1c075-1786-5ddc-8784-23b7c467a2ab/1fc1c075-1786-5ddc-8784-23b7c467a2ab_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59175,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/97/1a9718325ae90d2cd93c32fd25a7a03a/pa/RN69245_1804f9c1f94f267d4b9940f97a2dd81e.jpg',
             'Width': 800}],
 'postal_code': '44850',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Loire-Atlantique',
 'province_code': 'FR-44',
 'region': 'Pays de la Loire',
 'region_code': 'FR-52',
 'registration_date': '2013-01-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI Countryman Cooper SD ALL4',
 'transmission': 'automatic',
 'trim': 'ALL4',
 'year': 2013}
2026-04-27 07:54:53 [auto1.fr] INFO: Saving data for RN69245: {'created_time': 1777276493.29012, 'last_price_update_time': 1777276493.290129, 'has_photos': True, 'auction_closing_time': 1777389937.0}
2026-04-27 07:54:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/33/fe339977f194614b82a5e06f7677416b/pa/ZH79722_ef8813c0702a9a4c2feef1902738d9ed.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/8e/e28e2a27623aef4c322549049fcb856a/pa/HM67583_0ed43855ca602ddd540ca0a05bf85fe4.jpg not downloaded yet
2026-04-27 07:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/5a/565a3281898b1ce2e445e105c06e8728/pa/DL16043_fba2984898e7f08e238cdc48b7f95d98.jpg not downloaded yet
2026-04-27 07:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/8d/c38d09bf4b7a258c092b57d3f5b188d5/pa/KR77136_fd2bf6b8f399552a3cb71e15409c0340.jpg not downloaded yet
2026-04-27 07:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/89/c3893bc2f21b13da2314197f1c95b774/pa/PR21978_fd50d7cf13655961e8b8f312a09e3381.jpg not downloaded yet
2026-04-27 07:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/9f/779fc227974df518885145419d8f7c06/pa/SD98356_f0df9c10085491c7c105fec113cca495.jpg not downloaded yet
2026-04-27 07:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/22/9d2204321b9ed51eb97c7f7c65ba0e19/pa/TK52688_1191c293106fd0d7073e7aee39626535.jpg not downloaded yet
2026-04-27 07:54:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/42/2742f94a6e5cb7f882081920df20b721/pa/SA02986_a52c5a6e28ee56d1c8a4bb9956180755.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c5a0d0>
2026-04-27 07:54:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cf21ca6-d13a-5d18-81df-cddd84e82021/6cf21ca6-d13a-5d18-81df-cddd84e82021_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/c2/d6c2d7896dd17ebe2e3e9b1263fddee0/pa/KN31501_59c12fe70d3efc5c7d770ba1a72ae5d5.jpg saved to cache
2026-04-27 07:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6cf21ca6-d13a-5d18-81df-cddd84e82021
2026-04-27 07:54:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d83590>
2026-04-27 07:54:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e02b9e1f-d018-53ad-aee6-3a244deb8367/e02b9e1f-d018-53ad-aee6-3a244deb8367_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/8e/e28e2a27623aef4c322549049fcb856a/pa/HM67583_e2bfbe43d317ce682d354f40194c0640.jpg saved to cache
2026-04-27 07:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e02b9e1f-d018-53ad-aee6-3a244deb8367
2026-04-27 07:54:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d72a90>
2026-04-27 07:54:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a70c0496-bd82-59e0-97a4-a74b79811589/a70c0496-bd82-59e0-97a4-a74b79811589_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/42/2742f94a6e5cb7f882081920df20b721/pa/SA02986_fbdf2f206582197509236c6e3ada2f01.jpg saved to cache
2026-04-27 07:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a70c0496-bd82-59e0-97a4-a74b79811589
2026-04-27 07:54:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d83750>
2026-04-27 07:54:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_921844a4-8e81-58ba-8b3e-749be4dca568/921844a4-8e81-58ba-8b3e-749be4dca568_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/f7/53f7376a6736f646114485ae816cfb0b/pa/CN92978_0a94ac526c52c6abdea93cf7e42c392e.jpg saved to cache
2026-04-27 07:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 921844a4-8e81-58ba-8b3e-749be4dca568
2026-04-27 07:54:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438098610>
2026-04-27 07:54:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb5e3243-f0df-5f0c-9880-1f2580b56834/fb5e3243-f0df-5f0c-9880-1f2580b56834_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/8d/c38d09bf4b7a258c092b57d3f5b188d5/pa/KR77136_139bdd30c9dd756c081e464c08dfae54.jpg saved to cache
2026-04-27 07:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fb5e3243-f0df-5f0c-9880-1f2580b56834
2026-04-27 07:54:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a2ad50>
2026-04-27 07:54:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4b1e56d-919c-5273-a358-061840a577a1/e4b1e56d-919c-5273-a358-061840a577a1_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/5a/565a3281898b1ce2e445e105c06e8728/pa/DL16043_d6fdb7fadc02d3700dbffa4f0407bb52.jpg saved to cache
2026-04-27 07:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e4b1e56d-919c-5273-a358-061840a577a1
2026-04-27 07:54:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d93a10>
2026-04-27 07:54:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_240e7ce2-87ec-5c8c-9fa7-0377dde90f13/240e7ce2-87ec-5c8c-9fa7-0377dde90f13_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/33/fe339977f194614b82a5e06f7677416b/pa/ZH79722_43d34c12faba384129e4f6cbd3ded813.jpg saved to cache
2026-04-27 07:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 240e7ce2-87ec-5c8c-9fa7-0377dde90f13
2026-04-27 07:54:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a280d0>
2026-04-27 07:54:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dffe6f5d-7174-54ae-be13-afea5372199a/dffe6f5d-7174-54ae-be13-afea5372199a_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/87/5c8786e1b246e50591f190cd834f1ff0/pa/TA18701_a40bb663ebe93d70b65a70887b00b854.jpg saved to cache
2026-04-27 07:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dffe6f5d-7174-54ae-be13-afea5372199a
2026-04-27 07:54:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dffe6f5d-7174-54ae-be13-afea5372199a, skipping ID generation
2026-04-27 07:54:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dffe6f5d-7174-54ae-be13-afea5372199a with scrape type 1
2026-04-27 07:54:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dffe6f5d-7174-54ae-be13-afea5372199a sending to next pipeline
2026-04-27 07:54:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: dffe6f5d-7174-54ae-be13-afea5372199a, identifier: TA18701
2026-04-27 07:54:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/f7/53f7376a6736f646114485ae816cfb0b/pa/CN92978_b23fed3ddff9ea0daf4aaf4c114818cb.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/42/2742f94a6e5cb7f882081920df20b721/pa/SA02986_8825c7246611b0f5473edb0f2ea16d33.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/33/fe339977f194614b82a5e06f7677416b/pa/ZH79722_806fe2771bfaa4f80d00e0f2d75ad2fb.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/f7/53f7376a6736f646114485ae816cfb0b/pa/CN92978_bf5e050994bb444510ac5573a4e18f40.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/5a/565a3281898b1ce2e445e105c06e8728/pa/DL16043_127fa1237f953741cd5bd0ae501e6668.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/8d/c38d09bf4b7a258c092b57d3f5b188d5/pa/KR77136_57c648835d87a1186ab59a2e2e12d8af.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/8e/e28e2a27623aef4c322549049fcb856a/pa/HM67583_8a186d6fcd3daca2b53dd9470776c27f.jpg not downloaded yet
2026-04-27 07:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/5a/565a3281898b1ce2e445e105c06e8728/pa/DL16043_dfd4fa4af72d3e66fc11a910c49f3eb9.jpg not downloaded yet
2026-04-27 07:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/8d/c38d09bf4b7a258c092b57d3f5b188d5/pa/KR77136_93656faf52e08fb3ba2eaa61e6acbd05.jpg not downloaded yet
2026-04-27 07:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/89/c3893bc2f21b13da2314197f1c95b774/pa/PR21978_e6663230873628b04eba0d362a2eea93.jpg not downloaded yet
2026-04-27 07:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/9f/779fc227974df518885145419d8f7c06/pa/SD98356_4d172216a872018fb2d6b30ee0331f82.jpg not downloaded yet
2026-04-27 07:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/22/9d2204321b9ed51eb97c7f7c65ba0e19/pa/TK52688_bf8ad3df5df572a7d39ba84966bbf289.jpg not downloaded yet
2026-04-27 07:54:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: dffe6f5d-7174-54ae-be13-afea5372199a with identifier: TA18701
2026-04-27 07:54:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: dffe6f5d-7174-54ae-be13-afea5372199a with identifier: TA18701
2026-04-27 07:54:54 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: dffe6f5d-7174-54ae-be13-afea5372199a with identifier: TA18701 to the API
2026-04-27 07:54:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:54 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5c/87/5c8786e1b246e50591f190cd834f1ff0/pa/TA18701_a40bb663ebe93d70b65a70887b00b854.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'category': None,
 'city': 'Beaucaire',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 160,
 'expiration_date': '2026-04-28T15:38:26Z',
 'fuel_type': 'diesel',
 'id': 'dffe6f5d-7174-54ae-be13-afea5372199a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 43.8081,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TA18701',
 'listing': 'auction',
 'location': 'FR, Beaucaire',
 'location_confidence': 'geocoded',
 'longitude': 4.6442,
 'make': 'Renault',
 'model': 'Talisman',
 'odometer': 65944,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dffe6f5d-7174-54ae-be13-afea5372199a/dffe6f5d-7174-54ae-be13-afea5372199a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66228,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/87/5c8786e1b246e50591f190cd834f1ff0/pa/TA18701_1f3652b7459258cf6e6b8b0092c8a15d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dffe6f5d-7174-54ae-be13-afea5372199a/dffe6f5d-7174-54ae-be13-afea5372199a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65894,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/87/5c8786e1b246e50591f190cd834f1ff0/pa/TA18701_2443c2a8b85b6b7e2b4623bfd2b7e298.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dffe6f5d-7174-54ae-be13-afea5372199a/dffe6f5d-7174-54ae-be13-afea5372199a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67563,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/87/5c8786e1b246e50591f190cd834f1ff0/pa/TA18701_a40bb663ebe93d70b65a70887b00b854.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dffe6f5d-7174-54ae-be13-afea5372199a/dffe6f5d-7174-54ae-be13-afea5372199a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65658,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/87/5c8786e1b246e50591f190cd834f1ff0/pa/TA18701_0abbb0228210cd0e7c7260a8bab07d64.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dffe6f5d-7174-54ae-be13-afea5372199a/dffe6f5d-7174-54ae-be13-afea5372199a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70814,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/87/5c8786e1b246e50591f190cd834f1ff0/pa/TA18701_a32bab225f56d79deb7e81476b6382ff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dffe6f5d-7174-54ae-be13-afea5372199a/dffe6f5d-7174-54ae-be13-afea5372199a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68717,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/87/5c8786e1b246e50591f190cd834f1ff0/pa/TA18701_f5301ffbf0e77b7c57cdca3fe0740f61.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dffe6f5d-7174-54ae-be13-afea5372199a/dffe6f5d-7174-54ae-be13-afea5372199a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64522,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/87/5c8786e1b246e50591f190cd834f1ff0/pa/TA18701_01b62fbb95b300ea55624466b5c47c53.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dffe6f5d-7174-54ae-be13-afea5372199a/dffe6f5d-7174-54ae-be13-afea5372199a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76419,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/87/5c8786e1b246e50591f190cd834f1ff0/pa/TA18701_589e85caa0ff806654fc8e45f7ef0f09.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dffe6f5d-7174-54ae-be13-afea5372199a/dffe6f5d-7174-54ae-be13-afea5372199a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73681,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/87/5c8786e1b246e50591f190cd834f1ff0/pa/TA18701_999583be2063c497f42fb1fb94e98afd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dffe6f5d-7174-54ae-be13-afea5372199a/dffe6f5d-7174-54ae-be13-afea5372199a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51282,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/87/5c8786e1b246e50591f190cd834f1ff0/pa/TA18701_782be298061881ee4946cc5b627138fc.jpg',
             'Width': 800}],
 'postal_code': '30300',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Gard',
 'province_code': 'FR-30',
 'region': 'Occitanie',
 'region_code': 'FR-76',
 'registration_date': '2015-11-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Talisman 1.6 dCi Energy Intens',
 'transmission': 'automatic',
 'trim': 'Intens',
 'year': 2015}
2026-04-27 07:54:54 [auto1.fr] INFO: Saving data for TA18701: {'created_time': 1777276494.503585, 'last_price_update_time': 1777276494.503596, 'has_photos': True, 'auction_closing_time': 1777390706.0}
2026-04-27 07:54:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438e56cd0>
2026-04-27 07:54:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_240e7ce2-87ec-5c8c-9fa7-0377dde90f13/240e7ce2-87ec-5c8c-9fa7-0377dde90f13_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/33/fe339977f194614b82a5e06f7677416b/pa/ZH79722_ef8813c0702a9a4c2feef1902738d9ed.jpg saved to cache
2026-04-27 07:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 240e7ce2-87ec-5c8c-9fa7-0377dde90f13
2026-04-27 07:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/8e/e28e2a27623aef4c322549049fcb856a/pa/HM67583_37da66969807b2f85929de422dd1e211.jpg not downloaded yet
2026-04-27 07:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/5a/565a3281898b1ce2e445e105c06e8728/pa/DL16043_7bf8c05249c3ae666fb7faf86a4832cf.jpg not downloaded yet
2026-04-27 07:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/8d/c38d09bf4b7a258c092b57d3f5b188d5/pa/KR77136_4a746ce01ef4c2005ea2402fe1f97e67.jpg not downloaded yet
2026-04-27 07:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/89/c3893bc2f21b13da2314197f1c95b774/pa/PR21978_a1bbe32fd08535897480e27d38c0c29e.jpg not downloaded yet
2026-04-27 07:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/9f/779fc227974df518885145419d8f7c06/pa/SD98356_39a07d71d9bbe77bd81791a7f31324dc.jpg not downloaded yet
2026-04-27 07:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/22/9d2204321b9ed51eb97c7f7c65ba0e19/pa/TK52688_e083e72371d43310d8c7d118b6b45017.jpg not downloaded yet
2026-04-27 07:54:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/5a/565a3281898b1ce2e445e105c06e8728/pa/DL16043_3094581f83e56e45d1955194c77ed33a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/8d/c38d09bf4b7a258c092b57d3f5b188d5/pa/KR77136_433608f520d403794d3b68cdeec08d85.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/8e/e28e2a27623aef4c322549049fcb856a/pa/HM67583_cc3c28d54199fae5238befa8577d198a.jpg not downloaded yet
2026-04-27 07:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/5a/565a3281898b1ce2e445e105c06e8728/pa/DL16043_ae9b0f003f9c126adacfb72b53c51ccf.jpg not downloaded yet
2026-04-27 07:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/8d/c38d09bf4b7a258c092b57d3f5b188d5/pa/KR77136_e27fb4e91ee42f5842e3058dc6db65f2.jpg not downloaded yet
2026-04-27 07:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/89/c3893bc2f21b13da2314197f1c95b774/pa/PR21978_24a62cda1294e3c075a2fab739b5f3fa.jpg not downloaded yet
2026-04-27 07:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/9f/779fc227974df518885145419d8f7c06/pa/SD98356_fc6d9f8b5c597989679168995e93112e.jpg not downloaded yet
2026-04-27 07:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/22/9d2204321b9ed51eb97c7f7c65ba0e19/pa/TK52688_eb9b311f93051097e83078aa04cc5de4.jpg not downloaded yet
2026-04-27 07:54:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438e57a50>
2026-04-27 07:54:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a70c0496-bd82-59e0-97a4-a74b79811589/a70c0496-bd82-59e0-97a4-a74b79811589_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/42/2742f94a6e5cb7f882081920df20b721/pa/SA02986_a52c5a6e28ee56d1c8a4bb9956180755.jpg saved to cache
2026-04-27 07:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a70c0496-bd82-59e0-97a4-a74b79811589
2026-04-27 07:54:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438e55090>
2026-04-27 07:54:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_921844a4-8e81-58ba-8b3e-749be4dca568/921844a4-8e81-58ba-8b3e-749be4dca568_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/f7/53f7376a6736f646114485ae816cfb0b/pa/CN92978_b23fed3ddff9ea0daf4aaf4c114818cb.jpg saved to cache
2026-04-27 07:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 921844a4-8e81-58ba-8b3e-749be4dca568
2026-04-27 07:54:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380bf390>
2026-04-27 07:54:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a70c0496-bd82-59e0-97a4-a74b79811589/a70c0496-bd82-59e0-97a4-a74b79811589_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/42/2742f94a6e5cb7f882081920df20b721/pa/SA02986_8825c7246611b0f5473edb0f2ea16d33.jpg saved to cache
2026-04-27 07:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a70c0496-bd82-59e0-97a4-a74b79811589
2026-04-27 07:54:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438aeee90>
2026-04-27 07:54:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_240e7ce2-87ec-5c8c-9fa7-0377dde90f13/240e7ce2-87ec-5c8c-9fa7-0377dde90f13_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/33/fe339977f194614b82a5e06f7677416b/pa/ZH79722_806fe2771bfaa4f80d00e0f2d75ad2fb.jpg saved to cache
2026-04-27 07:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 240e7ce2-87ec-5c8c-9fa7-0377dde90f13
2026-04-27 07:54:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 240e7ce2-87ec-5c8c-9fa7-0377dde90f13, skipping ID generation
2026-04-27 07:54:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 240e7ce2-87ec-5c8c-9fa7-0377dde90f13 with scrape type 1
2026-04-27 07:54:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 240e7ce2-87ec-5c8c-9fa7-0377dde90f13 sending to next pipeline
2026-04-27 07:54:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 240e7ce2-87ec-5c8c-9fa7-0377dde90f13, identifier: ZH79722
2026-04-27 07:54:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14478dccd0>
2026-04-27 07:54:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_921844a4-8e81-58ba-8b3e-749be4dca568/921844a4-8e81-58ba-8b3e-749be4dca568_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/f7/53f7376a6736f646114485ae816cfb0b/pa/CN92978_bf5e050994bb444510ac5573a4e18f40.jpg saved to cache
2026-04-27 07:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 921844a4-8e81-58ba-8b3e-749be4dca568
2026-04-27 07:54:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 921844a4-8e81-58ba-8b3e-749be4dca568, skipping ID generation
2026-04-27 07:54:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 921844a4-8e81-58ba-8b3e-749be4dca568 with scrape type 1
2026-04-27 07:54:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 921844a4-8e81-58ba-8b3e-749be4dca568 sending to next pipeline
2026-04-27 07:54:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 921844a4-8e81-58ba-8b3e-749be4dca568, identifier: CN92978
2026-04-27 07:54:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438134fd0>
2026-04-27 07:54:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4b1e56d-919c-5273-a358-061840a577a1/e4b1e56d-919c-5273-a358-061840a577a1_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/5a/565a3281898b1ce2e445e105c06e8728/pa/DL16043_127fa1237f953741cd5bd0ae501e6668.jpg saved to cache
2026-04-27 07:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e4b1e56d-919c-5273-a358-061840a577a1
2026-04-27 07:54:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b8f050>
2026-04-27 07:54:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb5e3243-f0df-5f0c-9880-1f2580b56834/fb5e3243-f0df-5f0c-9880-1f2580b56834_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/8d/c38d09bf4b7a258c092b57d3f5b188d5/pa/KR77136_57c648835d87a1186ab59a2e2e12d8af.jpg saved to cache
2026-04-27 07:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fb5e3243-f0df-5f0c-9880-1f2580b56834
2026-04-27 07:54:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/42/2742f94a6e5cb7f882081920df20b721/pa/SA02986_b0d750c6b4e1d22306251048bcf1a775.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/42/2742f94a6e5cb7f882081920df20b721/pa/SA02986_66a1896fe4cf2a3ba98e639a675b4615.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 240e7ce2-87ec-5c8c-9fa7-0377dde90f13 with identifier: ZH79722
2026-04-27 07:54:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 240e7ce2-87ec-5c8c-9fa7-0377dde90f13 with identifier: ZH79722
2026-04-27 07:54:55 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 240e7ce2-87ec-5c8c-9fa7-0377dde90f13 with identifier: ZH79722 to the API
2026-04-27 07:54:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:55 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgfe/33/fe339977f194614b82a5e06f7677416b/pa/ZH79722_806fe2771bfaa4f80d00e0f2d75ad2fb.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'category': None,
 'city': 'Saint Aignan de Grandlieu',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-04-28T15:51:04Z',
 'fuel_type': 'petrol',
 'id': '240e7ce2-87ec-5c8c-9fa7-0377dde90f13',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 47.1237,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZH79722',
 'listing': 'auction',
 'location': 'FR, Saint Aignan de Grandlieu',
 'location_confidence': 'geocoded',
 'longitude': -1.6308,
 'make': 'Citroen',
 'model': 'C4',
 'odometer': 183407,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_240e7ce2-87ec-5c8c-9fa7-0377dde90f13/240e7ce2-87ec-5c8c-9fa7-0377dde90f13_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93209,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/33/fe339977f194614b82a5e06f7677416b/pa/ZH79722_0da7d2abbf2311a51cd370136a7ef61b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_240e7ce2-87ec-5c8c-9fa7-0377dde90f13/240e7ce2-87ec-5c8c-9fa7-0377dde90f13_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86026,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/33/fe339977f194614b82a5e06f7677416b/pa/ZH79722_2e39b4b17b454c856beada9b82286bd1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_240e7ce2-87ec-5c8c-9fa7-0377dde90f13/240e7ce2-87ec-5c8c-9fa7-0377dde90f13_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67838,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/33/fe339977f194614b82a5e06f7677416b/pa/ZH79722_e7f7c2aa6fd0a6ef46be56198597e7bd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_240e7ce2-87ec-5c8c-9fa7-0377dde90f13/240e7ce2-87ec-5c8c-9fa7-0377dde90f13_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75623,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/33/fe339977f194614b82a5e06f7677416b/pa/ZH79722_43d34c12faba384129e4f6cbd3ded813.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_240e7ce2-87ec-5c8c-9fa7-0377dde90f13/240e7ce2-87ec-5c8c-9fa7-0377dde90f13_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89566,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/33/fe339977f194614b82a5e06f7677416b/pa/ZH79722_806fe2771bfaa4f80d00e0f2d75ad2fb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_240e7ce2-87ec-5c8c-9fa7-0377dde90f13/240e7ce2-87ec-5c8c-9fa7-0377dde90f13_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61802,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/33/fe339977f194614b82a5e06f7677416b/pa/ZH79722_ef8813c0702a9a4c2feef1902738d9ed.jpg',
             'Width': 800}],
 'postal_code': '44860',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Loire-Atlantique',
 'province_code': 'FR-44',
 'region': 'Pays de la Loire',
 'region_code': 'FR-52',
 'registration_date': '2010-05-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C4 1.6 VTi Tendance',
 'transmission': 'manual',
 'trim': 'Tendance',
 'year': 2010}
2026-04-27 07:54:55 [auto1.fr] INFO: Saving data for ZH79722: {'created_time': 1777276495.780039, 'last_price_update_time': 1777276495.780054, 'has_photos': True, 'auction_closing_time': 1777391464.0}
2026-04-27 07:54:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 921844a4-8e81-58ba-8b3e-749be4dca568 with identifier: CN92978
2026-04-27 07:54:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 921844a4-8e81-58ba-8b3e-749be4dca568 with identifier: CN92978
2026-04-27 07:54:55 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 921844a4-8e81-58ba-8b3e-749be4dca568 with identifier: CN92978 to the API
2026-04-27 07:54:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:56 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img53/f7/53f7376a6736f646114485ae816cfb0b/pa/CN92978_bf5e050994bb444510ac5573a4e18f40.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'city': 'Marseille',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-04-28T15:25:08Z',
 'fuel_type': 'petrol',
 'id': '921844a4-8e81-58ba-8b3e-749be4dca568',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 43.2969,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CN92978',
 'listing': 'auction',
 'location': 'FR, Marseille',
 'location_confidence': 'geocoded',
 'longitude': 5.3811,
 'make': 'Peugeot',
 'model': '208',
 'odometer': 150687,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_921844a4-8e81-58ba-8b3e-749be4dca568/921844a4-8e81-58ba-8b3e-749be4dca568_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80033,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/f7/53f7376a6736f646114485ae816cfb0b/pa/CN92978_62b6a544a1f023b8b7445723752c6db6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_921844a4-8e81-58ba-8b3e-749be4dca568/921844a4-8e81-58ba-8b3e-749be4dca568_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76737,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/f7/53f7376a6736f646114485ae816cfb0b/pa/CN92978_c7eeb3c586c6de29d3a73182fdc6fa3b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_921844a4-8e81-58ba-8b3e-749be4dca568/921844a4-8e81-58ba-8b3e-749be4dca568_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66905,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/f7/53f7376a6736f646114485ae816cfb0b/pa/CN92978_09507455d79a37880e184e5c591872d9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_921844a4-8e81-58ba-8b3e-749be4dca568/921844a4-8e81-58ba-8b3e-749be4dca568_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78225,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/f7/53f7376a6736f646114485ae816cfb0b/pa/CN92978_0a94ac526c52c6abdea93cf7e42c392e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_921844a4-8e81-58ba-8b3e-749be4dca568/921844a4-8e81-58ba-8b3e-749be4dca568_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106404,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/f7/53f7376a6736f646114485ae816cfb0b/pa/CN92978_bf5e050994bb444510ac5573a4e18f40.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_921844a4-8e81-58ba-8b3e-749be4dca568/921844a4-8e81-58ba-8b3e-749be4dca568_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81088,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/f7/53f7376a6736f646114485ae816cfb0b/pa/CN92978_b23fed3ddff9ea0daf4aaf4c114818cb.jpg',
             'Width': 800}],
 'postal_code': '13000',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Bouches-du-Rhône',
 'province_code': 'FR-13',
 'region': "Provence-Alpes-Côte d'Azur",
 'region_code': 'FR-93',
 'registration_date': '2012-06-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 208 1.6 Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2012}
2026-04-27 07:54:56 [auto1.fr] INFO: Saving data for CN92978: {'created_time': 1777276496.21415, 'last_price_update_time': 1777276496.214167, 'has_photos': True, 'auction_closing_time': 1777389908.0}
2026-04-27 07:54:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/8e/e28e2a27623aef4c322549049fcb856a/pa/HM67583_d620947ef3686e9aba009894b5cc4034.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/8e/e28e2a27623aef4c322549049fcb856a/pa/HM67583_4e54de82f69a66f352b8ecca7ee28c4e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/8e/e28e2a27623aef4c322549049fcb856a/pa/HM67583_095f024c0a46e66c361fd441546b8bfa.jpg not downloaded yet
2026-04-27 07:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/5a/565a3281898b1ce2e445e105c06e8728/pa/DL16043_bff86f90b961f18b4f43dbf62443b476.jpg not downloaded yet
2026-04-27 07:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/8d/c38d09bf4b7a258c092b57d3f5b188d5/pa/KR77136_67d2ee36d960e68a1c61326d147dd781.jpg not downloaded yet
2026-04-27 07:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/89/c3893bc2f21b13da2314197f1c95b774/pa/PR21978_3682339a89a5156ec0c63d34685f69a2.jpg not downloaded yet
2026-04-27 07:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/9f/779fc227974df518885145419d8f7c06/pa/SD98356_a3e05e99eab0e2e68e17ae7c52b25998.jpg not downloaded yet
2026-04-27 07:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/22/9d2204321b9ed51eb97c7f7c65ba0e19/pa/TK52688_b66ed37f074167f525b510206d59deaa.jpg not downloaded yet
2026-04-27 07:54:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/8d/c38d09bf4b7a258c092b57d3f5b188d5/pa/KR77136_f054bd145897feae580848e7d1f1f986.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/9f/779fc227974df518885145419d8f7c06/pa/SD98356_b34db0e5e1fa5cd3cdf800bf0605f1df.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/22/9d2204321b9ed51eb97c7f7c65ba0e19/pa/TK52688_a79da755bfdba62326867b919767c135.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/89/c3893bc2f21b13da2314197f1c95b774/pa/PR21978_f5ccf536033e44f9220ac7c167850d32.jpg not downloaded yet
2026-04-27 07:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/9f/779fc227974df518885145419d8f7c06/pa/SD98356_ba1ab08b4bf207c2a29a8d4e3c8924a0.jpg not downloaded yet
2026-04-27 07:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/22/9d2204321b9ed51eb97c7f7c65ba0e19/pa/TK52688_041148aa614e9f896af3f5e177630231.jpg not downloaded yet
2026-04-27 07:54:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ac5810>
2026-04-27 07:54:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4b1e56d-919c-5273-a358-061840a577a1/e4b1e56d-919c-5273-a358-061840a577a1_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/5a/565a3281898b1ce2e445e105c06e8728/pa/DL16043_3094581f83e56e45d1955194c77ed33a.jpg saved to cache
2026-04-27 07:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e4b1e56d-919c-5273-a358-061840a577a1
2026-04-27 07:54:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438eca9d0>
2026-04-27 07:54:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb5e3243-f0df-5f0c-9880-1f2580b56834/fb5e3243-f0df-5f0c-9880-1f2580b56834_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/8d/c38d09bf4b7a258c092b57d3f5b188d5/pa/KR77136_433608f520d403794d3b68cdeec08d85.jpg saved to cache
2026-04-27 07:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fb5e3243-f0df-5f0c-9880-1f2580b56834
2026-04-27 07:54:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143817f9d0>
2026-04-27 07:54:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a70c0496-bd82-59e0-97a4-a74b79811589/a70c0496-bd82-59e0-97a4-a74b79811589_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/42/2742f94a6e5cb7f882081920df20b721/pa/SA02986_b0d750c6b4e1d22306251048bcf1a775.jpg saved to cache
2026-04-27 07:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a70c0496-bd82-59e0-97a4-a74b79811589
2026-04-27 07:54:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c679d0>
2026-04-27 07:54:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a70c0496-bd82-59e0-97a4-a74b79811589/a70c0496-bd82-59e0-97a4-a74b79811589_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/42/2742f94a6e5cb7f882081920df20b721/pa/SA02986_66a1896fe4cf2a3ba98e639a675b4615.jpg saved to cache
2026-04-27 07:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a70c0496-bd82-59e0-97a4-a74b79811589
2026-04-27 07:54:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c56090>
2026-04-27 07:54:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e02b9e1f-d018-53ad-aee6-3a244deb8367/e02b9e1f-d018-53ad-aee6-3a244deb8367_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/8e/e28e2a27623aef4c322549049fcb856a/pa/HM67583_d620947ef3686e9aba009894b5cc4034.jpg saved to cache
2026-04-27 07:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e02b9e1f-d018-53ad-aee6-3a244deb8367
2026-04-27 07:54:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438aeb2d0>
2026-04-27 07:54:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e02b9e1f-d018-53ad-aee6-3a244deb8367/e02b9e1f-d018-53ad-aee6-3a244deb8367_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/8e/e28e2a27623aef4c322549049fcb856a/pa/HM67583_4e54de82f69a66f352b8ecca7ee28c4e.jpg saved to cache
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e02b9e1f-d018-53ad-aee6-3a244deb8367
2026-04-27 07:54:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/89/c3893bc2f21b13da2314197f1c95b774/pa/PR21978_fd50d7cf13655961e8b8f312a09e3381.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/89/c3893bc2f21b13da2314197f1c95b774/pa/PR21978_7eb0c4d18982d3559fc3f0b6532e40f5.jpg not downloaded yet
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/9f/779fc227974df518885145419d8f7c06/pa/SD98356_b88ee878278ce12a6eb2d01049591fbb.jpg not downloaded yet
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/22/9d2204321b9ed51eb97c7f7c65ba0e19/pa/TK52688_9953a8a72746e6dbc44306b23c2cd67a.jpg not downloaded yet
2026-04-27 07:54:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/5a/565a3281898b1ce2e445e105c06e8728/pa/DL16043_fba2984898e7f08e238cdc48b7f95d98.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/22/9d2204321b9ed51eb97c7f7c65ba0e19/pa/TK52688_1191c293106fd0d7073e7aee39626535.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/8d/c38d09bf4b7a258c092b57d3f5b188d5/pa/KR77136_fd2bf6b8f399552a3cb71e15409c0340.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/9f/779fc227974df518885145419d8f7c06/pa/SD98356_f0df9c10085491c7c105fec113cca495.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/89/c3893bc2f21b13da2314197f1c95b774/pa/PR21978_26b1b2db7b5e16512e9dff5107d09ca0.jpg not downloaded yet
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/9f/779fc227974df518885145419d8f7c06/pa/SD98356_f3dfcca362e2c7f317d69e4e37d0544a.jpg not downloaded yet
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/22/9d2204321b9ed51eb97c7f7c65ba0e19/pa/TK52688_21de4cad5808bc4fc0141133e952a64b.jpg not downloaded yet
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438147b90>
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb5e3243-f0df-5f0c-9880-1f2580b56834/fb5e3243-f0df-5f0c-9880-1f2580b56834_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/8d/c38d09bf4b7a258c092b57d3f5b188d5/pa/KR77136_f054bd145897feae580848e7d1f1f986.jpg saved to cache
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fb5e3243-f0df-5f0c-9880-1f2580b56834
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438fc3090>
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a337ac9-a885-5106-a620-c538fe5d548a/9a337ac9-a885-5106-a620-c538fe5d548a_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/9f/779fc227974df518885145419d8f7c06/pa/SD98356_b34db0e5e1fa5cd3cdf800bf0605f1df.jpg saved to cache
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9a337ac9-a885-5106-a620-c538fe5d548a
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143803a150>
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14cb3e3e-3b06-5e7d-98fb-921773407ed3/14cb3e3e-3b06-5e7d-98fb-921773407ed3_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/22/9d2204321b9ed51eb97c7f7c65ba0e19/pa/TK52688_a79da755bfdba62326867b919767c135.jpg saved to cache
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 14cb3e3e-3b06-5e7d-98fb-921773407ed3
2026-04-27 07:54:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/22/9d2204321b9ed51eb97c7f7c65ba0e19/pa/TK52688_e083e72371d43310d8c7d118b6b45017.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/9f/779fc227974df518885145419d8f7c06/pa/SD98356_39a07d71d9bbe77bd81791a7f31324dc.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/9f/779fc227974df518885145419d8f7c06/pa/SD98356_fc6d9f8b5c597989679168995e93112e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/22/9d2204321b9ed51eb97c7f7c65ba0e19/pa/TK52688_eb9b311f93051097e83078aa04cc5de4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/89/c3893bc2f21b13da2314197f1c95b774/pa/PR21978_24a62cda1294e3c075a2fab739b5f3fa.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/89/c3893bc2f21b13da2314197f1c95b774/pa/PR21978_4b8091b9dab1627323a3a4946e3bd490.jpg not downloaded yet
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/9f/779fc227974df518885145419d8f7c06/pa/SD98356_be41fea463650ff239689b6187d00bf6.jpg not downloaded yet
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/22/9d2204321b9ed51eb97c7f7c65ba0e19/pa/TK52688_988d3ca0dab160892ecb538fa432007e.jpg not downloaded yet
2026-04-27 07:54:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/8e/e28e2a27623aef4c322549049fcb856a/pa/HM67583_0ed43855ca602ddd540ca0a05bf85fe4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/8d/c38d09bf4b7a258c092b57d3f5b188d5/pa/KR77136_e27fb4e91ee42f5842e3058dc6db65f2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438fc2410>
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cc7290c-894f-5f13-a7d5-45f69b98d3a2/4cc7290c-894f-5f13-a7d5-45f69b98d3a2_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/89/c3893bc2f21b13da2314197f1c95b774/pa/PR21978_fd50d7cf13655961e8b8f312a09e3381.jpg saved to cache
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4cc7290c-894f-5f13-a7d5-45f69b98d3a2
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c887d0>
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4b1e56d-919c-5273-a358-061840a577a1/e4b1e56d-919c-5273-a358-061840a577a1_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/5a/565a3281898b1ce2e445e105c06e8728/pa/DL16043_fba2984898e7f08e238cdc48b7f95d98.jpg saved to cache
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e4b1e56d-919c-5273-a358-061840a577a1
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d0bf10>
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14cb3e3e-3b06-5e7d-98fb-921773407ed3/14cb3e3e-3b06-5e7d-98fb-921773407ed3_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/22/9d2204321b9ed51eb97c7f7c65ba0e19/pa/TK52688_1191c293106fd0d7073e7aee39626535.jpg saved to cache
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 14cb3e3e-3b06-5e7d-98fb-921773407ed3
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c8b4d0>
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb5e3243-f0df-5f0c-9880-1f2580b56834/fb5e3243-f0df-5f0c-9880-1f2580b56834_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/8d/c38d09bf4b7a258c092b57d3f5b188d5/pa/KR77136_fd2bf6b8f399552a3cb71e15409c0340.jpg saved to cache
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fb5e3243-f0df-5f0c-9880-1f2580b56834
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ac5990>
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a337ac9-a885-5106-a620-c538fe5d548a/9a337ac9-a885-5106-a620-c538fe5d548a_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/9f/779fc227974df518885145419d8f7c06/pa/SD98356_f0df9c10085491c7c105fec113cca495.jpg saved to cache
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9a337ac9-a885-5106-a620-c538fe5d548a
2026-04-27 07:54:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/22/9d2204321b9ed51eb97c7f7c65ba0e19/pa/TK52688_b66ed37f074167f525b510206d59deaa.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/22/9d2204321b9ed51eb97c7f7c65ba0e19/pa/TK52688_041148aa614e9f896af3f5e177630231.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/89/c3893bc2f21b13da2314197f1c95b774/pa/PR21978_f5ccf536033e44f9220ac7c167850d32.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/9f/779fc227974df518885145419d8f7c06/pa/SD98356_ba1ab08b4bf207c2a29a8d4e3c8924a0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/9f/779fc227974df518885145419d8f7c06/pa/SD98356_a3e05e99eab0e2e68e17ae7c52b25998.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/5a/565a3281898b1ce2e445e105c06e8728/pa/DL16043_ae9b0f003f9c126adacfb72b53c51ccf.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d5bb10>
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14cb3e3e-3b06-5e7d-98fb-921773407ed3/14cb3e3e-3b06-5e7d-98fb-921773407ed3_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/22/9d2204321b9ed51eb97c7f7c65ba0e19/pa/TK52688_e083e72371d43310d8c7d118b6b45017.jpg saved to cache
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 14cb3e3e-3b06-5e7d-98fb-921773407ed3
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a35cd0>
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a337ac9-a885-5106-a620-c538fe5d548a/9a337ac9-a885-5106-a620-c538fe5d548a_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/9f/779fc227974df518885145419d8f7c06/pa/SD98356_39a07d71d9bbe77bd81791a7f31324dc.jpg saved to cache
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9a337ac9-a885-5106-a620-c538fe5d548a
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438cf8650>
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a337ac9-a885-5106-a620-c538fe5d548a/9a337ac9-a885-5106-a620-c538fe5d548a_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/9f/779fc227974df518885145419d8f7c06/pa/SD98356_fc6d9f8b5c597989679168995e93112e.jpg saved to cache
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9a337ac9-a885-5106-a620-c538fe5d548a
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a59710>
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14cb3e3e-3b06-5e7d-98fb-921773407ed3/14cb3e3e-3b06-5e7d-98fb-921773407ed3_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/22/9d2204321b9ed51eb97c7f7c65ba0e19/pa/TK52688_eb9b311f93051097e83078aa04cc5de4.jpg saved to cache
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 14cb3e3e-3b06-5e7d-98fb-921773407ed3
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438fc05d0>
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cc7290c-894f-5f13-a7d5-45f69b98d3a2/4cc7290c-894f-5f13-a7d5-45f69b98d3a2_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/89/c3893bc2f21b13da2314197f1c95b774/pa/PR21978_24a62cda1294e3c075a2fab739b5f3fa.jpg saved to cache
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4cc7290c-894f-5f13-a7d5-45f69b98d3a2
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a34990>
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e02b9e1f-d018-53ad-aee6-3a244deb8367/e02b9e1f-d018-53ad-aee6-3a244deb8367_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/8e/e28e2a27623aef4c322549049fcb856a/pa/HM67583_0ed43855ca602ddd540ca0a05bf85fe4.jpg saved to cache
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e02b9e1f-d018-53ad-aee6-3a244deb8367
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1439c74950>
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb5e3243-f0df-5f0c-9880-1f2580b56834/fb5e3243-f0df-5f0c-9880-1f2580b56834_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/8d/c38d09bf4b7a258c092b57d3f5b188d5/pa/KR77136_e27fb4e91ee42f5842e3058dc6db65f2.jpg saved to cache
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fb5e3243-f0df-5f0c-9880-1f2580b56834
2026-04-27 07:54:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/89/c3893bc2f21b13da2314197f1c95b774/pa/PR21978_26b1b2db7b5e16512e9dff5107d09ca0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/8d/c38d09bf4b7a258c092b57d3f5b188d5/pa/KR77136_67d2ee36d960e68a1c61326d147dd781.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/22/9d2204321b9ed51eb97c7f7c65ba0e19/pa/TK52688_21de4cad5808bc4fc0141133e952a64b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/9f/779fc227974df518885145419d8f7c06/pa/SD98356_f3dfcca362e2c7f317d69e4e37d0544a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/89/c3893bc2f21b13da2314197f1c95b774/pa/PR21978_3682339a89a5156ec0c63d34685f69a2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143807ae10>
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14cb3e3e-3b06-5e7d-98fb-921773407ed3/14cb3e3e-3b06-5e7d-98fb-921773407ed3_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/22/9d2204321b9ed51eb97c7f7c65ba0e19/pa/TK52688_b66ed37f074167f525b510206d59deaa.jpg saved to cache
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 14cb3e3e-3b06-5e7d-98fb-921773407ed3
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143807a510>
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14cb3e3e-3b06-5e7d-98fb-921773407ed3/14cb3e3e-3b06-5e7d-98fb-921773407ed3_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/22/9d2204321b9ed51eb97c7f7c65ba0e19/pa/TK52688_041148aa614e9f896af3f5e177630231.jpg saved to cache
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 14cb3e3e-3b06-5e7d-98fb-921773407ed3
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c931d0>
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cc7290c-894f-5f13-a7d5-45f69b98d3a2/4cc7290c-894f-5f13-a7d5-45f69b98d3a2_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/89/c3893bc2f21b13da2314197f1c95b774/pa/PR21978_f5ccf536033e44f9220ac7c167850d32.jpg saved to cache
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4cc7290c-894f-5f13-a7d5-45f69b98d3a2
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438cd0e90>
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a337ac9-a885-5106-a620-c538fe5d548a/9a337ac9-a885-5106-a620-c538fe5d548a_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/9f/779fc227974df518885145419d8f7c06/pa/SD98356_ba1ab08b4bf207c2a29a8d4e3c8924a0.jpg saved to cache
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9a337ac9-a885-5106-a620-c538fe5d548a
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c91f10>
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a337ac9-a885-5106-a620-c538fe5d548a/9a337ac9-a885-5106-a620-c538fe5d548a_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/9f/779fc227974df518885145419d8f7c06/pa/SD98356_a3e05e99eab0e2e68e17ae7c52b25998.jpg saved to cache
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9a337ac9-a885-5106-a620-c538fe5d548a
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143804ec10>
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4b1e56d-919c-5273-a358-061840a577a1/e4b1e56d-919c-5273-a358-061840a577a1_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/5a/565a3281898b1ce2e445e105c06e8728/pa/DL16043_ae9b0f003f9c126adacfb72b53c51ccf.jpg saved to cache
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e4b1e56d-919c-5273-a358-061840a577a1
2026-04-27 07:54:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/9f/779fc227974df518885145419d8f7c06/pa/SD98356_b88ee878278ce12a6eb2d01049591fbb.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/22/9d2204321b9ed51eb97c7f7c65ba0e19/pa/TK52688_9953a8a72746e6dbc44306b23c2cd67a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/89/c3893bc2f21b13da2314197f1c95b774/pa/PR21978_7eb0c4d18982d3559fc3f0b6532e40f5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438e037d0>
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cc7290c-894f-5f13-a7d5-45f69b98d3a2/4cc7290c-894f-5f13-a7d5-45f69b98d3a2_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/89/c3893bc2f21b13da2314197f1c95b774/pa/PR21978_26b1b2db7b5e16512e9dff5107d09ca0.jpg saved to cache
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4cc7290c-894f-5f13-a7d5-45f69b98d3a2
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438aead50>
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb5e3243-f0df-5f0c-9880-1f2580b56834/fb5e3243-f0df-5f0c-9880-1f2580b56834_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/8d/c38d09bf4b7a258c092b57d3f5b188d5/pa/KR77136_67d2ee36d960e68a1c61326d147dd781.jpg saved to cache
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fb5e3243-f0df-5f0c-9880-1f2580b56834
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a4d8d0>
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14cb3e3e-3b06-5e7d-98fb-921773407ed3/14cb3e3e-3b06-5e7d-98fb-921773407ed3_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/22/9d2204321b9ed51eb97c7f7c65ba0e19/pa/TK52688_21de4cad5808bc4fc0141133e952a64b.jpg saved to cache
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 14cb3e3e-3b06-5e7d-98fb-921773407ed3
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438fb5690>
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a337ac9-a885-5106-a620-c538fe5d548a/9a337ac9-a885-5106-a620-c538fe5d548a_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/9f/779fc227974df518885145419d8f7c06/pa/SD98356_f3dfcca362e2c7f317d69e4e37d0544a.jpg saved to cache
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9a337ac9-a885-5106-a620-c538fe5d548a
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438e21a50>
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cc7290c-894f-5f13-a7d5-45f69b98d3a2/4cc7290c-894f-5f13-a7d5-45f69b98d3a2_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/89/c3893bc2f21b13da2314197f1c95b774/pa/PR21978_3682339a89a5156ec0c63d34685f69a2.jpg saved to cache
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4cc7290c-894f-5f13-a7d5-45f69b98d3a2
2026-04-27 07:54:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/22/9d2204321b9ed51eb97c7f7c65ba0e19/pa/TK52688_988d3ca0dab160892ecb538fa432007e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/8e/e28e2a27623aef4c322549049fcb856a/pa/HM67583_095f024c0a46e66c361fd441546b8bfa.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/9f/779fc227974df518885145419d8f7c06/pa/SD98356_be41fea463650ff239689b6187d00bf6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/8e/e28e2a27623aef4c322549049fcb856a/pa/HM67583_cc3c28d54199fae5238befa8577d198a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/89/c3893bc2f21b13da2314197f1c95b774/pa/PR21978_a1bbe32fd08535897480e27d38c0c29e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/5a/565a3281898b1ce2e445e105c06e8728/pa/DL16043_bff86f90b961f18b4f43dbf62443b476.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/89/c3893bc2f21b13da2314197f1c95b774/pa/PR21978_4b8091b9dab1627323a3a4946e3bd490.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ae9ed0>
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a337ac9-a885-5106-a620-c538fe5d548a/9a337ac9-a885-5106-a620-c538fe5d548a_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/9f/779fc227974df518885145419d8f7c06/pa/SD98356_b88ee878278ce12a6eb2d01049591fbb.jpg saved to cache
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9a337ac9-a885-5106-a620-c538fe5d548a
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438127210>
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14cb3e3e-3b06-5e7d-98fb-921773407ed3/14cb3e3e-3b06-5e7d-98fb-921773407ed3_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/22/9d2204321b9ed51eb97c7f7c65ba0e19/pa/TK52688_9953a8a72746e6dbc44306b23c2cd67a.jpg saved to cache
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 14cb3e3e-3b06-5e7d-98fb-921773407ed3
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14381515d0>
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cc7290c-894f-5f13-a7d5-45f69b98d3a2/4cc7290c-894f-5f13-a7d5-45f69b98d3a2_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/89/c3893bc2f21b13da2314197f1c95b774/pa/PR21978_7eb0c4d18982d3559fc3f0b6532e40f5.jpg saved to cache
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4cc7290c-894f-5f13-a7d5-45f69b98d3a2
2026-04-27 07:54:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/22/9d2204321b9ed51eb97c7f7c65ba0e19/pa/TK52688_bf8ad3df5df572a7d39ba84966bbf289.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/8d/c38d09bf4b7a258c092b57d3f5b188d5/pa/KR77136_4a746ce01ef4c2005ea2402fe1f97e67.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/8e/e28e2a27623aef4c322549049fcb856a/pa/HM67583_37da66969807b2f85929de422dd1e211.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438cc4950>
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14cb3e3e-3b06-5e7d-98fb-921773407ed3/14cb3e3e-3b06-5e7d-98fb-921773407ed3_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/22/9d2204321b9ed51eb97c7f7c65ba0e19/pa/TK52688_988d3ca0dab160892ecb538fa432007e.jpg saved to cache
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 14cb3e3e-3b06-5e7d-98fb-921773407ed3
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438f0add0>
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e02b9e1f-d018-53ad-aee6-3a244deb8367/e02b9e1f-d018-53ad-aee6-3a244deb8367_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/8e/e28e2a27623aef4c322549049fcb856a/pa/HM67583_095f024c0a46e66c361fd441546b8bfa.jpg saved to cache
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e02b9e1f-d018-53ad-aee6-3a244deb8367
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b5b050>
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a337ac9-a885-5106-a620-c538fe5d548a/9a337ac9-a885-5106-a620-c538fe5d548a_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/9f/779fc227974df518885145419d8f7c06/pa/SD98356_be41fea463650ff239689b6187d00bf6.jpg saved to cache
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9a337ac9-a885-5106-a620-c538fe5d548a
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ff0a10>
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e02b9e1f-d018-53ad-aee6-3a244deb8367/e02b9e1f-d018-53ad-aee6-3a244deb8367_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/8e/e28e2a27623aef4c322549049fcb856a/pa/HM67583_cc3c28d54199fae5238befa8577d198a.jpg saved to cache
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e02b9e1f-d018-53ad-aee6-3a244deb8367
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1439c37e10>
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cc7290c-894f-5f13-a7d5-45f69b98d3a2/4cc7290c-894f-5f13-a7d5-45f69b98d3a2_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/89/c3893bc2f21b13da2314197f1c95b774/pa/PR21978_a1bbe32fd08535897480e27d38c0c29e.jpg saved to cache
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4cc7290c-894f-5f13-a7d5-45f69b98d3a2
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438efe950>
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4b1e56d-919c-5273-a358-061840a577a1/e4b1e56d-919c-5273-a358-061840a577a1_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/5a/565a3281898b1ce2e445e105c06e8728/pa/DL16043_bff86f90b961f18b4f43dbf62443b476.jpg saved to cache
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e4b1e56d-919c-5273-a358-061840a577a1
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b5a0d0>
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cc7290c-894f-5f13-a7d5-45f69b98d3a2/4cc7290c-894f-5f13-a7d5-45f69b98d3a2_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/89/c3893bc2f21b13da2314197f1c95b774/pa/PR21978_4b8091b9dab1627323a3a4946e3bd490.jpg saved to cache
2026-04-27 07:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4cc7290c-894f-5f13-a7d5-45f69b98d3a2
2026-04-27 07:54:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/89/c3893bc2f21b13da2314197f1c95b774/pa/PR21978_e6663230873628b04eba0d362a2eea93.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/9f/779fc227974df518885145419d8f7c06/pa/SD98356_4d172216a872018fb2d6b30ee0331f82.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/5a/565a3281898b1ce2e445e105c06e8728/pa/DL16043_7bf8c05249c3ae666fb7faf86a4832cf.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/5a/565a3281898b1ce2e445e105c06e8728/pa/DL16043_dfd4fa4af72d3e66fc11a910c49f3eb9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/8d/c38d09bf4b7a258c092b57d3f5b188d5/pa/KR77136_93656faf52e08fb3ba2eaa61e6acbd05.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14477fd510>
2026-04-27 07:54:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14cb3e3e-3b06-5e7d-98fb-921773407ed3/14cb3e3e-3b06-5e7d-98fb-921773407ed3_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/22/9d2204321b9ed51eb97c7f7c65ba0e19/pa/TK52688_bf8ad3df5df572a7d39ba84966bbf289.jpg saved to cache
2026-04-27 07:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 14cb3e3e-3b06-5e7d-98fb-921773407ed3
2026-04-27 07:54:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 14cb3e3e-3b06-5e7d-98fb-921773407ed3, skipping ID generation
2026-04-27 07:54:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14cb3e3e-3b06-5e7d-98fb-921773407ed3 with scrape type 1
2026-04-27 07:54:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 14cb3e3e-3b06-5e7d-98fb-921773407ed3 sending to next pipeline
2026-04-27 07:54:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 14cb3e3e-3b06-5e7d-98fb-921773407ed3, identifier: TK52688
2026-04-27 07:54:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c99250>
2026-04-27 07:54:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb5e3243-f0df-5f0c-9880-1f2580b56834/fb5e3243-f0df-5f0c-9880-1f2580b56834_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/8d/c38d09bf4b7a258c092b57d3f5b188d5/pa/KR77136_4a746ce01ef4c2005ea2402fe1f97e67.jpg saved to cache
2026-04-27 07:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fb5e3243-f0df-5f0c-9880-1f2580b56834
2026-04-27 07:54:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438e7a2d0>
2026-04-27 07:54:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e02b9e1f-d018-53ad-aee6-3a244deb8367/e02b9e1f-d018-53ad-aee6-3a244deb8367_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/8e/e28e2a27623aef4c322549049fcb856a/pa/HM67583_37da66969807b2f85929de422dd1e211.jpg saved to cache
2026-04-27 07:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e02b9e1f-d018-53ad-aee6-3a244deb8367
2026-04-27 07:54:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/89/c3893bc2f21b13da2314197f1c95b774/pa/PR21978_592eb5c0c82b2687187cb06daa8d7cce.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 14cb3e3e-3b06-5e7d-98fb-921773407ed3 with identifier: TK52688
2026-04-27 07:54:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 14cb3e3e-3b06-5e7d-98fb-921773407ed3 with identifier: TK52688
2026-04-27 07:54:59 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 14cb3e3e-3b06-5e7d-98fb-921773407ed3 with identifier: TK52688 to the API
2026-04-27 07:54:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:00 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img9d/22/9d2204321b9ed51eb97c7f7c65ba0e19/pa/TK52688_bf8ad3df5df572a7d39ba84966bbf289.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': None,
 'city': 'Marckolsheim',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-04-28T15:12:24Z',
 'fuel_type': 'diesel',
 'id': '14cb3e3e-3b06-5e7d-98fb-921773407ed3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.1647,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TK52688',
 'listing': 'auction',
 'location': 'FR, Marckolsheim',
 'location_confidence': 'geocoded',
 'longitude': 7.544,
 'make': 'BMW',
 'model': '2er',
 'odometer': 163725,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_14cb3e3e-3b06-5e7d-98fb-921773407ed3/14cb3e3e-3b06-5e7d-98fb-921773407ed3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74221,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/22/9d2204321b9ed51eb97c7f7c65ba0e19/pa/TK52688_a79da755bfdba62326867b919767c135.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_14cb3e3e-3b06-5e7d-98fb-921773407ed3/14cb3e3e-3b06-5e7d-98fb-921773407ed3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66222,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/22/9d2204321b9ed51eb97c7f7c65ba0e19/pa/TK52688_1191c293106fd0d7073e7aee39626535.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_14cb3e3e-3b06-5e7d-98fb-921773407ed3/14cb3e3e-3b06-5e7d-98fb-921773407ed3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63980,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/22/9d2204321b9ed51eb97c7f7c65ba0e19/pa/TK52688_bf8ad3df5df572a7d39ba84966bbf289.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_14cb3e3e-3b06-5e7d-98fb-921773407ed3/14cb3e3e-3b06-5e7d-98fb-921773407ed3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59390,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/22/9d2204321b9ed51eb97c7f7c65ba0e19/pa/TK52688_e083e72371d43310d8c7d118b6b45017.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_14cb3e3e-3b06-5e7d-98fb-921773407ed3/14cb3e3e-3b06-5e7d-98fb-921773407ed3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59907,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/22/9d2204321b9ed51eb97c7f7c65ba0e19/pa/TK52688_eb9b311f93051097e83078aa04cc5de4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_14cb3e3e-3b06-5e7d-98fb-921773407ed3/14cb3e3e-3b06-5e7d-98fb-921773407ed3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62738,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/22/9d2204321b9ed51eb97c7f7c65ba0e19/pa/TK52688_b66ed37f074167f525b510206d59deaa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_14cb3e3e-3b06-5e7d-98fb-921773407ed3/14cb3e3e-3b06-5e7d-98fb-921773407ed3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52704,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/22/9d2204321b9ed51eb97c7f7c65ba0e19/pa/TK52688_041148aa614e9f896af3f5e177630231.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_14cb3e3e-3b06-5e7d-98fb-921773407ed3/14cb3e3e-3b06-5e7d-98fb-921773407ed3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71596,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/22/9d2204321b9ed51eb97c7f7c65ba0e19/pa/TK52688_9953a8a72746e6dbc44306b23c2cd67a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_14cb3e3e-3b06-5e7d-98fb-921773407ed3/14cb3e3e-3b06-5e7d-98fb-921773407ed3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69180,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/22/9d2204321b9ed51eb97c7f7c65ba0e19/pa/TK52688_21de4cad5808bc4fc0141133e952a64b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_14cb3e3e-3b06-5e7d-98fb-921773407ed3/14cb3e3e-3b06-5e7d-98fb-921773407ed3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59348,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/22/9d2204321b9ed51eb97c7f7c65ba0e19/pa/TK52688_988d3ca0dab160892ecb538fa432007e.jpg',
             'Width': 800}],
 'postal_code': '67390',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Bas-Rhin',
 'province_code': 'FR-67',
 'region': 'Grand Est',
 'region_code': 'FR-44',
 'registration_date': '2016-12-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 2er 220d Active Tourer xDrive Sport Line',
 'transmission': 'automatic',
 'trim': 'xDrive Sport Line',
 'year': 2016}
2026-04-27 07:55:00 [auto1.fr] INFO: Saving data for TK52688: {'created_time': 1777276500.226297, 'last_price_update_time': 1777276500.226309, 'has_photos': True, 'auction_closing_time': 1777389144.0}
2026-04-27 07:55:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/8e/e28e2a27623aef4c322549049fcb856a/pa/HM67583_8a186d6fcd3daca2b53dd9470776c27f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:00 [scrapy.extensions.logstats] INFO: Crawled 79 pages (at 79 pages/min), scraped 28 items (at 28 items/min)
2026-04-27 07:55:00 [scrapy.extensions.memusage] INFO: Peak memory usage is 368MiB
2026-04-27 07:55:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/8e/e28e2a27623aef4c322549049fcb856a/pa/HM67583_1c2bb4e3a23eb7bd867e2db641c896c9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/8e/e28e2a27623aef4c322549049fcb856a/pa/HM67583_ee0eb452c2892bb183996aca42d03b19.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/8d/c38d09bf4b7a258c092b57d3f5b188d5/pa/KR77136_2ff9a080c4f24913b9987e9cd56eb492.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/5a/565a3281898b1ce2e445e105c06e8728/pa/DL16043_269a6a2a54fe02a73772418d8897c460.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/42/2742f94a6e5cb7f882081920df20b721/pa/SA02986_8641ff3f4636bec5874aa7b9e5261e26.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/5a/565a3281898b1ce2e445e105c06e8728/pa/DL16043_957c2dafb04ba07cdefe6bca3bde00a3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14478b2450>
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cc7290c-894f-5f13-a7d5-45f69b98d3a2/4cc7290c-894f-5f13-a7d5-45f69b98d3a2_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/89/c3893bc2f21b13da2314197f1c95b774/pa/PR21978_e6663230873628b04eba0d362a2eea93.jpg saved to cache
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4cc7290c-894f-5f13-a7d5-45f69b98d3a2
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ad1510>
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a337ac9-a885-5106-a620-c538fe5d548a/9a337ac9-a885-5106-a620-c538fe5d548a_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/9f/779fc227974df518885145419d8f7c06/pa/SD98356_4d172216a872018fb2d6b30ee0331f82.jpg saved to cache
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9a337ac9-a885-5106-a620-c538fe5d548a
2026-04-27 07:55:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9a337ac9-a885-5106-a620-c538fe5d548a, skipping ID generation
2026-04-27 07:55:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a337ac9-a885-5106-a620-c538fe5d548a with scrape type 1
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9a337ac9-a885-5106-a620-c538fe5d548a sending to next pipeline
2026-04-27 07:55:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 9a337ac9-a885-5106-a620-c538fe5d548a, identifier: SD98356
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a493d0>
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4b1e56d-919c-5273-a358-061840a577a1/e4b1e56d-919c-5273-a358-061840a577a1_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/5a/565a3281898b1ce2e445e105c06e8728/pa/DL16043_7bf8c05249c3ae666fb7faf86a4832cf.jpg saved to cache
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e4b1e56d-919c-5273-a358-061840a577a1
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438152a50>
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4b1e56d-919c-5273-a358-061840a577a1/e4b1e56d-919c-5273-a358-061840a577a1_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/5a/565a3281898b1ce2e445e105c06e8728/pa/DL16043_dfd4fa4af72d3e66fc11a910c49f3eb9.jpg saved to cache
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e4b1e56d-919c-5273-a358-061840a577a1
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1447b83890>
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb5e3243-f0df-5f0c-9880-1f2580b56834/fb5e3243-f0df-5f0c-9880-1f2580b56834_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/8d/c38d09bf4b7a258c092b57d3f5b188d5/pa/KR77136_93656faf52e08fb3ba2eaa61e6acbd05.jpg saved to cache
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fb5e3243-f0df-5f0c-9880-1f2580b56834
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d59410>
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cc7290c-894f-5f13-a7d5-45f69b98d3a2/4cc7290c-894f-5f13-a7d5-45f69b98d3a2_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/89/c3893bc2f21b13da2314197f1c95b774/pa/PR21978_592eb5c0c82b2687187cb06daa8d7cce.jpg saved to cache
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4cc7290c-894f-5f13-a7d5-45f69b98d3a2
2026-04-27 07:55:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4cc7290c-894f-5f13-a7d5-45f69b98d3a2, skipping ID generation
2026-04-27 07:55:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4cc7290c-894f-5f13-a7d5-45f69b98d3a2 with scrape type 1
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4cc7290c-894f-5f13-a7d5-45f69b98d3a2 sending to next pipeline
2026-04-27 07:55:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4cc7290c-894f-5f13-a7d5-45f69b98d3a2, identifier: PR21978
2026-04-27 07:55:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 9a337ac9-a885-5106-a620-c538fe5d548a with identifier: SD98356
2026-04-27 07:55:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 9a337ac9-a885-5106-a620-c538fe5d548a with identifier: SD98356
2026-04-27 07:55:01 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 9a337ac9-a885-5106-a620-c538fe5d548a with identifier: SD98356 to the API
2026-04-27 07:55:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:01 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img77/9f/779fc227974df518885145419d8f7c06/pa/SD98356_4d172216a872018fb2d6b30ee0331f82.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'category': None,
 'city': 'Villenoy',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.1L',
 'engine_horse_power': 135,
 'expiration_date': '2026-04-28T15:25:25Z',
 'fuel_type': 'diesel',
 'id': '9a337ac9-a885-5106-a620-c538fe5d548a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.9411,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD98356',
 'listing': 'auction',
 'location': 'FR, Villenoy',
 'location_confidence': 'geocoded',
 'longitude': 2.8602,
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 256564,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9a337ac9-a885-5106-a620-c538fe5d548a/9a337ac9-a885-5106-a620-c538fe5d548a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73645,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/9f/779fc227974df518885145419d8f7c06/pa/SD98356_b34db0e5e1fa5cd3cdf800bf0605f1df.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9a337ac9-a885-5106-a620-c538fe5d548a/9a337ac9-a885-5106-a620-c538fe5d548a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74934,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/9f/779fc227974df518885145419d8f7c06/pa/SD98356_f0df9c10085491c7c105fec113cca495.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9a337ac9-a885-5106-a620-c538fe5d548a/9a337ac9-a885-5106-a620-c538fe5d548a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67290,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/9f/779fc227974df518885145419d8f7c06/pa/SD98356_4d172216a872018fb2d6b30ee0331f82.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9a337ac9-a885-5106-a620-c538fe5d548a/9a337ac9-a885-5106-a620-c538fe5d548a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61030,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/9f/779fc227974df518885145419d8f7c06/pa/SD98356_39a07d71d9bbe77bd81791a7f31324dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9a337ac9-a885-5106-a620-c538fe5d548a/9a337ac9-a885-5106-a620-c538fe5d548a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63391,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/9f/779fc227974df518885145419d8f7c06/pa/SD98356_fc6d9f8b5c597989679168995e93112e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9a337ac9-a885-5106-a620-c538fe5d548a/9a337ac9-a885-5106-a620-c538fe5d548a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70908,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/9f/779fc227974df518885145419d8f7c06/pa/SD98356_a3e05e99eab0e2e68e17ae7c52b25998.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9a337ac9-a885-5106-a620-c538fe5d548a/9a337ac9-a885-5106-a620-c538fe5d548a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61718,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/9f/779fc227974df518885145419d8f7c06/pa/SD98356_ba1ab08b4bf207c2a29a8d4e3c8924a0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9a337ac9-a885-5106-a620-c538fe5d548a/9a337ac9-a885-5106-a620-c538fe5d548a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73471,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/9f/779fc227974df518885145419d8f7c06/pa/SD98356_b88ee878278ce12a6eb2d01049591fbb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9a337ac9-a885-5106-a620-c538fe5d548a/9a337ac9-a885-5106-a620-c538fe5d548a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71346,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/9f/779fc227974df518885145419d8f7c06/pa/SD98356_f3dfcca362e2c7f317d69e4e37d0544a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9a337ac9-a885-5106-a620-c538fe5d548a/9a337ac9-a885-5106-a620-c538fe5d548a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53578,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/9f/779fc227974df518885145419d8f7c06/pa/SD98356_be41fea463650ff239689b6187d00bf6.jpg',
             'Width': 800}],
 'postal_code': '77124',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Seine-et-Marne',
 'province_code': 'FR-77',
 'region': 'Île-de-France',
 'region_code': 'FR-11',
 'registration_date': '2019-04-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 200 d Business',
 'transmission': 'automatic',
 'trim': 'Business',
 'year': 2019}
2026-04-27 07:55:01 [auto1.fr] INFO: Saving data for SD98356: {'created_time': 1777276501.924995, 'last_price_update_time': 1777276501.925011, 'has_photos': True, 'auction_closing_time': 1777389925.0}
2026-04-27 07:55:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4cc7290c-894f-5f13-a7d5-45f69b98d3a2 with identifier: PR21978
2026-04-27 07:55:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4cc7290c-894f-5f13-a7d5-45f69b98d3a2 with identifier: PR21978
2026-04-27 07:55:02 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 4cc7290c-894f-5f13-a7d5-45f69b98d3a2 with identifier: PR21978 to the API
2026-04-27 07:55:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:02 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc3/89/c3893bc2f21b13da2314197f1c95b774/pa/PR21978_592eb5c0c82b2687187cb06daa8d7cce.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'city': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.0L',
 'engine_horse_power': 125,
 'expiration_date': '2026-04-28T15:52:11Z',
 'fuel_type': 'petrol',
 'id': '4cc7290c-894f-5f13-a7d5-45f69b98d3a2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PR21978',
 'listing': 'auction',
 'location': 'FR',
 'location_confidence': None,
 'longitude': None,
 'make': 'Ford',
 'model': 'B-Max',
 'odometer': 169612,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 19,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4cc7290c-894f-5f13-a7d5-45f69b98d3a2/4cc7290c-894f-5f13-a7d5-45f69b98d3a2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43179,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/89/c3893bc2f21b13da2314197f1c95b774/pa/PR21978_592eb5c0c82b2687187cb06daa8d7cce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4cc7290c-894f-5f13-a7d5-45f69b98d3a2/4cc7290c-894f-5f13-a7d5-45f69b98d3a2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42237,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/89/c3893bc2f21b13da2314197f1c95b774/pa/PR21978_fd50d7cf13655961e8b8f312a09e3381.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4cc7290c-894f-5f13-a7d5-45f69b98d3a2/4cc7290c-894f-5f13-a7d5-45f69b98d3a2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44497,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/89/c3893bc2f21b13da2314197f1c95b774/pa/PR21978_e6663230873628b04eba0d362a2eea93.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4cc7290c-894f-5f13-a7d5-45f69b98d3a2/4cc7290c-894f-5f13-a7d5-45f69b98d3a2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35353,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/89/c3893bc2f21b13da2314197f1c95b774/pa/PR21978_a1bbe32fd08535897480e27d38c0c29e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4cc7290c-894f-5f13-a7d5-45f69b98d3a2/4cc7290c-894f-5f13-a7d5-45f69b98d3a2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42285,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/89/c3893bc2f21b13da2314197f1c95b774/pa/PR21978_24a62cda1294e3c075a2fab739b5f3fa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4cc7290c-894f-5f13-a7d5-45f69b98d3a2/4cc7290c-894f-5f13-a7d5-45f69b98d3a2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103307,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/89/c3893bc2f21b13da2314197f1c95b774/pa/PR21978_3682339a89a5156ec0c63d34685f69a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4cc7290c-894f-5f13-a7d5-45f69b98d3a2/4cc7290c-894f-5f13-a7d5-45f69b98d3a2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35706,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/89/c3893bc2f21b13da2314197f1c95b774/pa/PR21978_f5ccf536033e44f9220ac7c167850d32.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4cc7290c-894f-5f13-a7d5-45f69b98d3a2/4cc7290c-894f-5f13-a7d5-45f69b98d3a2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99457,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/89/c3893bc2f21b13da2314197f1c95b774/pa/PR21978_7eb0c4d18982d3559fc3f0b6532e40f5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4cc7290c-894f-5f13-a7d5-45f69b98d3a2/4cc7290c-894f-5f13-a7d5-45f69b98d3a2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59982,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/89/c3893bc2f21b13da2314197f1c95b774/pa/PR21978_26b1b2db7b5e16512e9dff5107d09ca0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4cc7290c-894f-5f13-a7d5-45f69b98d3a2/4cc7290c-894f-5f13-a7d5-45f69b98d3a2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68299,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/89/c3893bc2f21b13da2314197f1c95b774/pa/PR21978_4b8091b9dab1627323a3a4946e3bd490.jpg',
             'Width': 800}],
 'postal_code': None,
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2015-06-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford B-Max 1.0 EcoBoost Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2015}
2026-04-27 07:55:02 [auto1.fr] INFO: Saving data for PR21978: {'created_time': 1777276502.409124, 'last_price_update_time': 1777276502.409135, 'has_photos': True, 'auction_closing_time': 1777391531.0}
2026-04-27 07:55:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/ed/4ded2608ed9a75a9297527d23fa3ce1a/pa/CY19379_caa34bd5129475867d3d5f6d33c1b436.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/ed/4ded2608ed9a75a9297527d23fa3ce1a/pa/CY19379_2a83f71af67430f6e8c4a9147c730c94.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/ed/4ded2608ed9a75a9297527d23fa3ce1a/pa/CY19379_d26b56f3321171d7d5763156bb23092a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/ed/4ded2608ed9a75a9297527d23fa3ce1a/pa/CY19379_8bc2ce9c3bfaeccfc84c589096730338.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/ed/4ded2608ed9a75a9297527d23fa3ce1a/pa/CY19379_1a3e17ff98e87eb8b352e4e39763258d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/c2/d6c2d7896dd17ebe2e3e9b1263fddee0/pa/KN31501_a78051e69970803a91ee6d77d8eed5d1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/42/2742f94a6e5cb7f882081920df20b721/pa/SA02986_1a07a7eeac0802a50c14556f46be1094.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d0b850>
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e02b9e1f-d018-53ad-aee6-3a244deb8367/e02b9e1f-d018-53ad-aee6-3a244deb8367_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/8e/e28e2a27623aef4c322549049fcb856a/pa/HM67583_8a186d6fcd3daca2b53dd9470776c27f.jpg saved to cache
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e02b9e1f-d018-53ad-aee6-3a244deb8367
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438cfb490>
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e02b9e1f-d018-53ad-aee6-3a244deb8367/e02b9e1f-d018-53ad-aee6-3a244deb8367_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/8e/e28e2a27623aef4c322549049fcb856a/pa/HM67583_1c2bb4e3a23eb7bd867e2db641c896c9.jpg saved to cache
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e02b9e1f-d018-53ad-aee6-3a244deb8367
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438bc5d10>
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e02b9e1f-d018-53ad-aee6-3a244deb8367/e02b9e1f-d018-53ad-aee6-3a244deb8367_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/8e/e28e2a27623aef4c322549049fcb856a/pa/HM67583_ee0eb452c2892bb183996aca42d03b19.jpg saved to cache
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e02b9e1f-d018-53ad-aee6-3a244deb8367
2026-04-27 07:55:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e02b9e1f-d018-53ad-aee6-3a244deb8367, skipping ID generation
2026-04-27 07:55:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e02b9e1f-d018-53ad-aee6-3a244deb8367 with scrape type 1
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e02b9e1f-d018-53ad-aee6-3a244deb8367 sending to next pipeline
2026-04-27 07:55:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e02b9e1f-d018-53ad-aee6-3a244deb8367, identifier: HM67583
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14478d84d0>
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb5e3243-f0df-5f0c-9880-1f2580b56834/fb5e3243-f0df-5f0c-9880-1f2580b56834_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/8d/c38d09bf4b7a258c092b57d3f5b188d5/pa/KR77136_2ff9a080c4f24913b9987e9cd56eb492.jpg saved to cache
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fb5e3243-f0df-5f0c-9880-1f2580b56834
2026-04-27 07:55:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fb5e3243-f0df-5f0c-9880-1f2580b56834, skipping ID generation
2026-04-27 07:55:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb5e3243-f0df-5f0c-9880-1f2580b56834 with scrape type 1
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fb5e3243-f0df-5f0c-9880-1f2580b56834 sending to next pipeline
2026-04-27 07:55:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: fb5e3243-f0df-5f0c-9880-1f2580b56834, identifier: KR77136
2026-04-27 07:55:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438cfb910>
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4b1e56d-919c-5273-a358-061840a577a1/e4b1e56d-919c-5273-a358-061840a577a1_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/5a/565a3281898b1ce2e445e105c06e8728/pa/DL16043_269a6a2a54fe02a73772418d8897c460.jpg saved to cache
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e4b1e56d-919c-5273-a358-061840a577a1
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438125250>
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a70c0496-bd82-59e0-97a4-a74b79811589/a70c0496-bd82-59e0-97a4-a74b79811589_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/42/2742f94a6e5cb7f882081920df20b721/pa/SA02986_8641ff3f4636bec5874aa7b9e5261e26.jpg saved to cache
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a70c0496-bd82-59e0-97a4-a74b79811589
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143804ca90>
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4b1e56d-919c-5273-a358-061840a577a1/e4b1e56d-919c-5273-a358-061840a577a1_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/5a/565a3281898b1ce2e445e105c06e8728/pa/DL16043_957c2dafb04ba07cdefe6bca3bde00a3.jpg saved to cache
2026-04-27 07:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e4b1e56d-919c-5273-a358-061840a577a1
2026-04-27 07:55:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e4b1e56d-919c-5273-a358-061840a577a1, skipping ID generation
2026-04-27 07:55:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4b1e56d-919c-5273-a358-061840a577a1 with scrape type 1
2026-04-27 07:55:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e4b1e56d-919c-5273-a358-061840a577a1 sending to next pipeline
2026-04-27 07:55:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e4b1e56d-919c-5273-a358-061840a577a1, identifier: DL16043
2026-04-27 07:55:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e02b9e1f-d018-53ad-aee6-3a244deb8367 with identifier: HM67583
2026-04-27 07:55:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e02b9e1f-d018-53ad-aee6-3a244deb8367 with identifier: HM67583
2026-04-27 07:55:03 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e02b9e1f-d018-53ad-aee6-3a244deb8367 with identifier: HM67583 to the API
2026-04-27 07:55:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:03 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge2/8e/e28e2a27623aef4c322549049fcb856a/pa/HM67583_ee0eb452c2892bb183996aca42d03b19.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'category': None,
 'city': 'Artigues-près-Bordeaux',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 100,
 'expiration_date': '2026-04-28T15:23:26Z',
 'fuel_type': 'petrol',
 'id': 'e02b9e1f-d018-53ad-aee6-3a244deb8367',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 44.8589,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HM67583',
 'listing': 'auction',
 'location': 'FR, Artigues-près-Bordeaux',
 'location_confidence': 'geocoded',
 'longitude': -0.4972,
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 68203,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e02b9e1f-d018-53ad-aee6-3a244deb8367/e02b9e1f-d018-53ad-aee6-3a244deb8367_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62107,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/8e/e28e2a27623aef4c322549049fcb856a/pa/HM67583_e2bfbe43d317ce682d354f40194c0640.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e02b9e1f-d018-53ad-aee6-3a244deb8367/e02b9e1f-d018-53ad-aee6-3a244deb8367_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62927,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/8e/e28e2a27623aef4c322549049fcb856a/pa/HM67583_1c2bb4e3a23eb7bd867e2db641c896c9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e02b9e1f-d018-53ad-aee6-3a244deb8367/e02b9e1f-d018-53ad-aee6-3a244deb8367_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61608,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/8e/e28e2a27623aef4c322549049fcb856a/pa/HM67583_4e54de82f69a66f352b8ecca7ee28c4e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e02b9e1f-d018-53ad-aee6-3a244deb8367/e02b9e1f-d018-53ad-aee6-3a244deb8367_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56677,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/8e/e28e2a27623aef4c322549049fcb856a/pa/HM67583_d620947ef3686e9aba009894b5cc4034.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e02b9e1f-d018-53ad-aee6-3a244deb8367/e02b9e1f-d018-53ad-aee6-3a244deb8367_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59835,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/8e/e28e2a27623aef4c322549049fcb856a/pa/HM67583_ee0eb452c2892bb183996aca42d03b19.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e02b9e1f-d018-53ad-aee6-3a244deb8367/e02b9e1f-d018-53ad-aee6-3a244deb8367_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65333,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/8e/e28e2a27623aef4c322549049fcb856a/pa/HM67583_0ed43855ca602ddd540ca0a05bf85fe4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e02b9e1f-d018-53ad-aee6-3a244deb8367/e02b9e1f-d018-53ad-aee6-3a244deb8367_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48659,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/8e/e28e2a27623aef4c322549049fcb856a/pa/HM67583_8a186d6fcd3daca2b53dd9470776c27f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e02b9e1f-d018-53ad-aee6-3a244deb8367/e02b9e1f-d018-53ad-aee6-3a244deb8367_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68087,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/8e/e28e2a27623aef4c322549049fcb856a/pa/HM67583_37da66969807b2f85929de422dd1e211.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e02b9e1f-d018-53ad-aee6-3a244deb8367/e02b9e1f-d018-53ad-aee6-3a244deb8367_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60754,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/8e/e28e2a27623aef4c322549049fcb856a/pa/HM67583_cc3c28d54199fae5238befa8577d198a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e02b9e1f-d018-53ad-aee6-3a244deb8367/e02b9e1f-d018-53ad-aee6-3a244deb8367_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53549,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/8e/e28e2a27623aef4c322549049fcb856a/pa/HM67583_095f024c0a46e66c361fd441546b8bfa.jpg',
             'Width': 800}],
 'postal_code': '33370',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Gironde',
 'province_code': 'FR-33',
 'region': 'Nouvelle-Aquitaine',
 'region_code': 'FR-75',
 'registration_date': '2016-05-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2016}
2026-04-27 07:55:03 [auto1.fr] INFO: Saving data for HM67583: {'created_time': 1777276503.495011, 'last_price_update_time': 1777276503.49502, 'has_photos': True, 'auction_closing_time': 1777389806.0}
2026-04-27 07:55:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: fb5e3243-f0df-5f0c-9880-1f2580b56834 with identifier: KR77136
2026-04-27 07:55:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: fb5e3243-f0df-5f0c-9880-1f2580b56834 with identifier: KR77136
2026-04-27 07:55:03 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: fb5e3243-f0df-5f0c-9880-1f2580b56834 with identifier: KR77136 to the API
2026-04-27 07:55:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:03 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc3/8d/c38d09bf4b7a258c092b57d3f5b188d5/pa/KR77136_2ff9a080c4f24913b9987e9cd56eb492.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 158,
 'category': None,
 'city': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 88,
 'expiration_date': '2026-04-28T15:12:42Z',
 'fuel_type': 'petrol',
 'id': 'fb5e3243-f0df-5f0c-9880-1f2580b56834',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KR77136',
 'listing': 'auction',
 'location': 'FR',
 'location_confidence': None,
 'longitude': None,
 'make': 'Nissan',
 'model': 'Micra',
 'odometer': 127839,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fb5e3243-f0df-5f0c-9880-1f2580b56834/fb5e3243-f0df-5f0c-9880-1f2580b56834_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87465,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/8d/c38d09bf4b7a258c092b57d3f5b188d5/pa/KR77136_139bdd30c9dd756c081e464c08dfae54.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fb5e3243-f0df-5f0c-9880-1f2580b56834/fb5e3243-f0df-5f0c-9880-1f2580b56834_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88332,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/8d/c38d09bf4b7a258c092b57d3f5b188d5/pa/KR77136_57c648835d87a1186ab59a2e2e12d8af.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fb5e3243-f0df-5f0c-9880-1f2580b56834/fb5e3243-f0df-5f0c-9880-1f2580b56834_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81439,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/8d/c38d09bf4b7a258c092b57d3f5b188d5/pa/KR77136_433608f520d403794d3b68cdeec08d85.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fb5e3243-f0df-5f0c-9880-1f2580b56834/fb5e3243-f0df-5f0c-9880-1f2580b56834_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70556,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/8d/c38d09bf4b7a258c092b57d3f5b188d5/pa/KR77136_f054bd145897feae580848e7d1f1f986.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fb5e3243-f0df-5f0c-9880-1f2580b56834/fb5e3243-f0df-5f0c-9880-1f2580b56834_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80696,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/8d/c38d09bf4b7a258c092b57d3f5b188d5/pa/KR77136_2ff9a080c4f24913b9987e9cd56eb492.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fb5e3243-f0df-5f0c-9880-1f2580b56834/fb5e3243-f0df-5f0c-9880-1f2580b56834_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95251,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/8d/c38d09bf4b7a258c092b57d3f5b188d5/pa/KR77136_fd2bf6b8f399552a3cb71e15409c0340.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fb5e3243-f0df-5f0c-9880-1f2580b56834/fb5e3243-f0df-5f0c-9880-1f2580b56834_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81187,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/8d/c38d09bf4b7a258c092b57d3f5b188d5/pa/KR77136_93656faf52e08fb3ba2eaa61e6acbd05.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fb5e3243-f0df-5f0c-9880-1f2580b56834/fb5e3243-f0df-5f0c-9880-1f2580b56834_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103520,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/8d/c38d09bf4b7a258c092b57d3f5b188d5/pa/KR77136_4a746ce01ef4c2005ea2402fe1f97e67.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fb5e3243-f0df-5f0c-9880-1f2580b56834/fb5e3243-f0df-5f0c-9880-1f2580b56834_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92899,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/8d/c38d09bf4b7a258c092b57d3f5b188d5/pa/KR77136_e27fb4e91ee42f5842e3058dc6db65f2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fb5e3243-f0df-5f0c-9880-1f2580b56834/fb5e3243-f0df-5f0c-9880-1f2580b56834_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66549,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/8d/c38d09bf4b7a258c092b57d3f5b188d5/pa/KR77136_67d2ee36d960e68a1c61326d147dd781.jpg',
             'Width': 800}],
 'postal_code': None,
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2008-06-26',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Nissan Micra 1.4 Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2008}
2026-04-27 07:55:03 [auto1.fr] INFO: Saving data for KR77136: {'created_time': 1777276503.872159, 'last_price_update_time': 1777276503.872171, 'has_photos': True, 'auction_closing_time': 1777389162.0}
2026-04-27 07:55:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e4b1e56d-919c-5273-a358-061840a577a1 with identifier: DL16043
2026-04-27 07:55:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e4b1e56d-919c-5273-a358-061840a577a1 with identifier: DL16043
2026-04-27 07:55:04 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e4b1e56d-919c-5273-a358-061840a577a1 with identifier: DL16043 to the API
2026-04-27 07:55:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:04 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img56/5a/565a3281898b1ce2e445e105c06e8728/pa/DL16043_957c2dafb04ba07cdefe6bca3bde00a3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'city': 'Châtillon',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 95,
 'expiration_date': '2026-04-28T15:18:05Z',
 'fuel_type': 'petrol',
 'id': 'e4b1e56d-919c-5273-a358-061840a577a1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.8024,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DL16043',
 'listing': 'auction',
 'location': 'FR, Châtillon',
 'location_confidence': 'geocoded',
 'longitude': 2.2935,
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 65546,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e4b1e56d-919c-5273-a358-061840a577a1/e4b1e56d-919c-5273-a358-061840a577a1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93025,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/5a/565a3281898b1ce2e445e105c06e8728/pa/DL16043_d6fdb7fadc02d3700dbffa4f0407bb52.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e4b1e56d-919c-5273-a358-061840a577a1/e4b1e56d-919c-5273-a358-061840a577a1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90541,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/5a/565a3281898b1ce2e445e105c06e8728/pa/DL16043_127fa1237f953741cd5bd0ae501e6668.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e4b1e56d-919c-5273-a358-061840a577a1/e4b1e56d-919c-5273-a358-061840a577a1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87436,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/5a/565a3281898b1ce2e445e105c06e8728/pa/DL16043_3094581f83e56e45d1955194c77ed33a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e4b1e56d-919c-5273-a358-061840a577a1/e4b1e56d-919c-5273-a358-061840a577a1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2860599,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img56/5a/565a3281898b1ce2e445e105c06e8728/pa/DL16043_269a6a2a54fe02a73772418d8897c460.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e4b1e56d-919c-5273-a358-061840a577a1/e4b1e56d-919c-5273-a358-061840a577a1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75173,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/5a/565a3281898b1ce2e445e105c06e8728/pa/DL16043_957c2dafb04ba07cdefe6bca3bde00a3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e4b1e56d-919c-5273-a358-061840a577a1/e4b1e56d-919c-5273-a358-061840a577a1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76429,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/5a/565a3281898b1ce2e445e105c06e8728/pa/DL16043_fba2984898e7f08e238cdc48b7f95d98.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e4b1e56d-919c-5273-a358-061840a577a1/e4b1e56d-919c-5273-a358-061840a577a1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64959,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/5a/565a3281898b1ce2e445e105c06e8728/pa/DL16043_dfd4fa4af72d3e66fc11a910c49f3eb9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e4b1e56d-919c-5273-a358-061840a577a1/e4b1e56d-919c-5273-a358-061840a577a1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82685,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/5a/565a3281898b1ce2e445e105c06e8728/pa/DL16043_7bf8c05249c3ae666fb7faf86a4832cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e4b1e56d-919c-5273-a358-061840a577a1/e4b1e56d-919c-5273-a358-061840a577a1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84517,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/5a/565a3281898b1ce2e445e105c06e8728/pa/DL16043_ae9b0f003f9c126adacfb72b53c51ccf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e4b1e56d-919c-5273-a358-061840a577a1/e4b1e56d-919c-5273-a358-061840a577a1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76291,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/5a/565a3281898b1ce2e445e105c06e8728/pa/DL16043_bff86f90b961f18b4f43dbf62443b476.jpg',
             'Width': 800}],
 'postal_code': '92320',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Hauts-de-Seine',
 'province_code': 'FR-92',
 'region': 'Île-de-France',
 'region_code': 'FR-11',
 'registration_date': '2010-03-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 1.4 VTi Exclusive',
 'transmission': 'manual',
 'trim': 'Exclusive',
 'year': 2010}
2026-04-27 07:55:04 [auto1.fr] INFO: Saving data for DL16043: {'created_time': 1777276504.279911, 'last_price_update_time': 1777276504.27992, 'has_photos': True, 'auction_closing_time': 1777389485.0}
2026-04-27 07:55:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438fbbe90>
2026-04-27 07:55:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6229fc14-cb4f-5c50-a11b-bcf1be8c1f2e/6229fc14-cb4f-5c50-a11b-bcf1be8c1f2e_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/ed/4ded2608ed9a75a9297527d23fa3ce1a/pa/CY19379_caa34bd5129475867d3d5f6d33c1b436.jpg saved to cache
2026-04-27 07:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6229fc14-cb4f-5c50-a11b-bcf1be8c1f2e
2026-04-27 07:55:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438be8410>
2026-04-27 07:55:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6229fc14-cb4f-5c50-a11b-bcf1be8c1f2e/6229fc14-cb4f-5c50-a11b-bcf1be8c1f2e_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/ed/4ded2608ed9a75a9297527d23fa3ce1a/pa/CY19379_2a83f71af67430f6e8c4a9147c730c94.jpg saved to cache
2026-04-27 07:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6229fc14-cb4f-5c50-a11b-bcf1be8c1f2e
2026-04-27 07:55:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b1ddd0>
2026-04-27 07:55:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6229fc14-cb4f-5c50-a11b-bcf1be8c1f2e/6229fc14-cb4f-5c50-a11b-bcf1be8c1f2e_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/ed/4ded2608ed9a75a9297527d23fa3ce1a/pa/CY19379_d26b56f3321171d7d5763156bb23092a.jpg saved to cache
2026-04-27 07:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6229fc14-cb4f-5c50-a11b-bcf1be8c1f2e
2026-04-27 07:55:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c666d0>
2026-04-27 07:55:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6229fc14-cb4f-5c50-a11b-bcf1be8c1f2e/6229fc14-cb4f-5c50-a11b-bcf1be8c1f2e_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/ed/4ded2608ed9a75a9297527d23fa3ce1a/pa/CY19379_8bc2ce9c3bfaeccfc84c589096730338.jpg saved to cache
2026-04-27 07:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6229fc14-cb4f-5c50-a11b-bcf1be8c1f2e
2026-04-27 07:55:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438be2ad0>
2026-04-27 07:55:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6229fc14-cb4f-5c50-a11b-bcf1be8c1f2e/6229fc14-cb4f-5c50-a11b-bcf1be8c1f2e_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/ed/4ded2608ed9a75a9297527d23fa3ce1a/pa/CY19379_1a3e17ff98e87eb8b352e4e39763258d.jpg saved to cache
2026-04-27 07:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6229fc14-cb4f-5c50-a11b-bcf1be8c1f2e
2026-04-27 07:55:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6229fc14-cb4f-5c50-a11b-bcf1be8c1f2e, skipping ID generation
2026-04-27 07:55:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6229fc14-cb4f-5c50-a11b-bcf1be8c1f2e with scrape type 1
2026-04-27 07:55:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6229fc14-cb4f-5c50-a11b-bcf1be8c1f2e sending to next pipeline
2026-04-27 07:55:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6229fc14-cb4f-5c50-a11b-bcf1be8c1f2e, identifier: CY19379
2026-04-27 07:55:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14477fc790>
2026-04-27 07:55:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cf21ca6-d13a-5d18-81df-cddd84e82021/6cf21ca6-d13a-5d18-81df-cddd84e82021_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/c2/d6c2d7896dd17ebe2e3e9b1263fddee0/pa/KN31501_a78051e69970803a91ee6d77d8eed5d1.jpg saved to cache
2026-04-27 07:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6cf21ca6-d13a-5d18-81df-cddd84e82021
2026-04-27 07:55:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6cf21ca6-d13a-5d18-81df-cddd84e82021, skipping ID generation
2026-04-27 07:55:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6cf21ca6-d13a-5d18-81df-cddd84e82021 with scrape type 1
2026-04-27 07:55:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6cf21ca6-d13a-5d18-81df-cddd84e82021 sending to next pipeline
2026-04-27 07:55:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6cf21ca6-d13a-5d18-81df-cddd84e82021, identifier: KN31501
2026-04-27 07:55:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438beab10>
2026-04-27 07:55:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a70c0496-bd82-59e0-97a4-a74b79811589/a70c0496-bd82-59e0-97a4-a74b79811589_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/42/2742f94a6e5cb7f882081920df20b721/pa/SA02986_1a07a7eeac0802a50c14556f46be1094.jpg saved to cache
2026-04-27 07:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a70c0496-bd82-59e0-97a4-a74b79811589
2026-04-27 07:55:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a70c0496-bd82-59e0-97a4-a74b79811589, skipping ID generation
2026-04-27 07:55:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a70c0496-bd82-59e0-97a4-a74b79811589 with scrape type 1
2026-04-27 07:55:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a70c0496-bd82-59e0-97a4-a74b79811589 sending to next pipeline
2026-04-27 07:55:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a70c0496-bd82-59e0-97a4-a74b79811589, identifier: SA02986
2026-04-27 07:55:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6229fc14-cb4f-5c50-a11b-bcf1be8c1f2e with identifier: CY19379
2026-04-27 07:55:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-27 07:55:04 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=beige HTTP/1.1" 200 None
2026-04-27 07:55:05 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-27 07:55:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6229fc14-cb4f-5c50-a11b-bcf1be8c1f2e with identifier: CY19379
2026-04-27 07:55:05 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6229fc14-cb4f-5c50-a11b-bcf1be8c1f2e with identifier: CY19379 to the API
2026-04-27 07:55:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:05 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4d/ed/4ded2608ed9a75a9297527d23fa3ce1a/pa/CY19379_1a3e17ff98e87eb8b352e4e39763258d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'category': None,
 'city': None,
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.5L',
 'engine_horse_power': 105,
 'expiration_date': '2026-04-28T15:47:58Z',
 'fuel_type': 'diesel',
 'id': '6229fc14-cb4f-5c50-a11b-bcf1be8c1f2e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CY19379',
 'listing': 'auction',
 'location': 'FR',
 'location_confidence': None,
 'longitude': None,
 'make': 'Renault',
 'model': 'Scenic',
 'odometer': 196134,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 24,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6229fc14-cb4f-5c50-a11b-bcf1be8c1f2e/6229fc14-cb4f-5c50-a11b-bcf1be8c1f2e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44298,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/ed/4ded2608ed9a75a9297527d23fa3ce1a/pa/CY19379_8bc2ce9c3bfaeccfc84c589096730338.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6229fc14-cb4f-5c50-a11b-bcf1be8c1f2e/6229fc14-cb4f-5c50-a11b-bcf1be8c1f2e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44298,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/ed/4ded2608ed9a75a9297527d23fa3ce1a/pa/CY19379_1a3e17ff98e87eb8b352e4e39763258d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6229fc14-cb4f-5c50-a11b-bcf1be8c1f2e/6229fc14-cb4f-5c50-a11b-bcf1be8c1f2e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43631,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/ed/4ded2608ed9a75a9297527d23fa3ce1a/pa/CY19379_d26b56f3321171d7d5763156bb23092a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6229fc14-cb4f-5c50-a11b-bcf1be8c1f2e/6229fc14-cb4f-5c50-a11b-bcf1be8c1f2e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31230,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/ed/4ded2608ed9a75a9297527d23fa3ce1a/pa/CY19379_caa34bd5129475867d3d5f6d33c1b436.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6229fc14-cb4f-5c50-a11b-bcf1be8c1f2e/6229fc14-cb4f-5c50-a11b-bcf1be8c1f2e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42398,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/ed/4ded2608ed9a75a9297527d23fa3ce1a/pa/CY19379_2a83f71af67430f6e8c4a9147c730c94.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6229fc14-cb4f-5c50-a11b-bcf1be8c1f2e/6229fc14-cb4f-5c50-a11b-bcf1be8c1f2e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36250,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/ed/4ded2608ed9a75a9297527d23fa3ce1a/pa/CY19379_9b1504ea624f7347c8c4d8b733cfccd5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6229fc14-cb4f-5c50-a11b-bcf1be8c1f2e/6229fc14-cb4f-5c50-a11b-bcf1be8c1f2e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35001,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/ed/4ded2608ed9a75a9297527d23fa3ce1a/pa/CY19379_a3ab68e512c44065479bca3f278efd1b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6229fc14-cb4f-5c50-a11b-bcf1be8c1f2e/6229fc14-cb4f-5c50-a11b-bcf1be8c1f2e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82944,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/ed/4ded2608ed9a75a9297527d23fa3ce1a/pa/CY19379_a872d5a49cf84cbd55caa0dc11a847d2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6229fc14-cb4f-5c50-a11b-bcf1be8c1f2e/6229fc14-cb4f-5c50-a11b-bcf1be8c1f2e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51637,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/ed/4ded2608ed9a75a9297527d23fa3ce1a/pa/CY19379_9cf3b728338978fac10a0253004356fb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6229fc14-cb4f-5c50-a11b-bcf1be8c1f2e/6229fc14-cb4f-5c50-a11b-bcf1be8c1f2e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68793,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/ed/4ded2608ed9a75a9297527d23fa3ce1a/pa/CY19379_ebe46cdde076789e4a4ab850f45dd016.jpg',
             'Width': 800}],
 'postal_code': None,
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2008-09-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Scenic 1.5 dCi Authentique',
 'transmission': 'manual',
 'trim': 'Authentique',
 'year': 2008}
2026-04-27 07:55:05 [auto1.fr] INFO: Saving data for CY19379: {'created_time': 1777276505.441912, 'last_price_update_time': 1777276505.441925, 'has_photos': True, 'auction_closing_time': 1777391278.0}
2026-04-27 07:55:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6cf21ca6-d13a-5d18-81df-cddd84e82021 with identifier: KN31501
2026-04-27 07:55:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6cf21ca6-d13a-5d18-81df-cddd84e82021 with identifier: KN31501
2026-04-27 07:55:05 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6cf21ca6-d13a-5d18-81df-cddd84e82021 with identifier: KN31501 to the API
2026-04-27 07:55:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:05 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd6/c2/d6c2d7896dd17ebe2e3e9b1263fddee0/pa/KN31501_a78051e69970803a91ee6d77d8eed5d1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'category': None,
 'city': 'Allennes-les-Marais',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2026-04-28T15:11:24Z',
 'fuel_type': 'diesel',
 'id': '6cf21ca6-d13a-5d18-81df-cddd84e82021',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 50.5375,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KN31501',
 'listing': 'auction',
 'location': 'FR, Allennes-les-Marais',
 'location_confidence': 'geocoded',
 'longitude': 2.9536,
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 266331,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6cf21ca6-d13a-5d18-81df-cddd84e82021/6cf21ca6-d13a-5d18-81df-cddd84e82021_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73979,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/c2/d6c2d7896dd17ebe2e3e9b1263fddee0/pa/KN31501_17e17a8caf225a2093e81d463f4d8b1a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6cf21ca6-d13a-5d18-81df-cddd84e82021/6cf21ca6-d13a-5d18-81df-cddd84e82021_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61936,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/c2/d6c2d7896dd17ebe2e3e9b1263fddee0/pa/KN31501_9f07358c2822bc790838941c0cf1616a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6cf21ca6-d13a-5d18-81df-cddd84e82021/6cf21ca6-d13a-5d18-81df-cddd84e82021_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67027,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/c2/d6c2d7896dd17ebe2e3e9b1263fddee0/pa/KN31501_a78051e69970803a91ee6d77d8eed5d1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6cf21ca6-d13a-5d18-81df-cddd84e82021/6cf21ca6-d13a-5d18-81df-cddd84e82021_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52269,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/c2/d6c2d7896dd17ebe2e3e9b1263fddee0/pa/KN31501_355f52daad8d1e9433b17c50d1e242c3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6cf21ca6-d13a-5d18-81df-cddd84e82021/6cf21ca6-d13a-5d18-81df-cddd84e82021_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63897,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/c2/d6c2d7896dd17ebe2e3e9b1263fddee0/pa/KN31501_59c12fe70d3efc5c7d770ba1a72ae5d5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6cf21ca6-d13a-5d18-81df-cddd84e82021/6cf21ca6-d13a-5d18-81df-cddd84e82021_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43497,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/c2/d6c2d7896dd17ebe2e3e9b1263fddee0/pa/KN31501_1ab75ec8afc4e1d896254d3d42e38978.jpg',
             'Width': 800}],
 'postal_code': '59251',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Nord',
 'province_code': 'FR-59',
 'region': 'Hauts-de-France',
 'region_code': 'FR-32',
 'registration_date': '2013-04-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 HDi Napapijri',
 'transmission': 'manual',
 'trim': 'Napapijri',
 'year': 2013}
2026-04-27 07:55:05 [auto1.fr] INFO: Saving data for KN31501: {'created_time': 1777276505.854774, 'last_price_update_time': 1777276505.854789, 'has_photos': True, 'auction_closing_time': 1777389084.0}
2026-04-27 07:55:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a70c0496-bd82-59e0-97a4-a74b79811589 with identifier: SA02986
2026-04-27 07:55:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a70c0496-bd82-59e0-97a4-a74b79811589 with identifier: SA02986
2026-04-27 07:55:05 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a70c0496-bd82-59e0-97a4-a74b79811589 with identifier: SA02986 to the API
2026-04-27 07:55:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:06 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img27/42/2742f94a6e5cb7f882081920df20b721/pa/SA02986_1a07a7eeac0802a50c14556f46be1094.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 150,
 'category': None,
 'city': 'Marseille',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 163,
 'expiration_date': '2026-04-28T15:51:59Z',
 'fuel_type': 'diesel',
 'id': 'a70c0496-bd82-59e0-97a4-a74b79811589',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 43.2969,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA02986',
 'listing': 'auction',
 'location': 'FR, Marseille',
 'location_confidence': 'geocoded',
 'longitude': 5.3811,
 'make': 'Peugeot',
 'model': '508',
 'odometer': 130959,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a70c0496-bd82-59e0-97a4-a74b79811589/a70c0496-bd82-59e0-97a4-a74b79811589_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95248,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/42/2742f94a6e5cb7f882081920df20b721/pa/SA02986_b8bf51b0a770cbaa8f057c8a9d68fd26.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a70c0496-bd82-59e0-97a4-a74b79811589/a70c0496-bd82-59e0-97a4-a74b79811589_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102503,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/42/2742f94a6e5cb7f882081920df20b721/pa/SA02986_e5eca53bde7132ef455015c0691d0c10.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a70c0496-bd82-59e0-97a4-a74b79811589/a70c0496-bd82-59e0-97a4-a74b79811589_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93297,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/42/2742f94a6e5cb7f882081920df20b721/pa/SA02986_0d8aa29a669f7516408a76ab229f736b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a70c0496-bd82-59e0-97a4-a74b79811589/a70c0496-bd82-59e0-97a4-a74b79811589_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71908,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/42/2742f94a6e5cb7f882081920df20b721/pa/SA02986_fbdf2f206582197509236c6e3ada2f01.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a70c0496-bd82-59e0-97a4-a74b79811589/a70c0496-bd82-59e0-97a4-a74b79811589_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103311,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/42/2742f94a6e5cb7f882081920df20b721/pa/SA02986_8825c7246611b0f5473edb0f2ea16d33.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a70c0496-bd82-59e0-97a4-a74b79811589/a70c0496-bd82-59e0-97a4-a74b79811589_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99583,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/42/2742f94a6e5cb7f882081920df20b721/pa/SA02986_a52c5a6e28ee56d1c8a4bb9956180755.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a70c0496-bd82-59e0-97a4-a74b79811589/a70c0496-bd82-59e0-97a4-a74b79811589_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92600,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/42/2742f94a6e5cb7f882081920df20b721/pa/SA02986_1a07a7eeac0802a50c14556f46be1094.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a70c0496-bd82-59e0-97a4-a74b79811589/a70c0496-bd82-59e0-97a4-a74b79811589_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103235,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/42/2742f94a6e5cb7f882081920df20b721/pa/SA02986_b0d750c6b4e1d22306251048bcf1a775.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a70c0496-bd82-59e0-97a4-a74b79811589/a70c0496-bd82-59e0-97a4-a74b79811589_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91725,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/42/2742f94a6e5cb7f882081920df20b721/pa/SA02986_66a1896fe4cf2a3ba98e639a675b4615.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a70c0496-bd82-59e0-97a4-a74b79811589/a70c0496-bd82-59e0-97a4-a74b79811589_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74496,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/42/2742f94a6e5cb7f882081920df20b721/pa/SA02986_8641ff3f4636bec5874aa7b9e5261e26.jpg',
             'Width': 800}],
 'postal_code': '13000',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Bouches-du-Rhône',
 'province_code': 'FR-13',
 'region': "Provence-Alpes-Côte d'Azur",
 'region_code': 'FR-93',
 'registration_date': '2020-10-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 508 2.0 Blue-HDi Allure Business',
 'transmission': 'automatic',
 'trim': 'Allure Business',
 'year': 2020}
2026-04-27 07:55:06 [auto1.fr] INFO: Saving data for SA02986: {'created_time': 1777276506.233592, 'last_price_update_time': 1777276506.233607, 'has_photos': True, 'auction_closing_time': 1777391519.0}
2026-04-27 07:55:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KU94506/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CU39401/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BL55245/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:06 [auto1.fr] INFO: Channel: 24h | Page: 2 | totalHits: 4718 | hits on page: 40
2026-04-27 07:55:06 [auto1.fr] INFO: Found listing with ID: UX62413
2026-04-27 07:55:06 [auto1.fr] INFO: Scrape type for UX62413: 0
2026-04-27 07:55:06 [auto1.fr] INFO: Found listing with ID: UV91216
2026-04-27 07:55:06 [auto1.fr] INFO: Scrape type for UV91216: 0
2026-04-27 07:55:06 [auto1.fr] INFO: Found listing with ID: SA02986
2026-04-27 07:55:06 [auto1.fr] INFO: Scrape type for SA02986: 0
2026-04-27 07:55:06 [auto1.fr] INFO: Found listing with ID: CN92978
2026-04-27 07:55:06 [auto1.fr] INFO: Scrape type for CN92978: 0
2026-04-27 07:55:06 [auto1.fr] INFO: Found listing with ID: VJ16113
2026-04-27 07:55:06 [auto1.fr] INFO: Scrape type for VJ16113: 0
2026-04-27 07:55:06 [auto1.fr] INFO: Found listing with ID: PN81338
2026-04-27 07:55:06 [auto1.fr] INFO: Scrape type for PN81338: 1
2026-04-27 07:55:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:06 [auto1.fr] INFO: Found listing with ID: NH82777
2026-04-27 07:55:06 [auto1.fr] INFO: Scrape type for NH82777: 1
2026-04-27 07:55:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:06 [auto1.fr] INFO: Found listing with ID: EW48919
2026-04-27 07:55:06 [auto1.fr] INFO: Scrape type for EW48919: 2
2026-04-27 07:55:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bdf1de17-4956-5cc8-98ba-5bc468e2c911 with identifier: EW48919
2026-04-27 07:55:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bdf1de17-4956-5cc8-98ba-5bc468e2c911 with scrape type 2
2026-04-27 07:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bdf1de17-4956-5cc8-98ba-5bc468e2c911 with scrape type 2
2026-04-27 07:55:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: bdf1de17-4956-5cc8-98ba-5bc468e2c911, identifier: EW48919
2026-04-27 07:55:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: bdf1de17-4956-5cc8-98ba-5bc468e2c911 with identifier: EW48919
2026-04-27 07:55:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: bdf1de17-4956-5cc8-98ba-5bc468e2c911 with identifier: EW48919
2026-04-27 07:55:06 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: bdf1de17-4956-5cc8-98ba-5bc468e2c911 with identifier: EW48919 to the API
2026-04-27 07:55:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:07 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-04-28T15:13:36Z',
 'fuel_type': 'diesel',
 'id': 'bdf1de17-4956-5cc8-98ba-5bc468e2c911',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EW48919',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Citroen',
 'model': 'C4 Picasso',
 'odometer': 235170,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2010-12-31',
 'seller_name': None,
 'title': 'Citroen C4 Picasso 1.6 HDi Confort',
 'transmission': 'manual',
 'trim': 'Confort',
 'year': 2010}
2026-04-27 07:55:07 [auto1.fr] INFO: Saving data for EW48919: {'auction_closing_time': 1777389216.0, 'created_time': 1777020619.791166, 'has_photos': True, 'last_price_update_time': 1777276507.406403}
2026-04-27 07:55:07 [auto1.fr] INFO: Found listing with ID: LW72658
2026-04-27 07:55:07 [auto1.fr] INFO: Scrape type for LW72658: 1
2026-04-27 07:55:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NN14660> (referer: https://www.auto1.com/v1/car-details-view/NN14660/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:07 [auto1.fr] INFO: Found listing with ID: VF20612
2026-04-27 07:55:07 [auto1.fr] INFO: Scrape type for VF20612: 1
2026-04-27 07:55:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JR90965/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:07 [auto1.fr] INFO: Found listing with ID: CF81227
2026-04-27 07:55:07 [auto1.fr] INFO: Scrape type for CF81227: 1
2026-04-27 07:55:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:07 [auto1.fr] INFO: Found listing with ID: YW08307
2026-04-27 07:55:07 [auto1.fr] INFO: Scrape type for YW08307: 1
2026-04-27 07:55:07 [auto1.fr] INFO: Found listing with ID: GP77578
2026-04-27 07:55:07 [auto1.fr] INFO: Scrape type for GP77578: 1
2026-04-27 07:55:07 [auto1.fr] INFO: Found listing with ID: YX93325
2026-04-27 07:55:07 [auto1.fr] INFO: Scrape type for YX93325: 1
2026-04-27 07:55:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7eef059c-ef2d-5c37-bb2e-2758fa114d0d with identifier: NN14660
2026-04-27 07:55:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7eef059c-ef2d-5c37-bb2e-2758fa114d0d with scrape type 1
2026-04-27 07:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7eef059c-ef2d-5c37-bb2e-2758fa114d0d
2026-04-27 07:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/cc/a0cc985089452ef520cd829adac8a2be/pa/NN14660_8d8907a181fa26826409821b17960089.jpg not downloaded yet
2026-04-27 07:55:07 [auto1.fr] INFO: Found listing with ID: TA08713
2026-04-27 07:55:07 [auto1.fr] INFO: Scrape type for TA08713: 1
2026-04-27 07:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/cc/a0cc985089452ef520cd829adac8a2be/pa/NN14660_3e1d504658258ad9474feb6228396480.jpg not downloaded yet
2026-04-27 07:55:07 [auto1.fr] INFO: Found listing with ID: DY54580
2026-04-27 07:55:07 [auto1.fr] INFO: Scrape type for DY54580: 1
2026-04-27 07:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/cc/a0cc985089452ef520cd829adac8a2be/pa/NN14660_4501784b15028d4d05b9bceeed117c84.jpg not downloaded yet
2026-04-27 07:55:07 [auto1.fr] INFO: Found listing with ID: GP51898
2026-04-27 07:55:07 [auto1.fr] INFO: Scrape type for GP51898: 1
2026-04-27 07:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/cc/a0cc985089452ef520cd829adac8a2be/pa/NN14660_7b60a79eefa629b1e584f31692ca5ecb.jpg not downloaded yet
2026-04-27 07:55:07 [auto1.fr] INFO: Found listing with ID: HP74277
2026-04-27 07:55:07 [auto1.fr] INFO: Scrape type for HP74277: 1
2026-04-27 07:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/cc/a0cc985089452ef520cd829adac8a2be/pa/NN14660_e5b7cc70cf02ae7bbaae3e603aca6e29.jpg not downloaded yet
2026-04-27 07:55:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/cc/a0cc985089452ef520cd829adac8a2be/pa/NN14660_8d8907a181fa26826409821b17960089.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:07 [auto1.fr] INFO: Found listing with ID: SK23170
2026-04-27 07:55:07 [auto1.fr] INFO: Scrape type for SK23170: 1
2026-04-27 07:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/cc/a0cc985089452ef520cd829adac8a2be/pa/NN14660_48aacc055b27aa72c335e6eb67a9d6eb.jpg not downloaded yet
2026-04-27 07:55:07 [auto1.fr] INFO: Found listing with ID: UP86027
2026-04-27 07:55:07 [auto1.fr] INFO: Scrape type for UP86027: 2
2026-04-27 07:55:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4da3bda7-156d-55fc-a174-57aece1893e4 with identifier: UP86027
2026-04-27 07:55:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4da3bda7-156d-55fc-a174-57aece1893e4 with scrape type 2
2026-04-27 07:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4da3bda7-156d-55fc-a174-57aece1893e4 with scrape type 2
2026-04-27 07:55:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4da3bda7-156d-55fc-a174-57aece1893e4, identifier: UP86027
2026-04-27 07:55:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4da3bda7-156d-55fc-a174-57aece1893e4 with identifier: UP86027
2026-04-27 07:55:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-27 07:55:08 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-04-27 07:55:08 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-27 07:55:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4da3bda7-156d-55fc-a174-57aece1893e4 with identifier: UP86027
2026-04-27 07:55:08 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 4da3bda7-156d-55fc-a174-57aece1893e4 with identifier: UP86027 to the API
2026-04-27 07:55:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:08 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 158,
 'expiration_date': '2026-04-28T15:23:50Z',
 'fuel_type': 'hybrid',
 'id': '4da3bda7-156d-55fc-a174-57aece1893e4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UP86027',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 86167,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2021-10-05',
 'seller_name': None,
 'title': 'Renault Megane 1.6 Hybrid E-Tech Business',
 'transmission': 'automatic',
 'trim': 'Business',
 'year': 2021}
2026-04-27 07:55:08 [auto1.fr] INFO: Saving data for UP86027: {'auction_closing_time': 1777389830.0, 'created_time': 1777024413.315303, 'has_photos': True, 'last_price_update_time': 1777276508.647421}
2026-04-27 07:55:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/cc/a0cc985089452ef520cd829adac8a2be/pa/NN14660_e543572d9703ae9fec22be18b9375a61.jpg not downloaded yet
2026-04-27 07:55:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/cc/a0cc985089452ef520cd829adac8a2be/pa/NN14660_3e1d504658258ad9474feb6228396480.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:08 [auto1.fr] INFO: Found listing with ID: YZ83641
2026-04-27 07:55:08 [auto1.fr] INFO: Scrape type for YZ83641: 1
2026-04-27 07:55:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/cc/a0cc985089452ef520cd829adac8a2be/pa/NN14660_e5b7cc70cf02ae7bbaae3e603aca6e29.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/cc/a0cc985089452ef520cd829adac8a2be/pa/NN14660_2939b9281ca37f18c616bfe69e861cfe.jpg not downloaded yet
2026-04-27 07:55:08 [auto1.fr] INFO: Found listing with ID: SU49210
2026-04-27 07:55:08 [auto1.fr] INFO: Scrape type for SU49210: 1
2026-04-27 07:55:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CU39401> (referer: https://www.auto1.com/v1/car-details-view/CU39401/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PN81338/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BL55245> (referer: https://www.auto1.com/v1/car-details-view/BL55245/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NH82777/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438fb62d0>
2026-04-27 07:55:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7eef059c-ef2d-5c37-bb2e-2758fa114d0d/7eef059c-ef2d-5c37-bb2e-2758fa114d0d_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/cc/a0cc985089452ef520cd829adac8a2be/pa/NN14660_8d8907a181fa26826409821b17960089.jpg saved to cache
2026-04-27 07:55:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7eef059c-ef2d-5c37-bb2e-2758fa114d0d
2026-04-27 07:55:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/cc/a0cc985089452ef520cd829adac8a2be/pa/NN14660_04f7074477fc5b85fe912e6e21411801.jpg not downloaded yet
2026-04-27 07:55:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:08 [auto1.fr] INFO: Found listing with ID: EA73513
2026-04-27 07:55:08 [auto1.fr] INFO: Scrape type for EA73513: 1
2026-04-27 07:55:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/cc/a0cc985089452ef520cd829adac8a2be/pa/NN14660_2b72e52a5086f7bd3c2b6408ed4ea2b3.jpg not downloaded yet
2026-04-27 07:55:08 [auto1.fr] INFO: Found listing with ID: TU85315
2026-04-27 07:55:09 [auto1.fr] INFO: Scrape type for TU85315: 2
2026-04-27 07:55:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 108b137f-5874-5402-8f5d-9ee37017a0b3 with identifier: TU85315
2026-04-27 07:55:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 108b137f-5874-5402-8f5d-9ee37017a0b3 with scrape type 2
2026-04-27 07:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 108b137f-5874-5402-8f5d-9ee37017a0b3 with scrape type 2
2026-04-27 07:55:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 108b137f-5874-5402-8f5d-9ee37017a0b3, identifier: TU85315
2026-04-27 07:55:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 108b137f-5874-5402-8f5d-9ee37017a0b3 with identifier: TU85315
2026-04-27 07:55:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 108b137f-5874-5402-8f5d-9ee37017a0b3 with identifier: TU85315
2026-04-27 07:55:09 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 108b137f-5874-5402-8f5d-9ee37017a0b3 with identifier: TU85315 to the API
2026-04-27 07:55:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:09 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-04-28T15:56:53Z',
 'fuel_type': 'petrol',
 'id': '108b137f-5874-5402-8f5d-9ee37017a0b3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU85315',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'DS Automobiles',
 'model': 'DS4',
 'odometer': 75364,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2017-06-28',
 'seller_name': None,
 'title': 'DS Automobiles DS4 1.2 PureTech SportChic',
 'transmission': 'manual',
 'trim': 'SportChic',
 'year': 2017}
2026-04-27 07:55:09 [auto1.fr] INFO: Saving data for TU85315: {'auction_closing_time': 1777391813.0, 'created_time': 1777024719.749018, 'has_photos': True, 'last_price_update_time': 1777276509.382606}
2026-04-27 07:55:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438166bd0>
2026-04-27 07:55:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7eef059c-ef2d-5c37-bb2e-2758fa114d0d/7eef059c-ef2d-5c37-bb2e-2758fa114d0d_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/cc/a0cc985089452ef520cd829adac8a2be/pa/NN14660_3e1d504658258ad9474feb6228396480.jpg saved to cache
2026-04-27 07:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7eef059c-ef2d-5c37-bb2e-2758fa114d0d
2026-04-27 07:55:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438fbac90>
2026-04-27 07:55:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7eef059c-ef2d-5c37-bb2e-2758fa114d0d/7eef059c-ef2d-5c37-bb2e-2758fa114d0d_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/cc/a0cc985089452ef520cd829adac8a2be/pa/NN14660_e5b7cc70cf02ae7bbaae3e603aca6e29.jpg saved to cache
2026-04-27 07:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7eef059c-ef2d-5c37-bb2e-2758fa114d0d
2026-04-27 07:55:09 [auto1.fr] INFO: Channel: 24h | Page: 3 | totalHits: 4719 | hits on page: 40
2026-04-27 07:55:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/cc/a0cc985089452ef520cd829adac8a2be/pa/NN14660_48aacc055b27aa72c335e6eb67a9d6eb.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/cc/a0cc985089452ef520cd829adac8a2be/pa/NN14660_e543572d9703ae9fec22be18b9375a61.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:09 [auto1.fr] INFO: Found listing with ID: ZB31200
2026-04-27 07:55:09 [auto1.fr] INFO: Scrape type for ZB31200: 2
2026-04-27 07:55:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19b37c58-5ea2-5713-9abe-2e2d342d40a4 with identifier: ZB31200
2026-04-27 07:55:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19b37c58-5ea2-5713-9abe-2e2d342d40a4 with scrape type 2
2026-04-27 07:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 19b37c58-5ea2-5713-9abe-2e2d342d40a4 with scrape type 2
2026-04-27 07:55:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 19b37c58-5ea2-5713-9abe-2e2d342d40a4, identifier: ZB31200
2026-04-27 07:55:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/cc/a0cc985089452ef520cd829adac8a2be/pa/NN14660_2939b9281ca37f18c616bfe69e861cfe.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 19b37c58-5ea2-5713-9abe-2e2d342d40a4 with identifier: ZB31200
2026-04-27 07:55:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 19b37c58-5ea2-5713-9abe-2e2d342d40a4 with identifier: ZB31200
2026-04-27 07:55:09 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 19b37c58-5ea2-5713-9abe-2e2d342d40a4 with identifier: ZB31200 to the API
2026-04-27 07:55:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:09 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 155,
 'expiration_date': '2026-04-28T15:22:18Z',
 'fuel_type': 'petrol',
 'id': '19b37c58-5ea2-5713-9abe-2e2d342d40a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZB31200',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Citroen',
 'model': 'C5',
 'odometer': 106340,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2015-04-19',
 'seller_name': None,
 'title': 'Citroen C5 1.6 Confort',
 'transmission': 'automatic',
 'trim': 'Confort',
 'year': 2015}
2026-04-27 07:55:09 [auto1.fr] INFO: Saving data for ZB31200: {'auction_closing_time': 1777389738.0, 'created_time': 1777024444.210849, 'has_photos': True, 'last_price_update_time': 1777276509.976043}
2026-04-27 07:55:09 [auto1.fr] INFO: Found listing with ID: BZ74074
2026-04-27 07:55:10 [auto1.fr] INFO: Scrape type for BZ74074: 1
2026-04-27 07:55:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 308936d8-9358-5614-8cf5-9a92ec62ed9e with identifier: CU39401
2026-04-27 07:55:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 308936d8-9358-5614-8cf5-9a92ec62ed9e with scrape type 1
2026-04-27 07:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 308936d8-9358-5614-8cf5-9a92ec62ed9e
2026-04-27 07:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/d5/83d52bbb58e8e2509dfb7a53c7a157a0/pa/CU39401_5cb1a4a65d8c39f0fc3c074921d07aa9.jpg not downloaded yet
2026-04-27 07:55:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac2e882b-3ac7-54a4-8742-a09a07f150cd with identifier: BL55245
2026-04-27 07:55:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac2e882b-3ac7-54a4-8742-a09a07f150cd with scrape type 1
2026-04-27 07:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ac2e882b-3ac7-54a4-8742-a09a07f150cd
2026-04-27 07:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/f5/49f5a2b3f4cdda74c12da23ed4884d10/pa/BL55245_2ad3d2ca8e9643e54b6733c71d21ca71.jpg not downloaded yet
2026-04-27 07:55:10 [auto1.fr] INFO: Found listing with ID: PW97821
2026-04-27 07:55:10 [auto1.fr] INFO: Scrape type for PW97821: 2
2026-04-27 07:55:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9986a6b-3cc6-5163-81b4-e360912ee070 with identifier: PW97821
2026-04-27 07:55:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9986a6b-3cc6-5163-81b4-e360912ee070 with scrape type 2
2026-04-27 07:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b9986a6b-3cc6-5163-81b4-e360912ee070 with scrape type 2
2026-04-27 07:55:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b9986a6b-3cc6-5163-81b4-e360912ee070, identifier: PW97821
2026-04-27 07:55:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LW72658/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b9986a6b-3cc6-5163-81b4-e360912ee070 with identifier: PW97821
2026-04-27 07:55:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b9986a6b-3cc6-5163-81b4-e360912ee070 with identifier: PW97821
2026-04-27 07:55:10 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b9986a6b-3cc6-5163-81b4-e360912ee070 with identifier: PW97821 to the API
2026-04-27 07:55:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:10 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 367,
 'expiration_date': '2026-04-28T15:19:39Z',
 'fuel_type': 'hybrid',
 'id': 'b9986a6b-3cc6-5163-81b4-e360912ee070',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PW97821',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 120529,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2020-06-22',
 'seller_name': None,
 'title': 'Audi Q5 55 TFSIe quattro S line',
 'transmission': 'automatic',
 'trim': 'quattro S line',
 'year': 2020}
2026-04-27 07:55:10 [auto1.fr] INFO: Saving data for PW97821: {'auction_closing_time': 1777389579.0, 'created_time': 1777024758.341877, 'has_photos': True, 'last_price_update_time': 1777276510.564419}
2026-04-27 07:55:10 [auto1.fr] INFO: Found listing with ID: DN51274
2026-04-27 07:55:10 [auto1.fr] INFO: Scrape type for DN51274: 2
2026-04-27 07:55:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b07dac7-8336-5240-a0ed-3458ad3edb5d with identifier: DN51274
2026-04-27 07:55:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b07dac7-8336-5240-a0ed-3458ad3edb5d with scrape type 2
2026-04-27 07:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7b07dac7-8336-5240-a0ed-3458ad3edb5d with scrape type 2
2026-04-27 07:55:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7b07dac7-8336-5240-a0ed-3458ad3edb5d, identifier: DN51274
2026-04-27 07:55:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/d5/83d52bbb58e8e2509dfb7a53c7a157a0/pa/CU39401_acc007da37c21defb9c8d7ce229d378d.png not downloaded yet
2026-04-27 07:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/f5/49f5a2b3f4cdda74c12da23ed4884d10/pa/BL55245_1a52825f6b06901d2b9aece263f0cc25.jpg not downloaded yet
2026-04-27 07:55:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VF20612/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d81a90>
2026-04-27 07:55:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7eef059c-ef2d-5c37-bb2e-2758fa114d0d/7eef059c-ef2d-5c37-bb2e-2758fa114d0d_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/cc/a0cc985089452ef520cd829adac8a2be/pa/NN14660_48aacc055b27aa72c335e6eb67a9d6eb.jpg saved to cache
2026-04-27 07:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7eef059c-ef2d-5c37-bb2e-2758fa114d0d
2026-04-27 07:55:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c5f210>
2026-04-27 07:55:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7eef059c-ef2d-5c37-bb2e-2758fa114d0d/7eef059c-ef2d-5c37-bb2e-2758fa114d0d_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/cc/a0cc985089452ef520cd829adac8a2be/pa/NN14660_e543572d9703ae9fec22be18b9375a61.jpg saved to cache
2026-04-27 07:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7eef059c-ef2d-5c37-bb2e-2758fa114d0d
2026-04-27 07:55:10 [auto1.fr] INFO: Found listing with ID: SE81249
2026-04-27 07:55:10 [auto1.fr] INFO: Scrape type for SE81249: 1
2026-04-27 07:55:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7b07dac7-8336-5240-a0ed-3458ad3edb5d with identifier: DN51274
2026-04-27 07:55:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7b07dac7-8336-5240-a0ed-3458ad3edb5d with identifier: DN51274
2026-04-27 07:55:10 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 7b07dac7-8336-5240-a0ed-3458ad3edb5d with identifier: DN51274 to the API
2026-04-27 07:55:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:11 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-04-28T15:24:04Z',
 'fuel_type': 'diesel',
 'id': '7b07dac7-8336-5240-a0ed-3458ad3edb5d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DN51274',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'BMW',
 'model': '1er',
 'odometer': 157425,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2013-05-20',
 'seller_name': None,
 'title': 'BMW 1er 116d EfficientDynamics Premiere',
 'transmission': 'manual',
 'trim': 'EfficientDynamics Premiere',
 'year': 2013}
2026-04-27 07:55:11 [auto1.fr] INFO: Saving data for DN51274: {'auction_closing_time': 1777389844.0, 'created_time': 1777023643.682676, 'has_photos': True, 'last_price_update_time': 1777276511.157631}
2026-04-27 07:55:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:11 [auto1.fr] INFO: Found listing with ID: YJ22330
2026-04-27 07:55:11 [auto1.fr] INFO: Scrape type for YJ22330: 1
2026-04-27 07:55:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/d5/83d52bbb58e8e2509dfb7a53c7a157a0/pa/CU39401_b24d471819ac2d5169e8a37c7a69b61d.jpg not downloaded yet
2026-04-27 07:55:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/f5/49f5a2b3f4cdda74c12da23ed4884d10/pa/BL55245_8aed3cf8afceed4569d9ff1ea6c30cda.jpg not downloaded yet
2026-04-27 07:55:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438016ad0>
2026-04-27 07:55:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7eef059c-ef2d-5c37-bb2e-2758fa114d0d/7eef059c-ef2d-5c37-bb2e-2758fa114d0d_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/cc/a0cc985089452ef520cd829adac8a2be/pa/NN14660_2939b9281ca37f18c616bfe69e861cfe.jpg saved to cache
2026-04-27 07:55:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7eef059c-ef2d-5c37-bb2e-2758fa114d0d
2026-04-27 07:55:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/cc/a0cc985089452ef520cd829adac8a2be/pa/NN14660_2b72e52a5086f7bd3c2b6408ed4ea2b3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:11 [auto1.fr] INFO: Found listing with ID: UB37186
2026-04-27 07:55:11 [auto1.fr] INFO: Scrape type for UB37186: 1
2026-04-27 07:55:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KU94506> (referer: https://www.auto1.com/v1/car-details-view/KU94506/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:11 [auto1.fr] INFO: Found listing with ID: RM20778
2026-04-27 07:55:11 [auto1.fr] INFO: Scrape type for RM20778: 1
2026-04-27 07:55:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/d5/83d52bbb58e8e2509dfb7a53c7a157a0/pa/CU39401_b6bb6f9c8c230ce196b79b809be5c6d0.jpg not downloaded yet
2026-04-27 07:55:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/f5/49f5a2b3f4cdda74c12da23ed4884d10/pa/BL55245_d6c666ba556640f565075d596348f970.jpg not downloaded yet
2026-04-27 07:55:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:11 [auto1.fr] INFO: Found listing with ID: DM72572
2026-04-27 07:55:11 [auto1.fr] INFO: Scrape type for DM72572: 1
2026-04-27 07:55:11 [auto1.fr] INFO: Found listing with ID: FA55776
2026-04-27 07:55:11 [auto1.fr] INFO: Scrape type for FA55776: 2
2026-04-27 07:55:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69bd8e4e-000f-5267-95dd-ce027daccaed with identifier: FA55776
2026-04-27 07:55:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69bd8e4e-000f-5267-95dd-ce027daccaed with scrape type 2
2026-04-27 07:55:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 69bd8e4e-000f-5267-95dd-ce027daccaed with scrape type 2
2026-04-27 07:55:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 69bd8e4e-000f-5267-95dd-ce027daccaed, identifier: FA55776
2026-04-27 07:55:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/d5/83d52bbb58e8e2509dfb7a53c7a157a0/pa/CU39401_c0f032ba096661b4faf517ad3683bed7.jpg not downloaded yet
2026-04-27 07:55:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/f5/49f5a2b3f4cdda74c12da23ed4884d10/pa/BL55245_afb1824d2294d1be2a426e5c24f2342b.jpg not downloaded yet
2026-04-27 07:55:11 [auto1.fr] INFO: Found listing with ID: NG71895
2026-04-27 07:55:11 [auto1.fr] INFO: Scrape type for NG71895: 2
2026-04-27 07:55:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18ade825-ab02-553b-bf5c-22b91d2f2efd with identifier: NG71895
2026-04-27 07:55:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18ade825-ab02-553b-bf5c-22b91d2f2efd with scrape type 2
2026-04-27 07:55:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 18ade825-ab02-553b-bf5c-22b91d2f2efd with scrape type 2
2026-04-27 07:55:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 18ade825-ab02-553b-bf5c-22b91d2f2efd, identifier: NG71895
2026-04-27 07:55:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 69bd8e4e-000f-5267-95dd-ce027daccaed with identifier: FA55776
2026-04-27 07:55:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 69bd8e4e-000f-5267-95dd-ce027daccaed with identifier: FA55776
2026-04-27 07:55:11 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 69bd8e4e-000f-5267-95dd-ce027daccaed with identifier: FA55776 to the API
2026-04-27 07:55:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:11 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 58,
 'expiration_date': '2026-04-28T15:48:05Z',
 'fuel_type': 'petrol',
 'id': '69bd8e4e-000f-5267-95dd-ce027daccaed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FA55776',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 175054,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2007-03-20',
 'seller_name': None,
 'title': 'Renault Clio 1.2 Campus Authentique',
 'transmission': 'manual',
 'trim': 'Campus Authentique',
 'year': 2007}
2026-04-27 07:55:11 [auto1.fr] INFO: Saving data for FA55776: {'auction_closing_time': 1777391285.0, 'created_time': 1777023640.915196, 'has_photos': True, 'last_price_update_time': 1777276511.965314}
2026-04-27 07:55:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 18ade825-ab02-553b-bf5c-22b91d2f2efd with identifier: NG71895
2026-04-27 07:55:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 18ade825-ab02-553b-bf5c-22b91d2f2efd with identifier: NG71895
2026-04-27 07:55:12 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 18ade825-ab02-553b-bf5c-22b91d2f2efd with identifier: NG71895 to the API
2026-04-27 07:55:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:12 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-04-28T15:02:10Z',
 'fuel_type': 'petrol',
 'id': '18ade825-ab02-553b-bf5c-22b91d2f2efd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NG71895',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Peugeot',
 'model': '308',
 'odometer': 112932,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2017-01-01',
 'seller_name': None,
 'title': 'Peugeot 308 1.2 e-THP Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2017}
2026-04-27 07:55:12 [auto1.fr] INFO: Saving data for NG71895: {'auction_closing_time': 1777388530.0, 'created_time': 1777023613.236938, 'has_photos': True, 'last_price_update_time': 1777276512.609621}
2026-04-27 07:55:12 [auto1.fr] INFO: Found listing with ID: GN80196
2026-04-27 07:55:12 [auto1.fr] INFO: Scrape type for GN80196: 1
2026-04-27 07:55:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/d5/83d52bbb58e8e2509dfb7a53c7a157a0/pa/CU39401_2cc0f9924c1c74171619c3dfe6fbb824.jpg not downloaded yet
2026-04-27 07:55:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/f5/49f5a2b3f4cdda74c12da23ed4884d10/pa/BL55245_cf77645c04a1a7c89ca5428b56a306de.jpg not downloaded yet
2026-04-27 07:55:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/f5/49f5a2b3f4cdda74c12da23ed4884d10/pa/BL55245_1a52825f6b06901d2b9aece263f0cc25.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:12 [auto1.fr] INFO: Found listing with ID: AW66318
2026-04-27 07:55:12 [auto1.fr] INFO: Scrape type for AW66318: 2
2026-04-27 07:55:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb22cfa5-dd62-59cc-9fc8-8765484133e4 with identifier: AW66318
2026-04-27 07:55:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb22cfa5-dd62-59cc-9fc8-8765484133e4 with scrape type 2
2026-04-27 07:55:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb22cfa5-dd62-59cc-9fc8-8765484133e4 with scrape type 2
2026-04-27 07:55:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: bb22cfa5-dd62-59cc-9fc8-8765484133e4, identifier: AW66318
2026-04-27 07:55:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: bb22cfa5-dd62-59cc-9fc8-8765484133e4 with identifier: AW66318
2026-04-27 07:55:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: bb22cfa5-dd62-59cc-9fc8-8765484133e4 with identifier: AW66318
2026-04-27 07:55:13 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: bb22cfa5-dd62-59cc-9fc8-8765484133e4 with identifier: AW66318 to the API
2026-04-27 07:55:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:13 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 100,
 'expiration_date': '2026-04-28T15:06:28Z',
 'fuel_type': 'diesel',
 'id': 'bb22cfa5-dd62-59cc-9fc8-8765484133e4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AW66318',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 159630,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2018-04-08',
 'seller_name': None,
 'title': 'Peugeot Partner 1.6 Blue-HDi Asphalt L1',
 'transmission': 'manual',
 'trim': 'Asphalt L1',
 'year': 2018}
2026-04-27 07:55:13 [auto1.fr] INFO: Saving data for AW66318: {'auction_closing_time': 1777388788.0, 'created_time': 1777023600.856437, 'has_photos': True, 'last_price_update_time': 1777276513.251731}
2026-04-27 07:55:13 [auto1.fr] INFO: Found listing with ID: AK58355
2026-04-27 07:55:13 [auto1.fr] INFO: Scrape type for AK58355: 2
2026-04-27 07:55:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7fe10bc-b299-5673-9cea-0039c77bf88a with identifier: AK58355
2026-04-27 07:55:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7fe10bc-b299-5673-9cea-0039c77bf88a with scrape type 2
2026-04-27 07:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f7fe10bc-b299-5673-9cea-0039c77bf88a with scrape type 2
2026-04-27 07:55:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f7fe10bc-b299-5673-9cea-0039c77bf88a, identifier: AK58355
2026-04-27 07:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/d5/83d52bbb58e8e2509dfb7a53c7a157a0/pa/CU39401_db1d3b16b4cf093c2b779471becd4d22.png not downloaded yet
2026-04-27 07:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/f5/49f5a2b3f4cdda74c12da23ed4884d10/pa/BL55245_864fd7f97ba45e1892ce8871a34dc996.jpg not downloaded yet
2026-04-27 07:55:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YX93325/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YW08307/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GP77578/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CF81227/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TA08713/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14551a5950>
2026-04-27 07:55:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7eef059c-ef2d-5c37-bb2e-2758fa114d0d/7eef059c-ef2d-5c37-bb2e-2758fa114d0d_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/cc/a0cc985089452ef520cd829adac8a2be/pa/NN14660_2b72e52a5086f7bd3c2b6408ed4ea2b3.jpg saved to cache
2026-04-27 07:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7eef059c-ef2d-5c37-bb2e-2758fa114d0d
2026-04-27 07:55:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43d1cee6-66cb-5992-b289-2b653dc37a1c with identifier: KU94506
2026-04-27 07:55:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43d1cee6-66cb-5992-b289-2b653dc37a1c with scrape type 1
2026-04-27 07:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 43d1cee6-66cb-5992-b289-2b653dc37a1c
2026-04-27 07:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/c8/45c8bb809f6f5f9c5c04fda13454ff2c/pa/KU94506_e1e60a61bf3916f024011fd901e0e65a.jpg not downloaded yet
2026-04-27 07:55:13 [auto1.fr] INFO: Found listing with ID: JL48792
2026-04-27 07:55:13 [auto1.fr] INFO: Scrape type for JL48792: 2
2026-04-27 07:55:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 35b44a47-eb2d-55f9-a673-3a637dc5a595 with identifier: JL48792
2026-04-27 07:55:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35b44a47-eb2d-55f9-a673-3a637dc5a595 with scrape type 2
2026-04-27 07:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 35b44a47-eb2d-55f9-a673-3a637dc5a595 with scrape type 2
2026-04-27 07:55:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 35b44a47-eb2d-55f9-a673-3a637dc5a595, identifier: JL48792
2026-04-27 07:55:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f7fe10bc-b299-5673-9cea-0039c77bf88a with identifier: AK58355
2026-04-27 07:55:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f7fe10bc-b299-5673-9cea-0039c77bf88a with identifier: AK58355
2026-04-27 07:55:13 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f7fe10bc-b299-5673-9cea-0039c77bf88a with identifier: AK58355 to the API
2026-04-27 07:55:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:13 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-04-28T15:02:19Z',
 'fuel_type': 'petrol',
 'id': 'f7fe10bc-b299-5673-9cea-0039c77bf88a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AK58355',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 73921,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2016-06-15',
 'seller_name': None,
 'title': 'Dacia Duster 1.6 SCe Ambiance 4x2',
 'transmission': 'manual',
 'trim': 'Ambiance 4x2',
 'year': 2016}
2026-04-27 07:55:14 [auto1.fr] INFO: Saving data for AK58355: {'auction_closing_time': 1777388539.0, 'created_time': 1777023551.544195, 'has_photos': True, 'last_price_update_time': 1777276514.115681}
2026-04-27 07:55:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 35b44a47-eb2d-55f9-a673-3a637dc5a595 with identifier: JL48792
2026-04-27 07:55:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 35b44a47-eb2d-55f9-a673-3a637dc5a595 with identifier: JL48792
2026-04-27 07:55:14 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 35b44a47-eb2d-55f9-a673-3a637dc5a595 with identifier: JL48792 to the API
2026-04-27 07:55:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:14 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-04-28T15:26:27Z',
 'fuel_type': 'diesel',
 'id': '35b44a47-eb2d-55f9-a673-3a637dc5a595',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JL48792',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 185327,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2013-05-16',
 'seller_name': None,
 'title': 'Renault Clio 1.5 dCi Energy Dynamique',
 'transmission': 'manual',
 'trim': 'Dynamique',
 'year': 2013}
2026-04-27 07:55:14 [auto1.fr] INFO: Saving data for JL48792: {'auction_closing_time': 1777389987.0, 'created_time': 1777023643.11493, 'has_photos': True, 'last_price_update_time': 1777276514.467544}
2026-04-27 07:55:14 [auto1.fr] INFO: Found listing with ID: NS88227
2026-04-27 07:55:14 [auto1.fr] INFO: Scrape type for NS88227: 2
2026-04-27 07:55:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27c88b4a-98c4-5874-a914-14eab952a4f6 with identifier: NS88227
2026-04-27 07:55:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27c88b4a-98c4-5874-a914-14eab952a4f6 with scrape type 2
2026-04-27 07:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 27c88b4a-98c4-5874-a914-14eab952a4f6 with scrape type 2
2026-04-27 07:55:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 27c88b4a-98c4-5874-a914-14eab952a4f6, identifier: NS88227
2026-04-27 07:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/d5/83d52bbb58e8e2509dfb7a53c7a157a0/pa/CU39401_5c400fd44990a7fcaf8c85338ea988b6.png not downloaded yet
2026-04-27 07:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/f5/49f5a2b3f4cdda74c12da23ed4884d10/pa/BL55245_6e65015af6bbb2300353ef6e308fa1af.jpg not downloaded yet
2026-04-27 07:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/c8/45c8bb809f6f5f9c5c04fda13454ff2c/pa/KU94506_a0193ad6939ce5415a08de924afecd27.jpg not downloaded yet
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1439c37f90>
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac2e882b-3ac7-54a4-8742-a09a07f150cd/ac2e882b-3ac7-54a4-8742-a09a07f150cd_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/f5/49f5a2b3f4cdda74c12da23ed4884d10/pa/BL55245_1a52825f6b06901d2b9aece263f0cc25.jpg saved to cache
2026-04-27 07:55:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ac2e882b-3ac7-54a4-8742-a09a07f150cd
2026-04-27 07:55:15 [auto1.fr] INFO: Found listing with ID: MC10318
2026-04-27 07:55:15 [auto1.fr] INFO: Scrape type for MC10318: 2
2026-04-27 07:55:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5101a0ed-52fb-5557-8e2e-cf7dedc8025a with identifier: MC10318
2026-04-27 07:55:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5101a0ed-52fb-5557-8e2e-cf7dedc8025a with scrape type 2
2026-04-27 07:55:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5101a0ed-52fb-5557-8e2e-cf7dedc8025a with scrape type 2
2026-04-27 07:55:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5101a0ed-52fb-5557-8e2e-cf7dedc8025a, identifier: MC10318
2026-04-27 07:55:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 27c88b4a-98c4-5874-a914-14eab952a4f6 with identifier: NS88227
2026-04-27 07:55:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 27c88b4a-98c4-5874-a914-14eab952a4f6 with identifier: NS88227
2026-04-27 07:55:15 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 27c88b4a-98c4-5874-a914-14eab952a4f6 with identifier: NS88227 to the API
2026-04-27 07:55:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:15 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-04-28T15:06:25Z',
 'fuel_type': 'diesel',
 'id': '27c88b4a-98c4-5874-a914-14eab952a4f6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NS88227',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 159543,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2018-06-28',
 'seller_name': None,
 'title': 'Renault Captur 1.5 dCi Energy Intens',
 'transmission': 'manual',
 'trim': 'Intens',
 'year': 2018}
2026-04-27 07:55:15 [auto1.fr] INFO: Saving data for NS88227: {'auction_closing_time': 1777388785.0, 'created_time': 1777023572.25987, 'has_photos': True, 'last_price_update_time': 1777276515.457492}
2026-04-27 07:55:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5101a0ed-52fb-5557-8e2e-cf7dedc8025a with identifier: MC10318
2026-04-27 07:55:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5101a0ed-52fb-5557-8e2e-cf7dedc8025a with identifier: MC10318
2026-04-27 07:55:15 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 5101a0ed-52fb-5557-8e2e-cf7dedc8025a with identifier: MC10318 to the API
2026-04-27 07:55:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:15 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-04-28T15:39:29Z',
 'fuel_type': 'diesel',
 'id': '5101a0ed-52fb-5557-8e2e-cf7dedc8025a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MC10318',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 170285,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2011-04-29',
 'seller_name': None,
 'title': 'Renault Twingo 1.5 dCi Yahoo!',
 'transmission': 'manual',
 'trim': 'Yahoo!',
 'year': 2011}
2026-04-27 07:55:15 [auto1.fr] INFO: Saving data for MC10318: {'auction_closing_time': 1777390769.0, 'created_time': 1777023641.679175, 'has_photos': True, 'last_price_update_time': 1777276515.785397}
2026-04-27 07:55:15 [auto1.fr] INFO: Found listing with ID: YR59514
2026-04-27 07:55:15 [auto1.fr] INFO: Scrape type for YR59514: 2
2026-04-27 07:55:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c74b19e3-c49d-5f16-8fe6-94c1c1d85aea with identifier: YR59514
2026-04-27 07:55:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c74b19e3-c49d-5f16-8fe6-94c1c1d85aea with scrape type 2
2026-04-27 07:55:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c74b19e3-c49d-5f16-8fe6-94c1c1d85aea with scrape type 2
2026-04-27 07:55:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c74b19e3-c49d-5f16-8fe6-94c1c1d85aea, identifier: YR59514
2026-04-27 07:55:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/d5/83d52bbb58e8e2509dfb7a53c7a157a0/pa/CU39401_cd9fb5af89bc52e389381df8ea21220c.jpg not downloaded yet
2026-04-27 07:55:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/f5/49f5a2b3f4cdda74c12da23ed4884d10/pa/BL55245_91d55fbb3217082920c10564e3e81289.jpg not downloaded yet
2026-04-27 07:55:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/c8/45c8bb809f6f5f9c5c04fda13454ff2c/pa/KU94506_f33d4ecf50bd90170744bba5b7732acd.jpg not downloaded yet
2026-04-27 07:55:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DY54580/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/d5/83d52bbb58e8e2509dfb7a53c7a157a0/pa/CU39401_c0f032ba096661b4faf517ad3683bed7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/d5/83d52bbb58e8e2509dfb7a53c7a157a0/pa/CU39401_2cc0f9924c1c74171619c3dfe6fbb824.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/f5/49f5a2b3f4cdda74c12da23ed4884d10/pa/BL55245_cf77645c04a1a7c89ca5428b56a306de.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:16 [auto1.fr] INFO: Found listing with ID: MR66023
2026-04-27 07:55:16 [auto1.fr] INFO: Scrape type for MR66023: 2
2026-04-27 07:55:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5422a8a-3b95-5ec3-89d6-99b1c73a1f66 with identifier: MR66023
2026-04-27 07:55:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5422a8a-3b95-5ec3-89d6-99b1c73a1f66 with scrape type 2
2026-04-27 07:55:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b5422a8a-3b95-5ec3-89d6-99b1c73a1f66 with scrape type 2
2026-04-27 07:55:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b5422a8a-3b95-5ec3-89d6-99b1c73a1f66, identifier: MR66023
2026-04-27 07:55:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c74b19e3-c49d-5f16-8fe6-94c1c1d85aea with identifier: YR59514
2026-04-27 07:55:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c74b19e3-c49d-5f16-8fe6-94c1c1d85aea with identifier: YR59514
2026-04-27 07:55:16 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c74b19e3-c49d-5f16-8fe6-94c1c1d85aea with identifier: YR59514 to the API
2026-04-27 07:55:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:16 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-04-28T15:46:10Z',
 'fuel_type': 'petrol',
 'id': 'c74b19e3-c49d-5f16-8fe6-94c1c1d85aea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YR59514',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Citroen',
 'model': 'C3 Aircross',
 'odometer': 49695,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2020-06-15',
 'seller_name': None,
 'title': 'Citroen C3 Aircross 1.2 PureTech Shine',
 'transmission': 'manual',
 'trim': 'Shine',
 'year': 2020}
2026-04-27 07:55:16 [auto1.fr] INFO: Saving data for YR59514: {'auction_closing_time': 1777391170.0, 'created_time': 1777023598.356366, 'has_photos': True, 'last_price_update_time': 1777276516.957375}
2026-04-27 07:55:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SU49210/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b5422a8a-3b95-5ec3-89d6-99b1c73a1f66 with identifier: MR66023
2026-04-27 07:55:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b5422a8a-3b95-5ec3-89d6-99b1c73a1f66 with identifier: MR66023
2026-04-27 07:55:17 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b5422a8a-3b95-5ec3-89d6-99b1c73a1f66 with identifier: MR66023 to the API
2026-04-27 07:55:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:17 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 177,
 'expiration_date': '2026-04-28T15:33:41Z',
 'fuel_type': 'diesel',
 'id': 'b5422a8a-3b95-5ec3-89d6-99b1c73a1f66',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MR66023',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 175716,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2013-09-30',
 'seller_name': None,
 'title': 'Audi Q3 2.0 TDI quattro Ambition Luxe',
 'transmission': 'automatic',
 'trim': 'quattro Ambition Luxe',
 'year': 2013}
2026-04-27 07:55:17 [auto1.fr] INFO: Saving data for MR66023: {'auction_closing_time': 1777390421.0, 'created_time': 1777024358.833214, 'has_photos': True, 'last_price_update_time': 1777276517.365623}
2026-04-27 07:55:17 [auto1.fr] INFO: Found listing with ID: FD49599
2026-04-27 07:55:17 [auto1.fr] INFO: Scrape type for FD49599: 2
2026-04-27 07:55:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9e39ec9-eeac-548d-8b31-b57b7af792f9 with identifier: FD49599
2026-04-27 07:55:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9e39ec9-eeac-548d-8b31-b57b7af792f9 with scrape type 2
2026-04-27 07:55:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e9e39ec9-eeac-548d-8b31-b57b7af792f9 with scrape type 2
2026-04-27 07:55:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e9e39ec9-eeac-548d-8b31-b57b7af792f9, identifier: FD49599
2026-04-27 07:55:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/d5/83d52bbb58e8e2509dfb7a53c7a157a0/pa/CU39401_c8e085cc8743f7b34cbea04a351b5807.jpg not downloaded yet
2026-04-27 07:55:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/f5/49f5a2b3f4cdda74c12da23ed4884d10/pa/BL55245_77c6da2699c0f6996fa30f9ace61f694.jpg not downloaded yet
2026-04-27 07:55:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/c8/45c8bb809f6f5f9c5c04fda13454ff2c/pa/KU94506_501218577fa9b2fabe19609614209283.jpg not downloaded yet
2026-04-27 07:55:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:17 [auto1.fr] INFO: Found listing with ID: SR18679
2026-04-27 07:55:17 [auto1.fr] INFO: Scrape type for SR18679: 1
2026-04-27 07:55:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e9e39ec9-eeac-548d-8b31-b57b7af792f9 with identifier: FD49599
2026-04-27 07:55:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e9e39ec9-eeac-548d-8b31-b57b7af792f9 with identifier: FD49599
2026-04-27 07:55:17 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e9e39ec9-eeac-548d-8b31-b57b7af792f9 with identifier: FD49599 to the API
2026-04-27 07:55:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:18 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-04-28T15:29:01Z',
 'fuel_type': 'petrol',
 'id': 'e9e39ec9-eeac-548d-8b31-b57b7af792f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FD49599',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 132518,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2014-10-16',
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 VTi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2014}
2026-04-27 07:55:18 [auto1.fr] INFO: Saving data for FD49599: {'auction_closing_time': 1777390141.0, 'created_time': 1777022324.237841, 'has_photos': True, 'last_price_update_time': 1777276518.454948}
2026-04-27 07:55:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YZ83641/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:18 [auto1.fr] INFO: Found listing with ID: YK73635
2026-04-27 07:55:18 [auto1.fr] INFO: Scrape type for YK73635: 2
2026-04-27 07:55:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b9cdcbb-067c-5c40-806e-81673504cc82 with identifier: YK73635
2026-04-27 07:55:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b9cdcbb-067c-5c40-806e-81673504cc82 with scrape type 2
2026-04-27 07:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5b9cdcbb-067c-5c40-806e-81673504cc82 with scrape type 2
2026-04-27 07:55:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5b9cdcbb-067c-5c40-806e-81673504cc82, identifier: YK73635
2026-04-27 07:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/c8/45c8bb809f6f5f9c5c04fda13454ff2c/pa/KU94506_44694dd7119074c2229fff5dee5586ec.jpg not downloaded yet
2026-04-27 07:55:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:18 [auto1.fr] INFO: Found listing with ID: WH71797
2026-04-27 07:55:18 [auto1.fr] INFO: Scrape type for WH71797: 2
2026-04-27 07:55:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11e73303-06e4-5635-aaf2-e5449ae0c27d with identifier: WH71797
2026-04-27 07:55:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11e73303-06e4-5635-aaf2-e5449ae0c27d with scrape type 2
2026-04-27 07:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 11e73303-06e4-5635-aaf2-e5449ae0c27d with scrape type 2
2026-04-27 07:55:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 11e73303-06e4-5635-aaf2-e5449ae0c27d, identifier: WH71797
2026-04-27 07:55:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5b9cdcbb-067c-5c40-806e-81673504cc82 with identifier: YK73635
2026-04-27 07:55:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5b9cdcbb-067c-5c40-806e-81673504cc82 with identifier: YK73635
2026-04-27 07:55:18 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 5b9cdcbb-067c-5c40-806e-81673504cc82 with identifier: YK73635 to the API
2026-04-27 07:55:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:19 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-04-28T15:28:31Z',
 'fuel_type': 'diesel',
 'id': '5b9cdcbb-067c-5c40-806e-81673504cc82',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YK73635',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Peugeot',
 'model': '308',
 'odometer': 152731,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2020-05-18',
 'seller_name': None,
 'title': 'Peugeot 308 1.5 Blue-HDi Active Business',
 'transmission': 'manual',
 'trim': 'Active Business',
 'year': 2020}
2026-04-27 07:55:19 [auto1.fr] INFO: Saving data for YK73635: {'auction_closing_time': 1777390111.0, 'created_time': 1777023563.449553, 'has_photos': True, 'last_price_update_time': 1777276519.38341}
2026-04-27 07:55:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c5f110>
2026-04-27 07:55:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_308936d8-9358-5614-8cf5-9a92ec62ed9e/308936d8-9358-5614-8cf5-9a92ec62ed9e_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/d5/83d52bbb58e8e2509dfb7a53c7a157a0/pa/CU39401_c0f032ba096661b4faf517ad3683bed7.jpg saved to cache
2026-04-27 07:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 308936d8-9358-5614-8cf5-9a92ec62ed9e
2026-04-27 07:55:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c608d0>
2026-04-27 07:55:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_308936d8-9358-5614-8cf5-9a92ec62ed9e/308936d8-9358-5614-8cf5-9a92ec62ed9e_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/d5/83d52bbb58e8e2509dfb7a53c7a157a0/pa/CU39401_2cc0f9924c1c74171619c3dfe6fbb824.jpg saved to cache
2026-04-27 07:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 308936d8-9358-5614-8cf5-9a92ec62ed9e
2026-04-27 07:55:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c29a10>
2026-04-27 07:55:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac2e882b-3ac7-54a4-8742-a09a07f150cd/ac2e882b-3ac7-54a4-8742-a09a07f150cd_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/f5/49f5a2b3f4cdda74c12da23ed4884d10/pa/BL55245_cf77645c04a1a7c89ca5428b56a306de.jpg saved to cache
2026-04-27 07:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ac2e882b-3ac7-54a4-8742-a09a07f150cd
2026-04-27 07:55:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/f5/49f5a2b3f4cdda74c12da23ed4884d10/pa/BL55245_afb1824d2294d1be2a426e5c24f2342b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 11e73303-06e4-5635-aaf2-e5449ae0c27d with identifier: WH71797
2026-04-27 07:55:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 11e73303-06e4-5635-aaf2-e5449ae0c27d with identifier: WH71797
2026-04-27 07:55:19 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 11e73303-06e4-5635-aaf2-e5449ae0c27d with identifier: WH71797 to the API
2026-04-27 07:55:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:19 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-04-28T15:00:57Z',
 'fuel_type': 'petrol',
 'id': '11e73303-06e4-5635-aaf2-e5449ae0c27d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WH71797',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 87128,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2001-02-22',
 'seller_name': None,
 'title': 'Renault Twingo 1.2 Expression',
 'transmission': 'manual',
 'trim': 'Expression',
 'year': 2001}
2026-04-27 07:55:19 [auto1.fr] INFO: Saving data for WH71797: {'auction_closing_time': 1777388457.0, 'created_time': 1777023596.67245, 'has_photos': True, 'last_price_update_time': 1777276519.953732}
2026-04-27 07:55:19 [auto1.fr] INFO: Found listing with ID: RA48817
2026-04-27 07:55:19 [auto1.fr] INFO: Scrape type for RA48817: 1
2026-04-27 07:55:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/c8/45c8bb809f6f5f9c5c04fda13454ff2c/pa/KU94506_8fde1581a086e269d9be1ee3b3f43c5f.jpg not downloaded yet
2026-04-27 07:55:20 [auto1.fr] INFO: Found listing with ID: BW62863
2026-04-27 07:55:20 [auto1.fr] INFO: Scrape type for BW62863: 1
2026-04-27 07:55:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/c8/45c8bb809f6f5f9c5c04fda13454ff2c/pa/KU94506_f33d4ecf50bd90170744bba5b7732acd.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:20 [auto1.fr] INFO: Found listing with ID: TG37812
2026-04-27 07:55:20 [auto1.fr] INFO: Scrape type for TG37812: 1
2026-04-27 07:55:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/c8/45c8bb809f6f5f9c5c04fda13454ff2c/pa/KU94506_501218577fa9b2fabe19609614209283.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:20 [auto1.fr] INFO: Found listing with ID: XG33570
2026-04-27 07:55:20 [auto1.fr] INFO: Scrape type for XG33570: 2
2026-04-27 07:55:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: feb94096-7866-5669-b62a-978addbdeb57 with identifier: XG33570
2026-04-27 07:55:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item feb94096-7866-5669-b62a-978addbdeb57 with scrape type 2
2026-04-27 07:55:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item feb94096-7866-5669-b62a-978addbdeb57 with scrape type 2
2026-04-27 07:55:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: feb94096-7866-5669-b62a-978addbdeb57, identifier: XG33570
2026-04-27 07:55:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-04-27 07:55:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-04-27 07:55:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-04-27 07:55:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-04-27 07:55:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-04-27 07:55:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c87b10>
2026-04-27 07:55:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac2e882b-3ac7-54a4-8742-a09a07f150cd/ac2e882b-3ac7-54a4-8742-a09a07f150cd_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/f5/49f5a2b3f4cdda74c12da23ed4884d10/pa/BL55245_afb1824d2294d1be2a426e5c24f2342b.jpg saved to cache
2026-04-27 07:55:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ac2e882b-3ac7-54a4-8742-a09a07f150cd
2026-04-27 07:55:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: feb94096-7866-5669-b62a-978addbdeb57 with identifier: XG33570
2026-04-27 07:55:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: feb94096-7866-5669-b62a-978addbdeb57 with identifier: XG33570
2026-04-27 07:55:20 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: feb94096-7866-5669-b62a-978addbdeb57 with identifier: XG33570 to the API
2026-04-27 07:55:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:20 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 60,
 'expiration_date': '2026-04-28T15:01:18Z',
 'fuel_type': 'petrol',
 'id': 'feb94096-7866-5669-b62a-978addbdeb57',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XG33570',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 131481,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2009-05-10',
 'seller_name': None,
 'title': "Skoda Fabia 1.2 Pep's",
 'transmission': 'manual',
 'trim': "Pep's",
 'year': 2009}
2026-04-27 07:55:20 [auto1.fr] INFO: Saving data for XG33570: {'auction_closing_time': 1777388478.0, 'created_time': 1777023597.98333, 'has_photos': True, 'last_price_update_time': 1777276520.565919}
2026-04-27 07:55:20 [auto1.fr] INFO: Found listing with ID: LE81617
2026-04-27 07:55:20 [auto1.fr] INFO: Scrape type for LE81617: 2
2026-04-27 07:55:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e13cf1dd-7ae0-552a-b5d9-fb53b8884013 with identifier: LE81617
2026-04-27 07:55:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e13cf1dd-7ae0-552a-b5d9-fb53b8884013 with scrape type 2
2026-04-27 07:55:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e13cf1dd-7ae0-552a-b5d9-fb53b8884013 with scrape type 2
2026-04-27 07:55:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e13cf1dd-7ae0-552a-b5d9-fb53b8884013, identifier: LE81617
2026-04-27 07:55:20 [auto1.fr] INFO: Found listing with ID: GH48056
2026-04-27 07:55:20 [auto1.fr] INFO: Scrape type for GH48056: 2
2026-04-27 07:55:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2da72756-6c46-5f56-b338-b21f4eb902db with identifier: GH48056
2026-04-27 07:55:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2da72756-6c46-5f56-b338-b21f4eb902db with scrape type 2
2026-04-27 07:55:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2da72756-6c46-5f56-b338-b21f4eb902db with scrape type 2
2026-04-27 07:55:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2da72756-6c46-5f56-b338-b21f4eb902db, identifier: GH48056
2026-04-27 07:55:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e13cf1dd-7ae0-552a-b5d9-fb53b8884013 with identifier: LE81617
2026-04-27 07:55:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e13cf1dd-7ae0-552a-b5d9-fb53b8884013 with identifier: LE81617
2026-04-27 07:55:20 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e13cf1dd-7ae0-552a-b5d9-fb53b8884013 with identifier: LE81617 to the API
2026-04-27 07:55:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:21 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 85,
 'expiration_date': '2026-04-28T15:38:08Z',
 'fuel_type': 'petrol',
 'id': 'e13cf1dd-7ae0-552a-b5d9-fb53b8884013',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LE81617',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 134562,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2013-04-04',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Color Edition',
 'transmission': 'manual',
 'trim': 'Color Edition',
 'year': 2013}
2026-04-27 07:55:21 [auto1.fr] INFO: Saving data for LE81617: {'auction_closing_time': 1777390688.0, 'created_time': 1777023602.692933, 'has_photos': True, 'last_price_update_time': 1777276521.160717}
2026-04-27 07:55:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2da72756-6c46-5f56-b338-b21f4eb902db with identifier: GH48056
2026-04-27 07:55:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2da72756-6c46-5f56-b338-b21f4eb902db with identifier: GH48056
2026-04-27 07:55:21 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2da72756-6c46-5f56-b338-b21f4eb902db with identifier: GH48056 to the API
2026-04-27 07:55:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:21 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-04-28T15:29:28Z',
 'fuel_type': 'diesel',
 'id': '2da72756-6c46-5f56-b338-b21f4eb902db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GH48056',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 100208,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2018-11-29',
 'seller_name': None,
 'title': 'Dacia Duster 1.5 Blue dCi Prestige',
 'transmission': 'manual',
 'trim': 'Prestige',
 'year': 2018}
2026-04-27 07:55:21 [auto1.fr] INFO: Saving data for GH48056: {'auction_closing_time': 1777390168.0, 'created_time': 1777024975.45681, 'has_photos': True, 'last_price_update_time': 1777276521.46104}
2026-04-27 07:55:21 [auto1.fr] INFO: Found listing with ID: FE78243
2026-04-27 07:55:21 [auto1.fr] INFO: Scrape type for FE78243: 1
2026-04-27 07:55:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c28990>
2026-04-27 07:55:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43d1cee6-66cb-5992-b289-2b653dc37a1c/43d1cee6-66cb-5992-b289-2b653dc37a1c_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/c8/45c8bb809f6f5f9c5c04fda13454ff2c/pa/KU94506_f33d4ecf50bd90170744bba5b7732acd.jpg saved to cache
2026-04-27 07:55:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 43d1cee6-66cb-5992-b289-2b653dc37a1c
2026-04-27 07:55:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b02ad0>
2026-04-27 07:55:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43d1cee6-66cb-5992-b289-2b653dc37a1c/43d1cee6-66cb-5992-b289-2b653dc37a1c_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/c8/45c8bb809f6f5f9c5c04fda13454ff2c/pa/KU94506_501218577fa9b2fabe19609614209283.jpg saved to cache
2026-04-27 07:55:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 43d1cee6-66cb-5992-b289-2b653dc37a1c
2026-04-27 07:55:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/c8/45c8bb809f6f5f9c5c04fda13454ff2c/pa/KU94506_8fde1581a086e269d9be1ee3b3f43c5f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:21 [auto1.fr] INFO: Found listing with ID: BZ74074
2026-04-27 07:55:21 [auto1.fr] INFO: Found listing with ID: TB94788
2026-04-27 07:55:21 [auto1.fr] INFO: Scrape type for TB94788: 1
2026-04-27 07:55:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SE81249/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:21 [auto1.fr] INFO: Found listing with ID: XZ65279
2026-04-27 07:55:21 [auto1.fr] INFO: Scrape type for XZ65279: 1
2026-04-27 07:55:21 [auto1.fr] INFO: Found listing with ID: GR59488
2026-04-27 07:55:21 [auto1.fr] INFO: Scrape type for GR59488: 2
2026-04-27 07:55:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a97db00-24f8-56d2-9672-6db10cfaaa37 with identifier: GR59488
2026-04-27 07:55:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a97db00-24f8-56d2-9672-6db10cfaaa37 with scrape type 2
2026-04-27 07:55:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9a97db00-24f8-56d2-9672-6db10cfaaa37 with scrape type 2
2026-04-27 07:55:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 9a97db00-24f8-56d2-9672-6db10cfaaa37, identifier: GR59488
2026-04-27 07:55:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 9a97db00-24f8-56d2-9672-6db10cfaaa37 with identifier: GR59488
2026-04-27 07:55:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 9a97db00-24f8-56d2-9672-6db10cfaaa37 with identifier: GR59488
2026-04-27 07:55:21 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 9a97db00-24f8-56d2-9672-6db10cfaaa37 with identifier: GR59488 to the API
2026-04-27 07:55:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:21 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 117,
 'expiration_date': '2026-04-28T15:17:41Z',
 'fuel_type': 'petrol',
 'id': '9a97db00-24f8-56d2-9672-6db10cfaaa37',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GR59488',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 147032,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2013-11-21',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.6 Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2013}
2026-04-27 07:55:22 [auto1.fr] INFO: Saving data for GR59488: {'auction_closing_time': 1777389461.0, 'created_time': 1777023614.444652, 'has_photos': True, 'last_price_update_time': 1777276522.065371}
2026-04-27 07:55:22 [auto1.fr] INFO: Found listing with ID: FD54899
2026-04-27 07:55:22 [auto1.fr] INFO: Scrape type for FD54899: 1
2026-04-27 07:55:22 [auto1.fr] INFO: Found listing with ID: MM74389
2026-04-27 07:55:22 [auto1.fr] INFO: Scrape type for MM74389: 1
2026-04-27 07:55:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HP74277/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a71f10>
2026-04-27 07:55:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43d1cee6-66cb-5992-b289-2b653dc37a1c/43d1cee6-66cb-5992-b289-2b653dc37a1c_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/c8/45c8bb809f6f5f9c5c04fda13454ff2c/pa/KU94506_8fde1581a086e269d9be1ee3b3f43c5f.jpg saved to cache
2026-04-27 07:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 43d1cee6-66cb-5992-b289-2b653dc37a1c
2026-04-27 07:55:22 [auto1.fr] INFO: Found listing with ID: WU07507
2026-04-27 07:55:22 [auto1.fr] INFO: Scrape type for WU07507: 1
2026-04-27 07:55:22 [auto1.fr] INFO: Found listing with ID: NK88443
2026-04-27 07:55:22 [auto1.fr] INFO: Scrape type for NK88443: 2
2026-04-27 07:55:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 530b9f07-94d1-5736-bb32-4c0275825fd7 with identifier: NK88443
2026-04-27 07:55:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 530b9f07-94d1-5736-bb32-4c0275825fd7 with scrape type 2
2026-04-27 07:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 530b9f07-94d1-5736-bb32-4c0275825fd7 with scrape type 2
2026-04-27 07:55:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 530b9f07-94d1-5736-bb32-4c0275825fd7, identifier: NK88443
2026-04-27 07:55:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EA73513/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 530b9f07-94d1-5736-bb32-4c0275825fd7 with identifier: NK88443
2026-04-27 07:55:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 530b9f07-94d1-5736-bb32-4c0275825fd7 with identifier: NK88443
2026-04-27 07:55:22 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 530b9f07-94d1-5736-bb32-4c0275825fd7 with identifier: NK88443 to the API
2026-04-27 07:55:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:22 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 250,
 'expiration_date': '2026-04-28T15:43:06Z',
 'fuel_type': 'diesel',
 'id': '530b9f07-94d1-5736-bb32-4c0275825fd7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NK88443',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Porsche',
 'model': 'Panamera',
 'odometer': 222793,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2012-04-02',
 'seller_name': None,
 'title': 'Porsche Panamera Diesel',
 'transmission': 'automatic',
 'trim': '',
 'year': 2012}
2026-04-27 07:55:22 [auto1.fr] INFO: Saving data for NK88443: {'auction_closing_time': 1777390986.0, 'created_time': 1777019584.66272, 'has_photos': True, 'last_price_update_time': 1777276522.661204}
2026-04-27 07:55:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:22 [auto1.fr] INFO: Found listing with ID: SF33375
2026-04-27 07:55:22 [auto1.fr] INFO: Scrape type for SF33375: 2
2026-04-27 07:55:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be5e04e4-33cd-5d6c-87a5-b3a396a97ea7 with identifier: SF33375
2026-04-27 07:55:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be5e04e4-33cd-5d6c-87a5-b3a396a97ea7 with scrape type 2
2026-04-27 07:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item be5e04e4-33cd-5d6c-87a5-b3a396a97ea7 with scrape type 2
2026-04-27 07:55:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: be5e04e4-33cd-5d6c-87a5-b3a396a97ea7, identifier: SF33375
2026-04-27 07:55:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: be5e04e4-33cd-5d6c-87a5-b3a396a97ea7 with identifier: SF33375
2026-04-27 07:55:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: be5e04e4-33cd-5d6c-87a5-b3a396a97ea7 with identifier: SF33375
2026-04-27 07:55:23 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: be5e04e4-33cd-5d6c-87a5-b3a396a97ea7 with identifier: SF33375 to the API
2026-04-27 07:55:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:23 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 360,
 'expiration_date': '2026-04-28T15:49:22Z',
 'fuel_type': 'petrol',
 'id': 'be5e04e4-33cd-5d6c-87a5-b3a396a97ea7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SF33375',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Porsche',
 'model': 'Macan',
 'odometer': 210280,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2017-06-19',
 'seller_name': None,
 'title': 'Porsche Macan GTS',
 'transmission': 'automatic',
 'trim': '',
 'year': 2017}
2026-04-27 07:55:23 [auto1.fr] INFO: Saving data for SF33375: {'auction_closing_time': 1777391362.0, 'created_time': 1777020617.891984, 'has_photos': True, 'last_price_update_time': 1777276523.215109}
2026-04-27 07:55:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GN80196/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SK23170/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:23 [auto1.fr] INFO: Found listing with ID: LJ30136
2026-04-27 07:55:23 [auto1.fr] INFO: Scrape type for LJ30136: 1
2026-04-27 07:55:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UB37186/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NH82777> (referer: https://www.auto1.com/v1/car-details-view/NH82777/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:23 [auto1.fr] INFO: Found listing with ID: CE05021
2026-04-27 07:55:23 [auto1.fr] INFO: Scrape type for CE05021: 1
2026-04-27 07:55:23 [auto1.fr] INFO: Found listing with ID: LU64065
2026-04-27 07:55:23 [auto1.fr] INFO: Scrape type for LU64065: 1
2026-04-27 07:55:23 [crawlers.middlewares.monitoring_spider_middleware] ERROR: invalid literal for int() with base 10: 'other'
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/auto1.py", line 231, in parse_api_search
    item = self._listing_from_search_result(car, channel, car_stock_number)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/auto1.py", line 346, in _listing_from_search_result
    item["doors_number"] = int(car.get("doors"))
                           ^^^^^^^^^^^^^^^^^^^^^
ValueError: invalid literal for int() with base 10: 'other'
2026-04-27 07:55:23 [crawlers.middlewares.monitoring_spider_middleware] ERROR: invalid literal for int() with base 10: 'other'
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/auto1.py", line 231, in parse_api_search
    item = self._listing_from_search_result(car, channel, car_stock_number)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/auto1.py", line 346, in _listing_from_search_result
    item["doors_number"] = int(car.get("doors"))
                           ^^^^^^^^^^^^^^^^^^^^^
ValueError: invalid literal for int() with base 10: 'other'
2026-04-27 07:55:23 [crawlers.middlewares.monitoring_spider_middleware] ERROR: invalid literal for int() with base 10: 'other'
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/auto1.py", line 231, in parse_api_search
    item = self._listing_from_search_result(car, channel, car_stock_number)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/auto1.py", line 346, in _listing_from_search_result
    item["doors_number"] = int(car.get("doors"))
                           ^^^^^^^^^^^^^^^^^^^^^
ValueError: invalid literal for int() with base 10: 'other'
2026-04-27 07:55:23 [crawlers.middlewares.monitoring_spider_middleware] ERROR: invalid literal for int() with base 10: 'other'
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/auto1.py", line 231, in parse_api_search
    item = self._listing_from_search_result(car, channel, car_stock_number)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/auto1.py", line 346, in _listing_from_search_result
    item["doors_number"] = int(car.get("doors"))
                           ^^^^^^^^^^^^^^^^^^^^^
ValueError: invalid literal for int() with base 10: 'other'
2026-04-27 07:55:23 [crawlers.middlewares.monitoring_spider_middleware] ERROR: invalid literal for int() with base 10: 'other'
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/auto1.py", line 231, in parse_api_search
    item = self._listing_from_search_result(car, channel, car_stock_number)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/auto1.py", line 346, in _listing_from_search_result
    item["doors_number"] = int(car.get("doors"))
                           ^^^^^^^^^^^^^^^^^^^^^
ValueError: invalid literal for int() with base 10: 'other'
2026-04-27 07:55:23 [crawlers.middlewares.monitoring_spider_middleware] ERROR: invalid literal for int() with base 10: 'other'
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/auto1.py", line 231, in parse_api_search
    item = self._listing_from_search_result(car, channel, car_stock_number)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/auto1.py", line 346, in _listing_from_search_result
    item["doors_number"] = int(car.get("doors"))
                           ^^^^^^^^^^^^^^^^^^^^^
ValueError: invalid literal for int() with base 10: 'other'
2026-04-27 07:55:23 [crawlers.middlewares.monitoring_spider_middleware] ERROR: invalid literal for int() with base 10: 'other'
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/auto1.py", line 231, in parse_api_search
    item = self._listing_from_search_result(car, channel, car_stock_number)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/auto1.py", line 346, in _listing_from_search_result
    item["doors_number"] = int(car.get("doors"))
                           ^^^^^^^^^^^^^^^^^^^^^
ValueError: invalid literal for int() with base 10: 'other'
2026-04-27 07:55:24 [scrapy.core.scraper] ERROR: Spider error processing <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 295, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 374, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 355, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 374, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 355, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy_zyte_api/_middlewares.py", line 206, in process_spider_output_async
    async for item_or_request in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/auto1.py", line 231, in parse_api_search
    item = self._listing_from_search_result(car, channel, car_stock_number)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/auto1.py", line 346, in _listing_from_search_result
    item["doors_number"] = int(car.get("doors"))
                           ^^^^^^^^^^^^^^^^^^^^^
ValueError: invalid literal for int() with base 10: 'other'
2026-04-27 07:55:24 [auto1.fr] INFO: Channel: 24h | Page: 4 | totalHits: 4719 | hits on page: 40
2026-04-27 07:55:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b155135f-8ca7-56e9-9ae2-be09ca0e2fa9 with identifier: NH82777
2026-04-27 07:55:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b155135f-8ca7-56e9-9ae2-be09ca0e2fa9 with scrape type 1
2026-04-27 07:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item b155135f-8ca7-56e9-9ae2-be09ca0e2fa9
2026-04-27 07:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/49/f8491f5cdebd17c919e5884d83616b41/pa/NH82777_6ab3d6873ec4aa42319e5784917c55e0.jpg not downloaded yet
2026-04-27 07:55:24 [auto1.fr] INFO: Found listing with ID: UG74072
2026-04-27 07:55:24 [auto1.fr] INFO: Scrape type for UG74072: 1
2026-04-27 07:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/49/f8491f5cdebd17c919e5884d83616b41/pa/NH82777_d9a4754f062e686dac415602eb06252a.jpg not downloaded yet
2026-04-27 07:55:24 [auto1.fr] INFO: Found listing with ID: WB70972
2026-04-27 07:55:24 [auto1.fr] INFO: Scrape type for WB70972: 2
2026-04-27 07:55:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23e819ce-84ce-5b72-82eb-0993586df097 with identifier: WB70972
2026-04-27 07:55:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23e819ce-84ce-5b72-82eb-0993586df097 with scrape type 2
2026-04-27 07:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23e819ce-84ce-5b72-82eb-0993586df097 with scrape type 2
2026-04-27 07:55:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 23e819ce-84ce-5b72-82eb-0993586df097, identifier: WB70972
2026-04-27 07:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/49/f8491f5cdebd17c919e5884d83616b41/pa/NH82777_322ba23eafc002cd14e971a36956ef24.jpg not downloaded yet
2026-04-27 07:55:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 23e819ce-84ce-5b72-82eb-0993586df097 with identifier: WB70972
2026-04-27 07:55:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 23e819ce-84ce-5b72-82eb-0993586df097 with identifier: WB70972
2026-04-27 07:55:24 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 23e819ce-84ce-5b72-82eb-0993586df097 with identifier: WB70972 to the API
2026-04-27 07:55:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:24 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 285,
 'expiration_date': '2026-04-28T15:36:28Z',
 'fuel_type': 'diesel',
 'id': '23e819ce-84ce-5b72-82eb-0993586df097',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WB70972',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Mercedes-Benz',
 'model': 'S-Klasse',
 'odometer': 82808,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2019-11-07',
 'seller_name': None,
 'title': 'Mercedes-Benz S-Klasse S 350 d L 4Matic',
 'transmission': 'automatic',
 'trim': 'L 4Matic',
 'year': 2019}
2026-04-27 07:55:24 [auto1.fr] INFO: Saving data for WB70972: {'auction_closing_time': 1777390588.0, 'created_time': 1777020892.102542, 'has_photos': True, 'last_price_update_time': 1777276524.913752}
2026-04-27 07:55:24 [auto1.fr] INFO: Found listing with ID: MJ78206
2026-04-27 07:55:24 [auto1.fr] INFO: Scrape type for MJ78206: 2
2026-04-27 07:55:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0aefab78-80d2-51f2-bb6c-0a04277d9716 with identifier: MJ78206
2026-04-27 07:55:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0aefab78-80d2-51f2-bb6c-0a04277d9716 with scrape type 2
2026-04-27 07:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0aefab78-80d2-51f2-bb6c-0a04277d9716 with scrape type 2
2026-04-27 07:55:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0aefab78-80d2-51f2-bb6c-0a04277d9716, identifier: MJ78206
2026-04-27 07:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/49/f8491f5cdebd17c919e5884d83616b41/pa/NH82777_fce7aec10f240edfd7f25071472d8aea.jpg not downloaded yet
2026-04-27 07:55:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0aefab78-80d2-51f2-bb6c-0a04277d9716 with identifier: MJ78206
2026-04-27 07:55:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0aefab78-80d2-51f2-bb6c-0a04277d9716 with identifier: MJ78206
2026-04-27 07:55:25 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 0aefab78-80d2-51f2-bb6c-0a04277d9716 with identifier: MJ78206 to the API
2026-04-27 07:55:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:25 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-04-28T15:24:09Z',
 'fuel_type': 'petrol',
 'id': '0aefab78-80d2-51f2-bb6c-0a04277d9716',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MJ78206',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 61878,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2015-11-03',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 TSI Lounge BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Lounge BlueMotion Tech',
 'year': 2015}
2026-04-27 07:55:25 [auto1.fr] INFO: Saving data for MJ78206: {'auction_closing_time': 1777389849.0, 'created_time': 1777020522.332651, 'has_photos': True, 'last_price_update_time': 1777276525.361718}
2026-04-27 07:55:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VF20612> (referer: https://www.auto1.com/v1/car-details-view/VF20612/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TA08713> (referer: https://www.auto1.com/v1/car-details-view/TA08713/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:25 [auto1.fr] INFO: Found listing with ID: CS20843
2026-04-27 07:55:25 [auto1.fr] INFO: Scrape type for CS20843: 1
2026-04-27 07:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/49/f8491f5cdebd17c919e5884d83616b41/pa/NH82777_9b869309f8d8a7b86d6e39341d05fbc1.jpg not downloaded yet
2026-04-27 07:55:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CF81227> (referer: https://www.auto1.com/v1/car-details-view/CF81227/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:25 [auto1.fr] INFO: Found listing with ID: KC11723
2026-04-27 07:55:25 [auto1.fr] INFO: Scrape type for KC11723: 2
2026-04-27 07:55:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3fe19ad0-79b1-52bd-87a9-973869e3bc30 with identifier: KC11723
2026-04-27 07:55:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3fe19ad0-79b1-52bd-87a9-973869e3bc30 with scrape type 2
2026-04-27 07:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3fe19ad0-79b1-52bd-87a9-973869e3bc30 with scrape type 2
2026-04-27 07:55:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3fe19ad0-79b1-52bd-87a9-973869e3bc30, identifier: KC11723
2026-04-27 07:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/49/f8491f5cdebd17c919e5884d83616b41/pa/NH82777_7d03634f3fe253535706546b626951b1.jpg not downloaded yet
2026-04-27 07:55:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3fe19ad0-79b1-52bd-87a9-973869e3bc30 with identifier: KC11723
2026-04-27 07:55:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3fe19ad0-79b1-52bd-87a9-973869e3bc30 with identifier: KC11723
2026-04-27 07:55:25 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 3fe19ad0-79b1-52bd-87a9-973869e3bc30 with identifier: KC11723 to the API
2026-04-27 07:55:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:25 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 68,
 'expiration_date': '2026-04-28T15:52:41Z',
 'fuel_type': 'diesel',
 'id': '3fe19ad0-79b1-52bd-87a9-973869e3bc30',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KC11723',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Citroen',
 'model': 'C2',
 'odometer': 249542,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2007-05-17',
 'seller_name': None,
 'title': 'Citroen C2 1.4 HDi Pulp',
 'transmission': 'manual',
 'trim': 'Pulp',
 'year': 2007}
2026-04-27 07:55:25 [auto1.fr] INFO: Saving data for KC11723: {'auction_closing_time': 1777391561.0, 'created_time': 1777019281.442435, 'has_photos': True, 'last_price_update_time': 1777276525.875984}
2026-04-27 07:55:25 [auto1.fr] INFO: Found listing with ID: PW05542
2026-04-27 07:55:25 [auto1.fr] INFO: Scrape type for PW05542: 1
2026-04-27 07:55:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/49/f8491f5cdebd17c919e5884d83616b41/pa/NH82777_322ba23eafc002cd14e971a36956ef24.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/49/f8491f5cdebd17c919e5884d83616b41/pa/NH82777_fce7aec10f240edfd7f25071472d8aea.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:25 [auto1.fr] INFO: Found listing with ID: AH90220
2026-04-27 07:55:25 [auto1.fr] INFO: Scrape type for AH90220: 2
2026-04-27 07:55:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3806cb79-e5f9-5281-a90d-1c11f1cdf9cf with identifier: AH90220
2026-04-27 07:55:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3806cb79-e5f9-5281-a90d-1c11f1cdf9cf with scrape type 2
2026-04-27 07:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3806cb79-e5f9-5281-a90d-1c11f1cdf9cf with scrape type 2
2026-04-27 07:55:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3806cb79-e5f9-5281-a90d-1c11f1cdf9cf, identifier: AH90220
2026-04-27 07:55:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61df9884-38a2-5c5b-8b45-b706541588c8 with identifier: VF20612
2026-04-27 07:55:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61df9884-38a2-5c5b-8b45-b706541588c8 with scrape type 1
2026-04-27 07:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 61df9884-38a2-5c5b-8b45-b706541588c8
2026-04-27 07:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/09/6e0972b07c3a1cbea9c95b25aa871a6b/pa/VF20612_0089ae023651bb2c546824ff4b3ce670.jpg not downloaded yet
2026-04-27 07:55:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0994b952-599e-52cc-89ea-c16e3404144e with identifier: TA08713
2026-04-27 07:55:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0994b952-599e-52cc-89ea-c16e3404144e with scrape type 1
2026-04-27 07:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0994b952-599e-52cc-89ea-c16e3404144e
2026-04-27 07:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/fb/d3fb6e092c8ae612cc276954dd3c7268/pa/TA08713_167cfa50def38dcdee4c91e8e320caa7.jpg not downloaded yet
2026-04-27 07:55:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7353ee17-53d0-5744-b24f-1f56deae3762 with identifier: CF81227
2026-04-27 07:55:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7353ee17-53d0-5744-b24f-1f56deae3762 with scrape type 1
2026-04-27 07:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7353ee17-53d0-5744-b24f-1f56deae3762
2026-04-27 07:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/26/1c26ea922860f7abb3c30306ae8d5a56/pa/CF81227_cde681c9f8c71a27fed99950e4757216.jpg not downloaded yet
2026-04-27 07:55:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3806cb79-e5f9-5281-a90d-1c11f1cdf9cf with identifier: AH90220
2026-04-27 07:55:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3806cb79-e5f9-5281-a90d-1c11f1cdf9cf with identifier: AH90220
2026-04-27 07:55:26 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 3806cb79-e5f9-5281-a90d-1c11f1cdf9cf with identifier: AH90220 to the API
2026-04-27 07:55:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:26 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-04-28T15:27:17Z',
 'fuel_type': 'petrol',
 'id': '3806cb79-e5f9-5281-a90d-1c11f1cdf9cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AH90220',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 92702,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2014-07-16',
 'seller_name': None,
 'title': 'Renault Captur 1.2 TCe Intens',
 'transmission': 'automatic',
 'trim': 'Intens',
 'year': 2014}
2026-04-27 07:55:26 [auto1.fr] INFO: Saving data for AH90220: {'auction_closing_time': 1777390037.0, 'created_time': 1777020054.988073, 'has_photos': True, 'last_price_update_time': 1777276526.461345}
2026-04-27 07:55:26 [auto1.fr] INFO: Found listing with ID: NF39193
2026-04-27 07:55:26 [auto1.fr] INFO: Scrape type for NF39193: 2
2026-04-27 07:55:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 22fbca76-1cbe-541b-b794-9fea4a1d8838 with identifier: NF39193
2026-04-27 07:55:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22fbca76-1cbe-541b-b794-9fea4a1d8838 with scrape type 2
2026-04-27 07:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 22fbca76-1cbe-541b-b794-9fea4a1d8838 with scrape type 2
2026-04-27 07:55:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 22fbca76-1cbe-541b-b794-9fea4a1d8838, identifier: NF39193
2026-04-27 07:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/09/6e0972b07c3a1cbea9c95b25aa871a6b/pa/VF20612_5833ede1bf298417fff0b29d984f237e.jpg not downloaded yet
2026-04-27 07:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/fb/d3fb6e092c8ae612cc276954dd3c7268/pa/TA08713_f5aad987534d957191f985b5de340584.jpg not downloaded yet
2026-04-27 07:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/26/1c26ea922860f7abb3c30306ae8d5a56/pa/CF81227_8648c1d2004fcdd173898ffda717ff9b.jpg not downloaded yet
2026-04-27 07:55:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/49/f8491f5cdebd17c919e5884d83616b41/pa/NH82777_9b869309f8d8a7b86d6e39341d05fbc1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 22fbca76-1cbe-541b-b794-9fea4a1d8838 with identifier: NF39193
2026-04-27 07:55:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 22fbca76-1cbe-541b-b794-9fea4a1d8838 with identifier: NF39193
2026-04-27 07:55:26 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 22fbca76-1cbe-541b-b794-9fea4a1d8838 with identifier: NF39193 to the API
2026-04-27 07:55:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:26 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 163,
 'expiration_date': '2026-04-28T15:21:52Z',
 'fuel_type': 'diesel',
 'id': '22fbca76-1cbe-541b-b794-9fea4a1d8838',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NF39193',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Citroen',
 'model': 'C5',
 'odometer': 182250,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2010-09-26',
 'seller_name': None,
 'title': 'Citroen C5 2.0 HDi Exclusive',
 'transmission': 'manual',
 'trim': 'Exclusive',
 'year': 2010}
2026-04-27 07:55:27 [auto1.fr] INFO: Saving data for NF39193: {'auction_closing_time': 1777389712.0, 'created_time': 1777022146.344618, 'has_photos': True, 'last_price_update_time': 1777276527.104559}
2026-04-27 07:55:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FE78243/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SU49210> (referer: https://www.auto1.com/v1/car-details-view/SU49210/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c2c210>
2026-04-27 07:55:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b155135f-8ca7-56e9-9ae2-be09ca0e2fa9/b155135f-8ca7-56e9-9ae2-be09ca0e2fa9_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/49/f8491f5cdebd17c919e5884d83616b41/pa/NH82777_322ba23eafc002cd14e971a36956ef24.jpg saved to cache
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b155135f-8ca7-56e9-9ae2-be09ca0e2fa9
2026-04-27 07:55:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d92c90>
2026-04-27 07:55:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b155135f-8ca7-56e9-9ae2-be09ca0e2fa9/b155135f-8ca7-56e9-9ae2-be09ca0e2fa9_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/49/f8491f5cdebd17c919e5884d83616b41/pa/NH82777_fce7aec10f240edfd7f25071472d8aea.jpg saved to cache
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b155135f-8ca7-56e9-9ae2-be09ca0e2fa9
2026-04-27 07:55:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/49/f8491f5cdebd17c919e5884d83616b41/pa/NH82777_7d03634f3fe253535706546b626951b1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:27 [auto1.fr] INFO: Found listing with ID: FF87313
2026-04-27 07:55:27 [auto1.fr] INFO: Scrape type for FF87313: 1
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/09/6e0972b07c3a1cbea9c95b25aa871a6b/pa/VF20612_70921968110d18fe31bcb48aed932d31.jpg not downloaded yet
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/fb/d3fb6e092c8ae612cc276954dd3c7268/pa/TA08713_db99c99ac4ead898c7d63d004c35a491.jpg not downloaded yet
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/26/1c26ea922860f7abb3c30306ae8d5a56/pa/CF81227_91404bdbe102b735b7398d0563bb9a13.jpg not downloaded yet
2026-04-27 07:55:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YW08307> (referer: https://www.auto1.com/v1/car-details-view/YW08307/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YZ83641> (referer: https://www.auto1.com/v1/car-details-view/YZ83641/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:27 [auto1.fr] INFO: Found listing with ID: ET93179
2026-04-27 07:55:27 [auto1.fr] INFO: Scrape type for ET93179: 1
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/09/6e0972b07c3a1cbea9c95b25aa871a6b/pa/VF20612_6a894a50ec2d835692bd67d6dd5a1522.jpg not downloaded yet
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/fb/d3fb6e092c8ae612cc276954dd3c7268/pa/TA08713_24c7136a47edc44ec21dc0219072171a.jpg not downloaded yet
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/26/1c26ea922860f7abb3c30306ae8d5a56/pa/CF81227_bfc2765822ca16358a9dabff048e819d.jpg not downloaded yet
2026-04-27 07:55:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c6c550>
2026-04-27 07:55:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b155135f-8ca7-56e9-9ae2-be09ca0e2fa9/b155135f-8ca7-56e9-9ae2-be09ca0e2fa9_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/49/f8491f5cdebd17c919e5884d83616b41/pa/NH82777_9b869309f8d8a7b86d6e39341d05fbc1.jpg saved to cache
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b155135f-8ca7-56e9-9ae2-be09ca0e2fa9
2026-04-27 07:55:27 [auto1.fr] INFO: Found listing with ID: JJ06707
2026-04-27 07:55:27 [auto1.fr] INFO: Scrape type for JJ06707: 2
2026-04-27 07:55:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e320c557-0f17-596e-85c0-982fd0b93251 with identifier: JJ06707
2026-04-27 07:55:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e320c557-0f17-596e-85c0-982fd0b93251 with scrape type 2
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e320c557-0f17-596e-85c0-982fd0b93251 with scrape type 2
2026-04-27 07:55:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e320c557-0f17-596e-85c0-982fd0b93251, identifier: JJ06707
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/09/6e0972b07c3a1cbea9c95b25aa871a6b/pa/VF20612_0cfe051a2b4b45dd409b1637c3b59b47.jpg not downloaded yet
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/fb/d3fb6e092c8ae612cc276954dd3c7268/pa/TA08713_4e866879836f367981f611131136796c.jpg not downloaded yet
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/26/1c26ea922860f7abb3c30306ae8d5a56/pa/CF81227_d20d1ddb491632cf5019cafc20494aa1.jpg not downloaded yet
2026-04-27 07:55:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2232960-7d9b-5500-b9f0-f7813319ccc6 with identifier: SU49210
2026-04-27 07:55:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2232960-7d9b-5500-b9f0-f7813319ccc6 with scrape type 1
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item f2232960-7d9b-5500-b9f0-f7813319ccc6
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/d7/1ad74f32bd23044aac14ab5bfad0bff3/pa/SU49210_cec391c0a91888798bf0d48bcbb7acf3.jpg not downloaded yet
2026-04-27 07:55:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/26/1c26ea922860f7abb3c30306ae8d5a56/pa/CF81227_cde681c9f8c71a27fed99950e4757216.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/09/6e0972b07c3a1cbea9c95b25aa871a6b/pa/VF20612_5833ede1bf298417fff0b29d984f237e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e320c557-0f17-596e-85c0-982fd0b93251 with identifier: JJ06707
2026-04-27 07:55:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e320c557-0f17-596e-85c0-982fd0b93251 with identifier: JJ06707
2026-04-27 07:55:27 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e320c557-0f17-596e-85c0-982fd0b93251 with identifier: JJ06707 to the API
2026-04-27 07:55:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:27 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-04-28T15:51:58Z',
 'fuel_type': 'petrol',
 'id': 'e320c557-0f17-596e-85c0-982fd0b93251',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JJ06707',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Nissan',
 'model': 'Qashqai+2',
 'odometer': 133037,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2014-02-17',
 'seller_name': None,
 'title': 'Nissan Qashqai+2 2.0 Tekna',
 'transmission': 'manual',
 'trim': 'Tekna',
 'year': 2014}
2026-04-27 07:55:27 [auto1.fr] INFO: Saving data for JJ06707: {'auction_closing_time': 1777391518.0, 'created_time': 1777021455.363163, 'has_photos': True, 'last_price_update_time': 1777276527.998666}
2026-04-27 07:55:28 [auto1.fr] INFO: Found listing with ID: GC36158
2026-04-27 07:55:28 [auto1.fr] INFO: Scrape type for GC36158: 2
2026-04-27 07:55:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8016c3a-5cae-579a-8fd9-c83096fc75e4 with identifier: GC36158
2026-04-27 07:55:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8016c3a-5cae-579a-8fd9-c83096fc75e4 with scrape type 2
2026-04-27 07:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f8016c3a-5cae-579a-8fd9-c83096fc75e4 with scrape type 2
2026-04-27 07:55:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f8016c3a-5cae-579a-8fd9-c83096fc75e4, identifier: GC36158
2026-04-27 07:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/09/6e0972b07c3a1cbea9c95b25aa871a6b/pa/VF20612_73eb11d15ac3124e61fb76489dc58481.jpg not downloaded yet
2026-04-27 07:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/fb/d3fb6e092c8ae612cc276954dd3c7268/pa/TA08713_f1b816b81372cdfe0b98552cb3bcc95f.jpg not downloaded yet
2026-04-27 07:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/26/1c26ea922860f7abb3c30306ae8d5a56/pa/CF81227_038c0c4d12b35b61ac374076f59b5284.jpg not downloaded yet
2026-04-27 07:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/d7/1ad74f32bd23044aac14ab5bfad0bff3/pa/SU49210_bacd0a54a4825074c5b5337f0e314b82.jpg not downloaded yet
2026-04-27 07:55:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143807fe50>
2026-04-27 07:55:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b155135f-8ca7-56e9-9ae2-be09ca0e2fa9/b155135f-8ca7-56e9-9ae2-be09ca0e2fa9_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/49/f8491f5cdebd17c919e5884d83616b41/pa/NH82777_7d03634f3fe253535706546b626951b1.jpg saved to cache
2026-04-27 07:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b155135f-8ca7-56e9-9ae2-be09ca0e2fa9
2026-04-27 07:55:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04 with identifier: YW08307
2026-04-27 07:55:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04 with scrape type 1
2026-04-27 07:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04
2026-04-27 07:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/cd/1acd89f71810cf630e095a83740d3638/pa/YW08307_f8608365da7d744b24da06789ac116dd.jpg not downloaded yet
2026-04-27 07:55:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 155c8fd5-d977-5582-a0bd-e0679c478b8d with identifier: YZ83641
2026-04-27 07:55:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 155c8fd5-d977-5582-a0bd-e0679c478b8d with scrape type 1
2026-04-27 07:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 155c8fd5-d977-5582-a0bd-e0679c478b8d
2026-04-27 07:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/23/1823e6af665e4b2c83169fc52a485e0c/pa/YZ83641_f73f3c8323edf468e671803a7541eeb0.jpg not downloaded yet
2026-04-27 07:55:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/fb/d3fb6e092c8ae612cc276954dd3c7268/pa/TA08713_f5aad987534d957191f985b5de340584.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/09/6e0972b07c3a1cbea9c95b25aa871a6b/pa/VF20612_0089ae023651bb2c546824ff4b3ce670.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/fb/d3fb6e092c8ae612cc276954dd3c7268/pa/TA08713_167cfa50def38dcdee4c91e8e320caa7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/26/1c26ea922860f7abb3c30306ae8d5a56/pa/CF81227_8648c1d2004fcdd173898ffda717ff9b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f8016c3a-5cae-579a-8fd9-c83096fc75e4 with identifier: GC36158
2026-04-27 07:55:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f8016c3a-5cae-579a-8fd9-c83096fc75e4 with identifier: GC36158
2026-04-27 07:55:28 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f8016c3a-5cae-579a-8fd9-c83096fc75e4 with identifier: GC36158 to the API
2026-04-27 07:55:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:28 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-04-28T15:44:55Z',
 'fuel_type': 'petrol',
 'id': 'f8016c3a-5cae-579a-8fd9-c83096fc75e4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GC36158',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Peugeot',
 'model': '208',
 'odometer': 86660,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2018-03-28',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 e-VTi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2018}
2026-04-27 07:55:28 [auto1.fr] INFO: Saving data for GC36158: {'auction_closing_time': 1777391095.0, 'created_time': 1777020292.128432, 'has_photos': True, 'last_price_update_time': 1777276528.748732}
2026-04-27 07:55:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TG37812/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FD54899/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:28 [auto1.fr] INFO: Found listing with ID: BV80652
2026-04-27 07:55:28 [auto1.fr] INFO: Scrape type for BV80652: 1
2026-04-27 07:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/09/6e0972b07c3a1cbea9c95b25aa871a6b/pa/VF20612_a133f9169d1184cac79054bb98fb0a80.jpg not downloaded yet
2026-04-27 07:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/fb/d3fb6e092c8ae612cc276954dd3c7268/pa/TA08713_3768493b07c99a16cce1f2010847c625.jpg not downloaded yet
2026-04-27 07:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/26/1c26ea922860f7abb3c30306ae8d5a56/pa/CF81227_a4ae5805279537325aacfd6585950a51.jpg not downloaded yet
2026-04-27 07:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/d7/1ad74f32bd23044aac14ab5bfad0bff3/pa/SU49210_70dcb68ff12d3fcc2a99e7a8eb451ec3.jpg not downloaded yet
2026-04-27 07:55:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/cd/1acd89f71810cf630e095a83740d3638/pa/YW08307_893e34ea68c09c7e8b274c58337c2a15.jpg not downloaded yet
2026-04-27 07:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/23/1823e6af665e4b2c83169fc52a485e0c/pa/YZ83641_5146a1d899520f6a941682bafa21a3bd.jpg not downloaded yet
2026-04-27 07:55:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WU07507/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438098250>
2026-04-27 07:55:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7353ee17-53d0-5744-b24f-1f56deae3762/7353ee17-53d0-5744-b24f-1f56deae3762_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/26/1c26ea922860f7abb3c30306ae8d5a56/pa/CF81227_cde681c9f8c71a27fed99950e4757216.jpg saved to cache
2026-04-27 07:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7353ee17-53d0-5744-b24f-1f56deae3762
2026-04-27 07:55:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b37210>
2026-04-27 07:55:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61df9884-38a2-5c5b-8b45-b706541588c8/61df9884-38a2-5c5b-8b45-b706541588c8_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/09/6e0972b07c3a1cbea9c95b25aa871a6b/pa/VF20612_5833ede1bf298417fff0b29d984f237e.jpg saved to cache
2026-04-27 07:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 61df9884-38a2-5c5b-8b45-b706541588c8
2026-04-27 07:55:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/fb/d3fb6e092c8ae612cc276954dd3c7268/pa/TA08713_24c7136a47edc44ec21dc0219072171a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/26/1c26ea922860f7abb3c30306ae8d5a56/pa/CF81227_bfc2765822ca16358a9dabff048e819d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:28 [auto1.fr] INFO: Found listing with ID: RS49285
2026-04-27 07:55:28 [auto1.fr] INFO: Scrape type for RS49285: 2
2026-04-27 07:55:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5988acef-469c-5da2-834a-006f188d0e2a with identifier: RS49285
2026-04-27 07:55:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5988acef-469c-5da2-834a-006f188d0e2a with scrape type 2
2026-04-27 07:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5988acef-469c-5da2-834a-006f188d0e2a with scrape type 2
2026-04-27 07:55:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5988acef-469c-5da2-834a-006f188d0e2a, identifier: RS49285
2026-04-27 07:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/09/6e0972b07c3a1cbea9c95b25aa871a6b/pa/VF20612_64a924ce54bc8f1a3b8ab0b7657ecb14.jpg not downloaded yet
2026-04-27 07:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/fb/d3fb6e092c8ae612cc276954dd3c7268/pa/TA08713_eb672eedc7ba4d5a7aa8ec98120b0d26.jpg not downloaded yet
2026-04-27 07:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/26/1c26ea922860f7abb3c30306ae8d5a56/pa/CF81227_473005c63baef8909ceeb60e5c54e7f7.jpg not downloaded yet
2026-04-27 07:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/d7/1ad74f32bd23044aac14ab5bfad0bff3/pa/SU49210_82d2e42894b3890af71784aba9a6c954.jpg not downloaded yet
2026-04-27 07:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/cd/1acd89f71810cf630e095a83740d3638/pa/YW08307_b2a16445c81bc0d5f5c9bc19536984f7.jpg not downloaded yet
2026-04-27 07:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/23/1823e6af665e4b2c83169fc52a485e0c/pa/YZ83641_13813ae9eac96fcc355c845234277e0c.jpg not downloaded yet
2026-04-27 07:55:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5988acef-469c-5da2-834a-006f188d0e2a with identifier: RS49285
2026-04-27 07:55:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5988acef-469c-5da2-834a-006f188d0e2a with identifier: RS49285
2026-04-27 07:55:29 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 5988acef-469c-5da2-834a-006f188d0e2a with identifier: RS49285 to the API
2026-04-27 07:55:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:29 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-04-28T15:22:03Z',
 'fuel_type': 'diesel',
 'id': '5988acef-469c-5da2-834a-006f188d0e2a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RS49285',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 54407,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2020-06-24',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 200 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2020}
2026-04-27 07:55:29 [auto1.fr] INFO: Saving data for RS49285: {'auction_closing_time': 1777389723.0, 'created_time': 1777020819.657996, 'has_photos': True, 'last_price_update_time': 1777276529.522828}
2026-04-27 07:55:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ba6590>
2026-04-27 07:55:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0994b952-599e-52cc-89ea-c16e3404144e/0994b952-599e-52cc-89ea-c16e3404144e_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/fb/d3fb6e092c8ae612cc276954dd3c7268/pa/TA08713_f5aad987534d957191f985b5de340584.jpg saved to cache
2026-04-27 07:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0994b952-599e-52cc-89ea-c16e3404144e
2026-04-27 07:55:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438f0a010>
2026-04-27 07:55:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61df9884-38a2-5c5b-8b45-b706541588c8/61df9884-38a2-5c5b-8b45-b706541588c8_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/09/6e0972b07c3a1cbea9c95b25aa871a6b/pa/VF20612_0089ae023651bb2c546824ff4b3ce670.jpg saved to cache
2026-04-27 07:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 61df9884-38a2-5c5b-8b45-b706541588c8
2026-04-27 07:55:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438be8e10>
2026-04-27 07:55:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0994b952-599e-52cc-89ea-c16e3404144e/0994b952-599e-52cc-89ea-c16e3404144e_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/fb/d3fb6e092c8ae612cc276954dd3c7268/pa/TA08713_167cfa50def38dcdee4c91e8e320caa7.jpg saved to cache
2026-04-27 07:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0994b952-599e-52cc-89ea-c16e3404144e
2026-04-27 07:55:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438afa090>
2026-04-27 07:55:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7353ee17-53d0-5744-b24f-1f56deae3762/7353ee17-53d0-5744-b24f-1f56deae3762_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/26/1c26ea922860f7abb3c30306ae8d5a56/pa/CF81227_8648c1d2004fcdd173898ffda717ff9b.jpg saved to cache
2026-04-27 07:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7353ee17-53d0-5744-b24f-1f56deae3762
2026-04-27 07:55:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/cd/1acd89f71810cf630e095a83740d3638/pa/YW08307_f8608365da7d744b24da06789ac116dd.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/d7/1ad74f32bd23044aac14ab5bfad0bff3/pa/SU49210_bacd0a54a4825074c5b5337f0e314b82.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:29 [auto1.fr] INFO: Found listing with ID: PE12831
2026-04-27 07:55:29 [auto1.fr] INFO: Scrape type for PE12831: 2
2026-04-27 07:55:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39b64be9-2f98-52e2-b99e-f46d3ca15117 with identifier: PE12831
2026-04-27 07:55:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39b64be9-2f98-52e2-b99e-f46d3ca15117 with scrape type 2
2026-04-27 07:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 39b64be9-2f98-52e2-b99e-f46d3ca15117 with scrape type 2
2026-04-27 07:55:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 39b64be9-2f98-52e2-b99e-f46d3ca15117, identifier: PE12831
2026-04-27 07:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/09/6e0972b07c3a1cbea9c95b25aa871a6b/pa/VF20612_077bf4a105858cbfc0f3091909150885.jpg not downloaded yet
2026-04-27 07:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/fb/d3fb6e092c8ae612cc276954dd3c7268/pa/TA08713_1bacf1163aa6e1a7467bb9c24fa34dda.jpg not downloaded yet
2026-04-27 07:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/26/1c26ea922860f7abb3c30306ae8d5a56/pa/CF81227_f79885782705818aaaa805d24af53c7d.jpg not downloaded yet
2026-04-27 07:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/d7/1ad74f32bd23044aac14ab5bfad0bff3/pa/SU49210_ce9bdcdd836cd705772e32f336bbc6eb.jpg not downloaded yet
2026-04-27 07:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/cd/1acd89f71810cf630e095a83740d3638/pa/YW08307_9031b0272cc525351dafb9769064d96a.jpg not downloaded yet
2026-04-27 07:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/23/1823e6af665e4b2c83169fc52a485e0c/pa/YZ83641_1f6392ebe0d33725f711aeaf653bbbb5.jpg not downloaded yet
2026-04-27 07:55:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/23/1823e6af665e4b2c83169fc52a485e0c/pa/YZ83641_f73f3c8323edf468e671803a7541eeb0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/fb/d3fb6e092c8ae612cc276954dd3c7268/pa/TA08713_f1b816b81372cdfe0b98552cb3bcc95f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/09/6e0972b07c3a1cbea9c95b25aa871a6b/pa/VF20612_73eb11d15ac3124e61fb76489dc58481.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/26/1c26ea922860f7abb3c30306ae8d5a56/pa/CF81227_038c0c4d12b35b61ac374076f59b5284.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 39b64be9-2f98-52e2-b99e-f46d3ca15117 with identifier: PE12831
2026-04-27 07:55:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 39b64be9-2f98-52e2-b99e-f46d3ca15117 with identifier: PE12831
2026-04-27 07:55:30 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 39b64be9-2f98-52e2-b99e-f46d3ca15117 with identifier: PE12831 to the API
2026-04-27 07:55:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:30 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-04-28T15:27:54Z',
 'fuel_type': 'petrol',
 'id': '39b64be9-2f98-52e2-b99e-f46d3ca15117',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PE12831',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Citroen',
 'model': 'C3 Aircross',
 'odometer': 119256,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2018-03-22',
 'seller_name': None,
 'title': 'Citroen C3 Aircross 1.2 PureTech Shine',
 'transmission': 'automatic',
 'trim': 'Shine',
 'year': 2018}
2026-04-27 07:55:30 [auto1.fr] INFO: Saving data for PE12831: {'auction_closing_time': 1777390074.0, 'created_time': 1777022372.004795, 'has_photos': True, 'last_price_update_time': 1777276530.35518}
2026-04-27 07:55:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b48410>
2026-04-27 07:55:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0994b952-599e-52cc-89ea-c16e3404144e/0994b952-599e-52cc-89ea-c16e3404144e_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/fb/d3fb6e092c8ae612cc276954dd3c7268/pa/TA08713_24c7136a47edc44ec21dc0219072171a.jpg saved to cache
2026-04-27 07:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0994b952-599e-52cc-89ea-c16e3404144e
2026-04-27 07:55:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c6a150>
2026-04-27 07:55:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7353ee17-53d0-5744-b24f-1f56deae3762/7353ee17-53d0-5744-b24f-1f56deae3762_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/26/1c26ea922860f7abb3c30306ae8d5a56/pa/CF81227_bfc2765822ca16358a9dabff048e819d.jpg saved to cache
2026-04-27 07:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7353ee17-53d0-5744-b24f-1f56deae3762
2026-04-27 07:55:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:30 [auto1.fr] INFO: Found listing with ID: GT54355
2026-04-27 07:55:30 [auto1.fr] INFO: Scrape type for GT54355: 1
2026-04-27 07:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/09/6e0972b07c3a1cbea9c95b25aa871a6b/pa/VF20612_cc24eb2c18e9e1c77036d3e13ad1dec3.jpg not downloaded yet
2026-04-27 07:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/fb/d3fb6e092c8ae612cc276954dd3c7268/pa/TA08713_0393c211352aa0dc7b79ae5615668e12.jpg not downloaded yet
2026-04-27 07:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/26/1c26ea922860f7abb3c30306ae8d5a56/pa/CF81227_027f71d5e2420236d9db2b51d8a74138.jpg not downloaded yet
2026-04-27 07:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/d7/1ad74f32bd23044aac14ab5bfad0bff3/pa/SU49210_89f15b21990c655fb6681aabb00a1d86.jpg not downloaded yet
2026-04-27 07:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/cd/1acd89f71810cf630e095a83740d3638/pa/YW08307_1e8c7e5f1f0053461bdafd0466526644.jpg not downloaded yet
2026-04-27 07:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/23/1823e6af665e4b2c83169fc52a485e0c/pa/YZ83641_fd08ed39f793b7712f8d9bd96279617e.jpg not downloaded yet
2026-04-27 07:55:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/cd/1acd89f71810cf630e095a83740d3638/pa/YW08307_893e34ea68c09c7e8b274c58337c2a15.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/d7/1ad74f32bd23044aac14ab5bfad0bff3/pa/SU49210_cec391c0a91888798bf0d48bcbb7acf3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/23/1823e6af665e4b2c83169fc52a485e0c/pa/YZ83641_5146a1d899520f6a941682bafa21a3bd.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:30 [auto1.fr] INFO: Found listing with ID: KZ47376
2026-04-27 07:55:30 [auto1.fr] INFO: Scrape type for KZ47376: 1
2026-04-27 07:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/cd/1acd89f71810cf630e095a83740d3638/pa/YW08307_59f6c9f63aed7301240f88f1e6fc427d.jpg not downloaded yet
2026-04-27 07:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/23/1823e6af665e4b2c83169fc52a485e0c/pa/YZ83641_5ac54e1d12942079a68b82af5b2940a5.jpg not downloaded yet
2026-04-27 07:55:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GP77578> (referer: https://www.auto1.com/v1/car-details-view/GP77578/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438fd7250>
2026-04-27 07:55:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04/c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/cd/1acd89f71810cf630e095a83740d3638/pa/YW08307_f8608365da7d744b24da06789ac116dd.jpg saved to cache
2026-04-27 07:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04
2026-04-27 07:55:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438eb5850>
2026-04-27 07:55:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2232960-7d9b-5500-b9f0-f7813319ccc6/f2232960-7d9b-5500-b9f0-f7813319ccc6_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/d7/1ad74f32bd23044aac14ab5bfad0bff3/pa/SU49210_bacd0a54a4825074c5b5337f0e314b82.jpg saved to cache
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f2232960-7d9b-5500-b9f0-f7813319ccc6
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c28310>
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_155c8fd5-d977-5582-a0bd-e0679c478b8d/155c8fd5-d977-5582-a0bd-e0679c478b8d_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/23/1823e6af665e4b2c83169fc52a485e0c/pa/YZ83641_f73f3c8323edf468e671803a7541eeb0.jpg saved to cache
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 155c8fd5-d977-5582-a0bd-e0679c478b8d
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438eb7110>
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0994b952-599e-52cc-89ea-c16e3404144e/0994b952-599e-52cc-89ea-c16e3404144e_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/fb/d3fb6e092c8ae612cc276954dd3c7268/pa/TA08713_f1b816b81372cdfe0b98552cb3bcc95f.jpg saved to cache
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0994b952-599e-52cc-89ea-c16e3404144e
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1447a05090>
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61df9884-38a2-5c5b-8b45-b706541588c8/61df9884-38a2-5c5b-8b45-b706541588c8_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/09/6e0972b07c3a1cbea9c95b25aa871a6b/pa/VF20612_73eb11d15ac3124e61fb76489dc58481.jpg saved to cache
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 61df9884-38a2-5c5b-8b45-b706541588c8
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380707d0>
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7353ee17-53d0-5744-b24f-1f56deae3762/7353ee17-53d0-5744-b24f-1f56deae3762_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/26/1c26ea922860f7abb3c30306ae8d5a56/pa/CF81227_038c0c4d12b35b61ac374076f59b5284.jpg saved to cache
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7353ee17-53d0-5744-b24f-1f56deae3762
2026-04-27 07:55:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/cd/1acd89f71810cf630e095a83740d3638/pa/YW08307_b2a16445c81bc0d5f5c9bc19536984f7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/23/1823e6af665e4b2c83169fc52a485e0c/pa/YZ83641_13813ae9eac96fcc355c845234277e0c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/d7/1ad74f32bd23044aac14ab5bfad0bff3/pa/SU49210_82d2e42894b3890af71784aba9a6c954.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/26/1c26ea922860f7abb3c30306ae8d5a56/pa/CF81227_473005c63baef8909ceeb60e5c54e7f7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:31 [auto1.fr] INFO: Found listing with ID: KE85331
2026-04-27 07:55:31 [auto1.fr] INFO: Scrape type for KE85331: 1
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/cd/1acd89f71810cf630e095a83740d3638/pa/YW08307_35d2d0c42b2ca05b56fd08f8964fce9a.jpg not downloaded yet
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/23/1823e6af665e4b2c83169fc52a485e0c/pa/YZ83641_930eb1dae56ae5a1b37cd9b0fb2934ce.jpg not downloaded yet
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438200ad0>
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04/c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/cd/1acd89f71810cf630e095a83740d3638/pa/YW08307_893e34ea68c09c7e8b274c58337c2a15.jpg saved to cache
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143819ea90>
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2232960-7d9b-5500-b9f0-f7813319ccc6/f2232960-7d9b-5500-b9f0-f7813319ccc6_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/d7/1ad74f32bd23044aac14ab5bfad0bff3/pa/SU49210_cec391c0a91888798bf0d48bcbb7acf3.jpg saved to cache
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f2232960-7d9b-5500-b9f0-f7813319ccc6
2026-04-27 07:55:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BW62863/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PW05542/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SE81249> (referer: https://www.auto1.com/v1/car-details-view/SE81249/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c68710>
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_155c8fd5-d977-5582-a0bd-e0679c478b8d/155c8fd5-d977-5582-a0bd-e0679c478b8d_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/23/1823e6af665e4b2c83169fc52a485e0c/pa/YZ83641_5146a1d899520f6a941682bafa21a3bd.jpg saved to cache
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 155c8fd5-d977-5582-a0bd-e0679c478b8d
2026-04-27 07:55:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 595f5cf4-61d6-5815-9ba7-f52cfee67d94 with identifier: GP77578
2026-04-27 07:55:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 595f5cf4-61d6-5815-9ba7-f52cfee67d94 with scrape type 1
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 595f5cf4-61d6-5815-9ba7-f52cfee67d94
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/87/128791546d8bf2628c4f2620c49b3e70/pa/GP77578_d6ce1c4fceb386961bcbcf40e54e7a75.jpg not downloaded yet
2026-04-27 07:55:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/cd/1acd89f71810cf630e095a83740d3638/pa/YW08307_1e8c7e5f1f0053461bdafd0466526644.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:31 [auto1.fr] INFO: Found listing with ID: LP12244
2026-04-27 07:55:31 [auto1.fr] INFO: Scrape type for LP12244: 1
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/cd/1acd89f71810cf630e095a83740d3638/pa/YW08307_341eecffd2589a8dd46da98a1009e4d3.jpg not downloaded yet
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/23/1823e6af665e4b2c83169fc52a485e0c/pa/YZ83641_57153809236386930be32ed5ea38cb71.jpg not downloaded yet
2026-04-27 07:55:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/d7/1ad74f32bd23044aac14ab5bfad0bff3/pa/SU49210_89f15b21990c655fb6681aabb00a1d86.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/23/1823e6af665e4b2c83169fc52a485e0c/pa/YZ83641_fd08ed39f793b7712f8d9bd96279617e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/87/128791546d8bf2628c4f2620c49b3e70/pa/GP77578_d2164c4ecbe7af8073b3e0a0c9915678.jpg not downloaded yet
2026-04-27 07:55:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MM74389/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TB94788/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438184510>
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04/c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/cd/1acd89f71810cf630e095a83740d3638/pa/YW08307_b2a16445c81bc0d5f5c9bc19536984f7.jpg saved to cache
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143819a150>
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_155c8fd5-d977-5582-a0bd-e0679c478b8d/155c8fd5-d977-5582-a0bd-e0679c478b8d_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/23/1823e6af665e4b2c83169fc52a485e0c/pa/YZ83641_13813ae9eac96fcc355c845234277e0c.jpg saved to cache
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 155c8fd5-d977-5582-a0bd-e0679c478b8d
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143817cf50>
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2232960-7d9b-5500-b9f0-f7813319ccc6/f2232960-7d9b-5500-b9f0-f7813319ccc6_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/d7/1ad74f32bd23044aac14ab5bfad0bff3/pa/SU49210_82d2e42894b3890af71784aba9a6c954.jpg saved to cache
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f2232960-7d9b-5500-b9f0-f7813319ccc6
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438cf09d0>
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7353ee17-53d0-5744-b24f-1f56deae3762/7353ee17-53d0-5744-b24f-1f56deae3762_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/26/1c26ea922860f7abb3c30306ae8d5a56/pa/CF81227_473005c63baef8909ceeb60e5c54e7f7.jpg saved to cache
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7353ee17-53d0-5744-b24f-1f56deae3762
2026-04-27 07:55:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/09/6e0972b07c3a1cbea9c95b25aa871a6b/pa/VF20612_cc24eb2c18e9e1c77036d3e13ad1dec3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:31 [auto1.fr] INFO: Found listing with ID: EC13815
2026-04-27 07:55:31 [auto1.fr] INFO: Scrape type for EC13815: 1
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/cd/1acd89f71810cf630e095a83740d3638/pa/YW08307_758997013546d9caca5eaf28f033020a.jpg not downloaded yet
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/23/1823e6af665e4b2c83169fc52a485e0c/pa/YZ83641_03850f3f7519ee30e041dfc1cfb1435a.jpg not downloaded yet
2026-04-27 07:55:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/cd/1acd89f71810cf630e095a83740d3638/pa/YW08307_59f6c9f63aed7301240f88f1e6fc427d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/fb/d3fb6e092c8ae612cc276954dd3c7268/pa/TA08713_0393c211352aa0dc7b79ae5615668e12.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/87/128791546d8bf2628c4f2620c49b3e70/pa/GP77578_5643178792d264339781176e5b7d24f9.jpg not downloaded yet
2026-04-27 07:55:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55776317-a1e6-52fe-ae28-786098c328ed with identifier: SE81249
2026-04-27 07:55:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55776317-a1e6-52fe-ae28-786098c328ed with scrape type 1
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 55776317-a1e6-52fe-ae28-786098c328ed
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/0c/6c0cdaf1bb6ea49e2b771a5afc9e5cbe/pa/SE81249_d11f23daac44376a4974d161151ea114.jpg not downloaded yet
2026-04-27 07:55:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/26/1c26ea922860f7abb3c30306ae8d5a56/pa/CF81227_027f71d5e2420236d9db2b51d8a74138.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/23/1823e6af665e4b2c83169fc52a485e0c/pa/YZ83641_5ac54e1d12942079a68b82af5b2940a5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:31 [auto1.fr] INFO: Found listing with ID: GN31601
2026-04-27 07:55:31 [auto1.fr] INFO: Scrape type for GN31601: 1
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/cd/1acd89f71810cf630e095a83740d3638/pa/YW08307_a187da64c45a4602292843fbec4bce65.jpg not downloaded yet
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/23/1823e6af665e4b2c83169fc52a485e0c/pa/YZ83641_e190422c444681e9b568c5d3f2bb5320.jpg not downloaded yet
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380e7a10>
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04/c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/cd/1acd89f71810cf630e095a83740d3638/pa/YW08307_1e8c7e5f1f0053461bdafd0466526644.jpg saved to cache
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438efc650>
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2232960-7d9b-5500-b9f0-f7813319ccc6/f2232960-7d9b-5500-b9f0-f7813319ccc6_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/d7/1ad74f32bd23044aac14ab5bfad0bff3/pa/SU49210_89f15b21990c655fb6681aabb00a1d86.jpg saved to cache
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f2232960-7d9b-5500-b9f0-f7813319ccc6
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a9dc10>
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_155c8fd5-d977-5582-a0bd-e0679c478b8d/155c8fd5-d977-5582-a0bd-e0679c478b8d_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/23/1823e6af665e4b2c83169fc52a485e0c/pa/YZ83641_fd08ed39f793b7712f8d9bd96279617e.jpg saved to cache
2026-04-27 07:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 155c8fd5-d977-5582-a0bd-e0679c478b8d
2026-04-27 07:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/87/128791546d8bf2628c4f2620c49b3e70/pa/GP77578_ebb552ce8867031ccd78a80757c080a2.jpg not downloaded yet
2026-04-27 07:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/0c/6c0cdaf1bb6ea49e2b771a5afc9e5cbe/pa/SE81249_9cc10222226667948d9bd56f3130d5b8.jpg not downloaded yet
2026-04-27 07:55:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/cd/1acd89f71810cf630e095a83740d3638/pa/YW08307_35d2d0c42b2ca05b56fd08f8964fce9a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/87/128791546d8bf2628c4f2620c49b3e70/pa/GP77578_d6ce1c4fceb386961bcbcf40e54e7a75.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:32 [auto1.fr] INFO: Found listing with ID: KH41597
2026-04-27 07:55:32 [auto1.fr] INFO: Scrape type for KH41597: 1
2026-04-27 07:55:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/23/1823e6af665e4b2c83169fc52a485e0c/pa/YZ83641_930eb1dae56ae5a1b37cd9b0fb2934ce.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/87/128791546d8bf2628c4f2620c49b3e70/pa/GP77578_b8146cf1ff7e3deec1e51bc434ccedb3.jpg not downloaded yet
2026-04-27 07:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/0c/6c0cdaf1bb6ea49e2b771a5afc9e5cbe/pa/SE81249_79ca616a024c844783c9c091f3c6bc81.jpg not downloaded yet
2026-04-27 07:55:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438af1610>
2026-04-27 07:55:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61df9884-38a2-5c5b-8b45-b706541588c8/61df9884-38a2-5c5b-8b45-b706541588c8_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/09/6e0972b07c3a1cbea9c95b25aa871a6b/pa/VF20612_cc24eb2c18e9e1c77036d3e13ad1dec3.jpg saved to cache
2026-04-27 07:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 61df9884-38a2-5c5b-8b45-b706541588c8
2026-04-27 07:55:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1439c74710>
2026-04-27 07:55:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04/c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/cd/1acd89f71810cf630e095a83740d3638/pa/YW08307_59f6c9f63aed7301240f88f1e6fc427d.jpg saved to cache
2026-04-27 07:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04
2026-04-27 07:55:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438cccf90>
2026-04-27 07:55:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0994b952-599e-52cc-89ea-c16e3404144e/0994b952-599e-52cc-89ea-c16e3404144e_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/fb/d3fb6e092c8ae612cc276954dd3c7268/pa/TA08713_0393c211352aa0dc7b79ae5615668e12.jpg saved to cache
2026-04-27 07:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0994b952-599e-52cc-89ea-c16e3404144e
2026-04-27 07:55:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1439c77490>
2026-04-27 07:55:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7353ee17-53d0-5744-b24f-1f56deae3762/7353ee17-53d0-5744-b24f-1f56deae3762_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/26/1c26ea922860f7abb3c30306ae8d5a56/pa/CF81227_027f71d5e2420236d9db2b51d8a74138.jpg saved to cache
2026-04-27 07:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7353ee17-53d0-5744-b24f-1f56deae3762
2026-04-27 07:55:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143817f9d0>
2026-04-27 07:55:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_155c8fd5-d977-5582-a0bd-e0679c478b8d/155c8fd5-d977-5582-a0bd-e0679c478b8d_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/23/1823e6af665e4b2c83169fc52a485e0c/pa/YZ83641_5ac54e1d12942079a68b82af5b2940a5.jpg saved to cache
2026-04-27 07:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 155c8fd5-d977-5582-a0bd-e0679c478b8d
2026-04-27 07:55:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/cd/1acd89f71810cf630e095a83740d3638/pa/YW08307_341eecffd2589a8dd46da98a1009e4d3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:32 [auto1.fr] INFO: Found listing with ID: NY83999
2026-04-27 07:55:32 [auto1.fr] INFO: Scrape type for NY83999: 2
2026-04-27 07:55:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2bd49b8f-1557-50d6-a08a-a4ba1406342f with identifier: NY83999
2026-04-27 07:55:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bd49b8f-1557-50d6-a08a-a4ba1406342f with scrape type 2
2026-04-27 07:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2bd49b8f-1557-50d6-a08a-a4ba1406342f with scrape type 2
2026-04-27 07:55:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2bd49b8f-1557-50d6-a08a-a4ba1406342f, identifier: NY83999
2026-04-27 07:55:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/cd/1acd89f71810cf630e095a83740d3638/pa/YW08307_758997013546d9caca5eaf28f033020a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2bd49b8f-1557-50d6-a08a-a4ba1406342f with identifier: NY83999
2026-04-27 07:55:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2bd49b8f-1557-50d6-a08a-a4ba1406342f with identifier: NY83999
2026-04-27 07:55:32 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2bd49b8f-1557-50d6-a08a-a4ba1406342f with identifier: NY83999 to the API
2026-04-27 07:55:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:32 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-04-28T15:32:17Z',
 'fuel_type': 'diesel',
 'id': '2bd49b8f-1557-50d6-a08a-a4ba1406342f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NY83999',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 91045,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2021-08-25',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 d Progressive',
 'transmission': 'automatic',
 'trim': 'Progressive',
 'year': 2021}
2026-04-27 07:55:33 [auto1.fr] INFO: Saving data for NY83999: {'auction_closing_time': 1777390337.0, 'created_time': 1777022761.530131, 'has_photos': True, 'last_price_update_time': 1777276533.119288}
2026-04-27 07:55:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/87/128791546d8bf2628c4f2620c49b3e70/pa/GP77578_1baa83dcb5ea48d73bf2afcd15f03726.jpg not downloaded yet
2026-04-27 07:55:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/0c/6c0cdaf1bb6ea49e2b771a5afc9e5cbe/pa/SE81249_0b3d8839116ecc3e977265d0c2389d42.jpg not downloaded yet
2026-04-27 07:55:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/23/1823e6af665e4b2c83169fc52a485e0c/pa/YZ83641_03850f3f7519ee30e041dfc1cfb1435a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/87/128791546d8bf2628c4f2620c49b3e70/pa/GP77578_d2164c4ecbe7af8073b3e0a0c9915678.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:33 [auto1.fr] INFO: Found listing with ID: TA82614
2026-04-27 07:55:33 [auto1.fr] INFO: Scrape type for TA82614: 2
2026-04-27 07:55:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 834a3252-a586-51b6-838a-88529557abca with identifier: TA82614
2026-04-27 07:55:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 834a3252-a586-51b6-838a-88529557abca with scrape type 2
2026-04-27 07:55:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 834a3252-a586-51b6-838a-88529557abca with scrape type 2
2026-04-27 07:55:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 834a3252-a586-51b6-838a-88529557abca, identifier: TA82614
2026-04-27 07:55:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KZ47376/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KE85331/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GT54355/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a1ead0>
2026-04-27 07:55:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04/c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/cd/1acd89f71810cf630e095a83740d3638/pa/YW08307_35d2d0c42b2ca05b56fd08f8964fce9a.jpg saved to cache
2026-04-27 07:55:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04
2026-04-27 07:55:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a65550>
2026-04-27 07:55:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_595f5cf4-61d6-5815-9ba7-f52cfee67d94/595f5cf4-61d6-5815-9ba7-f52cfee67d94_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/87/128791546d8bf2628c4f2620c49b3e70/pa/GP77578_d6ce1c4fceb386961bcbcf40e54e7a75.jpg saved to cache
2026-04-27 07:55:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 595f5cf4-61d6-5815-9ba7-f52cfee67d94
2026-04-27 07:55:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14381ee810>
2026-04-27 07:55:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_155c8fd5-d977-5582-a0bd-e0679c478b8d/155c8fd5-d977-5582-a0bd-e0679c478b8d_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/23/1823e6af665e4b2c83169fc52a485e0c/pa/YZ83641_930eb1dae56ae5a1b37cd9b0fb2934ce.jpg saved to cache
2026-04-27 07:55:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 155c8fd5-d977-5582-a0bd-e0679c478b8d
2026-04-27 07:55:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/87/128791546d8bf2628c4f2620c49b3e70/pa/GP77578_ebb552ce8867031ccd78a80757c080a2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/0c/6c0cdaf1bb6ea49e2b771a5afc9e5cbe/pa/SE81249_9cc10222226667948d9bd56f3130d5b8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 834a3252-a586-51b6-838a-88529557abca with identifier: TA82614
2026-04-27 07:55:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 834a3252-a586-51b6-838a-88529557abca with identifier: TA82614
2026-04-27 07:55:33 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 834a3252-a586-51b6-838a-88529557abca with identifier: TA82614 to the API
2026-04-27 07:55:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:33 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-04-28T15:32:40Z',
 'fuel_type': 'diesel',
 'id': '834a3252-a586-51b6-838a-88529557abca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TA82614',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'DS Automobiles',
 'model': 'DS7',
 'odometer': 161953,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2022-09-06',
 'seller_name': None,
 'title': 'DS Automobiles DS7 1.5 Blue-HDi Rivoli',
 'transmission': 'automatic',
 'trim': 'Rivoli',
 'year': 2022}
2026-04-27 07:55:33 [auto1.fr] INFO: Saving data for TA82614: {'auction_closing_time': 1777390360.0, 'created_time': 1777020512.446618, 'has_photos': True, 'last_price_update_time': 1777276533.860452}
2026-04-27 07:55:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/87/128791546d8bf2628c4f2620c49b3e70/pa/GP77578_0f5f3b68d1fe4ec8f820def2670a03bf.jpg not downloaded yet
2026-04-27 07:55:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/0c/6c0cdaf1bb6ea49e2b771a5afc9e5cbe/pa/SE81249_5adf561f45b1eab1796e200f548dddd4.jpg not downloaded yet
2026-04-27 07:55:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FD54899> (referer: https://www.auto1.com/v1/car-details-view/FD54899/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XZ65279/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438cf9990>
2026-04-27 07:55:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04/c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/cd/1acd89f71810cf630e095a83740d3638/pa/YW08307_341eecffd2589a8dd46da98a1009e4d3.jpg saved to cache
2026-04-27 07:55:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04
2026-04-27 07:55:33 [auto1.fr] INFO: Found listing with ID: RM94372
2026-04-27 07:55:34 [auto1.fr] INFO: Scrape type for RM94372: 1
2026-04-27 07:55:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TG37812> (referer: https://www.auto1.com/v1/car-details-view/TG37812/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14381c9d90>
2026-04-27 07:55:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04/c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/cd/1acd89f71810cf630e095a83740d3638/pa/YW08307_758997013546d9caca5eaf28f033020a.jpg saved to cache
2026-04-27 07:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04
2026-04-27 07:55:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/0c/6c0cdaf1bb6ea49e2b771a5afc9e5cbe/pa/SE81249_79ca616a024c844783c9c091f3c6bc81.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/87/128791546d8bf2628c4f2620c49b3e70/pa/GP77578_e06a465350130735558a2e1b297b96ab.jpg not downloaded yet
2026-04-27 07:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/0c/6c0cdaf1bb6ea49e2b771a5afc9e5cbe/pa/SE81249_6a6f5fdad0216b6c3df4cfe99ac57e20.jpg not downloaded yet
2026-04-27 07:55:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438024b90>
2026-04-27 07:55:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_155c8fd5-d977-5582-a0bd-e0679c478b8d/155c8fd5-d977-5582-a0bd-e0679c478b8d_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/23/1823e6af665e4b2c83169fc52a485e0c/pa/YZ83641_03850f3f7519ee30e041dfc1cfb1435a.jpg saved to cache
2026-04-27 07:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 155c8fd5-d977-5582-a0bd-e0679c478b8d
2026-04-27 07:55:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c38ad0>
2026-04-27 07:55:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_595f5cf4-61d6-5815-9ba7-f52cfee67d94/595f5cf4-61d6-5815-9ba7-f52cfee67d94_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/87/128791546d8bf2628c4f2620c49b3e70/pa/GP77578_d2164c4ecbe7af8073b3e0a0c9915678.jpg saved to cache
2026-04-27 07:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 595f5cf4-61d6-5815-9ba7-f52cfee67d94
2026-04-27 07:55:34 [auto1.fr] INFO: Found listing with ID: RP08022
2026-04-27 07:55:34 [auto1.fr] INFO: Scrape type for RP08022: 1
2026-04-27 07:55:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438f08d10>
2026-04-27 07:55:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_595f5cf4-61d6-5815-9ba7-f52cfee67d94/595f5cf4-61d6-5815-9ba7-f52cfee67d94_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/87/128791546d8bf2628c4f2620c49b3e70/pa/GP77578_ebb552ce8867031ccd78a80757c080a2.jpg saved to cache
2026-04-27 07:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 595f5cf4-61d6-5815-9ba7-f52cfee67d94
2026-04-27 07:55:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a37350>
2026-04-27 07:55:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55776317-a1e6-52fe-ae28-786098c328ed/55776317-a1e6-52fe-ae28-786098c328ed_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/0c/6c0cdaf1bb6ea49e2b771a5afc9e5cbe/pa/SE81249_9cc10222226667948d9bd56f3130d5b8.jpg saved to cache
2026-04-27 07:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 55776317-a1e6-52fe-ae28-786098c328ed
2026-04-27 07:55:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/87/128791546d8bf2628c4f2620c49b3e70/pa/GP77578_b8146cf1ff7e3deec1e51bc434ccedb3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/0c/6c0cdaf1bb6ea49e2b771a5afc9e5cbe/pa/SE81249_0b3d8839116ecc3e977265d0c2389d42.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/87/128791546d8bf2628c4f2620c49b3e70/pa/GP77578_bdb805429bbf90f4c3025c0d9dca6183.jpg not downloaded yet
2026-04-27 07:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/0c/6c0cdaf1bb6ea49e2b771a5afc9e5cbe/pa/SE81249_86f19009e4b934a90e3da9c81629e90f.jpg not downloaded yet
2026-04-27 07:55:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fdfcd267-d04a-59ee-ac3c-681602666f6f with identifier: FD54899
2026-04-27 07:55:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fdfcd267-d04a-59ee-ac3c-681602666f6f with scrape type 1
2026-04-27 07:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fdfcd267-d04a-59ee-ac3c-681602666f6f
2026-04-27 07:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/49/57497670dfa726a83867abbec3391bd9/pa/FD54899_a030278bb63c9f8dc92f872d1296b7bf.jpg not downloaded yet
2026-04-27 07:55:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/cd/1acd89f71810cf630e095a83740d3638/pa/YW08307_a187da64c45a4602292843fbec4bce65.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/0c/6c0cdaf1bb6ea49e2b771a5afc9e5cbe/pa/SE81249_d11f23daac44376a4974d161151ea114.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:34 [auto1.fr] INFO: Found listing with ID: AY79855
2026-04-27 07:55:34 [auto1.fr] INFO: Scrape type for AY79855: 2
2026-04-27 07:55:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f70ec83-164c-514d-9177-2df2c7a138d9 with identifier: AY79855
2026-04-27 07:55:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f70ec83-164c-514d-9177-2df2c7a138d9 with scrape type 2
2026-04-27 07:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f70ec83-164c-514d-9177-2df2c7a138d9 with scrape type 2
2026-04-27 07:55:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7f70ec83-164c-514d-9177-2df2c7a138d9, identifier: AY79855
2026-04-27 07:55:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4225ec09-f8fd-550e-9f3e-a0d541b71bd7 with identifier: TG37812
2026-04-27 07:55:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4225ec09-f8fd-550e-9f3e-a0d541b71bd7 with scrape type 1
2026-04-27 07:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 4225ec09-f8fd-550e-9f3e-a0d541b71bd7
2026-04-27 07:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/fc/82fc308e73f852a6e0f08500dd74ec54/pa/TG37812_d5d87d157f916b3d5e7d0bd68c117a1e.jpg not downloaded yet
2026-04-27 07:55:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438bbd990>
2026-04-27 07:55:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55776317-a1e6-52fe-ae28-786098c328ed/55776317-a1e6-52fe-ae28-786098c328ed_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/0c/6c0cdaf1bb6ea49e2b771a5afc9e5cbe/pa/SE81249_79ca616a024c844783c9c091f3c6bc81.jpg saved to cache
2026-04-27 07:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 55776317-a1e6-52fe-ae28-786098c328ed
2026-04-27 07:55:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/87/128791546d8bf2628c4f2620c49b3e70/pa/GP77578_0f5f3b68d1fe4ec8f820def2670a03bf.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/0c/6c0cdaf1bb6ea49e2b771a5afc9e5cbe/pa/SE81249_5adf561f45b1eab1796e200f548dddd4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/23/1823e6af665e4b2c83169fc52a485e0c/pa/YZ83641_e190422c444681e9b568c5d3f2bb5320.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/87/128791546d8bf2628c4f2620c49b3e70/pa/GP77578_1baa83dcb5ea48d73bf2afcd15f03726.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7f70ec83-164c-514d-9177-2df2c7a138d9 with identifier: AY79855
2026-04-27 07:55:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7f70ec83-164c-514d-9177-2df2c7a138d9 with identifier: AY79855
2026-04-27 07:55:34 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 7f70ec83-164c-514d-9177-2df2c7a138d9 with identifier: AY79855 to the API
2026-04-27 07:55:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:35 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-04-28T15:13:02Z',
 'fuel_type': 'petrol',
 'id': '7f70ec83-164c-514d-9177-2df2c7a138d9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AY79855',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 145953,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2020-02-24',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.5 TSI ACT Match Start-Stopp',
 'transmission': 'automatic',
 'trim': 'Match Start-Stopp',
 'year': 2020}
2026-04-27 07:55:35 [auto1.fr] INFO: Saving data for AY79855: {'auction_closing_time': 1777389182.0, 'created_time': 1777020347.259255, 'has_photos': True, 'last_price_update_time': 1777276535.195354}
2026-04-27 07:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/87/128791546d8bf2628c4f2620c49b3e70/pa/GP77578_6671374c78db43db24dd57404d27a7dd.jpg not downloaded yet
2026-04-27 07:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/0c/6c0cdaf1bb6ea49e2b771a5afc9e5cbe/pa/SE81249_4151218aeec3f4aedecdbef4feca6f3a.jpg not downloaded yet
2026-04-27 07:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/49/57497670dfa726a83867abbec3391bd9/pa/FD54899_d284b593b08e90ba1f8d2348b04d43ce.jpg not downloaded yet
2026-04-27 07:55:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WU07507> (referer: https://www.auto1.com/v1/car-details-view/WU07507/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LP12244/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:35 [auto1.fr] INFO: Found listing with ID: SK27420
2026-04-27 07:55:35 [auto1.fr] INFO: Scrape type for SK27420: 2
2026-04-27 07:55:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ee73b53-7fcc-5f0f-a5d5-16463d32478f with identifier: SK27420
2026-04-27 07:55:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ee73b53-7fcc-5f0f-a5d5-16463d32478f with scrape type 2
2026-04-27 07:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ee73b53-7fcc-5f0f-a5d5-16463d32478f with scrape type 2
2026-04-27 07:55:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8ee73b53-7fcc-5f0f-a5d5-16463d32478f, identifier: SK27420
2026-04-27 07:55:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/fc/82fc308e73f852a6e0f08500dd74ec54/pa/TG37812_b9fbb14cff1980a1a174472150ef29d0.jpg not downloaded yet
2026-04-27 07:55:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8ee73b53-7fcc-5f0f-a5d5-16463d32478f with identifier: SK27420
2026-04-27 07:55:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8ee73b53-7fcc-5f0f-a5d5-16463d32478f with identifier: SK27420
2026-04-27 07:55:35 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 8ee73b53-7fcc-5f0f-a5d5-16463d32478f with identifier: SK27420 to the API
2026-04-27 07:55:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:35 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-04-28T15:24:05Z',
 'fuel_type': 'petrol',
 'id': '8ee73b53-7fcc-5f0f-a5d5-16463d32478f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SK27420',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 89960,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2014-05-31',
 'seller_name': None,
 'title': 'Citroen C3 1.2 VTi Collection',
 'transmission': 'manual',
 'trim': 'Collection',
 'year': 2014}
2026-04-27 07:55:35 [auto1.fr] INFO: Saving data for SK27420: {'auction_closing_time': 1777389845.0, 'created_time': 1777020648.582961, 'has_photos': True, 'last_price_update_time': 1777276535.743891}
2026-04-27 07:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/0c/6c0cdaf1bb6ea49e2b771a5afc9e5cbe/pa/SE81249_3b42d12fdfa3ea92047c86e02207e4f3.jpg not downloaded yet
2026-04-27 07:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/49/57497670dfa726a83867abbec3391bd9/pa/FD54899_0e18fddad03663b42f9a1c05aab45c17.jpg not downloaded yet
2026-04-27 07:55:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380e00d0>
2026-04-27 07:55:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_595f5cf4-61d6-5815-9ba7-f52cfee67d94/595f5cf4-61d6-5815-9ba7-f52cfee67d94_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/87/128791546d8bf2628c4f2620c49b3e70/pa/GP77578_b8146cf1ff7e3deec1e51bc434ccedb3.jpg saved to cache
2026-04-27 07:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 595f5cf4-61d6-5815-9ba7-f52cfee67d94
2026-04-27 07:55:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438aef590>
2026-04-27 07:55:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55776317-a1e6-52fe-ae28-786098c328ed/55776317-a1e6-52fe-ae28-786098c328ed_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/0c/6c0cdaf1bb6ea49e2b771a5afc9e5cbe/pa/SE81249_0b3d8839116ecc3e977265d0c2389d42.jpg saved to cache
2026-04-27 07:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 55776317-a1e6-52fe-ae28-786098c328ed
2026-04-27 07:55:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a57350>
2026-04-27 07:55:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04/c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/cd/1acd89f71810cf630e095a83740d3638/pa/YW08307_a187da64c45a4602292843fbec4bce65.jpg saved to cache
2026-04-27 07:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04
2026-04-27 07:55:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438aef050>
2026-04-27 07:55:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55776317-a1e6-52fe-ae28-786098c328ed/55776317-a1e6-52fe-ae28-786098c328ed_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/0c/6c0cdaf1bb6ea49e2b771a5afc9e5cbe/pa/SE81249_d11f23daac44376a4974d161151ea114.jpg saved to cache
2026-04-27 07:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 55776317-a1e6-52fe-ae28-786098c328ed
2026-04-27 07:55:35 [auto1.fr] INFO: Found listing with ID: CG72057
2026-04-27 07:55:35 [auto1.fr] INFO: Scrape type for CG72057: 1
2026-04-27 07:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/fc/82fc308e73f852a6e0f08500dd74ec54/pa/TG37812_4c488637545ab6846c3943addf7425c1.jpg not downloaded yet
2026-04-27 07:55:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ae99d0>
2026-04-27 07:55:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_595f5cf4-61d6-5815-9ba7-f52cfee67d94/595f5cf4-61d6-5815-9ba7-f52cfee67d94_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/87/128791546d8bf2628c4f2620c49b3e70/pa/GP77578_0f5f3b68d1fe4ec8f820def2670a03bf.jpg saved to cache
2026-04-27 07:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 595f5cf4-61d6-5815-9ba7-f52cfee67d94
2026-04-27 07:55:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143809ff50>
2026-04-27 07:55:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55776317-a1e6-52fe-ae28-786098c328ed/55776317-a1e6-52fe-ae28-786098c328ed_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/0c/6c0cdaf1bb6ea49e2b771a5afc9e5cbe/pa/SE81249_5adf561f45b1eab1796e200f548dddd4.jpg saved to cache
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 55776317-a1e6-52fe-ae28-786098c328ed
2026-04-27 07:55:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438171250>
2026-04-27 07:55:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_155c8fd5-d977-5582-a0bd-e0679c478b8d/155c8fd5-d977-5582-a0bd-e0679c478b8d_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/23/1823e6af665e4b2c83169fc52a485e0c/pa/YZ83641_e190422c444681e9b568c5d3f2bb5320.jpg saved to cache
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 155c8fd5-d977-5582-a0bd-e0679c478b8d
2026-04-27 07:55:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143819df10>
2026-04-27 07:55:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_595f5cf4-61d6-5815-9ba7-f52cfee67d94/595f5cf4-61d6-5815-9ba7-f52cfee67d94_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/87/128791546d8bf2628c4f2620c49b3e70/pa/GP77578_1baa83dcb5ea48d73bf2afcd15f03726.jpg saved to cache
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 595f5cf4-61d6-5815-9ba7-f52cfee67d94
2026-04-27 07:55:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/49/57497670dfa726a83867abbec3391bd9/pa/FD54899_a030278bb63c9f8dc92f872d1296b7bf.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/0c/6c0cdaf1bb6ea49e2b771a5afc9e5cbe/pa/SE81249_86f19009e4b934a90e3da9c81629e90f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/0c/6c0cdaf1bb6ea49e2b771a5afc9e5cbe/pa/SE81249_c21aa3fff61be5e5e4569f13a50f1435.jpg not downloaded yet
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/49/57497670dfa726a83867abbec3391bd9/pa/FD54899_b72dc39826033e0d7f1937e39d724451.jpg not downloaded yet
2026-04-27 07:55:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/0c/6c0cdaf1bb6ea49e2b771a5afc9e5cbe/pa/SE81249_6a6f5fdad0216b6c3df4cfe99ac57e20.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/87/128791546d8bf2628c4f2620c49b3e70/pa/GP77578_bdb805429bbf90f4c3025c0d9dca6183.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:36 [auto1.fr] INFO: Found listing with ID: FY26470
2026-04-27 07:55:36 [auto1.fr] INFO: Scrape type for FY26470: 2
2026-04-27 07:55:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd1eeb23-5e09-5e68-97a0-f3ecef77ec99 with identifier: FY26470
2026-04-27 07:55:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd1eeb23-5e09-5e68-97a0-f3ecef77ec99 with scrape type 2
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bd1eeb23-5e09-5e68-97a0-f3ecef77ec99 with scrape type 2
2026-04-27 07:55:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: bd1eeb23-5e09-5e68-97a0-f3ecef77ec99, identifier: FY26470
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/fc/82fc308e73f852a6e0f08500dd74ec54/pa/TG37812_9bda96f53a3f5c54c03b507e0a93ca6b.jpg not downloaded yet
2026-04-27 07:55:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82c607f1-69da-537f-a5f9-ed4177752d1e with identifier: WU07507
2026-04-27 07:55:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82c607f1-69da-537f-a5f9-ed4177752d1e with scrape type 1
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 82c607f1-69da-537f-a5f9-ed4177752d1e
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/ae/dfae082e0b2e17650dfc49c59e8eab79/pa/WU07507_02726403ca31100196dc754e774bb19f.jpg not downloaded yet
2026-04-27 07:55:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/fc/82fc308e73f852a6e0f08500dd74ec54/pa/TG37812_d5d87d157f916b3d5e7d0bd68c117a1e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: bd1eeb23-5e09-5e68-97a0-f3ecef77ec99 with identifier: FY26470
2026-04-27 07:55:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: bd1eeb23-5e09-5e68-97a0-f3ecef77ec99 with identifier: FY26470
2026-04-27 07:55:36 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: bd1eeb23-5e09-5e68-97a0-f3ecef77ec99 with identifier: FY26470 to the API
2026-04-27 07:55:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:36 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-04-28T15:29:25Z',
 'fuel_type': 'diesel',
 'id': 'bd1eeb23-5e09-5e68-97a0-f3ecef77ec99',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FY26470',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Nissan',
 'model': 'Juke',
 'odometer': 179268,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2015-03-29',
 'seller_name': None,
 'title': 'Nissan Juke 1.5 Turbodiesel Connect Edition',
 'transmission': 'manual',
 'trim': 'Connect Edition',
 'year': 2015}
2026-04-27 07:55:36 [auto1.fr] INFO: Saving data for FY26470: {'auction_closing_time': 1777390165.0, 'created_time': 1777022170.355322, 'has_photos': True, 'last_price_update_time': 1777276536.670147}
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/49/57497670dfa726a83867abbec3391bd9/pa/FD54899_47ba69650d282db7cdba3d8070c333cf.jpg not downloaded yet
2026-04-27 07:55:36 [auto1.fr] INFO: Found listing with ID: XT37305
2026-04-27 07:55:36 [auto1.fr] INFO: Scrape type for XT37305: 2
2026-04-27 07:55:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0334bd78-26d5-5aff-a53e-c1fd2d58a262 with identifier: XT37305
2026-04-27 07:55:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0334bd78-26d5-5aff-a53e-c1fd2d58a262 with scrape type 2
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0334bd78-26d5-5aff-a53e-c1fd2d58a262 with scrape type 2
2026-04-27 07:55:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0334bd78-26d5-5aff-a53e-c1fd2d58a262, identifier: XT37305
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/fc/82fc308e73f852a6e0f08500dd74ec54/pa/TG37812_a0d412d9d1164a19dd7924ed3feea8e7.jpg not downloaded yet
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/ae/dfae082e0b2e17650dfc49c59e8eab79/pa/WU07507_174b9ff6aa52c941f1205258959198bc.jpg not downloaded yet
2026-04-27 07:55:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MM74389> (referer: https://www.auto1.com/v1/car-details-view/MM74389/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0334bd78-26d5-5aff-a53e-c1fd2d58a262 with identifier: XT37305
2026-04-27 07:55:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0334bd78-26d5-5aff-a53e-c1fd2d58a262 with identifier: XT37305
2026-04-27 07:55:36 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 0334bd78-26d5-5aff-a53e-c1fd2d58a262 with identifier: XT37305 to the API
2026-04-27 07:55:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:37 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-04-28T15:26:41Z',
 'fuel_type': 'diesel',
 'id': '0334bd78-26d5-5aff-a53e-c1fd2d58a262',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XT37305',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Mazda',
 'model': 'CX-5',
 'odometer': 22209,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2023-10-30',
 'seller_name': None,
 'title': "Mazda CX-5 2.2 SKYACTIV-D Ad'vantage 2WD",
 'transmission': 'automatic',
 'trim': "Ad'vantage 2WD",
 'year': 2023}
2026-04-27 07:55:37 [auto1.fr] INFO: Saving data for XT37305: {'auction_closing_time': 1777390001.0, 'created_time': 1777022025.329072, 'has_photos': True, 'last_price_update_time': 1777276537.210966}
2026-04-27 07:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/49/57497670dfa726a83867abbec3391bd9/pa/FD54899_e1f39f3b88a26d985b349cb1119a749e.jpg not downloaded yet
2026-04-27 07:55:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TB94788> (referer: https://www.auto1.com/v1/car-details-view/TB94788/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/49/57497670dfa726a83867abbec3391bd9/pa/FD54899_0e18fddad03663b42f9a1c05aab45c17.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/fc/82fc308e73f852a6e0f08500dd74ec54/pa/TG37812_4c488637545ab6846c3943addf7425c1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:37 [auto1.fr] INFO: Found listing with ID: JX55503
2026-04-27 07:55:37 [auto1.fr] INFO: Scrape type for JX55503: 1
2026-04-27 07:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/fc/82fc308e73f852a6e0f08500dd74ec54/pa/TG37812_7c957b5a1139d8bd3bdbc7880417d12e.jpg not downloaded yet
2026-04-27 07:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/ae/dfae082e0b2e17650dfc49c59e8eab79/pa/WU07507_c2760d1c17fa583da151b16248e54389.jpg not downloaded yet
2026-04-27 07:55:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KH41597/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GN31601/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ccd890>
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdfcd267-d04a-59ee-ac3c-681602666f6f/fdfcd267-d04a-59ee-ac3c-681602666f6f_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/49/57497670dfa726a83867abbec3391bd9/pa/FD54899_a030278bb63c9f8dc92f872d1296b7bf.jpg saved to cache
2026-04-27 07:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fdfcd267-d04a-59ee-ac3c-681602666f6f
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438cf93d0>
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55776317-a1e6-52fe-ae28-786098c328ed/55776317-a1e6-52fe-ae28-786098c328ed_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/0c/6c0cdaf1bb6ea49e2b771a5afc9e5cbe/pa/SE81249_86f19009e4b934a90e3da9c81629e90f.jpg saved to cache
2026-04-27 07:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 55776317-a1e6-52fe-ae28-786098c328ed
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143804c650>
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55776317-a1e6-52fe-ae28-786098c328ed/55776317-a1e6-52fe-ae28-786098c328ed_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/0c/6c0cdaf1bb6ea49e2b771a5afc9e5cbe/pa/SE81249_6a6f5fdad0216b6c3df4cfe99ac57e20.jpg saved to cache
2026-04-27 07:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 55776317-a1e6-52fe-ae28-786098c328ed
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438038b90>
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_595f5cf4-61d6-5815-9ba7-f52cfee67d94/595f5cf4-61d6-5815-9ba7-f52cfee67d94_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/87/128791546d8bf2628c4f2620c49b3e70/pa/GP77578_bdb805429bbf90f4c3025c0d9dca6183.jpg saved to cache
2026-04-27 07:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 595f5cf4-61d6-5815-9ba7-f52cfee67d94
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143804fd90>
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4225ec09-f8fd-550e-9f3e-a0d541b71bd7/4225ec09-f8fd-550e-9f3e-a0d541b71bd7_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/fc/82fc308e73f852a6e0f08500dd74ec54/pa/TG37812_d5d87d157f916b3d5e7d0bd68c117a1e.jpg saved to cache
2026-04-27 07:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4225ec09-f8fd-550e-9f3e-a0d541b71bd7
2026-04-27 07:55:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/49/57497670dfa726a83867abbec3391bd9/pa/FD54899_b72dc39826033e0d7f1937e39d724451.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/49/57497670dfa726a83867abbec3391bd9/pa/FD54899_5586301b3571eb819654d394b91a46ef.jpg not downloaded yet
2026-04-27 07:55:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PW05542> (referer: https://www.auto1.com/v1/car-details-view/PW05542/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/0c/6c0cdaf1bb6ea49e2b771a5afc9e5cbe/pa/SE81249_3b42d12fdfa3ea92047c86e02207e4f3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:37 [auto1.fr] INFO: Found listing with ID: YB75679
2026-04-27 07:55:37 [auto1.fr] INFO: Scrape type for YB75679: 2
2026-04-27 07:55:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f0a7d00e-4ff9-52b4-84ad-b6ae548ede42 with identifier: YB75679
2026-04-27 07:55:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0a7d00e-4ff9-52b4-84ad-b6ae548ede42 with scrape type 2
2026-04-27 07:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f0a7d00e-4ff9-52b4-84ad-b6ae548ede42 with scrape type 2
2026-04-27 07:55:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f0a7d00e-4ff9-52b4-84ad-b6ae548ede42, identifier: YB75679
2026-04-27 07:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/ae/dfae082e0b2e17650dfc49c59e8eab79/pa/WU07507_dbaf691079b5aea879b4832c16538aac.jpg not downloaded yet
2026-04-27 07:55:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GT54355> (referer: https://www.auto1.com/v1/car-details-view/GT54355/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: daef9541-9218-51e2-b640-94355be7994e with identifier: MM74389
2026-04-27 07:55:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item daef9541-9218-51e2-b640-94355be7994e with scrape type 1
2026-04-27 07:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item daef9541-9218-51e2-b640-94355be7994e
2026-04-27 07:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/8a/488a2d9f34fb94078e5aefe22426cb8c/pa/MM74389_d5cc11e591d059b5a506f7be96e04bef.jpg not downloaded yet
2026-04-27 07:55:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f0a7d00e-4ff9-52b4-84ad-b6ae548ede42 with identifier: YB75679
2026-04-27 07:55:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f0a7d00e-4ff9-52b4-84ad-b6ae548ede42 with identifier: YB75679
2026-04-27 07:55:37 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f0a7d00e-4ff9-52b4-84ad-b6ae548ede42 with identifier: YB75679 to the API
2026-04-27 07:55:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:37 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-04-28T15:04:50Z',
 'fuel_type': 'petrol',
 'id': 'f0a7d00e-4ff9-52b4-84ad-b6ae548ede42',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YB75679',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 142370,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2018-12-06',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.0 TSI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2018}
2026-04-27 07:55:38 [auto1.fr] INFO: Saving data for YB75679: {'auction_closing_time': 1777388690.0, 'created_time': 1777019527.744695, 'has_photos': True, 'last_price_update_time': 1777276538.048303}
2026-04-27 07:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/49/57497670dfa726a83867abbec3391bd9/pa/FD54899_faf4939aa15821b10a879366e1c65fd1.jpg not downloaded yet
2026-04-27 07:55:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 48cdacb5-a189-59f2-a4f1-20199f77037d with identifier: TB94788
2026-04-27 07:55:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48cdacb5-a189-59f2-a4f1-20199f77037d with scrape type 1
2026-04-27 07:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 48cdacb5-a189-59f2-a4f1-20199f77037d
2026-04-27 07:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/be/64be795c11002705e2ff7f552faead1b/pa/TB94788_1180adbb1f12223597bc1ee6c449bfa0.jpg not downloaded yet
2026-04-27 07:55:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438e21e50>
2026-04-27 07:55:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdfcd267-d04a-59ee-ac3c-681602666f6f/fdfcd267-d04a-59ee-ac3c-681602666f6f_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/49/57497670dfa726a83867abbec3391bd9/pa/FD54899_0e18fddad03663b42f9a1c05aab45c17.jpg saved to cache
2026-04-27 07:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fdfcd267-d04a-59ee-ac3c-681602666f6f
2026-04-27 07:55:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143801d110>
2026-04-27 07:55:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4225ec09-f8fd-550e-9f3e-a0d541b71bd7/4225ec09-f8fd-550e-9f3e-a0d541b71bd7_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/fc/82fc308e73f852a6e0f08500dd74ec54/pa/TG37812_4c488637545ab6846c3943addf7425c1.jpg saved to cache
2026-04-27 07:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4225ec09-f8fd-550e-9f3e-a0d541b71bd7
2026-04-27 07:55:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/49/57497670dfa726a83867abbec3391bd9/pa/FD54899_47ba69650d282db7cdba3d8070c333cf.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/ae/dfae082e0b2e17650dfc49c59e8eab79/pa/WU07507_174b9ff6aa52c941f1205258959198bc.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:38 [auto1.fr] INFO: Found listing with ID: WP67872
2026-04-27 07:55:38 [auto1.fr] INFO: Scrape type for WP67872: 1
2026-04-27 07:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/ae/dfae082e0b2e17650dfc49c59e8eab79/pa/WU07507_8f10dac5809ccf134e0ae46eca0f370f.jpg not downloaded yet
2026-04-27 07:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/8a/488a2d9f34fb94078e5aefe22426cb8c/pa/MM74389_a0f813a0b837d401741ed81dfc338361.jpg not downloaded yet
2026-04-27 07:55:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/ae/dfae082e0b2e17650dfc49c59e8eab79/pa/WU07507_02726403ca31100196dc754e774bb19f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/49/57497670dfa726a83867abbec3391bd9/pa/FD54899_e1f39f3b88a26d985b349cb1119a749e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/fc/82fc308e73f852a6e0f08500dd74ec54/pa/TG37812_a0d412d9d1164a19dd7924ed3feea8e7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/49/57497670dfa726a83867abbec3391bd9/pa/FD54899_3df691cf692792e9270ff52dc854b578.jpg not downloaded yet
2026-04-27 07:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/be/64be795c11002705e2ff7f552faead1b/pa/TB94788_3109675ce72adf7a7143457c6602d002.jpg not downloaded yet
2026-04-27 07:55:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b41850>
2026-04-27 07:55:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdfcd267-d04a-59ee-ac3c-681602666f6f/fdfcd267-d04a-59ee-ac3c-681602666f6f_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/49/57497670dfa726a83867abbec3391bd9/pa/FD54899_b72dc39826033e0d7f1937e39d724451.jpg saved to cache
2026-04-27 07:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fdfcd267-d04a-59ee-ac3c-681602666f6f
2026-04-27 07:55:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d53b333f-0b2c-5b0e-9906-764ddf709c52 with identifier: PW05542
2026-04-27 07:55:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d53b333f-0b2c-5b0e-9906-764ddf709c52 with scrape type 1
2026-04-27 07:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d53b333f-0b2c-5b0e-9906-764ddf709c52
2026-04-27 07:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/1f/bb1fa5fe94c99696714ab51667f1cab5/pa/PW05542_1c02d7290f7b58f0c622f2f7de734cf1.jpg not downloaded yet
2026-04-27 07:55:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c66fd0>
2026-04-27 07:55:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55776317-a1e6-52fe-ae28-786098c328ed/55776317-a1e6-52fe-ae28-786098c328ed_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/0c/6c0cdaf1bb6ea49e2b771a5afc9e5cbe/pa/SE81249_3b42d12fdfa3ea92047c86e02207e4f3.jpg saved to cache
2026-04-27 07:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 55776317-a1e6-52fe-ae28-786098c328ed
2026-04-27 07:55:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/fc/82fc308e73f852a6e0f08500dd74ec54/pa/TG37812_9bda96f53a3f5c54c03b507e0a93ca6b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:38 [auto1.fr] INFO: Found listing with ID: BY44228
2026-04-27 07:55:38 [auto1.fr] INFO: Scrape type for BY44228: 2
2026-04-27 07:55:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3085aca-3851-5aae-91c9-b0a4aaf032ff with identifier: BY44228
2026-04-27 07:55:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3085aca-3851-5aae-91c9-b0a4aaf032ff with scrape type 2
2026-04-27 07:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e3085aca-3851-5aae-91c9-b0a4aaf032ff with scrape type 2
2026-04-27 07:55:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e3085aca-3851-5aae-91c9-b0a4aaf032ff, identifier: BY44228
2026-04-27 07:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/ae/dfae082e0b2e17650dfc49c59e8eab79/pa/WU07507_8363ab4ecd2164c7b28a8e65d845a857.jpg not downloaded yet
2026-04-27 07:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/8a/488a2d9f34fb94078e5aefe22426cb8c/pa/MM74389_217c33d90934b84aa481a8123644c85a.jpg not downloaded yet
2026-04-27 07:55:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RP08022/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KE85331> (referer: https://www.auto1.com/v1/car-details-view/KE85331/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/ae/dfae082e0b2e17650dfc49c59e8eab79/pa/WU07507_c2760d1c17fa583da151b16248e54389.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e3085aca-3851-5aae-91c9-b0a4aaf032ff with identifier: BY44228
2026-04-27 07:55:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e3085aca-3851-5aae-91c9-b0a4aaf032ff with identifier: BY44228
2026-04-27 07:55:38 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e3085aca-3851-5aae-91c9-b0a4aaf032ff with identifier: BY44228 to the API
2026-04-27 07:55:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:38 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-04-28T15:00:20Z',
 'fuel_type': 'diesel',
 'id': 'e3085aca-3851-5aae-91c9-b0a4aaf032ff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BY44228',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 160972,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2017-05-28',
 'seller_name': None,
 'title': 'Audi Q5 2.0 TDI quattro S line',
 'transmission': 'automatic',
 'trim': 'quattro S line',
 'year': 2017}
2026-04-27 07:55:38 [auto1.fr] INFO: Saving data for BY44228: {'auction_closing_time': 1777388420.0, 'created_time': 1777021785.426797, 'has_photos': True, 'last_price_update_time': 1777276538.954412}
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/49/57497670dfa726a83867abbec3391bd9/pa/FD54899_073ed73200ce7e347db6b8baaf4f10a6.jpg not downloaded yet
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/be/64be795c11002705e2ff7f552faead1b/pa/TB94788_f65ee289579f13b8068b8e5065f6b5e6.jpg not downloaded yet
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/1f/bb1fa5fe94c99696714ab51667f1cab5/pa/PW05542_e56ccfedc4bc85163e1c17a874bbd57d.jpg not downloaded yet
2026-04-27 07:55:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec4743fa-6b14-571b-8c9d-81eb8783d066 with identifier: GT54355
2026-04-27 07:55:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec4743fa-6b14-571b-8c9d-81eb8783d066 with scrape type 1
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item ec4743fa-6b14-571b-8c9d-81eb8783d066
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/75/f7752536ed1193c904a538d6c97c87f1/pa/GT54355_b9691e243481b924d33c852af3cf88e5.jpg not downloaded yet
2026-04-27 07:55:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/49/57497670dfa726a83867abbec3391bd9/pa/FD54899_5586301b3571eb819654d394b91a46ef.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/fc/82fc308e73f852a6e0f08500dd74ec54/pa/TG37812_7c957b5a1139d8bd3bdbc7880417d12e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:39 [auto1.fr] INFO: Found listing with ID: KR98436
2026-04-27 07:55:39 [auto1.fr] INFO: Scrape type for KR98436: 1
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/ae/dfae082e0b2e17650dfc49c59e8eab79/pa/WU07507_8b49205093fb5a92cae085ce5a7d52e2.jpg not downloaded yet
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/8a/488a2d9f34fb94078e5aefe22426cb8c/pa/MM74389_ff998842f3163fb4427ccd267bee43d4.jpg not downloaded yet
2026-04-27 07:55:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438bea550>
2026-04-27 07:55:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdfcd267-d04a-59ee-ac3c-681602666f6f/fdfcd267-d04a-59ee-ac3c-681602666f6f_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/49/57497670dfa726a83867abbec3391bd9/pa/FD54899_47ba69650d282db7cdba3d8070c333cf.jpg saved to cache
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fdfcd267-d04a-59ee-ac3c-681602666f6f
2026-04-27 07:55:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14381fbe50>
2026-04-27 07:55:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82c607f1-69da-537f-a5f9-ed4177752d1e/82c607f1-69da-537f-a5f9-ed4177752d1e_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/ae/dfae082e0b2e17650dfc49c59e8eab79/pa/WU07507_174b9ff6aa52c941f1205258959198bc.jpg saved to cache
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 82c607f1-69da-537f-a5f9-ed4177752d1e
2026-04-27 07:55:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438bc4190>
2026-04-27 07:55:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82c607f1-69da-537f-a5f9-ed4177752d1e/82c607f1-69da-537f-a5f9-ed4177752d1e_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/ae/dfae082e0b2e17650dfc49c59e8eab79/pa/WU07507_02726403ca31100196dc754e774bb19f.jpg saved to cache
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 82c607f1-69da-537f-a5f9-ed4177752d1e
2026-04-27 07:55:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438019090>
2026-04-27 07:55:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdfcd267-d04a-59ee-ac3c-681602666f6f/fdfcd267-d04a-59ee-ac3c-681602666f6f_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/49/57497670dfa726a83867abbec3391bd9/pa/FD54899_e1f39f3b88a26d985b349cb1119a749e.jpg saved to cache
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fdfcd267-d04a-59ee-ac3c-681602666f6f
2026-04-27 07:55:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438badd10>
2026-04-27 07:55:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4225ec09-f8fd-550e-9f3e-a0d541b71bd7/4225ec09-f8fd-550e-9f3e-a0d541b71bd7_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/fc/82fc308e73f852a6e0f08500dd74ec54/pa/TG37812_a0d412d9d1164a19dd7924ed3feea8e7.jpg saved to cache
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4225ec09-f8fd-550e-9f3e-a0d541b71bd7
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/be/64be795c11002705e2ff7f552faead1b/pa/TB94788_473c4283b5844e0a09f997f5e2ac3dc3.jpg not downloaded yet
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/1f/bb1fa5fe94c99696714ab51667f1cab5/pa/PW05542_342520c3f642079dc23c0bca1f4e8da0.jpg not downloaded yet
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/75/f7752536ed1193c904a538d6c97c87f1/pa/GT54355_58a79f6ad3a9dd6e4f064dbc984eb998.jpg not downloaded yet
2026-04-27 07:55:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/8a/488a2d9f34fb94078e5aefe22426cb8c/pa/MM74389_d5cc11e591d059b5a506f7be96e04bef.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/be/64be795c11002705e2ff7f552faead1b/pa/TB94788_1180adbb1f12223597bc1ee6c449bfa0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/49/57497670dfa726a83867abbec3391bd9/pa/FD54899_faf4939aa15821b10a879366e1c65fd1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:39 [auto1.fr] INFO: Found listing with ID: UV38858
2026-04-27 07:55:39 [auto1.fr] INFO: Scrape type for UV38858: 2
2026-04-27 07:55:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12ba770f-e37b-54ea-82e1-6ec626bd2542 with identifier: UV38858
2026-04-27 07:55:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12ba770f-e37b-54ea-82e1-6ec626bd2542 with scrape type 2
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 12ba770f-e37b-54ea-82e1-6ec626bd2542 with scrape type 2
2026-04-27 07:55:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 12ba770f-e37b-54ea-82e1-6ec626bd2542, identifier: UV38858
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/ae/dfae082e0b2e17650dfc49c59e8eab79/pa/WU07507_51fd3f214829dca8eae7cead8a258990.jpg not downloaded yet
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/8a/488a2d9f34fb94078e5aefe22426cb8c/pa/MM74389_517d74746686245f428f0e72b8f49ecc.jpg not downloaded yet
2026-04-27 07:55:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438e83c50>
2026-04-27 07:55:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4225ec09-f8fd-550e-9f3e-a0d541b71bd7/4225ec09-f8fd-550e-9f3e-a0d541b71bd7_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/fc/82fc308e73f852a6e0f08500dd74ec54/pa/TG37812_9bda96f53a3f5c54c03b507e0a93ca6b.jpg saved to cache
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4225ec09-f8fd-550e-9f3e-a0d541b71bd7
2026-04-27 07:55:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67f1d977-64d5-555f-9910-6e0af8fb2572 with identifier: KE85331
2026-04-27 07:55:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67f1d977-64d5-555f-9910-6e0af8fb2572 with scrape type 1
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 67f1d977-64d5-555f-9910-6e0af8fb2572
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/1a/681a88bc342845f2840269fedfc297e0/pa/KE85331_1b71f6454b57d18b4f496baf54b99d43.jpg not downloaded yet
2026-04-27 07:55:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ac6650>
2026-04-27 07:55:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82c607f1-69da-537f-a5f9-ed4177752d1e/82c607f1-69da-537f-a5f9-ed4177752d1e_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/ae/dfae082e0b2e17650dfc49c59e8eab79/pa/WU07507_c2760d1c17fa583da151b16248e54389.jpg saved to cache
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 82c607f1-69da-537f-a5f9-ed4177752d1e
2026-04-27 07:55:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/be/64be795c11002705e2ff7f552faead1b/pa/TB94788_3109675ce72adf7a7143457c6602d002.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/8a/488a2d9f34fb94078e5aefe22426cb8c/pa/MM74389_a0f813a0b837d401741ed81dfc338361.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 12ba770f-e37b-54ea-82e1-6ec626bd2542 with identifier: UV38858
2026-04-27 07:55:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 12ba770f-e37b-54ea-82e1-6ec626bd2542 with identifier: UV38858
2026-04-27 07:55:39 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 12ba770f-e37b-54ea-82e1-6ec626bd2542 with identifier: UV38858 to the API
2026-04-27 07:55:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:40 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-04-28T15:43:15Z',
 'fuel_type': 'diesel',
 'id': '12ba770f-e37b-54ea-82e1-6ec626bd2542',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UV38858',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 162283,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2015-11-01',
 'seller_name': None,
 'title': 'Kia Sportage 1.7 CRDi Active 2WD',
 'transmission': 'manual',
 'trim': 'Active 2WD',
 'year': 2015}
2026-04-27 07:55:40 [auto1.fr] INFO: Saving data for UV38858: {'auction_closing_time': 1777390995.0, 'created_time': 1777022290.974119, 'has_photos': True, 'last_price_update_time': 1777276540.220224}
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/be/64be795c11002705e2ff7f552faead1b/pa/TB94788_a59cc6cb7c9908f95534b70889594c4f.jpg not downloaded yet
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/1f/bb1fa5fe94c99696714ab51667f1cab5/pa/PW05542_97376dad7fbac8ea5ba105d208a1dec6.jpg not downloaded yet
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/75/f7752536ed1193c904a538d6c97c87f1/pa/GT54355_64e946e2f5b119b02bcd038d515a1c36.jpg not downloaded yet
2026-04-27 07:55:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/1f/bb1fa5fe94c99696714ab51667f1cab5/pa/PW05542_1c02d7290f7b58f0c622f2f7de734cf1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:40 [auto1.fr] INFO: Found listing with ID: ZM99861
2026-04-27 07:55:40 [auto1.fr] INFO: Scrape type for ZM99861: 1
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/ae/dfae082e0b2e17650dfc49c59e8eab79/pa/WU07507_181adbde443788c5732c5016e7e0c8eb.jpg not downloaded yet
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/8a/488a2d9f34fb94078e5aefe22426cb8c/pa/MM74389_2ade0f9be52627e92d9b99c622e849e0.jpg not downloaded yet
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/1a/681a88bc342845f2840269fedfc297e0/pa/KE85331_497e5bc38ebf7c7eccbafae26f0345c5.jpg not downloaded yet
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438089810>
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdfcd267-d04a-59ee-ac3c-681602666f6f/fdfcd267-d04a-59ee-ac3c-681602666f6f_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/49/57497670dfa726a83867abbec3391bd9/pa/FD54899_5586301b3571eb819654d394b91a46ef.jpg saved to cache
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fdfcd267-d04a-59ee-ac3c-681602666f6f
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438fcea90>
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4225ec09-f8fd-550e-9f3e-a0d541b71bd7/4225ec09-f8fd-550e-9f3e-a0d541b71bd7_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/fc/82fc308e73f852a6e0f08500dd74ec54/pa/TG37812_7c957b5a1139d8bd3bdbc7880417d12e.jpg saved to cache
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4225ec09-f8fd-550e-9f3e-a0d541b71bd7
2026-04-27 07:55:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/ae/dfae082e0b2e17650dfc49c59e8eab79/pa/WU07507_8363ab4ecd2164c7b28a8e65d845a857.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/49/57497670dfa726a83867abbec3391bd9/pa/FD54899_3df691cf692792e9270ff52dc854b578.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/be/64be795c11002705e2ff7f552faead1b/pa/TB94788_6ea97c962114e3f795b72aeb1ccad1a5.jpg not downloaded yet
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/1f/bb1fa5fe94c99696714ab51667f1cab5/pa/PW05542_6bc8335cfe73e40b9734eb065f9ea121.jpg not downloaded yet
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/75/f7752536ed1193c904a538d6c97c87f1/pa/GT54355_8d231232f4dd96f486e68be5652ea460.jpg not downloaded yet
2026-04-27 07:55:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KZ47376> (referer: https://www.auto1.com/v1/car-details-view/KZ47376/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380e2890>
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_daef9541-9218-51e2-b640-94355be7994e/daef9541-9218-51e2-b640-94355be7994e_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/8a/488a2d9f34fb94078e5aefe22426cb8c/pa/MM74389_d5cc11e591d059b5a506f7be96e04bef.jpg saved to cache
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item daef9541-9218-51e2-b640-94355be7994e
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143807e410>
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48cdacb5-a189-59f2-a4f1-20199f77037d/48cdacb5-a189-59f2-a4f1-20199f77037d_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/be/64be795c11002705e2ff7f552faead1b/pa/TB94788_1180adbb1f12223597bc1ee6c449bfa0.jpg saved to cache
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 48cdacb5-a189-59f2-a4f1-20199f77037d
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14381847d0>
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdfcd267-d04a-59ee-ac3c-681602666f6f/fdfcd267-d04a-59ee-ac3c-681602666f6f_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/49/57497670dfa726a83867abbec3391bd9/pa/FD54899_faf4939aa15821b10a879366e1c65fd1.jpg saved to cache
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fdfcd267-d04a-59ee-ac3c-681602666f6f
2026-04-27 07:55:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/23/1823e6af665e4b2c83169fc52a485e0c/pa/YZ83641_57153809236386930be32ed5ea38cb71.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/8a/488a2d9f34fb94078e5aefe22426cb8c/pa/MM74389_217c33d90934b84aa481a8123644c85a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:40 [auto1.fr] INFO: Found listing with ID: KV02757
2026-04-27 07:55:40 [auto1.fr] INFO: Scrape type for KV02757: 1
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/ae/dfae082e0b2e17650dfc49c59e8eab79/pa/WU07507_b49b1e3559839f94015b39af0c924a11.jpg not downloaded yet
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/8a/488a2d9f34fb94078e5aefe22426cb8c/pa/MM74389_d8d829bf9a77cfc3432d671505ab8230.jpg not downloaded yet
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/1a/681a88bc342845f2840269fedfc297e0/pa/KE85331_eb9f017e8e2c2b1b5d560e2ff6ce0379.jpg not downloaded yet
2026-04-27 07:55:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XZ65279> (referer: https://www.auto1.com/v1/car-details-view/XZ65279/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14551b95d0>
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48cdacb5-a189-59f2-a4f1-20199f77037d/48cdacb5-a189-59f2-a4f1-20199f77037d_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/be/64be795c11002705e2ff7f552faead1b/pa/TB94788_3109675ce72adf7a7143457c6602d002.jpg saved to cache
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 48cdacb5-a189-59f2-a4f1-20199f77037d
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c2ccd0>
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_daef9541-9218-51e2-b640-94355be7994e/daef9541-9218-51e2-b640-94355be7994e_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/8a/488a2d9f34fb94078e5aefe22426cb8c/pa/MM74389_a0f813a0b837d401741ed81dfc338361.jpg saved to cache
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item daef9541-9218-51e2-b640-94355be7994e
2026-04-27 07:55:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/ae/dfae082e0b2e17650dfc49c59e8eab79/pa/WU07507_8b49205093fb5a92cae085ce5a7d52e2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/8a/488a2d9f34fb94078e5aefe22426cb8c/pa/MM74389_ff998842f3163fb4427ccd267bee43d4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/1f/bb1fa5fe94c99696714ab51667f1cab5/pa/PW05542_a39a001c9a1c8508e92c46716c25ea2a.jpg not downloaded yet
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/75/f7752536ed1193c904a538d6c97c87f1/pa/GT54355_6248608abbe634028be9c2806bbd2859.jpg not downloaded yet
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438cf9750>
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d53b333f-0b2c-5b0e-9906-764ddf709c52/d53b333f-0b2c-5b0e-9906-764ddf709c52_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/1f/bb1fa5fe94c99696714ab51667f1cab5/pa/PW05542_1c02d7290f7b58f0c622f2f7de734cf1.jpg saved to cache
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d53b333f-0b2c-5b0e-9906-764ddf709c52
2026-04-27 07:55:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/1a/681a88bc342845f2840269fedfc297e0/pa/KE85331_1b71f6454b57d18b4f496baf54b99d43.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/75/f7752536ed1193c904a538d6c97c87f1/pa/GT54355_58a79f6ad3a9dd6e4f064dbc984eb998.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/1f/bb1fa5fe94c99696714ab51667f1cab5/pa/PW05542_342520c3f642079dc23c0bca1f4e8da0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:41 [auto1.fr] INFO: Found listing with ID: WY50698
2026-04-27 07:55:41 [auto1.fr] INFO: Scrape type for WY50698: 2
2026-04-27 07:55:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b82d2fd2-23ef-50ba-8ec8-5a5eb23a06bd with identifier: WY50698
2026-04-27 07:55:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b82d2fd2-23ef-50ba-8ec8-5a5eb23a06bd with scrape type 2
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b82d2fd2-23ef-50ba-8ec8-5a5eb23a06bd with scrape type 2
2026-04-27 07:55:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b82d2fd2-23ef-50ba-8ec8-5a5eb23a06bd, identifier: WY50698
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/8a/488a2d9f34fb94078e5aefe22426cb8c/pa/MM74389_a4015f3654633782deb7a608bf51aad2.jpg not downloaded yet
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/1a/681a88bc342845f2840269fedfc297e0/pa/KE85331_07a34f2d55090c8b86869897bf4c2567.jpg not downloaded yet
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d87750>
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82c607f1-69da-537f-a5f9-ed4177752d1e/82c607f1-69da-537f-a5f9-ed4177752d1e_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/ae/dfae082e0b2e17650dfc49c59e8eab79/pa/WU07507_8363ab4ecd2164c7b28a8e65d845a857.jpg saved to cache
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 82c607f1-69da-537f-a5f9-ed4177752d1e
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143807df90>
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdfcd267-d04a-59ee-ac3c-681602666f6f/fdfcd267-d04a-59ee-ac3c-681602666f6f_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/49/57497670dfa726a83867abbec3391bd9/pa/FD54899_3df691cf692792e9270ff52dc854b578.jpg saved to cache
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fdfcd267-d04a-59ee-ac3c-681602666f6f
2026-04-27 07:55:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17520174-f266-59c7-9735-9b24cc23cc5d with identifier: KZ47376
2026-04-27 07:55:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17520174-f266-59c7-9735-9b24cc23cc5d with scrape type 1
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 17520174-f266-59c7-9735-9b24cc23cc5d
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/67/5a67353b3062e4a763491ee45c9e6cd8/pa/KZ47376_5868c3547a670eab58f81bba7e113678.jpg not downloaded yet
2026-04-27 07:55:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b82d2fd2-23ef-50ba-8ec8-5a5eb23a06bd with identifier: WY50698
2026-04-27 07:55:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-27 07:55:41 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-04-27 07:55:41 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-27 07:55:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b82d2fd2-23ef-50ba-8ec8-5a5eb23a06bd with identifier: WY50698
2026-04-27 07:55:41 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b82d2fd2-23ef-50ba-8ec8-5a5eb23a06bd with identifier: WY50698 to the API
2026-04-27 07:55:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:41 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-04-28T15:15:04Z',
 'fuel_type': 'diesel',
 'id': 'b82d2fd2-23ef-50ba-8ec8-5a5eb23a06bd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WY50698',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Citroen',
 'model': 'C3 Picasso',
 'odometer': 170843,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2009-06-28',
 'seller_name': None,
 'title': 'Citroen C3 Picasso 1.6 HDi Confort',
 'transmission': 'manual',
 'trim': 'Confort',
 'year': 2009}
2026-04-27 07:55:42 [auto1.fr] INFO: Saving data for WY50698: {'auction_closing_time': 1777389304.0, 'created_time': 1777020293.670684, 'has_photos': True, 'last_price_update_time': 1777276542.012696}
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/1f/bb1fa5fe94c99696714ab51667f1cab5/pa/PW05542_5afd08a1a3e9b1c319e825fade46e807.jpg not downloaded yet
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/75/f7752536ed1193c904a538d6c97c87f1/pa/GT54355_26c9b36f6b4089cc01fdbdb51b7a8f09.jpg not downloaded yet
2026-04-27 07:55:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438098d50>
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_155c8fd5-d977-5582-a0bd-e0679c478b8d/155c8fd5-d977-5582-a0bd-e0679c478b8d_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/23/1823e6af665e4b2c83169fc52a485e0c/pa/YZ83641_57153809236386930be32ed5ea38cb71.jpg saved to cache
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 155c8fd5-d977-5582-a0bd-e0679c478b8d
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c63e90>
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_daef9541-9218-51e2-b640-94355be7994e/daef9541-9218-51e2-b640-94355be7994e_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/8a/488a2d9f34fb94078e5aefe22426cb8c/pa/MM74389_217c33d90934b84aa481a8123644c85a.jpg saved to cache
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item daef9541-9218-51e2-b640-94355be7994e
2026-04-27 07:55:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/1a/681a88bc342845f2840269fedfc297e0/pa/KE85331_497e5bc38ebf7c7eccbafae26f0345c5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/1f/bb1fa5fe94c99696714ab51667f1cab5/pa/PW05542_97376dad7fbac8ea5ba105d208a1dec6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/8a/488a2d9f34fb94078e5aefe22426cb8c/pa/MM74389_2581832c632bf87ee1b625ac457360a0.jpg not downloaded yet
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/1a/681a88bc342845f2840269fedfc297e0/pa/KE85331_d7b3057cef3916415ff0892907f25876.jpg not downloaded yet
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/67/5a67353b3062e4a763491ee45c9e6cd8/pa/KZ47376_ec7e1884c765f8d4585e30bba11a3cf4.jpg not downloaded yet
2026-04-27 07:55:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GN31601> (referer: https://www.auto1.com/v1/car-details-view/GN31601/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd53f4d9-ef1f-52a4-aac6-9779ba6bdc40 with identifier: XZ65279
2026-04-27 07:55:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd53f4d9-ef1f-52a4-aac6-9779ba6bdc40 with scrape type 1
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fd53f4d9-ef1f-52a4-aac6-9779ba6bdc40
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/d0/5fd05b446dbb19a2a3cff7b23b1d9ae8/pa/XZ65279_1e2595c0f94ec37d7fe3a32827176165.jpg not downloaded yet
2026-04-27 07:55:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/1f/bb1fa5fe94c99696714ab51667f1cab5/pa/PW05542_6bc8335cfe73e40b9734eb065f9ea121.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/75/f7752536ed1193c904a538d6c97c87f1/pa/GT54355_8d231232f4dd96f486e68be5652ea460.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/be/64be795c11002705e2ff7f552faead1b/pa/TB94788_6ea97c962114e3f795b72aeb1ccad1a5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/75/f7752536ed1193c904a538d6c97c87f1/pa/GT54355_64e946e2f5b119b02bcd038d515a1c36.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/8a/488a2d9f34fb94078e5aefe22426cb8c/pa/MM74389_2ade0f9be52627e92d9b99c622e849e0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/ae/dfae082e0b2e17650dfc49c59e8eab79/pa/WU07507_181adbde443788c5732c5016e7e0c8eb.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/1f/bb1fa5fe94c99696714ab51667f1cab5/pa/PW05542_8cb4922f12183366ba047b212b05d860.jpg not downloaded yet
2026-04-27 07:55:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KH41597> (referer: https://www.auto1.com/v1/car-details-view/KH41597/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14381451d0>
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82c607f1-69da-537f-a5f9-ed4177752d1e/82c607f1-69da-537f-a5f9-ed4177752d1e_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/ae/dfae082e0b2e17650dfc49c59e8eab79/pa/WU07507_8b49205093fb5a92cae085ce5a7d52e2.jpg saved to cache
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 82c607f1-69da-537f-a5f9-ed4177752d1e
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a1ca50>
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_daef9541-9218-51e2-b640-94355be7994e/daef9541-9218-51e2-b640-94355be7994e_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/8a/488a2d9f34fb94078e5aefe22426cb8c/pa/MM74389_ff998842f3163fb4427ccd267bee43d4.jpg saved to cache
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item daef9541-9218-51e2-b640-94355be7994e
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a58cd0>
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67f1d977-64d5-555f-9910-6e0af8fb2572/67f1d977-64d5-555f-9910-6e0af8fb2572_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/1a/681a88bc342845f2840269fedfc297e0/pa/KE85331_1b71f6454b57d18b4f496baf54b99d43.jpg saved to cache
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 67f1d977-64d5-555f-9910-6e0af8fb2572
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438cd63d0>
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec4743fa-6b14-571b-8c9d-81eb8783d066/ec4743fa-6b14-571b-8c9d-81eb8783d066_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/75/f7752536ed1193c904a538d6c97c87f1/pa/GT54355_58a79f6ad3a9dd6e4f064dbc984eb998.jpg saved to cache
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ec4743fa-6b14-571b-8c9d-81eb8783d066
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438067710>
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d53b333f-0b2c-5b0e-9906-764ddf709c52/d53b333f-0b2c-5b0e-9906-764ddf709c52_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/1f/bb1fa5fe94c99696714ab51667f1cab5/pa/PW05542_342520c3f642079dc23c0bca1f4e8da0.jpg saved to cache
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d53b333f-0b2c-5b0e-9906-764ddf709c52
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/8a/488a2d9f34fb94078e5aefe22426cb8c/pa/MM74389_62003094f07b101c18140e34a7f7ae7e.jpg not downloaded yet
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/1a/681a88bc342845f2840269fedfc297e0/pa/KE85331_58be590c0b61f0dbac026cbb6c978983.jpg not downloaded yet
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/67/5a67353b3062e4a763491ee45c9e6cd8/pa/KZ47376_ed35bc6f3dc4c9298744489ec8df9c84.jpg not downloaded yet
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/d0/5fd05b446dbb19a2a3cff7b23b1d9ae8/pa/XZ65279_208bbf4dcf79124a167f7710328182de.jpg not downloaded yet
2026-04-27 07:55:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CG72057/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LP12244> (referer: https://www.auto1.com/v1/car-details-view/LP12244/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/1a/681a88bc342845f2840269fedfc297e0/pa/KE85331_eb9f017e8e2c2b1b5d560e2ff6ce0379.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/1f/bb1fa5fe94c99696714ab51667f1cab5/pa/PW05542_1c3ed74aabc3ae89658436ed20c51d46.jpg not downloaded yet
2026-04-27 07:55:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/8a/488a2d9f34fb94078e5aefe22426cb8c/pa/MM74389_d8d829bf9a77cfc3432d671505ab8230.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/1a/681a88bc342845f2840269fedfc297e0/pa/KE85331_a0bc1be3f414d32fef9af91ddf192f4b.jpg not downloaded yet
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/67/5a67353b3062e4a763491ee45c9e6cd8/pa/KZ47376_69073f77d9336433fd01ca63d853ee08.jpg not downloaded yet
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/d0/5fd05b446dbb19a2a3cff7b23b1d9ae8/pa/XZ65279_9c44388d3b72cd83891ca2e3ad2c0b01.jpg not downloaded yet
2026-04-27 07:55:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KR98436/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438cd5e90>
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67f1d977-64d5-555f-9910-6e0af8fb2572/67f1d977-64d5-555f-9910-6e0af8fb2572_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/1a/681a88bc342845f2840269fedfc297e0/pa/KE85331_497e5bc38ebf7c7eccbafae26f0345c5.jpg saved to cache
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 67f1d977-64d5-555f-9910-6e0af8fb2572
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438047310>
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d53b333f-0b2c-5b0e-9906-764ddf709c52/d53b333f-0b2c-5b0e-9906-764ddf709c52_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/1f/bb1fa5fe94c99696714ab51667f1cab5/pa/PW05542_97376dad7fbac8ea5ba105d208a1dec6.jpg saved to cache
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d53b333f-0b2c-5b0e-9906-764ddf709c52
2026-04-27 07:55:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a59659a7-24be-5055-8bc3-1a49cb0aa31c with identifier: GN31601
2026-04-27 07:55:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a59659a7-24be-5055-8bc3-1a49cb0aa31c with scrape type 1
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a59659a7-24be-5055-8bc3-1a49cb0aa31c
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/44/aa44cad36004efb2b5b489106645bd91/pa/GN31601_ed6cc13b4746f1fa0df1063141bfc55d.jpg not downloaded yet
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438203290>
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d53b333f-0b2c-5b0e-9906-764ddf709c52/d53b333f-0b2c-5b0e-9906-764ddf709c52_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/1f/bb1fa5fe94c99696714ab51667f1cab5/pa/PW05542_6bc8335cfe73e40b9734eb065f9ea121.jpg saved to cache
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d53b333f-0b2c-5b0e-9906-764ddf709c52
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b778d0>
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec4743fa-6b14-571b-8c9d-81eb8783d066/ec4743fa-6b14-571b-8c9d-81eb8783d066_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/75/f7752536ed1193c904a538d6c97c87f1/pa/GT54355_8d231232f4dd96f486e68be5652ea460.jpg saved to cache
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ec4743fa-6b14-571b-8c9d-81eb8783d066
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14381497d0>
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48cdacb5-a189-59f2-a4f1-20199f77037d/48cdacb5-a189-59f2-a4f1-20199f77037d_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/be/64be795c11002705e2ff7f552faead1b/pa/TB94788_6ea97c962114e3f795b72aeb1ccad1a5.jpg saved to cache
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 48cdacb5-a189-59f2-a4f1-20199f77037d
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b34450>
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec4743fa-6b14-571b-8c9d-81eb8783d066/ec4743fa-6b14-571b-8c9d-81eb8783d066_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/75/f7752536ed1193c904a538d6c97c87f1/pa/GT54355_64e946e2f5b119b02bcd038d515a1c36.jpg saved to cache
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ec4743fa-6b14-571b-8c9d-81eb8783d066
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14382037d0>
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_daef9541-9218-51e2-b640-94355be7994e/daef9541-9218-51e2-b640-94355be7994e_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/8a/488a2d9f34fb94078e5aefe22426cb8c/pa/MM74389_2ade0f9be52627e92d9b99c622e849e0.jpg saved to cache
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item daef9541-9218-51e2-b640-94355be7994e
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143804c310>
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82c607f1-69da-537f-a5f9-ed4177752d1e/82c607f1-69da-537f-a5f9-ed4177752d1e_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/ae/dfae082e0b2e17650dfc49c59e8eab79/pa/WU07507_181adbde443788c5732c5016e7e0c8eb.jpg saved to cache
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 82c607f1-69da-537f-a5f9-ed4177752d1e
2026-04-27 07:55:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07cf5e62-9aa6-5b98-be62-2b16944b1fb1 with identifier: KH41597
2026-04-27 07:55:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07cf5e62-9aa6-5b98-be62-2b16944b1fb1 with scrape type 1
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 07cf5e62-9aa6-5b98-be62-2b16944b1fb1
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/5b/015b9118be319555f3f35fd14b789c4e/pa/KH41597_85f3c6ba9d63a077c60bbf41ca635700.jpg not downloaded yet
2026-04-27 07:55:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/67/5a67353b3062e4a763491ee45c9e6cd8/pa/KZ47376_5868c3547a670eab58f81bba7e113678.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/1f/bb1fa5fe94c99696714ab51667f1cab5/pa/PW05542_58a6e7aa1a6a0beb6689e85f156ec5a5.jpg not downloaded yet
2026-04-27 07:55:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/1a/681a88bc342845f2840269fedfc297e0/pa/KE85331_07a34f2d55090c8b86869897bf4c2567.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/75/f7752536ed1193c904a538d6c97c87f1/pa/GT54355_26c9b36f6b4089cc01fdbdb51b7a8f09.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/1f/bb1fa5fe94c99696714ab51667f1cab5/pa/PW05542_5afd08a1a3e9b1c319e825fade46e807.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/8a/488a2d9f34fb94078e5aefe22426cb8c/pa/MM74389_a4015f3654633782deb7a608bf51aad2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/ae/dfae082e0b2e17650dfc49c59e8eab79/pa/WU07507_b49b1e3559839f94015b39af0c924a11.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/1a/681a88bc342845f2840269fedfc297e0/pa/KE85331_334aedee9c8790aa247e88476fc95b1f.jpg not downloaded yet
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/67/5a67353b3062e4a763491ee45c9e6cd8/pa/KZ47376_f5f63761c26e5b9ca1f59bd723b045ad.jpg not downloaded yet
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/d0/5fd05b446dbb19a2a3cff7b23b1d9ae8/pa/XZ65279_6b06087261eecf32a7cb407685b8e421.jpg not downloaded yet
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/44/aa44cad36004efb2b5b489106645bd91/pa/GN31601_1cd3809c6abb02d9b8560a2afc4a81db.jpg not downloaded yet
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/5b/015b9118be319555f3f35fd14b789c4e/pa/KH41597_c54f25e570c1b4b5e66b4ce94cd650c7.jpg not downloaded yet
2026-04-27 07:55:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/75/f7752536ed1193c904a538d6c97c87f1/pa/GT54355_6248608abbe634028be9c2806bbd2859.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/1a/681a88bc342845f2840269fedfc297e0/pa/KE85331_37847d6cb4aa1c8a8ad6c576f6cd36a9.jpg not downloaded yet
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/67/5a67353b3062e4a763491ee45c9e6cd8/pa/KZ47376_629a7fb486daf6a6fe114b8d62902b53.jpg not downloaded yet
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/d0/5fd05b446dbb19a2a3cff7b23b1d9ae8/pa/XZ65279_1c015c298567e1d41b60485db16a0ae8.jpg not downloaded yet
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/44/aa44cad36004efb2b5b489106645bd91/pa/GN31601_8f6b03e4d8340b10fac9ca6437b70ff5.jpg not downloaded yet
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/5b/015b9118be319555f3f35fd14b789c4e/pa/KH41597_c64b67936d6b3c0b3f56cae2a0c50893.jpg not downloaded yet
2026-04-27 07:55:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/1f/bb1fa5fe94c99696714ab51667f1cab5/pa/PW05542_a39a001c9a1c8508e92c46716c25ea2a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 302c0055-d531-53d2-aa2a-27a344e9c91c with identifier: LP12244
2026-04-27 07:55:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 302c0055-d531-53d2-aa2a-27a344e9c91c with scrape type 1
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 302c0055-d531-53d2-aa2a-27a344e9c91c
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/a5/8fa511aea5c2810d5ccf30819a6d04de/pa/LP12244_8e95fa5d8f0ceda7db3397561217af34.jpg not downloaded yet
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143809ee50>
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67f1d977-64d5-555f-9910-6e0af8fb2572/67f1d977-64d5-555f-9910-6e0af8fb2572_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/1a/681a88bc342845f2840269fedfc297e0/pa/KE85331_eb9f017e8e2c2b1b5d560e2ff6ce0379.jpg saved to cache
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 67f1d977-64d5-555f-9910-6e0af8fb2572
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bfa0710>
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_daef9541-9218-51e2-b640-94355be7994e/daef9541-9218-51e2-b640-94355be7994e_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/8a/488a2d9f34fb94078e5aefe22426cb8c/pa/MM74389_d8d829bf9a77cfc3432d671505ab8230.jpg saved to cache
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item daef9541-9218-51e2-b640-94355be7994e
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bf9f5d0>
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17520174-f266-59c7-9735-9b24cc23cc5d/17520174-f266-59c7-9735-9b24cc23cc5d_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/67/5a67353b3062e4a763491ee45c9e6cd8/pa/KZ47376_5868c3547a670eab58f81bba7e113678.jpg saved to cache
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 17520174-f266-59c7-9735-9b24cc23cc5d
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bfb4dd0>
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67f1d977-64d5-555f-9910-6e0af8fb2572/67f1d977-64d5-555f-9910-6e0af8fb2572_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/1a/681a88bc342845f2840269fedfc297e0/pa/KE85331_07a34f2d55090c8b86869897bf4c2567.jpg saved to cache
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 67f1d977-64d5-555f-9910-6e0af8fb2572
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143804e090>
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec4743fa-6b14-571b-8c9d-81eb8783d066/ec4743fa-6b14-571b-8c9d-81eb8783d066_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/75/f7752536ed1193c904a538d6c97c87f1/pa/GT54355_26c9b36f6b4089cc01fdbdb51b7a8f09.jpg saved to cache
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ec4743fa-6b14-571b-8c9d-81eb8783d066
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bf9a990>
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d53b333f-0b2c-5b0e-9906-764ddf709c52/d53b333f-0b2c-5b0e-9906-764ddf709c52_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/1f/bb1fa5fe94c99696714ab51667f1cab5/pa/PW05542_5afd08a1a3e9b1c319e825fade46e807.jpg saved to cache
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d53b333f-0b2c-5b0e-9906-764ddf709c52
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bfa6d90>
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_daef9541-9218-51e2-b640-94355be7994e/daef9541-9218-51e2-b640-94355be7994e_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/8a/488a2d9f34fb94078e5aefe22426cb8c/pa/MM74389_a4015f3654633782deb7a608bf51aad2.jpg saved to cache
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item daef9541-9218-51e2-b640-94355be7994e
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bfafe90>
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82c607f1-69da-537f-a5f9-ed4177752d1e/82c607f1-69da-537f-a5f9-ed4177752d1e_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/ae/dfae082e0b2e17650dfc49c59e8eab79/pa/WU07507_b49b1e3559839f94015b39af0c924a11.jpg saved to cache
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 82c607f1-69da-537f-a5f9-ed4177752d1e
2026-04-27 07:55:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/d0/5fd05b446dbb19a2a3cff7b23b1d9ae8/pa/XZ65279_208bbf4dcf79124a167f7710328182de.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/1a/681a88bc342845f2840269fedfc297e0/pa/KE85331_1296bec3bdd3ee66e7e25366d3fc7682.jpg not downloaded yet
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/d0/5fd05b446dbb19a2a3cff7b23b1d9ae8/pa/XZ65279_00eb1d39a1d609b4a122227f40e2b5fa.jpg not downloaded yet
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/44/aa44cad36004efb2b5b489106645bd91/pa/GN31601_9d5b3d29ec6c372cda88894ff340e043.jpg not downloaded yet
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/5b/015b9118be319555f3f35fd14b789c4e/pa/KH41597_d14a239bd086485f7aa7989c45592321.jpg not downloaded yet
2026-04-27 07:55:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/1a/681a88bc342845f2840269fedfc297e0/pa/KE85331_d7b3057cef3916415ff0892907f25876.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/d0/5fd05b446dbb19a2a3cff7b23b1d9ae8/pa/XZ65279_1e2595c0f94ec37d7fe3a32827176165.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/44/aa44cad36004efb2b5b489106645bd91/pa/GN31601_ed6cc13b4746f1fa0df1063141bfc55d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/5b/015b9118be319555f3f35fd14b789c4e/pa/KH41597_85f3c6ba9d63a077c60bbf41ca635700.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/1f/bb1fa5fe94c99696714ab51667f1cab5/pa/PW05542_8cb4922f12183366ba047b212b05d860.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/a5/8fa511aea5c2810d5ccf30819a6d04de/pa/LP12244_76ac98c457752dab9a35eaceb8bb84b6.jpg not downloaded yet
2026-04-27 07:55:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/67/5a67353b3062e4a763491ee45c9e6cd8/pa/KZ47376_ec7e1884c765f8d4585e30bba11a3cf4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/d0/5fd05b446dbb19a2a3cff7b23b1d9ae8/pa/XZ65279_71eeb53f204ee513ce0459eb51e139bd.jpg not downloaded yet
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/44/aa44cad36004efb2b5b489106645bd91/pa/GN31601_d9bf893d1cc65e21402d6df5e0f188e7.jpg not downloaded yet
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/5b/015b9118be319555f3f35fd14b789c4e/pa/KH41597_2b98b3afe89a53f94fa65906b4aad2dd.jpg not downloaded yet
2026-04-27 07:55:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b7ca50>
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec4743fa-6b14-571b-8c9d-81eb8783d066/ec4743fa-6b14-571b-8c9d-81eb8783d066_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/75/f7752536ed1193c904a538d6c97c87f1/pa/GT54355_6248608abbe634028be9c2806bbd2859.jpg saved to cache
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ec4743fa-6b14-571b-8c9d-81eb8783d066
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a3d910>
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d53b333f-0b2c-5b0e-9906-764ddf709c52/d53b333f-0b2c-5b0e-9906-764ddf709c52_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/1f/bb1fa5fe94c99696714ab51667f1cab5/pa/PW05542_a39a001c9a1c8508e92c46716c25ea2a.jpg saved to cache
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d53b333f-0b2c-5b0e-9906-764ddf709c52
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/a5/8fa511aea5c2810d5ccf30819a6d04de/pa/LP12244_d64630c01f6fa92c7502c1a8eb5ab3d2.jpg not downloaded yet
2026-04-27 07:55:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KV02757/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/d0/5fd05b446dbb19a2a3cff7b23b1d9ae8/pa/XZ65279_139f963f26c7be18f7e25e48789e1980.jpg not downloaded yet
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/44/aa44cad36004efb2b5b489106645bd91/pa/GN31601_3e646f873b2fe8acc92248d6c14eb81e.jpg not downloaded yet
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/5b/015b9118be319555f3f35fd14b789c4e/pa/KH41597_a1dbd56fb170c7e3dca304982f6d4611.jpg not downloaded yet
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438019c90>
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd53f4d9-ef1f-52a4-aac6-9779ba6bdc40/fd53f4d9-ef1f-52a4-aac6-9779ba6bdc40_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/d0/5fd05b446dbb19a2a3cff7b23b1d9ae8/pa/XZ65279_208bbf4dcf79124a167f7710328182de.jpg saved to cache
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fd53f4d9-ef1f-52a4-aac6-9779ba6bdc40
2026-04-27 07:55:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/d0/5fd05b446dbb19a2a3cff7b23b1d9ae8/pa/XZ65279_9c44388d3b72cd83891ca2e3ad2c0b01.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/a5/8fa511aea5c2810d5ccf30819a6d04de/pa/LP12244_8fd34bedc20f6628499b3d1ec16cf695.jpg not downloaded yet
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438134e10>
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67f1d977-64d5-555f-9910-6e0af8fb2572/67f1d977-64d5-555f-9910-6e0af8fb2572_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/1a/681a88bc342845f2840269fedfc297e0/pa/KE85331_d7b3057cef3916415ff0892907f25876.jpg saved to cache
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 67f1d977-64d5-555f-9910-6e0af8fb2572
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438167a50>
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd53f4d9-ef1f-52a4-aac6-9779ba6bdc40/fd53f4d9-ef1f-52a4-aac6-9779ba6bdc40_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/d0/5fd05b446dbb19a2a3cff7b23b1d9ae8/pa/XZ65279_1e2595c0f94ec37d7fe3a32827176165.jpg saved to cache
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fd53f4d9-ef1f-52a4-aac6-9779ba6bdc40
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14381348d0>
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a59659a7-24be-5055-8bc3-1a49cb0aa31c/a59659a7-24be-5055-8bc3-1a49cb0aa31c_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/44/aa44cad36004efb2b5b489106645bd91/pa/GN31601_ed6cc13b4746f1fa0df1063141bfc55d.jpg saved to cache
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a59659a7-24be-5055-8bc3-1a49cb0aa31c
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438af9d50>
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07cf5e62-9aa6-5b98-be62-2b16944b1fb1/07cf5e62-9aa6-5b98-be62-2b16944b1fb1_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/5b/015b9118be319555f3f35fd14b789c4e/pa/KH41597_85f3c6ba9d63a077c60bbf41ca635700.jpg saved to cache
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 07cf5e62-9aa6-5b98-be62-2b16944b1fb1
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c2f450>
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d53b333f-0b2c-5b0e-9906-764ddf709c52/d53b333f-0b2c-5b0e-9906-764ddf709c52_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/1f/bb1fa5fe94c99696714ab51667f1cab5/pa/PW05542_8cb4922f12183366ba047b212b05d860.jpg saved to cache
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d53b333f-0b2c-5b0e-9906-764ddf709c52
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438166cd0>
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17520174-f266-59c7-9735-9b24cc23cc5d/17520174-f266-59c7-9735-9b24cc23cc5d_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/67/5a67353b3062e4a763491ee45c9e6cd8/pa/KZ47376_ec7e1884c765f8d4585e30bba11a3cf4.jpg saved to cache
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 17520174-f266-59c7-9735-9b24cc23cc5d
2026-04-27 07:55:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/1f/bb1fa5fe94c99696714ab51667f1cab5/pa/PW05542_58a6e7aa1a6a0beb6689e85f156ec5a5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/67/5a67353b3062e4a763491ee45c9e6cd8/pa/KZ47376_69073f77d9336433fd01ca63d853ee08.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/1a/681a88bc342845f2840269fedfc297e0/pa/KE85331_a0bc1be3f414d32fef9af91ddf192f4b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/d0/5fd05b446dbb19a2a3cff7b23b1d9ae8/pa/XZ65279_7eb83097362b8e4a74177ab5f1608f7d.jpg not downloaded yet
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/44/aa44cad36004efb2b5b489106645bd91/pa/GN31601_19d6ffc0c044b7f8cbb0af525859c83b.jpg not downloaded yet
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/5b/015b9118be319555f3f35fd14b789c4e/pa/KH41597_ea426b50e4ae993420ebc3588f45dc15.jpg not downloaded yet
2026-04-27 07:55:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/1f/bb1fa5fe94c99696714ab51667f1cab5/pa/PW05542_1c3ed74aabc3ae89658436ed20c51d46.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/67/5a67353b3062e4a763491ee45c9e6cd8/pa/KZ47376_ed35bc6f3dc4c9298744489ec8df9c84.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/5b/015b9118be319555f3f35fd14b789c4e/pa/KH41597_c54f25e570c1b4b5e66b4ce94cd650c7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/5b/015b9118be319555f3f35fd14b789c4e/pa/KH41597_c64b67936d6b3c0b3f56cae2a0c50893.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/a5/8fa511aea5c2810d5ccf30819a6d04de/pa/LP12244_8ac213342c843b1126431c0c0afaa38a.jpg not downloaded yet
2026-04-27 07:55:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/5b/015b9118be319555f3f35fd14b789c4e/pa/KH41597_d14a239bd086485f7aa7989c45592321.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/d0/5fd05b446dbb19a2a3cff7b23b1d9ae8/pa/XZ65279_7a657f414867bee20577df60e12d5318.jpg not downloaded yet
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/44/aa44cad36004efb2b5b489106645bd91/pa/GN31601_7aaa06d44709f621751f4dd33ced8b4f.jpg not downloaded yet
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/5b/015b9118be319555f3f35fd14b789c4e/pa/KH41597_2fc57cb15257bee3c0604b472979b52a.jpg not downloaded yet
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438efd110>
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd53f4d9-ef1f-52a4-aac6-9779ba6bdc40/fd53f4d9-ef1f-52a4-aac6-9779ba6bdc40_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/d0/5fd05b446dbb19a2a3cff7b23b1d9ae8/pa/XZ65279_9c44388d3b72cd83891ca2e3ad2c0b01.jpg saved to cache
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fd53f4d9-ef1f-52a4-aac6-9779ba6bdc40
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/a5/8fa511aea5c2810d5ccf30819a6d04de/pa/LP12244_d0497852d494fb807e767f847d947cbc.jpg not downloaded yet
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/44/aa44cad36004efb2b5b489106645bd91/pa/GN31601_fba571e7e4a52908eb0cddccf9716705.jpg not downloaded yet
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/5b/015b9118be319555f3f35fd14b789c4e/pa/KH41597_31b23f5f02f7aeb73f247ab50a498fc8.jpg not downloaded yet
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143809ded0>
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d53b333f-0b2c-5b0e-9906-764ddf709c52/d53b333f-0b2c-5b0e-9906-764ddf709c52_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/1f/bb1fa5fe94c99696714ab51667f1cab5/pa/PW05542_58a6e7aa1a6a0beb6689e85f156ec5a5.jpg saved to cache
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d53b333f-0b2c-5b0e-9906-764ddf709c52
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b66ad0>
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17520174-f266-59c7-9735-9b24cc23cc5d/17520174-f266-59c7-9735-9b24cc23cc5d_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/67/5a67353b3062e4a763491ee45c9e6cd8/pa/KZ47376_69073f77d9336433fd01ca63d853ee08.jpg saved to cache
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 17520174-f266-59c7-9735-9b24cc23cc5d
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438adf610>
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67f1d977-64d5-555f-9910-6e0af8fb2572/67f1d977-64d5-555f-9910-6e0af8fb2572_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/1a/681a88bc342845f2840269fedfc297e0/pa/KE85331_a0bc1be3f414d32fef9af91ddf192f4b.jpg saved to cache
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 67f1d977-64d5-555f-9910-6e0af8fb2572
2026-04-27 07:55:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/a5/8fa511aea5c2810d5ccf30819a6d04de/pa/LP12244_8e95fa5d8f0ceda7db3397561217af34.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/a5/8fa511aea5c2810d5ccf30819a6d04de/pa/LP12244_c663cc9d31bb07cea3937adedd6ace62.jpg not downloaded yet
2026-04-27 07:55:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/5b/015b9118be319555f3f35fd14b789c4e/pa/KH41597_2b98b3afe89a53f94fa65906b4aad2dd.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/d0/5fd05b446dbb19a2a3cff7b23b1d9ae8/pa/XZ65279_00eb1d39a1d609b4a122227f40e2b5fa.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/44/aa44cad36004efb2b5b489106645bd91/pa/GN31601_b0b0d157fed2e3f8a8d426d7304bbec4.jpg not downloaded yet
2026-04-27 07:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/5b/015b9118be319555f3f35fd14b789c4e/pa/KH41597_3198dc93cd48b17333a6810ff34c0ccc.jpg not downloaded yet
2026-04-27 07:55:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d6f990>
2026-04-27 07:55:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d53b333f-0b2c-5b0e-9906-764ddf709c52/d53b333f-0b2c-5b0e-9906-764ddf709c52_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/1f/bb1fa5fe94c99696714ab51667f1cab5/pa/PW05542_1c3ed74aabc3ae89658436ed20c51d46.jpg saved to cache
2026-04-27 07:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d53b333f-0b2c-5b0e-9906-764ddf709c52
2026-04-27 07:55:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bf44ad0>
2026-04-27 07:55:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17520174-f266-59c7-9735-9b24cc23cc5d/17520174-f266-59c7-9735-9b24cc23cc5d_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/67/5a67353b3062e4a763491ee45c9e6cd8/pa/KZ47376_ed35bc6f3dc4c9298744489ec8df9c84.jpg saved to cache
2026-04-27 07:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 17520174-f266-59c7-9735-9b24cc23cc5d
2026-04-27 07:55:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a1a090>
2026-04-27 07:55:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07cf5e62-9aa6-5b98-be62-2b16944b1fb1/07cf5e62-9aa6-5b98-be62-2b16944b1fb1_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/5b/015b9118be319555f3f35fd14b789c4e/pa/KH41597_c54f25e570c1b4b5e66b4ce94cd650c7.jpg saved to cache
2026-04-27 07:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 07cf5e62-9aa6-5b98-be62-2b16944b1fb1
2026-04-27 07:55:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438bd1390>
2026-04-27 07:55:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07cf5e62-9aa6-5b98-be62-2b16944b1fb1/07cf5e62-9aa6-5b98-be62-2b16944b1fb1_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/5b/015b9118be319555f3f35fd14b789c4e/pa/KH41597_c64b67936d6b3c0b3f56cae2a0c50893.jpg saved to cache
2026-04-27 07:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 07cf5e62-9aa6-5b98-be62-2b16944b1fb1
2026-04-27 07:55:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c3f750>
2026-04-27 07:55:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07cf5e62-9aa6-5b98-be62-2b16944b1fb1/07cf5e62-9aa6-5b98-be62-2b16944b1fb1_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/5b/015b9118be319555f3f35fd14b789c4e/pa/KH41597_d14a239bd086485f7aa7989c45592321.jpg saved to cache
2026-04-27 07:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 07cf5e62-9aa6-5b98-be62-2b16944b1fb1
2026-04-27 07:55:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/1a/681a88bc342845f2840269fedfc297e0/pa/KE85331_1296bec3bdd3ee66e7e25366d3fc7682.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/44/aa44cad36004efb2b5b489106645bd91/pa/GN31601_9d5b3d29ec6c372cda88894ff340e043.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/5b/015b9118be319555f3f35fd14b789c4e/pa/KH41597_a1dbd56fb170c7e3dca304982f6d4611.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/a5/8fa511aea5c2810d5ccf30819a6d04de/pa/LP12244_d64630c01f6fa92c7502c1a8eb5ab3d2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/44/aa44cad36004efb2b5b489106645bd91/pa/GN31601_3e646f873b2fe8acc92248d6c14eb81e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/a5/8fa511aea5c2810d5ccf30819a6d04de/pa/LP12244_50f03bc9db76e609155dc4586ab5a3b5.jpg not downloaded yet
2026-04-27 07:55:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/d0/5fd05b446dbb19a2a3cff7b23b1d9ae8/pa/XZ65279_139f963f26c7be18f7e25e48789e1980.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/a5/8fa511aea5c2810d5ccf30819a6d04de/pa/LP12244_74a06d02fbda38b19481f1f8e18ddec4.jpg not downloaded yet
2026-04-27 07:55:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b29b90>
2026-04-27 07:55:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_302c0055-d531-53d2-aa2a-27a344e9c91c/302c0055-d531-53d2-aa2a-27a344e9c91c_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/a5/8fa511aea5c2810d5ccf30819a6d04de/pa/LP12244_8e95fa5d8f0ceda7db3397561217af34.jpg saved to cache
2026-04-27 07:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 302c0055-d531-53d2-aa2a-27a344e9c91c
2026-04-27 07:55:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bf01350>
2026-04-27 07:55:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07cf5e62-9aa6-5b98-be62-2b16944b1fb1/07cf5e62-9aa6-5b98-be62-2b16944b1fb1_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/5b/015b9118be319555f3f35fd14b789c4e/pa/KH41597_2b98b3afe89a53f94fa65906b4aad2dd.jpg saved to cache
2026-04-27 07:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 07cf5e62-9aa6-5b98-be62-2b16944b1fb1
2026-04-27 07:55:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bf6a150>
2026-04-27 07:55:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd53f4d9-ef1f-52a4-aac6-9779ba6bdc40/fd53f4d9-ef1f-52a4-aac6-9779ba6bdc40_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/d0/5fd05b446dbb19a2a3cff7b23b1d9ae8/pa/XZ65279_00eb1d39a1d609b4a122227f40e2b5fa.jpg saved to cache
2026-04-27 07:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fd53f4d9-ef1f-52a4-aac6-9779ba6bdc40
2026-04-27 07:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/a5/8fa511aea5c2810d5ccf30819a6d04de/pa/LP12244_da3fab92f14af914e8f8d42c373f3137.jpg not downloaded yet
2026-04-27 07:55:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/5b/015b9118be319555f3f35fd14b789c4e/pa/KH41597_31b23f5f02f7aeb73f247ab50a498fc8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/d0/5fd05b446dbb19a2a3cff7b23b1d9ae8/pa/XZ65279_71eeb53f204ee513ce0459eb51e139bd.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/a5/8fa511aea5c2810d5ccf30819a6d04de/pa/LP12244_8fd34bedc20f6628499b3d1ec16cf695.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/a5/8fa511aea5c2810d5ccf30819a6d04de/pa/LP12244_76ac98c457752dab9a35eaceb8bb84b6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/a5/8fa511aea5c2810d5ccf30819a6d04de/pa/LP12244_d0497852d494fb807e767f847d947cbc.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b35310>
2026-04-27 07:55:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67f1d977-64d5-555f-9910-6e0af8fb2572/67f1d977-64d5-555f-9910-6e0af8fb2572_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/1a/681a88bc342845f2840269fedfc297e0/pa/KE85331_1296bec3bdd3ee66e7e25366d3fc7682.jpg saved to cache
2026-04-27 07:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 67f1d977-64d5-555f-9910-6e0af8fb2572
2026-04-27 07:55:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438e4ff50>
2026-04-27 07:55:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a59659a7-24be-5055-8bc3-1a49cb0aa31c/a59659a7-24be-5055-8bc3-1a49cb0aa31c_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/44/aa44cad36004efb2b5b489106645bd91/pa/GN31601_9d5b3d29ec6c372cda88894ff340e043.jpg saved to cache
2026-04-27 07:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a59659a7-24be-5055-8bc3-1a49cb0aa31c
2026-04-27 07:55:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1447bb0210>
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07cf5e62-9aa6-5b98-be62-2b16944b1fb1/07cf5e62-9aa6-5b98-be62-2b16944b1fb1_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/5b/015b9118be319555f3f35fd14b789c4e/pa/KH41597_a1dbd56fb170c7e3dca304982f6d4611.jpg saved to cache
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 07cf5e62-9aa6-5b98-be62-2b16944b1fb1
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b03290>
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_302c0055-d531-53d2-aa2a-27a344e9c91c/302c0055-d531-53d2-aa2a-27a344e9c91c_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/a5/8fa511aea5c2810d5ccf30819a6d04de/pa/LP12244_d64630c01f6fa92c7502c1a8eb5ab3d2.jpg saved to cache
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 302c0055-d531-53d2-aa2a-27a344e9c91c
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bfa4850>
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a59659a7-24be-5055-8bc3-1a49cb0aa31c/a59659a7-24be-5055-8bc3-1a49cb0aa31c_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/44/aa44cad36004efb2b5b489106645bd91/pa/GN31601_3e646f873b2fe8acc92248d6c14eb81e.jpg saved to cache
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a59659a7-24be-5055-8bc3-1a49cb0aa31c
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438dc9310>
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd53f4d9-ef1f-52a4-aac6-9779ba6bdc40/fd53f4d9-ef1f-52a4-aac6-9779ba6bdc40_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/d0/5fd05b446dbb19a2a3cff7b23b1d9ae8/pa/XZ65279_139f963f26c7be18f7e25e48789e1980.jpg saved to cache
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fd53f4d9-ef1f-52a4-aac6-9779ba6bdc40
2026-04-27 07:55:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/5b/015b9118be319555f3f35fd14b789c4e/pa/KH41597_ea426b50e4ae993420ebc3588f45dc15.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/44/aa44cad36004efb2b5b489106645bd91/pa/GN31601_d9bf893d1cc65e21402d6df5e0f188e7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/44/aa44cad36004efb2b5b489106645bd91/pa/GN31601_fba571e7e4a52908eb0cddccf9716705.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KR98436> (referer: https://www.auto1.com/v1/car-details-view/KR98436/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZM99861/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ae9550>
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07cf5e62-9aa6-5b98-be62-2b16944b1fb1/07cf5e62-9aa6-5b98-be62-2b16944b1fb1_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/5b/015b9118be319555f3f35fd14b789c4e/pa/KH41597_31b23f5f02f7aeb73f247ab50a498fc8.jpg saved to cache
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 07cf5e62-9aa6-5b98-be62-2b16944b1fb1
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bf98210>
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd53f4d9-ef1f-52a4-aac6-9779ba6bdc40/fd53f4d9-ef1f-52a4-aac6-9779ba6bdc40_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/d0/5fd05b446dbb19a2a3cff7b23b1d9ae8/pa/XZ65279_71eeb53f204ee513ce0459eb51e139bd.jpg saved to cache
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fd53f4d9-ef1f-52a4-aac6-9779ba6bdc40
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a62650>
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_302c0055-d531-53d2-aa2a-27a344e9c91c/302c0055-d531-53d2-aa2a-27a344e9c91c_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/a5/8fa511aea5c2810d5ccf30819a6d04de/pa/LP12244_8fd34bedc20f6628499b3d1ec16cf695.jpg saved to cache
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 302c0055-d531-53d2-aa2a-27a344e9c91c
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bf99490>
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_302c0055-d531-53d2-aa2a-27a344e9c91c/302c0055-d531-53d2-aa2a-27a344e9c91c_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/a5/8fa511aea5c2810d5ccf30819a6d04de/pa/LP12244_76ac98c457752dab9a35eaceb8bb84b6.jpg saved to cache
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 302c0055-d531-53d2-aa2a-27a344e9c91c
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1439c74810>
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_302c0055-d531-53d2-aa2a-27a344e9c91c/302c0055-d531-53d2-aa2a-27a344e9c91c_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/a5/8fa511aea5c2810d5ccf30819a6d04de/pa/LP12244_d0497852d494fb807e767f847d947cbc.jpg saved to cache
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 302c0055-d531-53d2-aa2a-27a344e9c91c
2026-04-27 07:55:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/a5/8fa511aea5c2810d5ccf30819a6d04de/pa/LP12244_c663cc9d31bb07cea3937adedd6ace62.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/d0/5fd05b446dbb19a2a3cff7b23b1d9ae8/pa/XZ65279_7a657f414867bee20577df60e12d5318.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/5b/015b9118be319555f3f35fd14b789c4e/pa/KH41597_3198dc93cd48b17333a6810ff34c0ccc.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/44/aa44cad36004efb2b5b489106645bd91/pa/GN31601_b0b0d157fed2e3f8a8d426d7304bbec4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/44/aa44cad36004efb2b5b489106645bd91/pa/GN31601_7aaa06d44709f621751f4dd33ced8b4f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/a5/8fa511aea5c2810d5ccf30819a6d04de/pa/LP12244_74a06d02fbda38b19481f1f8e18ddec4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/a5/8fa511aea5c2810d5ccf30819a6d04de/pa/LP12244_50f03bc9db76e609155dc4586ab5a3b5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/5b/015b9118be319555f3f35fd14b789c4e/pa/KH41597_2fc57cb15257bee3c0604b472979b52a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c3b510>
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07cf5e62-9aa6-5b98-be62-2b16944b1fb1/07cf5e62-9aa6-5b98-be62-2b16944b1fb1_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/5b/015b9118be319555f3f35fd14b789c4e/pa/KH41597_ea426b50e4ae993420ebc3588f45dc15.jpg saved to cache
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 07cf5e62-9aa6-5b98-be62-2b16944b1fb1
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14381494d0>
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a59659a7-24be-5055-8bc3-1a49cb0aa31c/a59659a7-24be-5055-8bc3-1a49cb0aa31c_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/44/aa44cad36004efb2b5b489106645bd91/pa/GN31601_d9bf893d1cc65e21402d6df5e0f188e7.jpg saved to cache
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a59659a7-24be-5055-8bc3-1a49cb0aa31c
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ccc990>
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a59659a7-24be-5055-8bc3-1a49cb0aa31c/a59659a7-24be-5055-8bc3-1a49cb0aa31c_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/44/aa44cad36004efb2b5b489106645bd91/pa/GN31601_fba571e7e4a52908eb0cddccf9716705.jpg saved to cache
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a59659a7-24be-5055-8bc3-1a49cb0aa31c
2026-04-27 07:55:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0dce51e5-a537-5163-a723-63a98f53aaa1 with identifier: KR98436
2026-04-27 07:55:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0dce51e5-a537-5163-a723-63a98f53aaa1 with scrape type 1
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 0dce51e5-a537-5163-a723-63a98f53aaa1
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/14/b1141ea1826c8f7f11660cdb231e3dc9/pa/KR98436_e3c8d90ccb11138227ae79fb89bf5b98.jpg not downloaded yet
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/14/b1141ea1826c8f7f11660cdb231e3dc9/pa/KR98436_3a845e8d703fd4faacc5a2e79fa5ae18.jpg not downloaded yet
2026-04-27 07:55:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/d0/5fd05b446dbb19a2a3cff7b23b1d9ae8/pa/XZ65279_7eb83097362b8e4a74177ab5f1608f7d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/44/aa44cad36004efb2b5b489106645bd91/pa/GN31601_8f6b03e4d8340b10fac9ca6437b70ff5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/a5/8fa511aea5c2810d5ccf30819a6d04de/pa/LP12244_8ac213342c843b1126431c0c0afaa38a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/a5/8fa511aea5c2810d5ccf30819a6d04de/pa/LP12244_da3fab92f14af914e8f8d42c373f3137.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/14/b1141ea1826c8f7f11660cdb231e3dc9/pa/KR98436_80bbc943ba1318ca4fd341e47734376c.jpg not downloaded yet
2026-04-27 07:55:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380bc090>
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_302c0055-d531-53d2-aa2a-27a344e9c91c/302c0055-d531-53d2-aa2a-27a344e9c91c_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/a5/8fa511aea5c2810d5ccf30819a6d04de/pa/LP12244_c663cc9d31bb07cea3937adedd6ace62.jpg saved to cache
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 302c0055-d531-53d2-aa2a-27a344e9c91c
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d26990>
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd53f4d9-ef1f-52a4-aac6-9779ba6bdc40/fd53f4d9-ef1f-52a4-aac6-9779ba6bdc40_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/d0/5fd05b446dbb19a2a3cff7b23b1d9ae8/pa/XZ65279_7a657f414867bee20577df60e12d5318.jpg saved to cache
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fd53f4d9-ef1f-52a4-aac6-9779ba6bdc40
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d5bad0>
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07cf5e62-9aa6-5b98-be62-2b16944b1fb1/07cf5e62-9aa6-5b98-be62-2b16944b1fb1_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/5b/015b9118be319555f3f35fd14b789c4e/pa/KH41597_3198dc93cd48b17333a6810ff34c0ccc.jpg saved to cache
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 07cf5e62-9aa6-5b98-be62-2b16944b1fb1
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438f08590>
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a59659a7-24be-5055-8bc3-1a49cb0aa31c/a59659a7-24be-5055-8bc3-1a49cb0aa31c_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/44/aa44cad36004efb2b5b489106645bd91/pa/GN31601_b0b0d157fed2e3f8a8d426d7304bbec4.jpg saved to cache
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a59659a7-24be-5055-8bc3-1a49cb0aa31c
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d58610>
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a59659a7-24be-5055-8bc3-1a49cb0aa31c/a59659a7-24be-5055-8bc3-1a49cb0aa31c_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/44/aa44cad36004efb2b5b489106645bd91/pa/GN31601_7aaa06d44709f621751f4dd33ced8b4f.jpg saved to cache
2026-04-27 07:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a59659a7-24be-5055-8bc3-1a49cb0aa31c
2026-04-27 07:55:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438fad950>
2026-04-27 07:55:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_302c0055-d531-53d2-aa2a-27a344e9c91c/302c0055-d531-53d2-aa2a-27a344e9c91c_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/a5/8fa511aea5c2810d5ccf30819a6d04de/pa/LP12244_74a06d02fbda38b19481f1f8e18ddec4.jpg saved to cache
2026-04-27 07:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 302c0055-d531-53d2-aa2a-27a344e9c91c
2026-04-27 07:55:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143819b0d0>
2026-04-27 07:55:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_302c0055-d531-53d2-aa2a-27a344e9c91c/302c0055-d531-53d2-aa2a-27a344e9c91c_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/a5/8fa511aea5c2810d5ccf30819a6d04de/pa/LP12244_50f03bc9db76e609155dc4586ab5a3b5.jpg saved to cache
2026-04-27 07:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 302c0055-d531-53d2-aa2a-27a344e9c91c
2026-04-27 07:55:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b1dc10>
2026-04-27 07:55:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07cf5e62-9aa6-5b98-be62-2b16944b1fb1/07cf5e62-9aa6-5b98-be62-2b16944b1fb1_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/5b/015b9118be319555f3f35fd14b789c4e/pa/KH41597_2fc57cb15257bee3c0604b472979b52a.jpg saved to cache
2026-04-27 07:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 07cf5e62-9aa6-5b98-be62-2b16944b1fb1
2026-04-27 07:55:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 07cf5e62-9aa6-5b98-be62-2b16944b1fb1, skipping ID generation
2026-04-27 07:55:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07cf5e62-9aa6-5b98-be62-2b16944b1fb1 with scrape type 1
2026-04-27 07:55:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 07cf5e62-9aa6-5b98-be62-2b16944b1fb1 sending to next pipeline
2026-04-27 07:55:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 07cf5e62-9aa6-5b98-be62-2b16944b1fb1, identifier: KH41597
2026-04-27 07:55:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/44/aa44cad36004efb2b5b489106645bd91/pa/GN31601_19d6ffc0c044b7f8cbb0af525859c83b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 07cf5e62-9aa6-5b98-be62-2b16944b1fb1 with identifier: KH41597
2026-04-27 07:55:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 07cf5e62-9aa6-5b98-be62-2b16944b1fb1 with identifier: KH41597
2026-04-27 07:55:47 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 07cf5e62-9aa6-5b98-be62-2b16944b1fb1 with identifier: KH41597 to the API
2026-04-27 07:55:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:47 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img01/5b/015b9118be319555f3f35fd14b789c4e/pa/KH41597_2fc57cb15257bee3c0604b472979b52a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 50,
 'category': None,
 'city': 'Loyettes',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 320,
 'expiration_date': '2026-04-28T15:42:02Z',
 'fuel_type': 'hybrid',
 'id': '07cf5e62-9aa6-5b98-be62-2b16944b1fb1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 45.7766,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KH41597',
 'listing': 'auction',
 'location': 'FR, Loyettes',
 'location_confidence': 'geocoded',
 'longitude': 5.2069,
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 128200,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_07cf5e62-9aa6-5b98-be62-2b16944b1fb1/07cf5e62-9aa6-5b98-be62-2b16944b1fb1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78403,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/5b/015b9118be319555f3f35fd14b789c4e/pa/KH41597_85f3c6ba9d63a077c60bbf41ca635700.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_07cf5e62-9aa6-5b98-be62-2b16944b1fb1/07cf5e62-9aa6-5b98-be62-2b16944b1fb1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75962,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/5b/015b9118be319555f3f35fd14b789c4e/pa/KH41597_c54f25e570c1b4b5e66b4ce94cd650c7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_07cf5e62-9aa6-5b98-be62-2b16944b1fb1/07cf5e62-9aa6-5b98-be62-2b16944b1fb1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68384,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/5b/015b9118be319555f3f35fd14b789c4e/pa/KH41597_c64b67936d6b3c0b3f56cae2a0c50893.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_07cf5e62-9aa6-5b98-be62-2b16944b1fb1/07cf5e62-9aa6-5b98-be62-2b16944b1fb1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54031,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/5b/015b9118be319555f3f35fd14b789c4e/pa/KH41597_d14a239bd086485f7aa7989c45592321.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_07cf5e62-9aa6-5b98-be62-2b16944b1fb1/07cf5e62-9aa6-5b98-be62-2b16944b1fb1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63520,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/5b/015b9118be319555f3f35fd14b789c4e/pa/KH41597_2b98b3afe89a53f94fa65906b4aad2dd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_07cf5e62-9aa6-5b98-be62-2b16944b1fb1/07cf5e62-9aa6-5b98-be62-2b16944b1fb1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73378,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/5b/015b9118be319555f3f35fd14b789c4e/pa/KH41597_a1dbd56fb170c7e3dca304982f6d4611.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_07cf5e62-9aa6-5b98-be62-2b16944b1fb1/07cf5e62-9aa6-5b98-be62-2b16944b1fb1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53037,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/5b/015b9118be319555f3f35fd14b789c4e/pa/KH41597_ea426b50e4ae993420ebc3588f45dc15.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_07cf5e62-9aa6-5b98-be62-2b16944b1fb1/07cf5e62-9aa6-5b98-be62-2b16944b1fb1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75648,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/5b/015b9118be319555f3f35fd14b789c4e/pa/KH41597_2fc57cb15257bee3c0604b472979b52a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_07cf5e62-9aa6-5b98-be62-2b16944b1fb1/07cf5e62-9aa6-5b98-be62-2b16944b1fb1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73721,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/5b/015b9118be319555f3f35fd14b789c4e/pa/KH41597_31b23f5f02f7aeb73f247ab50a498fc8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_07cf5e62-9aa6-5b98-be62-2b16944b1fb1/07cf5e62-9aa6-5b98-be62-2b16944b1fb1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46671,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/5b/015b9118be319555f3f35fd14b789c4e/pa/KH41597_3198dc93cd48b17333a6810ff34c0ccc.jpg',
             'Width': 800}],
 'postal_code': '01360',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Ain',
 'province_code': 'FR-01',
 'region': 'Auvergne-Rhône-Alpes',
 'region_code': 'FR-84',
 'registration_date': '2020-02-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 300e 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2020}
2026-04-27 07:55:47 [auto1.fr] INFO: Saving data for KH41597: {'created_time': 1777276547.881268, 'last_price_update_time': 1777276547.881279, 'has_photos': True, 'auction_closing_time': 1777390922.0}
2026-04-27 07:55:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/d0/5fd05b446dbb19a2a3cff7b23b1d9ae8/pa/XZ65279_1c015c298567e1d41b60485db16a0ae8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/67/5a67353b3062e4a763491ee45c9e6cd8/pa/KZ47376_629a7fb486daf6a6fe114b8d62902b53.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/14/b1141ea1826c8f7f11660cdb231e3dc9/pa/KR98436_06c585b97f62923eaf90571a54bed105.jpg not downloaded yet
2026-04-27 07:55:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/d0/5fd05b446dbb19a2a3cff7b23b1d9ae8/pa/XZ65279_6b06087261eecf32a7cb407685b8e421.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/1a/681a88bc342845f2840269fedfc297e0/pa/KE85331_37847d6cb4aa1c8a8ad6c576f6cd36a9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CG72057> (referer: https://www.auto1.com/v1/car-details-view/CG72057/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KV02757> (referer: https://www.auto1.com/v1/car-details-view/KV02757/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b1fd10>
2026-04-27 07:55:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd53f4d9-ef1f-52a4-aac6-9779ba6bdc40/fd53f4d9-ef1f-52a4-aac6-9779ba6bdc40_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/d0/5fd05b446dbb19a2a3cff7b23b1d9ae8/pa/XZ65279_7eb83097362b8e4a74177ab5f1608f7d.jpg saved to cache
2026-04-27 07:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fd53f4d9-ef1f-52a4-aac6-9779ba6bdc40
2026-04-27 07:55:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143805e110>
2026-04-27 07:55:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a59659a7-24be-5055-8bc3-1a49cb0aa31c/a59659a7-24be-5055-8bc3-1a49cb0aa31c_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/44/aa44cad36004efb2b5b489106645bd91/pa/GN31601_8f6b03e4d8340b10fac9ca6437b70ff5.jpg saved to cache
2026-04-27 07:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a59659a7-24be-5055-8bc3-1a49cb0aa31c
2026-04-27 07:55:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bfd7210>
2026-04-27 07:55:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_302c0055-d531-53d2-aa2a-27a344e9c91c/302c0055-d531-53d2-aa2a-27a344e9c91c_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/a5/8fa511aea5c2810d5ccf30819a6d04de/pa/LP12244_8ac213342c843b1126431c0c0afaa38a.jpg saved to cache
2026-04-27 07:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 302c0055-d531-53d2-aa2a-27a344e9c91c
2026-04-27 07:55:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438fbf2d0>
2026-04-27 07:55:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_302c0055-d531-53d2-aa2a-27a344e9c91c/302c0055-d531-53d2-aa2a-27a344e9c91c_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/a5/8fa511aea5c2810d5ccf30819a6d04de/pa/LP12244_da3fab92f14af914e8f8d42c373f3137.jpg saved to cache
2026-04-27 07:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 302c0055-d531-53d2-aa2a-27a344e9c91c
2026-04-27 07:55:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 302c0055-d531-53d2-aa2a-27a344e9c91c, skipping ID generation
2026-04-27 07:55:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 302c0055-d531-53d2-aa2a-27a344e9c91c with scrape type 1
2026-04-27 07:55:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 302c0055-d531-53d2-aa2a-27a344e9c91c sending to next pipeline
2026-04-27 07:55:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 302c0055-d531-53d2-aa2a-27a344e9c91c, identifier: LP12244
2026-04-27 07:55:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/67/5a67353b3062e4a763491ee45c9e6cd8/pa/KZ47376_f5f63761c26e5b9ca1f59bd723b045ad.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/44/aa44cad36004efb2b5b489106645bd91/pa/GN31601_1cd3809c6abb02d9b8560a2afc4a81db.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/1a/681a88bc342845f2840269fedfc297e0/pa/KE85331_334aedee9c8790aa247e88476fc95b1f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/14/b1141ea1826c8f7f11660cdb231e3dc9/pa/KR98436_ec0bf98861ef6275b22c01e1a95917f7.jpg not downloaded yet
2026-04-27 07:55:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 302c0055-d531-53d2-aa2a-27a344e9c91c with identifier: LP12244
2026-04-27 07:55:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 302c0055-d531-53d2-aa2a-27a344e9c91c with identifier: LP12244
2026-04-27 07:55:48 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 302c0055-d531-53d2-aa2a-27a344e9c91c with identifier: LP12244 to the API
2026-04-27 07:55:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:48 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8f/a5/8fa511aea5c2810d5ccf30819a6d04de/pa/LP12244_da3fab92f14af914e8f8d42c373f3137.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'category': None,
 'city': 'Beaucaire',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 90,
 'expiration_date': '2026-04-28T15:59:54Z',
 'fuel_type': 'diesel',
 'id': '302c0055-d531-53d2-aa2a-27a344e9c91c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 43.8081,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LP12244',
 'listing': 'auction',
 'location': 'FR, Beaucaire',
 'location_confidence': 'geocoded',
 'longitude': 4.6442,
 'make': 'Audi',
 'model': 'A1',
 'odometer': 234912,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_302c0055-d531-53d2-aa2a-27a344e9c91c/302c0055-d531-53d2-aa2a-27a344e9c91c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74007,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/a5/8fa511aea5c2810d5ccf30819a6d04de/pa/LP12244_8e95fa5d8f0ceda7db3397561217af34.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_302c0055-d531-53d2-aa2a-27a344e9c91c/302c0055-d531-53d2-aa2a-27a344e9c91c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80345,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/a5/8fa511aea5c2810d5ccf30819a6d04de/pa/LP12244_76ac98c457752dab9a35eaceb8bb84b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_302c0055-d531-53d2-aa2a-27a344e9c91c/302c0055-d531-53d2-aa2a-27a344e9c91c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88034,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/a5/8fa511aea5c2810d5ccf30819a6d04de/pa/LP12244_d64630c01f6fa92c7502c1a8eb5ab3d2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_302c0055-d531-53d2-aa2a-27a344e9c91c/302c0055-d531-53d2-aa2a-27a344e9c91c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64887,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/a5/8fa511aea5c2810d5ccf30819a6d04de/pa/LP12244_8fd34bedc20f6628499b3d1ec16cf695.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_302c0055-d531-53d2-aa2a-27a344e9c91c/302c0055-d531-53d2-aa2a-27a344e9c91c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65124,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/a5/8fa511aea5c2810d5ccf30819a6d04de/pa/LP12244_8ac213342c843b1126431c0c0afaa38a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_302c0055-d531-53d2-aa2a-27a344e9c91c/302c0055-d531-53d2-aa2a-27a344e9c91c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80715,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/a5/8fa511aea5c2810d5ccf30819a6d04de/pa/LP12244_d0497852d494fb807e767f847d947cbc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_302c0055-d531-53d2-aa2a-27a344e9c91c/302c0055-d531-53d2-aa2a-27a344e9c91c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59236,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/a5/8fa511aea5c2810d5ccf30819a6d04de/pa/LP12244_c663cc9d31bb07cea3937adedd6ace62.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_302c0055-d531-53d2-aa2a-27a344e9c91c/302c0055-d531-53d2-aa2a-27a344e9c91c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87452,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/a5/8fa511aea5c2810d5ccf30819a6d04de/pa/LP12244_50f03bc9db76e609155dc4586ab5a3b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_302c0055-d531-53d2-aa2a-27a344e9c91c/302c0055-d531-53d2-aa2a-27a344e9c91c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79247,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/a5/8fa511aea5c2810d5ccf30819a6d04de/pa/LP12244_74a06d02fbda38b19481f1f8e18ddec4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_302c0055-d531-53d2-aa2a-27a344e9c91c/302c0055-d531-53d2-aa2a-27a344e9c91c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70634,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/a5/8fa511aea5c2810d5ccf30819a6d04de/pa/LP12244_da3fab92f14af914e8f8d42c373f3137.jpg',
             'Width': 800}],
 'postal_code': '30300',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Gard',
 'province_code': 'FR-30',
 'region': 'Occitanie',
 'region_code': 'FR-76',
 'registration_date': '2012-03-14',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Audi A1 1.6 TDI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2012}
2026-04-27 07:55:48 [auto1.fr] INFO: Saving data for LP12244: {'created_time': 1777276548.768326, 'last_price_update_time': 1777276548.768335, 'has_photos': True, 'auction_closing_time': 1777391994.0}
2026-04-27 07:55:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/1a/681a88bc342845f2840269fedfc297e0/pa/KE85331_58be590c0b61f0dbac026cbb6c978983.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bfd7c10>
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a59659a7-24be-5055-8bc3-1a49cb0aa31c/a59659a7-24be-5055-8bc3-1a49cb0aa31c_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/44/aa44cad36004efb2b5b489106645bd91/pa/GN31601_19d6ffc0c044b7f8cbb0af525859c83b.jpg saved to cache
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a59659a7-24be-5055-8bc3-1a49cb0aa31c
2026-04-27 07:55:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/8a/488a2d9f34fb94078e5aefe22426cb8c/pa/MM74389_62003094f07b101c18140e34a7f7ae7e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/14/b1141ea1826c8f7f11660cdb231e3dc9/pa/KR98436_976be982a4dc234326727a92c194a41b.jpg not downloaded yet
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a65e90>
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd53f4d9-ef1f-52a4-aac6-9779ba6bdc40/fd53f4d9-ef1f-52a4-aac6-9779ba6bdc40_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/d0/5fd05b446dbb19a2a3cff7b23b1d9ae8/pa/XZ65279_1c015c298567e1d41b60485db16a0ae8.jpg saved to cache
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fd53f4d9-ef1f-52a4-aac6-9779ba6bdc40
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438bd03d0>
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17520174-f266-59c7-9735-9b24cc23cc5d/17520174-f266-59c7-9735-9b24cc23cc5d_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/67/5a67353b3062e4a763491ee45c9e6cd8/pa/KZ47376_629a7fb486daf6a6fe114b8d62902b53.jpg saved to cache
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 17520174-f266-59c7-9735-9b24cc23cc5d
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b345d0>
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd53f4d9-ef1f-52a4-aac6-9779ba6bdc40/fd53f4d9-ef1f-52a4-aac6-9779ba6bdc40_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/d0/5fd05b446dbb19a2a3cff7b23b1d9ae8/pa/XZ65279_6b06087261eecf32a7cb407685b8e421.jpg saved to cache
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fd53f4d9-ef1f-52a4-aac6-9779ba6bdc40
2026-04-27 07:55:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fd53f4d9-ef1f-52a4-aac6-9779ba6bdc40, skipping ID generation
2026-04-27 07:55:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd53f4d9-ef1f-52a4-aac6-9779ba6bdc40 with scrape type 1
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fd53f4d9-ef1f-52a4-aac6-9779ba6bdc40 sending to next pipeline
2026-04-27 07:55:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: fd53f4d9-ef1f-52a4-aac6-9779ba6bdc40, identifier: XZ65279
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bf47c10>
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67f1d977-64d5-555f-9910-6e0af8fb2572/67f1d977-64d5-555f-9910-6e0af8fb2572_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/1a/681a88bc342845f2840269fedfc297e0/pa/KE85331_37847d6cb4aa1c8a8ad6c576f6cd36a9.jpg saved to cache
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 67f1d977-64d5-555f-9910-6e0af8fb2572
2026-04-27 07:55:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a2a1808-b7d3-5e1a-a432-13d943d07411 with identifier: CG72057
2026-04-27 07:55:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a2a1808-b7d3-5e1a-a432-13d943d07411 with scrape type 1
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1a2a1808-b7d3-5e1a-a432-13d943d07411
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/4c/514c9c9c2e25144d920cc8334d57b1a9/pa/CG72057_5b9f59ecc73fbee33cf960f0b2480e9c.jpg not downloaded yet
2026-04-27 07:55:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05f3eff2-1ffe-503d-b1ff-e2f8a844e609 with identifier: KV02757
2026-04-27 07:55:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05f3eff2-1ffe-503d-b1ff-e2f8a844e609 with scrape type 1
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 05f3eff2-1ffe-503d-b1ff-e2f8a844e609
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/ba/6fbaac9b1ca3675f4d52986fa9ca20b5/pa/KV02757_e4605a8b5da83656995f25a3e5c7babb.jpg not downloaded yet
2026-04-27 07:55:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/14/b1141ea1826c8f7f11660cdb231e3dc9/pa/KR98436_e3c8d90ccb11138227ae79fb89bf5b98.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/8a/488a2d9f34fb94078e5aefe22426cb8c/pa/MM74389_2581832c632bf87ee1b625ac457360a0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/14/b1141ea1826c8f7f11660cdb231e3dc9/pa/KR98436_3a845e8d703fd4faacc5a2e79fa5ae18.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: fd53f4d9-ef1f-52a4-aac6-9779ba6bdc40 with identifier: XZ65279
2026-04-27 07:55:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: fd53f4d9-ef1f-52a4-aac6-9779ba6bdc40 with identifier: XZ65279
2026-04-27 07:55:49 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: fd53f4d9-ef1f-52a4-aac6-9779ba6bdc40 with identifier: XZ65279 to the API
2026-04-27 07:55:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:49 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5f/d0/5fd05b446dbb19a2a3cff7b23b1d9ae8/pa/XZ65279_6b06087261eecf32a7cb407685b8e421.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 35,
 'category': None,
 'city': 'Montataire',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 224,
 'expiration_date': '2026-04-28T15:29:37Z',
 'fuel_type': 'hybrid',
 'id': 'fd53f4d9-ef1f-52a4-aac6-9779ba6bdc40',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 49.259,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XZ65279',
 'listing': 'auction',
 'location': 'FR, Montataire',
 'location_confidence': 'geocoded',
 'longitude': 2.4378,
 'make': 'Peugeot',
 'model': '508',
 'odometer': 102251,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fd53f4d9-ef1f-52a4-aac6-9779ba6bdc40/fd53f4d9-ef1f-52a4-aac6-9779ba6bdc40_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73886,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/d0/5fd05b446dbb19a2a3cff7b23b1d9ae8/pa/XZ65279_1e2595c0f94ec37d7fe3a32827176165.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fd53f4d9-ef1f-52a4-aac6-9779ba6bdc40/fd53f4d9-ef1f-52a4-aac6-9779ba6bdc40_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59860,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/d0/5fd05b446dbb19a2a3cff7b23b1d9ae8/pa/XZ65279_208bbf4dcf79124a167f7710328182de.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fd53f4d9-ef1f-52a4-aac6-9779ba6bdc40/fd53f4d9-ef1f-52a4-aac6-9779ba6bdc40_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71004,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/d0/5fd05b446dbb19a2a3cff7b23b1d9ae8/pa/XZ65279_9c44388d3b72cd83891ca2e3ad2c0b01.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fd53f4d9-ef1f-52a4-aac6-9779ba6bdc40/fd53f4d9-ef1f-52a4-aac6-9779ba6bdc40_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59998,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/d0/5fd05b446dbb19a2a3cff7b23b1d9ae8/pa/XZ65279_6b06087261eecf32a7cb407685b8e421.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fd53f4d9-ef1f-52a4-aac6-9779ba6bdc40/fd53f4d9-ef1f-52a4-aac6-9779ba6bdc40_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62502,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/d0/5fd05b446dbb19a2a3cff7b23b1d9ae8/pa/XZ65279_1c015c298567e1d41b60485db16a0ae8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fd53f4d9-ef1f-52a4-aac6-9779ba6bdc40/fd53f4d9-ef1f-52a4-aac6-9779ba6bdc40_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75392,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/d0/5fd05b446dbb19a2a3cff7b23b1d9ae8/pa/XZ65279_00eb1d39a1d609b4a122227f40e2b5fa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fd53f4d9-ef1f-52a4-aac6-9779ba6bdc40/fd53f4d9-ef1f-52a4-aac6-9779ba6bdc40_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71386,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/d0/5fd05b446dbb19a2a3cff7b23b1d9ae8/pa/XZ65279_71eeb53f204ee513ce0459eb51e139bd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fd53f4d9-ef1f-52a4-aac6-9779ba6bdc40/fd53f4d9-ef1f-52a4-aac6-9779ba6bdc40_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80153,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/d0/5fd05b446dbb19a2a3cff7b23b1d9ae8/pa/XZ65279_139f963f26c7be18f7e25e48789e1980.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fd53f4d9-ef1f-52a4-aac6-9779ba6bdc40/fd53f4d9-ef1f-52a4-aac6-9779ba6bdc40_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71050,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/d0/5fd05b446dbb19a2a3cff7b23b1d9ae8/pa/XZ65279_7eb83097362b8e4a74177ab5f1608f7d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fd53f4d9-ef1f-52a4-aac6-9779ba6bdc40/fd53f4d9-ef1f-52a4-aac6-9779ba6bdc40_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60858,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/d0/5fd05b446dbb19a2a3cff7b23b1d9ae8/pa/XZ65279_7a657f414867bee20577df60e12d5318.jpg',
             'Width': 800}],
 'postal_code': '60160',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Oise',
 'province_code': 'FR-60',
 'region': 'Hauts-de-France',
 'region_code': 'FR-32',
 'registration_date': '2021-02-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 508 1.6 Hybrid GT Pack',
 'transmission': 'automatic',
 'trim': 'GT Pack',
 'year': 2021}
2026-04-27 07:55:49 [auto1.fr] INFO: Saving data for XZ65279: {'created_time': 1777276549.772691, 'last_price_update_time': 1777276549.772702, 'has_photos': True, 'auction_closing_time': 1777390177.0}
2026-04-27 07:55:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/8a/488a2d9f34fb94078e5aefe22426cb8c/pa/MM74389_517d74746686245f428f0e72b8f49ecc.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/4c/514c9c9c2e25144d920cc8334d57b1a9/pa/CG72057_caede284b2a8b640580d43b757ccb032.jpg not downloaded yet
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/ba/6fbaac9b1ca3675f4d52986fa9ca20b5/pa/KV02757_2e1481d03913e6396d378852a99adc9b.jpg not downloaded yet
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438baeb10>
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17520174-f266-59c7-9735-9b24cc23cc5d/17520174-f266-59c7-9735-9b24cc23cc5d_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/67/5a67353b3062e4a763491ee45c9e6cd8/pa/KZ47376_f5f63761c26e5b9ca1f59bd723b045ad.jpg saved to cache
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 17520174-f266-59c7-9735-9b24cc23cc5d
2026-04-27 07:55:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 17520174-f266-59c7-9735-9b24cc23cc5d, skipping ID generation
2026-04-27 07:55:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17520174-f266-59c7-9735-9b24cc23cc5d with scrape type 1
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 17520174-f266-59c7-9735-9b24cc23cc5d sending to next pipeline
2026-04-27 07:55:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 17520174-f266-59c7-9735-9b24cc23cc5d, identifier: KZ47376
2026-04-27 07:55:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14381b9390>
2026-04-27 07:55:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a59659a7-24be-5055-8bc3-1a49cb0aa31c/a59659a7-24be-5055-8bc3-1a49cb0aa31c_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/44/aa44cad36004efb2b5b489106645bd91/pa/GN31601_1cd3809c6abb02d9b8560a2afc4a81db.jpg saved to cache
2026-04-27 07:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a59659a7-24be-5055-8bc3-1a49cb0aa31c
2026-04-27 07:55:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a59659a7-24be-5055-8bc3-1a49cb0aa31c, skipping ID generation
2026-04-27 07:55:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a59659a7-24be-5055-8bc3-1a49cb0aa31c with scrape type 1
2026-04-27 07:55:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a59659a7-24be-5055-8bc3-1a49cb0aa31c sending to next pipeline
2026-04-27 07:55:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a59659a7-24be-5055-8bc3-1a49cb0aa31c, identifier: GN31601
2026-04-27 07:55:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143807c550>
2026-04-27 07:55:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67f1d977-64d5-555f-9910-6e0af8fb2572/67f1d977-64d5-555f-9910-6e0af8fb2572_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/1a/681a88bc342845f2840269fedfc297e0/pa/KE85331_334aedee9c8790aa247e88476fc95b1f.jpg saved to cache
2026-04-27 07:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 67f1d977-64d5-555f-9910-6e0af8fb2572
2026-04-27 07:55:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/ae/dfae082e0b2e17650dfc49c59e8eab79/pa/WU07507_51fd3f214829dca8eae7cead8a258990.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/be/64be795c11002705e2ff7f552faead1b/pa/TB94788_a59cc6cb7c9908f95534b70889594c4f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/14/b1141ea1826c8f7f11660cdb231e3dc9/pa/KR98436_80bbc943ba1318ca4fd341e47734376c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 17520174-f266-59c7-9735-9b24cc23cc5d with identifier: KZ47376
2026-04-27 07:55:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 17520174-f266-59c7-9735-9b24cc23cc5d with identifier: KZ47376
2026-04-27 07:55:50 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 17520174-f266-59c7-9735-9b24cc23cc5d with identifier: KZ47376 to the API
2026-04-27 07:55:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:50 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5a/67/5a67353b3062e4a763491ee45c9e6cd8/pa/KZ47376_f5f63761c26e5b9ca1f59bd723b045ad.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'category': None,
 'city': 'Marckolsheim',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 75,
 'expiration_date': '2026-04-28T15:00:58Z',
 'fuel_type': 'diesel',
 'id': '17520174-f266-59c7-9735-9b24cc23cc5d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.1647,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KZ47376',
 'listing': 'auction',
 'location': 'FR, Marckolsheim',
 'location_confidence': 'geocoded',
 'longitude': 7.544,
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 211721,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_17520174-f266-59c7-9735-9b24cc23cc5d/17520174-f266-59c7-9735-9b24cc23cc5d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82787,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/67/5a67353b3062e4a763491ee45c9e6cd8/pa/KZ47376_5868c3547a670eab58f81bba7e113678.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_17520174-f266-59c7-9735-9b24cc23cc5d/17520174-f266-59c7-9735-9b24cc23cc5d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98296,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/67/5a67353b3062e4a763491ee45c9e6cd8/pa/KZ47376_ec7e1884c765f8d4585e30bba11a3cf4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_17520174-f266-59c7-9735-9b24cc23cc5d/17520174-f266-59c7-9735-9b24cc23cc5d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88232,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/67/5a67353b3062e4a763491ee45c9e6cd8/pa/KZ47376_ed35bc6f3dc4c9298744489ec8df9c84.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_17520174-f266-59c7-9735-9b24cc23cc5d/17520174-f266-59c7-9735-9b24cc23cc5d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70969,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/67/5a67353b3062e4a763491ee45c9e6cd8/pa/KZ47376_69073f77d9336433fd01ca63d853ee08.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_17520174-f266-59c7-9735-9b24cc23cc5d/17520174-f266-59c7-9735-9b24cc23cc5d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85198,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/67/5a67353b3062e4a763491ee45c9e6cd8/pa/KZ47376_f5f63761c26e5b9ca1f59bd723b045ad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_17520174-f266-59c7-9735-9b24cc23cc5d/17520174-f266-59c7-9735-9b24cc23cc5d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57673,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/67/5a67353b3062e4a763491ee45c9e6cd8/pa/KZ47376_629a7fb486daf6a6fe114b8d62902b53.jpg',
             'Width': 800}],
 'postal_code': '67390',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Bas-Rhin',
 'province_code': 'FR-67',
 'region': 'Grand Est',
 'region_code': 'FR-44',
 'registration_date': '2011-07-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Corsa 1.3 CDTI Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2011}
2026-04-27 07:55:50 [auto1.fr] INFO: Saving data for KZ47376: {'created_time': 1777276550.67711, 'last_price_update_time': 1777276550.677123, 'has_photos': True, 'auction_closing_time': 1777388458.0}
2026-04-27 07:55:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a59659a7-24be-5055-8bc3-1a49cb0aa31c with identifier: GN31601
2026-04-27 07:55:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a59659a7-24be-5055-8bc3-1a49cb0aa31c with identifier: GN31601
2026-04-27 07:55:50 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a59659a7-24be-5055-8bc3-1a49cb0aa31c with identifier: GN31601 to the API
2026-04-27 07:55:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:51 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgaa/44/aa44cad36004efb2b5b489106645bd91/pa/GN31601_1cd3809c6abb02d9b8560a2afc4a81db.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'category': None,
 'city': 'Beaucaire',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'engine_horse_power': 131,
 'expiration_date': '2026-04-28T15:06:15Z',
 'fuel_type': 'petrol',
 'id': 'a59659a7-24be-5055-8bc3-1a49cb0aa31c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 43.8081,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GN31601',
 'listing': 'auction',
 'location': 'FR, Beaucaire',
 'location_confidence': 'geocoded',
 'longitude': 4.6442,
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 151062,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a59659a7-24be-5055-8bc3-1a49cb0aa31c/a59659a7-24be-5055-8bc3-1a49cb0aa31c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98296,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/44/aa44cad36004efb2b5b489106645bd91/pa/GN31601_ed6cc13b4746f1fa0df1063141bfc55d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a59659a7-24be-5055-8bc3-1a49cb0aa31c/a59659a7-24be-5055-8bc3-1a49cb0aa31c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93802,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/44/aa44cad36004efb2b5b489106645bd91/pa/GN31601_1cd3809c6abb02d9b8560a2afc4a81db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a59659a7-24be-5055-8bc3-1a49cb0aa31c/a59659a7-24be-5055-8bc3-1a49cb0aa31c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92551,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/44/aa44cad36004efb2b5b489106645bd91/pa/GN31601_8f6b03e4d8340b10fac9ca6437b70ff5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a59659a7-24be-5055-8bc3-1a49cb0aa31c/a59659a7-24be-5055-8bc3-1a49cb0aa31c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94026,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/44/aa44cad36004efb2b5b489106645bd91/pa/GN31601_9d5b3d29ec6c372cda88894ff340e043.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a59659a7-24be-5055-8bc3-1a49cb0aa31c/a59659a7-24be-5055-8bc3-1a49cb0aa31c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79079,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/44/aa44cad36004efb2b5b489106645bd91/pa/GN31601_d9bf893d1cc65e21402d6df5e0f188e7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a59659a7-24be-5055-8bc3-1a49cb0aa31c/a59659a7-24be-5055-8bc3-1a49cb0aa31c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89731,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/44/aa44cad36004efb2b5b489106645bd91/pa/GN31601_3e646f873b2fe8acc92248d6c14eb81e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a59659a7-24be-5055-8bc3-1a49cb0aa31c/a59659a7-24be-5055-8bc3-1a49cb0aa31c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88808,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/44/aa44cad36004efb2b5b489106645bd91/pa/GN31601_19d6ffc0c044b7f8cbb0af525859c83b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a59659a7-24be-5055-8bc3-1a49cb0aa31c/a59659a7-24be-5055-8bc3-1a49cb0aa31c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113686,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/44/aa44cad36004efb2b5b489106645bd91/pa/GN31601_7aaa06d44709f621751f4dd33ced8b4f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a59659a7-24be-5055-8bc3-1a49cb0aa31c/a59659a7-24be-5055-8bc3-1a49cb0aa31c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95072,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/44/aa44cad36004efb2b5b489106645bd91/pa/GN31601_fba571e7e4a52908eb0cddccf9716705.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a59659a7-24be-5055-8bc3-1a49cb0aa31c/a59659a7-24be-5055-8bc3-1a49cb0aa31c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59919,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/44/aa44cad36004efb2b5b489106645bd91/pa/GN31601_b0b0d157fed2e3f8a8d426d7304bbec4.jpg',
             'Width': 800}],
 'postal_code': '30300',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Gard',
 'province_code': 'FR-30',
 'region': 'Occitanie',
 'region_code': 'FR-76',
 'registration_date': '2019-09-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Captur 1.3 TCe Intens',
 'transmission': 'manual',
 'trim': 'Intens',
 'year': 2019}
2026-04-27 07:55:51 [auto1.fr] INFO: Saving data for GN31601: {'created_time': 1777276551.184523, 'last_price_update_time': 1777276551.184537, 'has_photos': True, 'auction_closing_time': 1777388775.0}
2026-04-27 07:55:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/14/b1141ea1826c8f7f11660cdb231e3dc9/pa/KR98436_06c585b97f62923eaf90571a54bed105.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/4c/514c9c9c2e25144d920cc8334d57b1a9/pa/CG72057_cf4a37d63b7059585c426e4185fcb9e9.jpg not downloaded yet
2026-04-27 07:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/ba/6fbaac9b1ca3675f4d52986fa9ca20b5/pa/KV02757_b225b6fbe78174b1c96c0227d85a61a1.jpg not downloaded yet
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438148850>
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67f1d977-64d5-555f-9910-6e0af8fb2572/67f1d977-64d5-555f-9910-6e0af8fb2572_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/1a/681a88bc342845f2840269fedfc297e0/pa/KE85331_58be590c0b61f0dbac026cbb6c978983.jpg saved to cache
2026-04-27 07:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 67f1d977-64d5-555f-9910-6e0af8fb2572
2026-04-27 07:55:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 67f1d977-64d5-555f-9910-6e0af8fb2572, skipping ID generation
2026-04-27 07:55:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67f1d977-64d5-555f-9910-6e0af8fb2572 with scrape type 1
2026-04-27 07:55:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 67f1d977-64d5-555f-9910-6e0af8fb2572 sending to next pipeline
2026-04-27 07:55:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 67f1d977-64d5-555f-9910-6e0af8fb2572, identifier: KE85331
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143814b990>
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_daef9541-9218-51e2-b640-94355be7994e/daef9541-9218-51e2-b640-94355be7994e_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/8a/488a2d9f34fb94078e5aefe22426cb8c/pa/MM74389_62003094f07b101c18140e34a7f7ae7e.jpg saved to cache
2026-04-27 07:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item daef9541-9218-51e2-b640-94355be7994e
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bf1b010>
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dce51e5-a537-5163-a723-63a98f53aaa1/0dce51e5-a537-5163-a723-63a98f53aaa1_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/14/b1141ea1826c8f7f11660cdb231e3dc9/pa/KR98436_e3c8d90ccb11138227ae79fb89bf5b98.jpg saved to cache
2026-04-27 07:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0dce51e5-a537-5163-a723-63a98f53aaa1
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438cabfd0>
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_daef9541-9218-51e2-b640-94355be7994e/daef9541-9218-51e2-b640-94355be7994e_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/8a/488a2d9f34fb94078e5aefe22426cb8c/pa/MM74389_2581832c632bf87ee1b625ac457360a0.jpg saved to cache
2026-04-27 07:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item daef9541-9218-51e2-b640-94355be7994e
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b2b050>
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dce51e5-a537-5163-a723-63a98f53aaa1/0dce51e5-a537-5163-a723-63a98f53aaa1_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/14/b1141ea1826c8f7f11660cdb231e3dc9/pa/KR98436_3a845e8d703fd4faacc5a2e79fa5ae18.jpg saved to cache
2026-04-27 07:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0dce51e5-a537-5163-a723-63a98f53aaa1
2026-04-27 07:55:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/be/64be795c11002705e2ff7f552faead1b/pa/TB94788_473c4283b5844e0a09f997f5e2ac3dc3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RP08022> (referer: https://www.auto1.com/v1/car-details-view/RP08022/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZM99861> (referer: https://www.auto1.com/v1/car-details-view/ZM99861/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 67f1d977-64d5-555f-9910-6e0af8fb2572 with identifier: KE85331
2026-04-27 07:55:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 67f1d977-64d5-555f-9910-6e0af8fb2572 with identifier: KE85331
2026-04-27 07:55:51 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 67f1d977-64d5-555f-9910-6e0af8fb2572 with identifier: KE85331 to the API
2026-04-27 07:55:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:51 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img68/1a/681a88bc342845f2840269fedfc297e0/pa/KE85331_58be590c0b61f0dbac026cbb6c978983.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'category': None,
 'city': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 90,
 'expiration_date': '2026-04-28T15:16:45Z',
 'fuel_type': 'diesel',
 'id': '67f1d977-64d5-555f-9910-6e0af8fb2572',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KE85331',
 'listing': 'auction',
 'location': 'FR',
 'location_confidence': None,
 'longitude': None,
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 138148,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 19,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_67f1d977-64d5-555f-9910-6e0af8fb2572/67f1d977-64d5-555f-9910-6e0af8fb2572_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59806,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img68/1a/681a88bc342845f2840269fedfc297e0/pa/KE85331_1b71f6454b57d18b4f496baf54b99d43.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_67f1d977-64d5-555f-9910-6e0af8fb2572/67f1d977-64d5-555f-9910-6e0af8fb2572_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59918,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img68/1a/681a88bc342845f2840269fedfc297e0/pa/KE85331_497e5bc38ebf7c7eccbafae26f0345c5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_67f1d977-64d5-555f-9910-6e0af8fb2572/67f1d977-64d5-555f-9910-6e0af8fb2572_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60853,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img68/1a/681a88bc342845f2840269fedfc297e0/pa/KE85331_eb9f017e8e2c2b1b5d560e2ff6ce0379.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_67f1d977-64d5-555f-9910-6e0af8fb2572/67f1d977-64d5-555f-9910-6e0af8fb2572_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59345,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img68/1a/681a88bc342845f2840269fedfc297e0/pa/KE85331_07a34f2d55090c8b86869897bf4c2567.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_67f1d977-64d5-555f-9910-6e0af8fb2572/67f1d977-64d5-555f-9910-6e0af8fb2572_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62516,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img68/1a/681a88bc342845f2840269fedfc297e0/pa/KE85331_d7b3057cef3916415ff0892907f25876.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_67f1d977-64d5-555f-9910-6e0af8fb2572/67f1d977-64d5-555f-9910-6e0af8fb2572_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64246,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img68/1a/681a88bc342845f2840269fedfc297e0/pa/KE85331_58be590c0b61f0dbac026cbb6c978983.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_67f1d977-64d5-555f-9910-6e0af8fb2572/67f1d977-64d5-555f-9910-6e0af8fb2572_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56145,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img68/1a/681a88bc342845f2840269fedfc297e0/pa/KE85331_a0bc1be3f414d32fef9af91ddf192f4b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_67f1d977-64d5-555f-9910-6e0af8fb2572/67f1d977-64d5-555f-9910-6e0af8fb2572_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106916,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img68/1a/681a88bc342845f2840269fedfc297e0/pa/KE85331_334aedee9c8790aa247e88476fc95b1f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_67f1d977-64d5-555f-9910-6e0af8fb2572/67f1d977-64d5-555f-9910-6e0af8fb2572_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76112,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img68/1a/681a88bc342845f2840269fedfc297e0/pa/KE85331_37847d6cb4aa1c8a8ad6c576f6cd36a9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_67f1d977-64d5-555f-9910-6e0af8fb2572/67f1d977-64d5-555f-9910-6e0af8fb2572_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71741,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img68/1a/681a88bc342845f2840269fedfc297e0/pa/KE85331_1296bec3bdd3ee66e7e25366d3fc7682.jpg',
             'Width': 800}],
 'postal_code': None,
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2012-09-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Yaris 1.4 D-4D Dynamic',
 'transmission': 'manual',
 'trim': 'Dynamic',
 'year': 2012}
2026-04-27 07:55:51 [auto1.fr] INFO: Saving data for KE85331: {'created_time': 1777276551.969243, 'last_price_update_time': 1777276551.969256, 'has_photos': True, 'auction_closing_time': 1777389405.0}
2026-04-27 07:55:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438cb9390>
2026-04-27 07:55:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_daef9541-9218-51e2-b640-94355be7994e/daef9541-9218-51e2-b640-94355be7994e_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/8a/488a2d9f34fb94078e5aefe22426cb8c/pa/MM74389_517d74746686245f428f0e72b8f49ecc.jpg saved to cache
2026-04-27 07:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item daef9541-9218-51e2-b640-94355be7994e
2026-04-27 07:55:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: daef9541-9218-51e2-b640-94355be7994e, skipping ID generation
2026-04-27 07:55:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item daef9541-9218-51e2-b640-94355be7994e with scrape type 1
2026-04-27 07:55:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item daef9541-9218-51e2-b640-94355be7994e sending to next pipeline
2026-04-27 07:55:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: daef9541-9218-51e2-b640-94355be7994e, identifier: MM74389
2026-04-27 07:55:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/ba/6fbaac9b1ca3675f4d52986fa9ca20b5/pa/KV02757_e4605a8b5da83656995f25a3e5c7babb.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/75/f7752536ed1193c904a538d6c97c87f1/pa/GT54355_b9691e243481b924d33c852af3cf88e5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/be/64be795c11002705e2ff7f552faead1b/pa/TB94788_f65ee289579f13b8068b8e5065f6b5e6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/1f/bb1fa5fe94c99696714ab51667f1cab5/pa/PW05542_e56ccfedc4bc85163e1c17a874bbd57d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/4c/514c9c9c2e25144d920cc8334d57b1a9/pa/CG72057_1cca2de55cfbfd8eb7d8bb06ee9cb170.jpg not downloaded yet
2026-04-27 07:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/ba/6fbaac9b1ca3675f4d52986fa9ca20b5/pa/KV02757_df457194f2d21b450954d5c6edebd390.jpg not downloaded yet
2026-04-27 07:55:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: daef9541-9218-51e2-b640-94355be7994e with identifier: MM74389
2026-04-27 07:55:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: daef9541-9218-51e2-b640-94355be7994e with identifier: MM74389
2026-04-27 07:55:52 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: daef9541-9218-51e2-b640-94355be7994e with identifier: MM74389 to the API
2026-04-27 07:55:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:52 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img48/8a/488a2d9f34fb94078e5aefe22426cb8c/pa/MM74389_517d74746686245f428f0e72b8f49ecc.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 108,
 'category': None,
 'city': 'Beaucaire',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO N\\/A',
 'engine': '1.5L',
 'engine_horse_power': 116,
 'expiration_date': '2026-04-28T15:46:40Z',
 'fuel_type': 'diesel',
 'id': 'daef9541-9218-51e2-b640-94355be7994e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 43.8081,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MM74389',
 'listing': 'auction',
 'location': 'FR, Beaucaire',
 'location_confidence': 'geocoded',
 'longitude': 4.6442,
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 127128,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_daef9541-9218-51e2-b640-94355be7994e/daef9541-9218-51e2-b640-94355be7994e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93690,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/8a/488a2d9f34fb94078e5aefe22426cb8c/pa/MM74389_d5cc11e591d059b5a506f7be96e04bef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_daef9541-9218-51e2-b640-94355be7994e/daef9541-9218-51e2-b640-94355be7994e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96324,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/8a/488a2d9f34fb94078e5aefe22426cb8c/pa/MM74389_a0f813a0b837d401741ed81dfc338361.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_daef9541-9218-51e2-b640-94355be7994e/daef9541-9218-51e2-b640-94355be7994e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91149,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/8a/488a2d9f34fb94078e5aefe22426cb8c/pa/MM74389_217c33d90934b84aa481a8123644c85a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_daef9541-9218-51e2-b640-94355be7994e/daef9541-9218-51e2-b640-94355be7994e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94342,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/8a/488a2d9f34fb94078e5aefe22426cb8c/pa/MM74389_ff998842f3163fb4427ccd267bee43d4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_daef9541-9218-51e2-b640-94355be7994e/daef9541-9218-51e2-b640-94355be7994e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78304,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/8a/488a2d9f34fb94078e5aefe22426cb8c/pa/MM74389_517d74746686245f428f0e72b8f49ecc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_daef9541-9218-51e2-b640-94355be7994e/daef9541-9218-51e2-b640-94355be7994e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88697,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/8a/488a2d9f34fb94078e5aefe22426cb8c/pa/MM74389_2ade0f9be52627e92d9b99c622e849e0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_daef9541-9218-51e2-b640-94355be7994e/daef9541-9218-51e2-b640-94355be7994e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69454,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/8a/488a2d9f34fb94078e5aefe22426cb8c/pa/MM74389_d8d829bf9a77cfc3432d671505ab8230.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_daef9541-9218-51e2-b640-94355be7994e/daef9541-9218-51e2-b640-94355be7994e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111985,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/8a/488a2d9f34fb94078e5aefe22426cb8c/pa/MM74389_a4015f3654633782deb7a608bf51aad2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_daef9541-9218-51e2-b640-94355be7994e/daef9541-9218-51e2-b640-94355be7994e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97497,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/8a/488a2d9f34fb94078e5aefe22426cb8c/pa/MM74389_2581832c632bf87ee1b625ac457360a0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_daef9541-9218-51e2-b640-94355be7994e/daef9541-9218-51e2-b640-94355be7994e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53652,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/8a/488a2d9f34fb94078e5aefe22426cb8c/pa/MM74389_62003094f07b101c18140e34a7f7ae7e.jpg',
             'Width': 800}],
 'postal_code': '30300',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Gard',
 'province_code': 'FR-30',
 'region': 'Occitanie',
 'region_code': 'FR-76',
 'registration_date': '2020-08-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Duster 1.5 Blue dCi Prestige',
 'transmission': 'manual',
 'trim': 'Prestige',
 'year': 2020}
2026-04-27 07:55:52 [auto1.fr] INFO: Saving data for MM74389: {'created_time': 1777276552.580443, 'last_price_update_time': 1777276552.580453, 'has_photos': True, 'auction_closing_time': 1777391200.0}
2026-04-27 07:55:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/49/57497670dfa726a83867abbec3391bd9/pa/FD54899_073ed73200ce7e347db6b8baaf4f10a6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/14/b1141ea1826c8f7f11660cdb231e3dc9/pa/KR98436_ec0bf98861ef6275b22c01e1a95917f7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438fa4c90>
2026-04-27 07:55:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82c607f1-69da-537f-a5f9-ed4177752d1e/82c607f1-69da-537f-a5f9-ed4177752d1e_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/ae/dfae082e0b2e17650dfc49c59e8eab79/pa/WU07507_51fd3f214829dca8eae7cead8a258990.jpg saved to cache
2026-04-27 07:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 82c607f1-69da-537f-a5f9-ed4177752d1e
2026-04-27 07:55:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c2cbd0>
2026-04-27 07:55:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48cdacb5-a189-59f2-a4f1-20199f77037d/48cdacb5-a189-59f2-a4f1-20199f77037d_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/be/64be795c11002705e2ff7f552faead1b/pa/TB94788_a59cc6cb7c9908f95534b70889594c4f.jpg saved to cache
2026-04-27 07:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 48cdacb5-a189-59f2-a4f1-20199f77037d
2026-04-27 07:55:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438af9e50>
2026-04-27 07:55:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dce51e5-a537-5163-a723-63a98f53aaa1/0dce51e5-a537-5163-a723-63a98f53aaa1_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/14/b1141ea1826c8f7f11660cdb231e3dc9/pa/KR98436_80bbc943ba1318ca4fd341e47734376c.jpg saved to cache
2026-04-27 07:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0dce51e5-a537-5163-a723-63a98f53aaa1
2026-04-27 07:55:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c2e950>
2026-04-27 07:55:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dce51e5-a537-5163-a723-63a98f53aaa1/0dce51e5-a537-5163-a723-63a98f53aaa1_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/14/b1141ea1826c8f7f11660cdb231e3dc9/pa/KR98436_06c585b97f62923eaf90571a54bed105.jpg saved to cache
2026-04-27 07:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0dce51e5-a537-5163-a723-63a98f53aaa1
2026-04-27 07:55:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/4c/514c9c9c2e25144d920cc8334d57b1a9/pa/CG72057_5b9f59ecc73fbee33cf960f0b2480e9c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/4c/514c9c9c2e25144d920cc8334d57b1a9/pa/CG72057_e81718506740ce1382356c9a3ed0b160.jpg not downloaded yet
2026-04-27 07:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/ba/6fbaac9b1ca3675f4d52986fa9ca20b5/pa/KV02757_8416c277f4fa5c1d5657f80ac2cf4afa.jpg not downloaded yet
2026-04-27 07:55:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/14/b1141ea1826c8f7f11660cdb231e3dc9/pa/KR98436_976be982a4dc234326727a92c194a41b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d63e90>
2026-04-27 07:55:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48cdacb5-a189-59f2-a4f1-20199f77037d/48cdacb5-a189-59f2-a4f1-20199f77037d_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/be/64be795c11002705e2ff7f552faead1b/pa/TB94788_473c4283b5844e0a09f997f5e2ac3dc3.jpg saved to cache
2026-04-27 07:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 48cdacb5-a189-59f2-a4f1-20199f77037d
2026-04-27 07:55:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5726058e-63e1-5026-8464-654082bb2e7b with identifier: RP08022
2026-04-27 07:55:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5726058e-63e1-5026-8464-654082bb2e7b with scrape type 1
2026-04-27 07:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5726058e-63e1-5026-8464-654082bb2e7b
2026-04-27 07:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/63/6c63f2c43a4fccd2b416b4bd083197ce/pa/RP08022_3ff8747057a2866e4f7b49a0209853e0.jpg not downloaded yet
2026-04-27 07:55:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4827977b-3ae4-5fd4-8443-692d668c0268 with identifier: ZM99861
2026-04-27 07:55:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4827977b-3ae4-5fd4-8443-692d668c0268 with scrape type 1
2026-04-27 07:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4827977b-3ae4-5fd4-8443-692d668c0268
2026-04-27 07:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/bb/62bbc7cf037431f83ae8ba3baf40753e/pa/ZM99861_e780936aacd920fd51e76fdb52d29f0e.jpg not downloaded yet
2026-04-27 07:55:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bf1a890>
2026-04-27 07:55:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05f3eff2-1ffe-503d-b1ff-e2f8a844e609/05f3eff2-1ffe-503d-b1ff-e2f8a844e609_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/ba/6fbaac9b1ca3675f4d52986fa9ca20b5/pa/KV02757_e4605a8b5da83656995f25a3e5c7babb.jpg saved to cache
2026-04-27 07:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 05f3eff2-1ffe-503d-b1ff-e2f8a844e609
2026-04-27 07:55:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bf1a310>
2026-04-27 07:55:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec4743fa-6b14-571b-8c9d-81eb8783d066/ec4743fa-6b14-571b-8c9d-81eb8783d066_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/75/f7752536ed1193c904a538d6c97c87f1/pa/GT54355_b9691e243481b924d33c852af3cf88e5.jpg saved to cache
2026-04-27 07:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ec4743fa-6b14-571b-8c9d-81eb8783d066
2026-04-27 07:55:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ec4743fa-6b14-571b-8c9d-81eb8783d066, skipping ID generation
2026-04-27 07:55:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec4743fa-6b14-571b-8c9d-81eb8783d066 with scrape type 1
2026-04-27 07:55:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ec4743fa-6b14-571b-8c9d-81eb8783d066 sending to next pipeline
2026-04-27 07:55:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ec4743fa-6b14-571b-8c9d-81eb8783d066, identifier: GT54355
2026-04-27 07:55:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bf801d0>
2026-04-27 07:55:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48cdacb5-a189-59f2-a4f1-20199f77037d/48cdacb5-a189-59f2-a4f1-20199f77037d_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/be/64be795c11002705e2ff7f552faead1b/pa/TB94788_f65ee289579f13b8068b8e5065f6b5e6.jpg saved to cache
2026-04-27 07:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 48cdacb5-a189-59f2-a4f1-20199f77037d
2026-04-27 07:55:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 48cdacb5-a189-59f2-a4f1-20199f77037d, skipping ID generation
2026-04-27 07:55:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48cdacb5-a189-59f2-a4f1-20199f77037d with scrape type 1
2026-04-27 07:55:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 48cdacb5-a189-59f2-a4f1-20199f77037d sending to next pipeline
2026-04-27 07:55:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 48cdacb5-a189-59f2-a4f1-20199f77037d, identifier: TB94788
2026-04-27 07:55:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438cb7cd0>
2026-04-27 07:55:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d53b333f-0b2c-5b0e-9906-764ddf709c52/d53b333f-0b2c-5b0e-9906-764ddf709c52_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/1f/bb1fa5fe94c99696714ab51667f1cab5/pa/PW05542_e56ccfedc4bc85163e1c17a874bbd57d.jpg saved to cache
2026-04-27 07:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d53b333f-0b2c-5b0e-9906-764ddf709c52
2026-04-27 07:55:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d53b333f-0b2c-5b0e-9906-764ddf709c52, skipping ID generation
2026-04-27 07:55:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d53b333f-0b2c-5b0e-9906-764ddf709c52 with scrape type 1
2026-04-27 07:55:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d53b333f-0b2c-5b0e-9906-764ddf709c52 sending to next pipeline
2026-04-27 07:55:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d53b333f-0b2c-5b0e-9906-764ddf709c52, identifier: PW05542
2026-04-27 07:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/4c/514c9c9c2e25144d920cc8334d57b1a9/pa/CG72057_81b80511d59761b44d4b25131de28418.jpg not downloaded yet
2026-04-27 07:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/ba/6fbaac9b1ca3675f4d52986fa9ca20b5/pa/KV02757_d78d7ae189319736454999efedd25900.jpg not downloaded yet
2026-04-27 07:55:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ec4743fa-6b14-571b-8c9d-81eb8783d066 with identifier: GT54355
2026-04-27 07:55:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ec4743fa-6b14-571b-8c9d-81eb8783d066 with identifier: GT54355
2026-04-27 07:55:53 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ec4743fa-6b14-571b-8c9d-81eb8783d066 with identifier: GT54355 to the API
2026-04-27 07:55:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:53 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf7/75/f7752536ed1193c904a538d6c97c87f1/pa/GT54355_b9691e243481b924d33c852af3cf88e5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'city': 'CASTELNAU D’ESTRETEFONDS',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO N\\/A',
 'engine': '1.1L',
 'engine_horse_power': 55,
 'expiration_date': '2026-04-28T15:16:47Z',
 'fuel_type': 'petrol',
 'id': 'ec4743fa-6b14-571b-8c9d-81eb8783d066',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 43.7837,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GT54355',
 'listing': 'auction',
 'location': 'FR, CASTELNAU D’ESTRETEFONDS',
 'location_confidence': 'geocoded',
 'longitude': 1.359,
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 160444,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ec4743fa-6b14-571b-8c9d-81eb8783d066/ec4743fa-6b14-571b-8c9d-81eb8783d066_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80887,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/75/f7752536ed1193c904a538d6c97c87f1/pa/GT54355_b9691e243481b924d33c852af3cf88e5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ec4743fa-6b14-571b-8c9d-81eb8783d066/ec4743fa-6b14-571b-8c9d-81eb8783d066_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89234,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/75/f7752536ed1193c904a538d6c97c87f1/pa/GT54355_58a79f6ad3a9dd6e4f064dbc984eb998.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ec4743fa-6b14-571b-8c9d-81eb8783d066/ec4743fa-6b14-571b-8c9d-81eb8783d066_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73720,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/75/f7752536ed1193c904a538d6c97c87f1/pa/GT54355_64e946e2f5b119b02bcd038d515a1c36.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ec4743fa-6b14-571b-8c9d-81eb8783d066/ec4743fa-6b14-571b-8c9d-81eb8783d066_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44666,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/75/f7752536ed1193c904a538d6c97c87f1/pa/GT54355_8d231232f4dd96f486e68be5652ea460.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ec4743fa-6b14-571b-8c9d-81eb8783d066/ec4743fa-6b14-571b-8c9d-81eb8783d066_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83720,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/75/f7752536ed1193c904a538d6c97c87f1/pa/GT54355_6248608abbe634028be9c2806bbd2859.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ec4743fa-6b14-571b-8c9d-81eb8783d066/ec4743fa-6b14-571b-8c9d-81eb8783d066_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38804,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/75/f7752536ed1193c904a538d6c97c87f1/pa/GT54355_26c9b36f6b4089cc01fdbdb51b7a8f09.jpg',
             'Width': 800}],
 'postal_code': '31620',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Haute-Garonne',
 'province_code': 'FR-31',
 'region': 'Occitanie',
 'region_code': 'FR-76',
 'registration_date': '2004-04-08',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat Panda 1.1 Team',
 'transmission': 'manual',
 'trim': 'Team',
 'year': 2004}
2026-04-27 07:55:53 [auto1.fr] INFO: Saving data for GT54355: {'created_time': 1777276553.889056, 'last_price_update_time': 1777276553.889065, 'has_photos': True, 'auction_closing_time': 1777389407.0}
2026-04-27 07:55:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 48cdacb5-a189-59f2-a4f1-20199f77037d with identifier: TB94788
2026-04-27 07:55:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 48cdacb5-a189-59f2-a4f1-20199f77037d with identifier: TB94788
2026-04-27 07:55:54 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 48cdacb5-a189-59f2-a4f1-20199f77037d with identifier: TB94788 to the API
2026-04-27 07:55:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:54 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img64/be/64be795c11002705e2ff7f552faead1b/pa/TB94788_f65ee289579f13b8068b8e5065f6b5e6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 188,
 'category': None,
 'city': 'Auxerre',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO N\\/A',
 'engine': '1.9L',
 'engine_horse_power': 130,
 'expiration_date': '2026-04-28T15:39:04Z',
 'fuel_type': 'diesel',
 'id': '48cdacb5-a189-59f2-a4f1-20199f77037d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 47.7996,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TB94788',
 'listing': 'auction',
 'location': 'FR, Auxerre',
 'location_confidence': 'geocoded',
 'longitude': 3.5703,
 'make': 'Renault',
 'model': 'Scenic',
 'odometer': 999999,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_48cdacb5-a189-59f2-a4f1-20199f77037d/48cdacb5-a189-59f2-a4f1-20199f77037d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79427,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/be/64be795c11002705e2ff7f552faead1b/pa/TB94788_1180adbb1f12223597bc1ee6c449bfa0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_48cdacb5-a189-59f2-a4f1-20199f77037d/48cdacb5-a189-59f2-a4f1-20199f77037d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64519,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/be/64be795c11002705e2ff7f552faead1b/pa/TB94788_3109675ce72adf7a7143457c6602d002.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_48cdacb5-a189-59f2-a4f1-20199f77037d/48cdacb5-a189-59f2-a4f1-20199f77037d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68720,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/be/64be795c11002705e2ff7f552faead1b/pa/TB94788_f65ee289579f13b8068b8e5065f6b5e6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_48cdacb5-a189-59f2-a4f1-20199f77037d/48cdacb5-a189-59f2-a4f1-20199f77037d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36013,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/be/64be795c11002705e2ff7f552faead1b/pa/TB94788_473c4283b5844e0a09f997f5e2ac3dc3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_48cdacb5-a189-59f2-a4f1-20199f77037d/48cdacb5-a189-59f2-a4f1-20199f77037d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88260,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/be/64be795c11002705e2ff7f552faead1b/pa/TB94788_a59cc6cb7c9908f95534b70889594c4f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_48cdacb5-a189-59f2-a4f1-20199f77037d/48cdacb5-a189-59f2-a4f1-20199f77037d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64438,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/be/64be795c11002705e2ff7f552faead1b/pa/TB94788_6ea97c962114e3f795b72aeb1ccad1a5.jpg',
             'Width': 800}],
 'postal_code': '89000',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Yonne',
 'province_code': 'FR-89',
 'region': 'Bourgogne-Franche-Comté',
 'region_code': 'FR-27',
 'registration_date': '2008-03-05',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Renault Scenic 1.9 dCi Dynamique',
 'transmission': 'automatic',
 'trim': 'Dynamique',
 'year': 2008}
2026-04-27 07:55:54 [auto1.fr] INFO: Saving data for TB94788: {'created_time': 1777276554.358744, 'last_price_update_time': 1777276554.358757, 'has_photos': True, 'auction_closing_time': 1777390744.0}
2026-04-27 07:55:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d53b333f-0b2c-5b0e-9906-764ddf709c52 with identifier: PW05542
2026-04-27 07:55:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d53b333f-0b2c-5b0e-9906-764ddf709c52 with identifier: PW05542
2026-04-27 07:55:54 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: d53b333f-0b2c-5b0e-9906-764ddf709c52 with identifier: PW05542 to the API
2026-04-27 07:55:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:54 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgbb/1f/bb1fa5fe94c99696714ab51667f1cab5/pa/PW05542_e56ccfedc4bc85163e1c17a874bbd57d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'city': 'Loyettes',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 105,
 'expiration_date': '2026-04-28T15:55:01Z',
 'fuel_type': 'diesel',
 'id': 'd53b333f-0b2c-5b0e-9906-764ddf709c52',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 45.7766,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PW05542',
 'listing': 'auction',
 'location': 'FR, Loyettes',
 'location_confidence': 'geocoded',
 'longitude': 5.2069,
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 235165,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d53b333f-0b2c-5b0e-9906-764ddf709c52/d53b333f-0b2c-5b0e-9906-764ddf709c52_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76919,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/1f/bb1fa5fe94c99696714ab51667f1cab5/pa/PW05542_1c02d7290f7b58f0c622f2f7de734cf1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d53b333f-0b2c-5b0e-9906-764ddf709c52/d53b333f-0b2c-5b0e-9906-764ddf709c52_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76996,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/1f/bb1fa5fe94c99696714ab51667f1cab5/pa/PW05542_e56ccfedc4bc85163e1c17a874bbd57d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d53b333f-0b2c-5b0e-9906-764ddf709c52/d53b333f-0b2c-5b0e-9906-764ddf709c52_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69794,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/1f/bb1fa5fe94c99696714ab51667f1cab5/pa/PW05542_342520c3f642079dc23c0bca1f4e8da0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d53b333f-0b2c-5b0e-9906-764ddf709c52/d53b333f-0b2c-5b0e-9906-764ddf709c52_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66102,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/1f/bb1fa5fe94c99696714ab51667f1cab5/pa/PW05542_97376dad7fbac8ea5ba105d208a1dec6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d53b333f-0b2c-5b0e-9906-764ddf709c52/d53b333f-0b2c-5b0e-9906-764ddf709c52_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60326,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/1f/bb1fa5fe94c99696714ab51667f1cab5/pa/PW05542_6bc8335cfe73e40b9734eb065f9ea121.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d53b333f-0b2c-5b0e-9906-764ddf709c52/d53b333f-0b2c-5b0e-9906-764ddf709c52_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73917,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/1f/bb1fa5fe94c99696714ab51667f1cab5/pa/PW05542_a39a001c9a1c8508e92c46716c25ea2a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d53b333f-0b2c-5b0e-9906-764ddf709c52/d53b333f-0b2c-5b0e-9906-764ddf709c52_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63157,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/1f/bb1fa5fe94c99696714ab51667f1cab5/pa/PW05542_5afd08a1a3e9b1c319e825fade46e807.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d53b333f-0b2c-5b0e-9906-764ddf709c52/d53b333f-0b2c-5b0e-9906-764ddf709c52_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71142,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/1f/bb1fa5fe94c99696714ab51667f1cab5/pa/PW05542_8cb4922f12183366ba047b212b05d860.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d53b333f-0b2c-5b0e-9906-764ddf709c52/d53b333f-0b2c-5b0e-9906-764ddf709c52_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65769,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/1f/bb1fa5fe94c99696714ab51667f1cab5/pa/PW05542_1c3ed74aabc3ae89658436ed20c51d46.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d53b333f-0b2c-5b0e-9906-764ddf709c52/d53b333f-0b2c-5b0e-9906-764ddf709c52_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55405,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/1f/bb1fa5fe94c99696714ab51667f1cab5/pa/PW05542_58a6e7aa1a6a0beb6689e85f156ec5a5.jpg',
             'Width': 800}],
 'postal_code': '01360',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Ain',
 'province_code': 'FR-01',
 'region': 'Auvergne-Rhône-Alpes',
 'region_code': 'FR-84',
 'registration_date': '2012-01-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.6 TDI Comfortline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2012}
2026-04-27 07:55:54 [auto1.fr] INFO: Saving data for PW05542: {'created_time': 1777276554.724177, 'last_price_update_time': 1777276554.724188, 'has_photos': True, 'auction_closing_time': 1777391701.0}
2026-04-27 07:55:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14381cead0>
2026-04-27 07:55:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdfcd267-d04a-59ee-ac3c-681602666f6f/fdfcd267-d04a-59ee-ac3c-681602666f6f_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/49/57497670dfa726a83867abbec3391bd9/pa/FD54899_073ed73200ce7e347db6b8baaf4f10a6.jpg saved to cache
2026-04-27 07:55:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fdfcd267-d04a-59ee-ac3c-681602666f6f
2026-04-27 07:55:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bf45550>
2026-04-27 07:55:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dce51e5-a537-5163-a723-63a98f53aaa1/0dce51e5-a537-5163-a723-63a98f53aaa1_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/14/b1141ea1826c8f7f11660cdb231e3dc9/pa/KR98436_ec0bf98861ef6275b22c01e1a95917f7.jpg saved to cache
2026-04-27 07:55:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0dce51e5-a537-5163-a723-63a98f53aaa1
2026-04-27 07:55:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/ba/6fbaac9b1ca3675f4d52986fa9ca20b5/pa/KV02757_2e1481d03913e6396d378852a99adc9b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/ae/dfae082e0b2e17650dfc49c59e8eab79/pa/WU07507_dbaf691079b5aea879b4832c16538aac.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/ae/dfae082e0b2e17650dfc49c59e8eab79/pa/WU07507_8f10dac5809ccf134e0ae46eca0f370f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/63/6c63f2c43a4fccd2b416b4bd083197ce/pa/RP08022_1f1cb737b063d6f4443f8b67539f2021.jpg not downloaded yet
2026-04-27 07:55:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/bb/62bbc7cf037431f83ae8ba3baf40753e/pa/ZM99861_478c1fa3798c44b2752adc850929d2e9.jpg not downloaded yet
2026-04-27 07:55:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/ba/6fbaac9b1ca3675f4d52986fa9ca20b5/pa/KV02757_b225b6fbe78174b1c96c0227d85a61a1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/4c/514c9c9c2e25144d920cc8334d57b1a9/pa/CG72057_cf4a37d63b7059585c426e4185fcb9e9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/4c/514c9c9c2e25144d920cc8334d57b1a9/pa/CG72057_caede284b2a8b640580d43b757ccb032.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/0c/6c0cdaf1bb6ea49e2b771a5afc9e5cbe/pa/SE81249_c21aa3fff61be5e5e4569f13a50f1435.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/4c/514c9c9c2e25144d920cc8334d57b1a9/pa/CG72057_78cee6cbf1c073da6dda3b00e5f3c0b2.jpg not downloaded yet
2026-04-27 07:55:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/ba/6fbaac9b1ca3675f4d52986fa9ca20b5/pa/KV02757_30dc47a57a9c091481985d118497417a.jpg not downloaded yet
2026-04-27 07:55:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bf8ca90>
2026-04-27 07:55:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a2a1808-b7d3-5e1a-a432-13d943d07411/1a2a1808-b7d3-5e1a-a432-13d943d07411_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/4c/514c9c9c2e25144d920cc8334d57b1a9/pa/CG72057_5b9f59ecc73fbee33cf960f0b2480e9c.jpg saved to cache
2026-04-27 07:55:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1a2a1808-b7d3-5e1a-a432-13d943d07411
2026-04-27 07:55:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a720d0>
2026-04-27 07:55:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dce51e5-a537-5163-a723-63a98f53aaa1/0dce51e5-a537-5163-a723-63a98f53aaa1_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/14/b1141ea1826c8f7f11660cdb231e3dc9/pa/KR98436_976be982a4dc234326727a92c194a41b.jpg saved to cache
2026-04-27 07:55:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0dce51e5-a537-5163-a723-63a98f53aaa1
2026-04-27 07:55:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0dce51e5-a537-5163-a723-63a98f53aaa1, skipping ID generation
2026-04-27 07:55:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0dce51e5-a537-5163-a723-63a98f53aaa1 with scrape type 1
2026-04-27 07:55:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0dce51e5-a537-5163-a723-63a98f53aaa1 sending to next pipeline
2026-04-27 07:55:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0dce51e5-a537-5163-a723-63a98f53aaa1, identifier: KR98436
2026-04-27 07:55:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/fc/82fc308e73f852a6e0f08500dd74ec54/pa/TG37812_b9fbb14cff1980a1a174472150ef29d0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/63/6c63f2c43a4fccd2b416b4bd083197ce/pa/RP08022_193a844a343b8f420ab3edf69d807593.jpg not downloaded yet
2026-04-27 07:55:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/bb/62bbc7cf037431f83ae8ba3baf40753e/pa/ZM99861_52821840642351317bcaf9643c6b92e3.jpg not downloaded yet
2026-04-27 07:55:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0dce51e5-a537-5163-a723-63a98f53aaa1 with identifier: KR98436
2026-04-27 07:55:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0dce51e5-a537-5163-a723-63a98f53aaa1 with identifier: KR98436
2026-04-27 07:55:55 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 0dce51e5-a537-5163-a723-63a98f53aaa1 with identifier: KR98436 to the API
2026-04-27 07:55:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:55 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb1/14/b1141ea1826c8f7f11660cdb231e3dc9/pa/KR98436_976be982a4dc234326727a92c194a41b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'city': 'Tarnos',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO N\\/A',
 'engine': '1.6L',
 'engine_horse_power': 90,
 'expiration_date': '2026-04-28T15:41:47Z',
 'fuel_type': 'petrol',
 'id': '0dce51e5-a537-5163-a723-63a98f53aaa1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 43.5417,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KR98436',
 'listing': 'auction',
 'location': 'FR, Tarnos',
 'location_confidence': 'geocoded',
 'longitude': -1.4628,
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 212044,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0dce51e5-a537-5163-a723-63a98f53aaa1/0dce51e5-a537-5163-a723-63a98f53aaa1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82045,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/14/b1141ea1826c8f7f11660cdb231e3dc9/pa/KR98436_e3c8d90ccb11138227ae79fb89bf5b98.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0dce51e5-a537-5163-a723-63a98f53aaa1/0dce51e5-a537-5163-a723-63a98f53aaa1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86437,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/14/b1141ea1826c8f7f11660cdb231e3dc9/pa/KR98436_3a845e8d703fd4faacc5a2e79fa5ae18.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0dce51e5-a537-5163-a723-63a98f53aaa1/0dce51e5-a537-5163-a723-63a98f53aaa1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84053,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/14/b1141ea1826c8f7f11660cdb231e3dc9/pa/KR98436_80bbc943ba1318ca4fd341e47734376c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0dce51e5-a537-5163-a723-63a98f53aaa1/0dce51e5-a537-5163-a723-63a98f53aaa1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85213,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/14/b1141ea1826c8f7f11660cdb231e3dc9/pa/KR98436_06c585b97f62923eaf90571a54bed105.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0dce51e5-a537-5163-a723-63a98f53aaa1/0dce51e5-a537-5163-a723-63a98f53aaa1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107690,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/14/b1141ea1826c8f7f11660cdb231e3dc9/pa/KR98436_ec0bf98861ef6275b22c01e1a95917f7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0dce51e5-a537-5163-a723-63a98f53aaa1/0dce51e5-a537-5163-a723-63a98f53aaa1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68629,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/14/b1141ea1826c8f7f11660cdb231e3dc9/pa/KR98436_976be982a4dc234326727a92c194a41b.jpg',
             'Width': 800}],
 'postal_code': '40220',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Landes',
 'province_code': 'FR-40',
 'region': 'Nouvelle-Aquitaine',
 'region_code': 'FR-75',
 'registration_date': '2005-07-03',
 'seats_number': 4,
 'seller_name': None,
 'title': 'MINI One',
 'transmission': 'manual',
 'trim': '',
 'year': 2005}
2026-04-27 07:55:55 [auto1.fr] INFO: Saving data for KR98436: {'created_time': 1777276555.495998, 'last_price_update_time': 1777276555.496009, 'has_photos': True, 'auction_closing_time': 1777390907.0}
2026-04-27 07:55:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/4c/514c9c9c2e25144d920cc8334d57b1a9/pa/CG72057_6e6a6cd9af550b379e584451783a0761.jpg not downloaded yet
2026-04-27 07:55:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/ba/6fbaac9b1ca3675f4d52986fa9ca20b5/pa/KV02757_07a593ceb376c5cec836ed6e49fdd28b.jpg not downloaded yet
2026-04-27 07:55:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/87/128791546d8bf2628c4f2620c49b3e70/pa/GP77578_e06a465350130735558a2e1b297b96ab.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/ba/6fbaac9b1ca3675f4d52986fa9ca20b5/pa/KV02757_df457194f2d21b450954d5c6edebd390.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/49/57497670dfa726a83867abbec3391bd9/pa/FD54899_d284b593b08e90ba1f8d2348b04d43ce.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/0c/6c0cdaf1bb6ea49e2b771a5afc9e5cbe/pa/SE81249_4151218aeec3f4aedecdbef4feca6f3a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/4c/514c9c9c2e25144d920cc8334d57b1a9/pa/CG72057_1cca2de55cfbfd8eb7d8bb06ee9cb170.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/63/6c63f2c43a4fccd2b416b4bd083197ce/pa/RP08022_ea3a8f9b50bf183bf1bbbe17fff3aa1c.jpg not downloaded yet
2026-04-27 07:55:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/bb/62bbc7cf037431f83ae8ba3baf40753e/pa/ZM99861_7ef062408c9b63bb6a5700604b36a172.jpg not downloaded yet
2026-04-27 07:55:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143809ef90>
2026-04-27 07:55:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05f3eff2-1ffe-503d-b1ff-e2f8a844e609/05f3eff2-1ffe-503d-b1ff-e2f8a844e609_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/ba/6fbaac9b1ca3675f4d52986fa9ca20b5/pa/KV02757_2e1481d03913e6396d378852a99adc9b.jpg saved to cache
2026-04-27 07:55:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 05f3eff2-1ffe-503d-b1ff-e2f8a844e609
2026-04-27 07:55:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380e5390>
2026-04-27 07:55:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82c607f1-69da-537f-a5f9-ed4177752d1e/82c607f1-69da-537f-a5f9-ed4177752d1e_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/ae/dfae082e0b2e17650dfc49c59e8eab79/pa/WU07507_dbaf691079b5aea879b4832c16538aac.jpg saved to cache
2026-04-27 07:55:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 82c607f1-69da-537f-a5f9-ed4177752d1e
2026-04-27 07:55:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14381687d0>
2026-04-27 07:55:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82c607f1-69da-537f-a5f9-ed4177752d1e/82c607f1-69da-537f-a5f9-ed4177752d1e_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/ae/dfae082e0b2e17650dfc49c59e8eab79/pa/WU07507_8f10dac5809ccf134e0ae46eca0f370f.jpg saved to cache
2026-04-27 07:55:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 82c607f1-69da-537f-a5f9-ed4177752d1e
2026-04-27 07:55:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 82c607f1-69da-537f-a5f9-ed4177752d1e, skipping ID generation
2026-04-27 07:55:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82c607f1-69da-537f-a5f9-ed4177752d1e with scrape type 1
2026-04-27 07:55:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 82c607f1-69da-537f-a5f9-ed4177752d1e sending to next pipeline
2026-04-27 07:55:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 82c607f1-69da-537f-a5f9-ed4177752d1e, identifier: WU07507
2026-04-27 07:55:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438e08c50>
2026-04-27 07:55:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05f3eff2-1ffe-503d-b1ff-e2f8a844e609/05f3eff2-1ffe-503d-b1ff-e2f8a844e609_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/ba/6fbaac9b1ca3675f4d52986fa9ca20b5/pa/KV02757_b225b6fbe78174b1c96c0227d85a61a1.jpg saved to cache
2026-04-27 07:55:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 05f3eff2-1ffe-503d-b1ff-e2f8a844e609
2026-04-27 07:55:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380e7910>
2026-04-27 07:55:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a2a1808-b7d3-5e1a-a432-13d943d07411/1a2a1808-b7d3-5e1a-a432-13d943d07411_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/4c/514c9c9c2e25144d920cc8334d57b1a9/pa/CG72057_cf4a37d63b7059585c426e4185fcb9e9.jpg saved to cache
2026-04-27 07:55:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1a2a1808-b7d3-5e1a-a432-13d943d07411
2026-04-27 07:55:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438fa4390>
2026-04-27 07:55:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a2a1808-b7d3-5e1a-a432-13d943d07411/1a2a1808-b7d3-5e1a-a432-13d943d07411_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/4c/514c9c9c2e25144d920cc8334d57b1a9/pa/CG72057_caede284b2a8b640580d43b757ccb032.jpg saved to cache
2026-04-27 07:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1a2a1808-b7d3-5e1a-a432-13d943d07411
2026-04-27 07:55:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438169490>
2026-04-27 07:55:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55776317-a1e6-52fe-ae28-786098c328ed/55776317-a1e6-52fe-ae28-786098c328ed_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/0c/6c0cdaf1bb6ea49e2b771a5afc9e5cbe/pa/SE81249_c21aa3fff61be5e5e4569f13a50f1435.jpg saved to cache
2026-04-27 07:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 55776317-a1e6-52fe-ae28-786098c328ed
2026-04-27 07:55:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/4c/514c9c9c2e25144d920cc8334d57b1a9/pa/CG72057_81b80511d59761b44d4b25131de28418.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/87/128791546d8bf2628c4f2620c49b3e70/pa/GP77578_6671374c78db43db24dd57404d27a7dd.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/4c/514c9c9c2e25144d920cc8334d57b1a9/pa/CG72057_e3d401f06c060e5b0b272a14db26235d.jpg not downloaded yet
2026-04-27 07:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/ba/6fbaac9b1ca3675f4d52986fa9ca20b5/pa/KV02757_53b4d2ed571a19165d57a5ce60456391.jpg not downloaded yet
2026-04-27 07:55:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 82c607f1-69da-537f-a5f9-ed4177752d1e with identifier: WU07507
2026-04-27 07:55:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 82c607f1-69da-537f-a5f9-ed4177752d1e with identifier: WU07507
2026-04-27 07:55:56 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 82c607f1-69da-537f-a5f9-ed4177752d1e with identifier: WU07507 to the API
2026-04-27 07:55:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:56 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgdf/ae/dfae082e0b2e17650dfc49c59e8eab79/pa/WU07507_8f10dac5809ccf134e0ae46eca0f370f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'city': 'Ambarès-et-Lagrave',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 90,
 'expiration_date': '2026-04-28T15:15:21Z',
 'fuel_type': 'diesel',
 'id': '82c607f1-69da-537f-a5f9-ed4177752d1e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 44.9274,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WU07507',
 'listing': 'auction',
 'location': 'FR, Ambarès-et-Lagrave',
 'location_confidence': 'geocoded',
 'longitude': -0.4914,
 'make': 'Peugeot',
 'model': '207',
 'odometer': 212939,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 19,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_82c607f1-69da-537f-a5f9-ed4177752d1e/82c607f1-69da-537f-a5f9-ed4177752d1e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50328,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/ae/dfae082e0b2e17650dfc49c59e8eab79/pa/WU07507_02726403ca31100196dc754e774bb19f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_82c607f1-69da-537f-a5f9-ed4177752d1e/82c607f1-69da-537f-a5f9-ed4177752d1e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53195,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/ae/dfae082e0b2e17650dfc49c59e8eab79/pa/WU07507_174b9ff6aa52c941f1205258959198bc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_82c607f1-69da-537f-a5f9-ed4177752d1e/82c607f1-69da-537f-a5f9-ed4177752d1e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53945,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/ae/dfae082e0b2e17650dfc49c59e8eab79/pa/WU07507_c2760d1c17fa583da151b16248e54389.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_82c607f1-69da-537f-a5f9-ed4177752d1e/82c607f1-69da-537f-a5f9-ed4177752d1e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47018,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/ae/dfae082e0b2e17650dfc49c59e8eab79/pa/WU07507_dbaf691079b5aea879b4832c16538aac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_82c607f1-69da-537f-a5f9-ed4177752d1e/82c607f1-69da-537f-a5f9-ed4177752d1e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52402,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/ae/dfae082e0b2e17650dfc49c59e8eab79/pa/WU07507_8f10dac5809ccf134e0ae46eca0f370f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_82c607f1-69da-537f-a5f9-ed4177752d1e/82c607f1-69da-537f-a5f9-ed4177752d1e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50642,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/ae/dfae082e0b2e17650dfc49c59e8eab79/pa/WU07507_8363ab4ecd2164c7b28a8e65d845a857.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_82c607f1-69da-537f-a5f9-ed4177752d1e/82c607f1-69da-537f-a5f9-ed4177752d1e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45525,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/ae/dfae082e0b2e17650dfc49c59e8eab79/pa/WU07507_8b49205093fb5a92cae085ce5a7d52e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_82c607f1-69da-537f-a5f9-ed4177752d1e/82c607f1-69da-537f-a5f9-ed4177752d1e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103330,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/ae/dfae082e0b2e17650dfc49c59e8eab79/pa/WU07507_51fd3f214829dca8eae7cead8a258990.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_82c607f1-69da-537f-a5f9-ed4177752d1e/82c607f1-69da-537f-a5f9-ed4177752d1e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104065,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/ae/dfae082e0b2e17650dfc49c59e8eab79/pa/WU07507_181adbde443788c5732c5016e7e0c8eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_82c607f1-69da-537f-a5f9-ed4177752d1e/82c607f1-69da-537f-a5f9-ed4177752d1e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78508,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/ae/dfae082e0b2e17650dfc49c59e8eab79/pa/WU07507_b49b1e3559839f94015b39af0c924a11.jpg',
             'Width': 800}],
 'postal_code': '33440',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Gironde',
 'province_code': 'FR-33',
 'region': 'Nouvelle-Aquitaine',
 'region_code': 'FR-75',
 'registration_date': '2008-09-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 207 1.6 HDi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2008}
2026-04-27 07:55:56 [auto1.fr] INFO: Saving data for WU07507: {'created_time': 1777276556.738948, 'last_price_update_time': 1777276556.738961, 'has_photos': True, 'auction_closing_time': 1777389321.0}
2026-04-27 07:55:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/ba/6fbaac9b1ca3675f4d52986fa9ca20b5/pa/KV02757_d78d7ae189319736454999efedd25900.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/63/6c63f2c43a4fccd2b416b4bd083197ce/pa/RP08022_46ec78b9b89a4430f8ba238e5e85ab2f.jpg not downloaded yet
2026-04-27 07:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/bb/62bbc7cf037431f83ae8ba3baf40753e/pa/ZM99861_9a05fc6b9eeefe7b02b4690b36d691fd.jpg not downloaded yet
2026-04-27 07:55:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380e5750>
2026-04-27 07:55:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4225ec09-f8fd-550e-9f3e-a0d541b71bd7/4225ec09-f8fd-550e-9f3e-a0d541b71bd7_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/fc/82fc308e73f852a6e0f08500dd74ec54/pa/TG37812_b9fbb14cff1980a1a174472150ef29d0.jpg saved to cache
2026-04-27 07:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4225ec09-f8fd-550e-9f3e-a0d541b71bd7
2026-04-27 07:55:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4225ec09-f8fd-550e-9f3e-a0d541b71bd7, skipping ID generation
2026-04-27 07:55:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4225ec09-f8fd-550e-9f3e-a0d541b71bd7 with scrape type 1
2026-04-27 07:55:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4225ec09-f8fd-550e-9f3e-a0d541b71bd7 sending to next pipeline
2026-04-27 07:55:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4225ec09-f8fd-550e-9f3e-a0d541b71bd7, identifier: TG37812
2026-04-27 07:55:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/bb/62bbc7cf037431f83ae8ba3baf40753e/pa/ZM99861_e780936aacd920fd51e76fdb52d29f0e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/63/6c63f2c43a4fccd2b416b4bd083197ce/pa/RP08022_3ff8747057a2866e4f7b49a0209853e0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/4c/514c9c9c2e25144d920cc8334d57b1a9/pa/CG72057_e81718506740ce1382356c9a3ed0b160.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/ba/6fbaac9b1ca3675f4d52986fa9ca20b5/pa/KV02757_8416c277f4fa5c1d5657f80ac2cf4afa.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/bb/62bbc7cf037431f83ae8ba3baf40753e/pa/ZM99861_478c1fa3798c44b2752adc850929d2e9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/4c/514c9c9c2e25144d920cc8334d57b1a9/pa/CG72057_87263c29e347903e6412a62bf6010955.jpg not downloaded yet
2026-04-27 07:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/ba/6fbaac9b1ca3675f4d52986fa9ca20b5/pa/KV02757_1107ca323f402c6873e981097d7bf3f0.jpg not downloaded yet
2026-04-27 07:55:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WP67872/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4225ec09-f8fd-550e-9f3e-a0d541b71bd7 with identifier: TG37812
2026-04-27 07:55:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4225ec09-f8fd-550e-9f3e-a0d541b71bd7 with identifier: TG37812
2026-04-27 07:55:57 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 4225ec09-f8fd-550e-9f3e-a0d541b71bd7 with identifier: TG37812 to the API
2026-04-27 07:55:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:57 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img82/fc/82fc308e73f852a6e0f08500dd74ec54/pa/TG37812_b9fbb14cff1980a1a174472150ef29d0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'category': None,
 'city': 'Narbonne',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO N\\/A',
 'engine': '1.4L',
 'engine_horse_power': 68,
 'expiration_date': '2026-04-28T15:42:08Z',
 'fuel_type': 'diesel',
 'id': '4225ec09-f8fd-550e-9f3e-a0d541b71bd7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 43.184,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TG37812',
 'listing': 'auction',
 'location': 'FR, Narbonne',
 'location_confidence': 'geocoded',
 'longitude': 3.0014,
 'make': 'Peugeot',
 'model': '207',
 'odometer': 178670,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4225ec09-f8fd-550e-9f3e-a0d541b71bd7/4225ec09-f8fd-550e-9f3e-a0d541b71bd7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67825,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/fc/82fc308e73f852a6e0f08500dd74ec54/pa/TG37812_d5d87d157f916b3d5e7d0bd68c117a1e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4225ec09-f8fd-550e-9f3e-a0d541b71bd7/4225ec09-f8fd-550e-9f3e-a0d541b71bd7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106801,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/fc/82fc308e73f852a6e0f08500dd74ec54/pa/TG37812_b9fbb14cff1980a1a174472150ef29d0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4225ec09-f8fd-550e-9f3e-a0d541b71bd7/4225ec09-f8fd-550e-9f3e-a0d541b71bd7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58138,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/fc/82fc308e73f852a6e0f08500dd74ec54/pa/TG37812_4c488637545ab6846c3943addf7425c1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4225ec09-f8fd-550e-9f3e-a0d541b71bd7/4225ec09-f8fd-550e-9f3e-a0d541b71bd7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80248,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/fc/82fc308e73f852a6e0f08500dd74ec54/pa/TG37812_9bda96f53a3f5c54c03b507e0a93ca6b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4225ec09-f8fd-550e-9f3e-a0d541b71bd7/4225ec09-f8fd-550e-9f3e-a0d541b71bd7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77010,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/fc/82fc308e73f852a6e0f08500dd74ec54/pa/TG37812_a0d412d9d1164a19dd7924ed3feea8e7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4225ec09-f8fd-550e-9f3e-a0d541b71bd7/4225ec09-f8fd-550e-9f3e-a0d541b71bd7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39049,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/fc/82fc308e73f852a6e0f08500dd74ec54/pa/TG37812_7c957b5a1139d8bd3bdbc7880417d12e.jpg',
             'Width': 800}],
 'postal_code': '11100',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Aude',
 'province_code': 'FR-11',
 'region': 'Occitanie',
 'region_code': 'FR-76',
 'registration_date': '2011-08-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 207 1.4 HDi Urban',
 'transmission': 'manual',
 'trim': 'Urban',
 'year': 2011}
2026-04-27 07:55:57 [auto1.fr] INFO: Saving data for TG37812: {'created_time': 1777276557.485756, 'last_price_update_time': 1777276557.48577, 'has_photos': True, 'auction_closing_time': 1777390928.0}
2026-04-27 07:55:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/63/6c63f2c43a4fccd2b416b4bd083197ce/pa/RP08022_e1afe080fbc18e27f76877bac02b0bae.jpg not downloaded yet
2026-04-27 07:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/bb/62bbc7cf037431f83ae8ba3baf40753e/pa/ZM99861_eb657d3cfca17b1546a303e163a14dd3.jpg not downloaded yet
2026-04-27 07:55:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/63/6c63f2c43a4fccd2b416b4bd083197ce/pa/RP08022_193a844a343b8f420ab3edf69d807593.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/bb/62bbc7cf037431f83ae8ba3baf40753e/pa/ZM99861_52821840642351317bcaf9643c6b92e3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/ba/6fbaac9b1ca3675f4d52986fa9ca20b5/pa/KV02757_30dc47a57a9c091481985d118497417a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438cea590>
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_595f5cf4-61d6-5815-9ba7-f52cfee67d94/595f5cf4-61d6-5815-9ba7-f52cfee67d94_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/87/128791546d8bf2628c4f2620c49b3e70/pa/GP77578_e06a465350130735558a2e1b297b96ab.jpg saved to cache
2026-04-27 07:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 595f5cf4-61d6-5815-9ba7-f52cfee67d94
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b42850>
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05f3eff2-1ffe-503d-b1ff-e2f8a844e609/05f3eff2-1ffe-503d-b1ff-e2f8a844e609_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/ba/6fbaac9b1ca3675f4d52986fa9ca20b5/pa/KV02757_df457194f2d21b450954d5c6edebd390.jpg saved to cache
2026-04-27 07:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 05f3eff2-1ffe-503d-b1ff-e2f8a844e609
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ffa410>
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdfcd267-d04a-59ee-ac3c-681602666f6f/fdfcd267-d04a-59ee-ac3c-681602666f6f_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/49/57497670dfa726a83867abbec3391bd9/pa/FD54899_d284b593b08e90ba1f8d2348b04d43ce.jpg saved to cache
2026-04-27 07:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fdfcd267-d04a-59ee-ac3c-681602666f6f
2026-04-27 07:55:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fdfcd267-d04a-59ee-ac3c-681602666f6f, skipping ID generation
2026-04-27 07:55:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fdfcd267-d04a-59ee-ac3c-681602666f6f with scrape type 1
2026-04-27 07:55:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fdfcd267-d04a-59ee-ac3c-681602666f6f sending to next pipeline
2026-04-27 07:55:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: fdfcd267-d04a-59ee-ac3c-681602666f6f, identifier: FD54899
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d86d90>
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55776317-a1e6-52fe-ae28-786098c328ed/55776317-a1e6-52fe-ae28-786098c328ed_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/0c/6c0cdaf1bb6ea49e2b771a5afc9e5cbe/pa/SE81249_4151218aeec3f4aedecdbef4feca6f3a.jpg saved to cache
2026-04-27 07:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 55776317-a1e6-52fe-ae28-786098c328ed
2026-04-27 07:55:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 55776317-a1e6-52fe-ae28-786098c328ed, skipping ID generation
2026-04-27 07:55:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55776317-a1e6-52fe-ae28-786098c328ed with scrape type 1
2026-04-27 07:55:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 55776317-a1e6-52fe-ae28-786098c328ed sending to next pipeline
2026-04-27 07:55:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 55776317-a1e6-52fe-ae28-786098c328ed, identifier: SE81249
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bf6a450>
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a2a1808-b7d3-5e1a-a432-13d943d07411/1a2a1808-b7d3-5e1a-a432-13d943d07411_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/4c/514c9c9c2e25144d920cc8334d57b1a9/pa/CG72057_1cca2de55cfbfd8eb7d8bb06ee9cb170.jpg saved to cache
2026-04-27 07:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1a2a1808-b7d3-5e1a-a432-13d943d07411
2026-04-27 07:55:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d2c1d0>
2026-04-27 07:55:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a2a1808-b7d3-5e1a-a432-13d943d07411/1a2a1808-b7d3-5e1a-a432-13d943d07411_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/4c/514c9c9c2e25144d920cc8334d57b1a9/pa/CG72057_81b80511d59761b44d4b25131de28418.jpg saved to cache
2026-04-27 07:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1a2a1808-b7d3-5e1a-a432-13d943d07411
2026-04-27 07:55:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438e36d50>
2026-04-27 07:55:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_595f5cf4-61d6-5815-9ba7-f52cfee67d94/595f5cf4-61d6-5815-9ba7-f52cfee67d94_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/87/128791546d8bf2628c4f2620c49b3e70/pa/GP77578_6671374c78db43db24dd57404d27a7dd.jpg saved to cache
2026-04-27 07:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 595f5cf4-61d6-5815-9ba7-f52cfee67d94
2026-04-27 07:55:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438aed890>
2026-04-27 07:55:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05f3eff2-1ffe-503d-b1ff-e2f8a844e609/05f3eff2-1ffe-503d-b1ff-e2f8a844e609_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/ba/6fbaac9b1ca3675f4d52986fa9ca20b5/pa/KV02757_d78d7ae189319736454999efedd25900.jpg saved to cache
2026-04-27 07:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 05f3eff2-1ffe-503d-b1ff-e2f8a844e609
2026-04-27 07:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/63/6c63f2c43a4fccd2b416b4bd083197ce/pa/RP08022_237a0e7eb74b3dc0b636c408de949851.jpg not downloaded yet
2026-04-27 07:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/bb/62bbc7cf037431f83ae8ba3baf40753e/pa/ZM99861_c2c25231a20d6fd2cb5b4ccc076015fc.jpg not downloaded yet
2026-04-27 07:55:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JX55503/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: fdfcd267-d04a-59ee-ac3c-681602666f6f with identifier: FD54899
2026-04-27 07:55:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: fdfcd267-d04a-59ee-ac3c-681602666f6f with identifier: FD54899
2026-04-27 07:55:58 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: fdfcd267-d04a-59ee-ac3c-681602666f6f with identifier: FD54899 to the API
2026-04-27 07:55:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:58 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img57/49/57497670dfa726a83867abbec3391bd9/pa/FD54899_d284b593b08e90ba1f8d2348b04d43ce.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'category': None,
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 140,
 'expiration_date': '2026-04-28T15:02:39Z',
 'fuel_type': 'petrol',
 'id': 'fdfcd267-d04a-59ee-ac3c-681602666f6f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FD54899',
 'listing': 'auction',
 'location': 'FR',
 'location_confidence': None,
 'longitude': None,
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 112286,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fdfcd267-d04a-59ee-ac3c-681602666f6f/fdfcd267-d04a-59ee-ac3c-681602666f6f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53411,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/49/57497670dfa726a83867abbec3391bd9/pa/FD54899_a030278bb63c9f8dc92f872d1296b7bf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fdfcd267-d04a-59ee-ac3c-681602666f6f/fdfcd267-d04a-59ee-ac3c-681602666f6f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53411,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/49/57497670dfa726a83867abbec3391bd9/pa/FD54899_d284b593b08e90ba1f8d2348b04d43ce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fdfcd267-d04a-59ee-ac3c-681602666f6f/fdfcd267-d04a-59ee-ac3c-681602666f6f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57787,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/49/57497670dfa726a83867abbec3391bd9/pa/FD54899_0e18fddad03663b42f9a1c05aab45c17.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fdfcd267-d04a-59ee-ac3c-681602666f6f/fdfcd267-d04a-59ee-ac3c-681602666f6f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42077,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/49/57497670dfa726a83867abbec3391bd9/pa/FD54899_b72dc39826033e0d7f1937e39d724451.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fdfcd267-d04a-59ee-ac3c-681602666f6f/fdfcd267-d04a-59ee-ac3c-681602666f6f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52863,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/49/57497670dfa726a83867abbec3391bd9/pa/FD54899_47ba69650d282db7cdba3d8070c333cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fdfcd267-d04a-59ee-ac3c-681602666f6f/fdfcd267-d04a-59ee-ac3c-681602666f6f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51417,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/49/57497670dfa726a83867abbec3391bd9/pa/FD54899_e1f39f3b88a26d985b349cb1119a749e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fdfcd267-d04a-59ee-ac3c-681602666f6f/fdfcd267-d04a-59ee-ac3c-681602666f6f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51186,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/49/57497670dfa726a83867abbec3391bd9/pa/FD54899_5586301b3571eb819654d394b91a46ef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fdfcd267-d04a-59ee-ac3c-681602666f6f/fdfcd267-d04a-59ee-ac3c-681602666f6f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108428,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/49/57497670dfa726a83867abbec3391bd9/pa/FD54899_faf4939aa15821b10a879366e1c65fd1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fdfcd267-d04a-59ee-ac3c-681602666f6f/fdfcd267-d04a-59ee-ac3c-681602666f6f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81631,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/49/57497670dfa726a83867abbec3391bd9/pa/FD54899_3df691cf692792e9270ff52dc854b578.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fdfcd267-d04a-59ee-ac3c-681602666f6f/fdfcd267-d04a-59ee-ac3c-681602666f6f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74806,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/49/57497670dfa726a83867abbec3391bd9/pa/FD54899_073ed73200ce7e347db6b8baaf4f10a6.jpg',
             'Width': 800}],
 'postal_code': None,
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2020-08-13',
 'seats_number': 5,
 'seller_name': None,
 'title': "Kia cee'd 1.4 TGDI GT Line",
 'transmission': 'automatic',
 'trim': 'GT Line',
 'year': 2020}
2026-04-27 07:55:58 [auto1.fr] INFO: Saving data for FD54899: {'created_time': 1777276558.712728, 'last_price_update_time': 1777276558.712736, 'has_photos': True, 'auction_closing_time': 1777388559.0}
2026-04-27 07:55:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 55776317-a1e6-52fe-ae28-786098c328ed with identifier: SE81249
2026-04-27 07:55:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 55776317-a1e6-52fe-ae28-786098c328ed with identifier: SE81249
2026-04-27 07:55:58 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 55776317-a1e6-52fe-ae28-786098c328ed with identifier: SE81249 to the API
2026-04-27 07:55:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:59 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6c/0c/6c0cdaf1bb6ea49e2b771a5afc9e5cbe/pa/SE81249_4151218aeec3f4aedecdbef4feca6f3a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'category': None,
 'city': 'Beaucaire',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.2L',
 'engine_horse_power': 150,
 'expiration_date': '2026-04-28T15:28:28Z',
 'fuel_type': 'diesel',
 'id': '55776317-a1e6-52fe-ae28-786098c328ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 43.8081,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SE81249',
 'listing': 'auction',
 'location': 'FR, Beaucaire',
 'location_confidence': 'geocoded',
 'longitude': 4.6442,
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 150549,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_55776317-a1e6-52fe-ae28-786098c328ed/55776317-a1e6-52fe-ae28-786098c328ed_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64516,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/0c/6c0cdaf1bb6ea49e2b771a5afc9e5cbe/pa/SE81249_d11f23daac44376a4974d161151ea114.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_55776317-a1e6-52fe-ae28-786098c328ed/55776317-a1e6-52fe-ae28-786098c328ed_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63610,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/0c/6c0cdaf1bb6ea49e2b771a5afc9e5cbe/pa/SE81249_9cc10222226667948d9bd56f3130d5b8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_55776317-a1e6-52fe-ae28-786098c328ed/55776317-a1e6-52fe-ae28-786098c328ed_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59383,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/0c/6c0cdaf1bb6ea49e2b771a5afc9e5cbe/pa/SE81249_79ca616a024c844783c9c091f3c6bc81.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_55776317-a1e6-52fe-ae28-786098c328ed/55776317-a1e6-52fe-ae28-786098c328ed_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56842,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/0c/6c0cdaf1bb6ea49e2b771a5afc9e5cbe/pa/SE81249_0b3d8839116ecc3e977265d0c2389d42.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_55776317-a1e6-52fe-ae28-786098c328ed/55776317-a1e6-52fe-ae28-786098c328ed_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63547,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/0c/6c0cdaf1bb6ea49e2b771a5afc9e5cbe/pa/SE81249_5adf561f45b1eab1796e200f548dddd4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_55776317-a1e6-52fe-ae28-786098c328ed/55776317-a1e6-52fe-ae28-786098c328ed_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62097,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/0c/6c0cdaf1bb6ea49e2b771a5afc9e5cbe/pa/SE81249_6a6f5fdad0216b6c3df4cfe99ac57e20.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_55776317-a1e6-52fe-ae28-786098c328ed/55776317-a1e6-52fe-ae28-786098c328ed_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50652,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/0c/6c0cdaf1bb6ea49e2b771a5afc9e5cbe/pa/SE81249_86f19009e4b934a90e3da9c81629e90f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_55776317-a1e6-52fe-ae28-786098c328ed/55776317-a1e6-52fe-ae28-786098c328ed_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64710,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/0c/6c0cdaf1bb6ea49e2b771a5afc9e5cbe/pa/SE81249_4151218aeec3f4aedecdbef4feca6f3a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_55776317-a1e6-52fe-ae28-786098c328ed/55776317-a1e6-52fe-ae28-786098c328ed_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67448,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/0c/6c0cdaf1bb6ea49e2b771a5afc9e5cbe/pa/SE81249_3b42d12fdfa3ea92047c86e02207e4f3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_55776317-a1e6-52fe-ae28-786098c328ed/55776317-a1e6-52fe-ae28-786098c328ed_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66790,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/0c/6c0cdaf1bb6ea49e2b771a5afc9e5cbe/pa/SE81249_c21aa3fff61be5e5e4569f13a50f1435.jpg',
             'Width': 800}],
 'postal_code': '30300',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Gard',
 'province_code': 'FR-30',
 'region': 'Occitanie',
 'region_code': 'FR-76',
 'registration_date': '2015-01-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Evoque 2.2 Td4 Pure',
 'transmission': 'manual',
 'trim': 'Pure',
 'year': 2015}
2026-04-27 07:55:59 [auto1.fr] INFO: Saving data for SE81249: {'created_time': 1777276559.246686, 'last_price_update_time': 1777276559.246697, 'has_photos': True, 'auction_closing_time': 1777390108.0}
2026-04-27 07:55:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/bb/62bbc7cf037431f83ae8ba3baf40753e/pa/ZM99861_7ef062408c9b63bb6a5700604b36a172.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/ba/6fbaac9b1ca3675f4d52986fa9ca20b5/pa/KV02757_07a593ceb376c5cec836ed6e49fdd28b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/63/6c63f2c43a4fccd2b416b4bd083197ce/pa/RP08022_1f1cb737b063d6f4443f8b67539f2021.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/63/6c63f2c43a4fccd2b416b4bd083197ce/pa/RP08022_ea3a8f9b50bf183bf1bbbe17fff3aa1c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ad1190>
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4827977b-3ae4-5fd4-8443-692d668c0268/4827977b-3ae4-5fd4-8443-692d668c0268_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/bb/62bbc7cf037431f83ae8ba3baf40753e/pa/ZM99861_e780936aacd920fd51e76fdb52d29f0e.jpg saved to cache
2026-04-27 07:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4827977b-3ae4-5fd4-8443-692d668c0268
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ae5b10>
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5726058e-63e1-5026-8464-654082bb2e7b/5726058e-63e1-5026-8464-654082bb2e7b_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/63/6c63f2c43a4fccd2b416b4bd083197ce/pa/RP08022_3ff8747057a2866e4f7b49a0209853e0.jpg saved to cache
2026-04-27 07:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5726058e-63e1-5026-8464-654082bb2e7b
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bf46ad0>
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a2a1808-b7d3-5e1a-a432-13d943d07411/1a2a1808-b7d3-5e1a-a432-13d943d07411_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/4c/514c9c9c2e25144d920cc8334d57b1a9/pa/CG72057_e81718506740ce1382356c9a3ed0b160.jpg saved to cache
2026-04-27 07:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1a2a1808-b7d3-5e1a-a432-13d943d07411
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143816ad50>
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05f3eff2-1ffe-503d-b1ff-e2f8a844e609/05f3eff2-1ffe-503d-b1ff-e2f8a844e609_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/ba/6fbaac9b1ca3675f4d52986fa9ca20b5/pa/KV02757_8416c277f4fa5c1d5657f80ac2cf4afa.jpg saved to cache
2026-04-27 07:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 05f3eff2-1ffe-503d-b1ff-e2f8a844e609
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a663d0>
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4827977b-3ae4-5fd4-8443-692d668c0268/4827977b-3ae4-5fd4-8443-692d668c0268_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/bb/62bbc7cf037431f83ae8ba3baf40753e/pa/ZM99861_478c1fa3798c44b2752adc850929d2e9.jpg saved to cache
2026-04-27 07:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4827977b-3ae4-5fd4-8443-692d668c0268
2026-04-27 07:55:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/ba/6fbaac9b1ca3675f4d52986fa9ca20b5/pa/KV02757_53b4d2ed571a19165d57a5ce60456391.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/4c/514c9c9c2e25144d920cc8334d57b1a9/pa/CG72057_78cee6cbf1c073da6dda3b00e5f3c0b2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/63/6c63f2c43a4fccd2b416b4bd083197ce/pa/RP08022_17c2190cdd1b7c040c69c07757abb50a.jpg not downloaded yet
2026-04-27 07:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/bb/62bbc7cf037431f83ae8ba3baf40753e/pa/ZM99861_d4d9e91c197adaa370f86715cb95122c.jpg not downloaded yet
2026-04-27 07:55:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RM94372/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bf697d0>
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5726058e-63e1-5026-8464-654082bb2e7b/5726058e-63e1-5026-8464-654082bb2e7b_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/63/6c63f2c43a4fccd2b416b4bd083197ce/pa/RP08022_193a844a343b8f420ab3edf69d807593.jpg saved to cache
2026-04-27 07:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5726058e-63e1-5026-8464-654082bb2e7b
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143812dd10>
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4827977b-3ae4-5fd4-8443-692d668c0268/4827977b-3ae4-5fd4-8443-692d668c0268_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/bb/62bbc7cf037431f83ae8ba3baf40753e/pa/ZM99861_52821840642351317bcaf9643c6b92e3.jpg saved to cache
2026-04-27 07:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4827977b-3ae4-5fd4-8443-692d668c0268
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438134190>
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05f3eff2-1ffe-503d-b1ff-e2f8a844e609/05f3eff2-1ffe-503d-b1ff-e2f8a844e609_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/ba/6fbaac9b1ca3675f4d52986fa9ca20b5/pa/KV02757_30dc47a57a9c091481985d118497417a.jpg saved to cache
2026-04-27 07:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 05f3eff2-1ffe-503d-b1ff-e2f8a844e609
2026-04-27 07:55:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/4c/514c9c9c2e25144d920cc8334d57b1a9/pa/CG72057_e3d401f06c060e5b0b272a14db26235d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/4c/514c9c9c2e25144d920cc8334d57b1a9/pa/CG72057_6e6a6cd9af550b379e584451783a0761.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/4c/514c9c9c2e25144d920cc8334d57b1a9/pa/CG72057_87263c29e347903e6412a62bf6010955.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/63/6c63f2c43a4fccd2b416b4bd083197ce/pa/RP08022_dcd152fc39f0cee23675946124c62bf0.jpg not downloaded yet
2026-04-27 07:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/bb/62bbc7cf037431f83ae8ba3baf40753e/pa/ZM99861_056d25f765fd4e35240d62268fd92d7b.jpg not downloaded yet
2026-04-27 07:55:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b74d50>
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4827977b-3ae4-5fd4-8443-692d668c0268/4827977b-3ae4-5fd4-8443-692d668c0268_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/bb/62bbc7cf037431f83ae8ba3baf40753e/pa/ZM99861_7ef062408c9b63bb6a5700604b36a172.jpg saved to cache
2026-04-27 07:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4827977b-3ae4-5fd4-8443-692d668c0268
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438045310>
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05f3eff2-1ffe-503d-b1ff-e2f8a844e609/05f3eff2-1ffe-503d-b1ff-e2f8a844e609_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/ba/6fbaac9b1ca3675f4d52986fa9ca20b5/pa/KV02757_07a593ceb376c5cec836ed6e49fdd28b.jpg saved to cache
2026-04-27 07:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 05f3eff2-1ffe-503d-b1ff-e2f8a844e609
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438189d90>
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5726058e-63e1-5026-8464-654082bb2e7b/5726058e-63e1-5026-8464-654082bb2e7b_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/63/6c63f2c43a4fccd2b416b4bd083197ce/pa/RP08022_1f1cb737b063d6f4443f8b67539f2021.jpg saved to cache
2026-04-27 07:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5726058e-63e1-5026-8464-654082bb2e7b
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438e218d0>
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5726058e-63e1-5026-8464-654082bb2e7b/5726058e-63e1-5026-8464-654082bb2e7b_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/63/6c63f2c43a4fccd2b416b4bd083197ce/pa/RP08022_ea3a8f9b50bf183bf1bbbe17fff3aa1c.jpg saved to cache
2026-04-27 07:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5726058e-63e1-5026-8464-654082bb2e7b
2026-04-27 07:55:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/87/128791546d8bf2628c4f2620c49b3e70/pa/GP77578_5643178792d264339781176e5b7d24f9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/bb/62bbc7cf037431f83ae8ba3baf40753e/pa/ZM99861_9a05fc6b9eeefe7b02b4690b36d691fd.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/ba/6fbaac9b1ca3675f4d52986fa9ca20b5/pa/KV02757_1107ca323f402c6873e981097d7bf3f0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/bb/62bbc7cf037431f83ae8ba3baf40753e/pa/ZM99861_eb657d3cfca17b1546a303e163a14dd3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/63/6c63f2c43a4fccd2b416b4bd083197ce/pa/RP08022_46ec78b9b89a4430f8ba238e5e85ab2f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/63/6c63f2c43a4fccd2b416b4bd083197ce/pa/RP08022_7ba7c7bdbff19c805c886e54bb7f52ee.jpg not downloaded yet
2026-04-27 07:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/bb/62bbc7cf037431f83ae8ba3baf40753e/pa/ZM99861_f4c124d3a25721356a3b054b88f96900.jpg not downloaded yet
2026-04-27 07:55:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438188590>
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05f3eff2-1ffe-503d-b1ff-e2f8a844e609/05f3eff2-1ffe-503d-b1ff-e2f8a844e609_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/ba/6fbaac9b1ca3675f4d52986fa9ca20b5/pa/KV02757_53b4d2ed571a19165d57a5ce60456391.jpg saved to cache
2026-04-27 07:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 05f3eff2-1ffe-503d-b1ff-e2f8a844e609
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bf56910>
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a2a1808-b7d3-5e1a-a432-13d943d07411/1a2a1808-b7d3-5e1a-a432-13d943d07411_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/4c/514c9c9c2e25144d920cc8334d57b1a9/pa/CG72057_78cee6cbf1c073da6dda3b00e5f3c0b2.jpg saved to cache
2026-04-27 07:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1a2a1808-b7d3-5e1a-a432-13d943d07411
2026-04-27 07:56:00 [scrapy.extensions.logstats] INFO: Crawled 159 pages (at 80 pages/min), scraped 94 items (at 66 items/min)
2026-04-27 07:56:00 [scrapy.extensions.memusage] INFO: Peak memory usage is 370MiB
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143819a550>
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a2a1808-b7d3-5e1a-a432-13d943d07411/1a2a1808-b7d3-5e1a-a432-13d943d07411_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/4c/514c9c9c2e25144d920cc8334d57b1a9/pa/CG72057_e3d401f06c060e5b0b272a14db26235d.jpg saved to cache
2026-04-27 07:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1a2a1808-b7d3-5e1a-a432-13d943d07411
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f144781ea50>
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a2a1808-b7d3-5e1a-a432-13d943d07411/1a2a1808-b7d3-5e1a-a432-13d943d07411_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/4c/514c9c9c2e25144d920cc8334d57b1a9/pa/CG72057_6e6a6cd9af550b379e584451783a0761.jpg saved to cache
2026-04-27 07:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1a2a1808-b7d3-5e1a-a432-13d943d07411
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ade210>
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a2a1808-b7d3-5e1a-a432-13d943d07411/1a2a1808-b7d3-5e1a-a432-13d943d07411_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/4c/514c9c9c2e25144d920cc8334d57b1a9/pa/CG72057_87263c29e347903e6412a62bf6010955.jpg saved to cache
2026-04-27 07:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1a2a1808-b7d3-5e1a-a432-13d943d07411
2026-04-27 07:56:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1a2a1808-b7d3-5e1a-a432-13d943d07411, skipping ID generation
2026-04-27 07:56:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a2a1808-b7d3-5e1a-a432-13d943d07411 with scrape type 1
2026-04-27 07:56:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1a2a1808-b7d3-5e1a-a432-13d943d07411 sending to next pipeline
2026-04-27 07:56:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 1a2a1808-b7d3-5e1a-a432-13d943d07411, identifier: CG72057
2026-04-27 07:56:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 1a2a1808-b7d3-5e1a-a432-13d943d07411 with identifier: CG72057
2026-04-27 07:56:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 1a2a1808-b7d3-5e1a-a432-13d943d07411 with identifier: CG72057
2026-04-27 07:56:00 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 1a2a1808-b7d3-5e1a-a432-13d943d07411 with identifier: CG72057 to the API
2026-04-27 07:56:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:00 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img51/4c/514c9c9c2e25144d920cc8334d57b1a9/pa/CG72057_87263c29e347903e6412a62bf6010955.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'city': 'Allennes-les-Marais',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-04-28T15:55:15Z',
 'fuel_type': 'diesel',
 'id': '1a2a1808-b7d3-5e1a-a432-13d943d07411',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 50.5375,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CG72057',
 'listing': 'auction',
 'location': 'FR, Allennes-les-Marais',
 'location_confidence': 'geocoded',
 'longitude': 2.9536,
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 140697,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1a2a1808-b7d3-5e1a-a432-13d943d07411/1a2a1808-b7d3-5e1a-a432-13d943d07411_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75920,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/4c/514c9c9c2e25144d920cc8334d57b1a9/pa/CG72057_5b9f59ecc73fbee33cf960f0b2480e9c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1a2a1808-b7d3-5e1a-a432-13d943d07411/1a2a1808-b7d3-5e1a-a432-13d943d07411_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77994,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/4c/514c9c9c2e25144d920cc8334d57b1a9/pa/CG72057_caede284b2a8b640580d43b757ccb032.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1a2a1808-b7d3-5e1a-a432-13d943d07411/1a2a1808-b7d3-5e1a-a432-13d943d07411_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65345,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/4c/514c9c9c2e25144d920cc8334d57b1a9/pa/CG72057_cf4a37d63b7059585c426e4185fcb9e9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1a2a1808-b7d3-5e1a-a432-13d943d07411/1a2a1808-b7d3-5e1a-a432-13d943d07411_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64131,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/4c/514c9c9c2e25144d920cc8334d57b1a9/pa/CG72057_1cca2de55cfbfd8eb7d8bb06ee9cb170.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1a2a1808-b7d3-5e1a-a432-13d943d07411/1a2a1808-b7d3-5e1a-a432-13d943d07411_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58218,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/4c/514c9c9c2e25144d920cc8334d57b1a9/pa/CG72057_e81718506740ce1382356c9a3ed0b160.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1a2a1808-b7d3-5e1a-a432-13d943d07411/1a2a1808-b7d3-5e1a-a432-13d943d07411_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64546,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/4c/514c9c9c2e25144d920cc8334d57b1a9/pa/CG72057_81b80511d59761b44d4b25131de28418.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1a2a1808-b7d3-5e1a-a432-13d943d07411/1a2a1808-b7d3-5e1a-a432-13d943d07411_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66876,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/4c/514c9c9c2e25144d920cc8334d57b1a9/pa/CG72057_78cee6cbf1c073da6dda3b00e5f3c0b2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1a2a1808-b7d3-5e1a-a432-13d943d07411/1a2a1808-b7d3-5e1a-a432-13d943d07411_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69859,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/4c/514c9c9c2e25144d920cc8334d57b1a9/pa/CG72057_6e6a6cd9af550b379e584451783a0761.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1a2a1808-b7d3-5e1a-a432-13d943d07411/1a2a1808-b7d3-5e1a-a432-13d943d07411_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77119,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/4c/514c9c9c2e25144d920cc8334d57b1a9/pa/CG72057_e3d401f06c060e5b0b272a14db26235d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1a2a1808-b7d3-5e1a-a432-13d943d07411/1a2a1808-b7d3-5e1a-a432-13d943d07411_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57642,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/4c/514c9c9c2e25144d920cc8334d57b1a9/pa/CG72057_87263c29e347903e6412a62bf6010955.jpg',
             'Width': 800}],
 'postal_code': '59251',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Nord',
 'province_code': 'FR-59',
 'region': 'Hauts-de-France',
 'region_code': 'FR-32',
 'registration_date': '2019-01-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen T-Roc 2.0 TDI Lounge 4Motion',
 'transmission': 'automatic',
 'trim': 'Lounge 4Motion',
 'year': 2019}
2026-04-27 07:56:00 [auto1.fr] INFO: Saving data for CG72057: {'created_time': 1777276560.79439, 'last_price_update_time': 1777276560.7944, 'has_photos': True, 'auction_closing_time': 1777391715.0}
2026-04-27 07:56:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/cd/1acd89f71810cf630e095a83740d3638/pa/YW08307_9031b0272cc525351dafb9769064d96a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/63/6c63f2c43a4fccd2b416b4bd083197ce/pa/RP08022_e1afe080fbc18e27f76877bac02b0bae.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/bb/62bbc7cf037431f83ae8ba3baf40753e/pa/ZM99861_c2c25231a20d6fd2cb5b4ccc076015fc.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/63/6c63f2c43a4fccd2b416b4bd083197ce/pa/RP08022_237a0e7eb74b3dc0b636c408de949851.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/23/1823e6af665e4b2c83169fc52a485e0c/pa/YZ83641_1f6392ebe0d33725f711aeaf653bbbb5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/63/6c63f2c43a4fccd2b416b4bd083197ce/pa/RP08022_17c2190cdd1b7c040c69c07757abb50a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438061e90>
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_595f5cf4-61d6-5815-9ba7-f52cfee67d94/595f5cf4-61d6-5815-9ba7-f52cfee67d94_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/87/128791546d8bf2628c4f2620c49b3e70/pa/GP77578_5643178792d264339781176e5b7d24f9.jpg saved to cache
2026-04-27 07:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 595f5cf4-61d6-5815-9ba7-f52cfee67d94
2026-04-27 07:56:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 595f5cf4-61d6-5815-9ba7-f52cfee67d94, skipping ID generation
2026-04-27 07:56:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 595f5cf4-61d6-5815-9ba7-f52cfee67d94 with scrape type 1
2026-04-27 07:56:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 595f5cf4-61d6-5815-9ba7-f52cfee67d94 sending to next pipeline
2026-04-27 07:56:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 595f5cf4-61d6-5815-9ba7-f52cfee67d94, identifier: GP77578
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438be9c90>
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4827977b-3ae4-5fd4-8443-692d668c0268/4827977b-3ae4-5fd4-8443-692d668c0268_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/bb/62bbc7cf037431f83ae8ba3baf40753e/pa/ZM99861_9a05fc6b9eeefe7b02b4690b36d691fd.jpg saved to cache
2026-04-27 07:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4827977b-3ae4-5fd4-8443-692d668c0268
2026-04-27 07:56:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14381df090>
2026-04-27 07:56:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05f3eff2-1ffe-503d-b1ff-e2f8a844e609/05f3eff2-1ffe-503d-b1ff-e2f8a844e609_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/ba/6fbaac9b1ca3675f4d52986fa9ca20b5/pa/KV02757_1107ca323f402c6873e981097d7bf3f0.jpg saved to cache
2026-04-27 07:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 05f3eff2-1ffe-503d-b1ff-e2f8a844e609
2026-04-27 07:56:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 05f3eff2-1ffe-503d-b1ff-e2f8a844e609, skipping ID generation
2026-04-27 07:56:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05f3eff2-1ffe-503d-b1ff-e2f8a844e609 with scrape type 1
2026-04-27 07:56:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 05f3eff2-1ffe-503d-b1ff-e2f8a844e609 sending to next pipeline
2026-04-27 07:56:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 05f3eff2-1ffe-503d-b1ff-e2f8a844e609, identifier: KV02757
2026-04-27 07:56:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d6c0d0>
2026-04-27 07:56:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4827977b-3ae4-5fd4-8443-692d668c0268/4827977b-3ae4-5fd4-8443-692d668c0268_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/bb/62bbc7cf037431f83ae8ba3baf40753e/pa/ZM99861_eb657d3cfca17b1546a303e163a14dd3.jpg saved to cache
2026-04-27 07:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4827977b-3ae4-5fd4-8443-692d668c0268
2026-04-27 07:56:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ba6ad0>
2026-04-27 07:56:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5726058e-63e1-5026-8464-654082bb2e7b/5726058e-63e1-5026-8464-654082bb2e7b_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/63/6c63f2c43a4fccd2b416b4bd083197ce/pa/RP08022_46ec78b9b89a4430f8ba238e5e85ab2f.jpg saved to cache
2026-04-27 07:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5726058e-63e1-5026-8464-654082bb2e7b
2026-04-27 07:56:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/bb/62bbc7cf037431f83ae8ba3baf40753e/pa/ZM99861_d4d9e91c197adaa370f86715cb95122c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/d7/1ad74f32bd23044aac14ab5bfad0bff3/pa/SU49210_ce9bdcdd836cd705772e32f336bbc6eb.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 595f5cf4-61d6-5815-9ba7-f52cfee67d94 with identifier: GP77578
2026-04-27 07:56:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 595f5cf4-61d6-5815-9ba7-f52cfee67d94 with identifier: GP77578
2026-04-27 07:56:01 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 595f5cf4-61d6-5815-9ba7-f52cfee67d94 with identifier: GP77578 to the API
2026-04-27 07:56:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:01 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img12/87/128791546d8bf2628c4f2620c49b3e70/pa/GP77578_5643178792d264339781176e5b7d24f9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 174,
 'category': None,
 'city': 'Allennes-les-Marais',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 325,
 'expiration_date': '2026-04-28T15:21:04Z',
 'fuel_type': 'diesel',
 'id': '595f5cf4-61d6-5815-9ba7-f52cfee67d94',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 50.5375,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GP77578',
 'listing': 'auction',
 'location': 'FR, Allennes-les-Marais',
 'location_confidence': 'geocoded',
 'longitude': 2.9536,
 'make': 'Audi',
 'model': 'SQ5',
 'odometer': 120509,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_595f5cf4-61d6-5815-9ba7-f52cfee67d94/595f5cf4-61d6-5815-9ba7-f52cfee67d94_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67530,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/87/128791546d8bf2628c4f2620c49b3e70/pa/GP77578_d6ce1c4fceb386961bcbcf40e54e7a75.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_595f5cf4-61d6-5815-9ba7-f52cfee67d94/595f5cf4-61d6-5815-9ba7-f52cfee67d94_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67163,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/87/128791546d8bf2628c4f2620c49b3e70/pa/GP77578_d2164c4ecbe7af8073b3e0a0c9915678.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_595f5cf4-61d6-5815-9ba7-f52cfee67d94/595f5cf4-61d6-5815-9ba7-f52cfee67d94_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65738,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/87/128791546d8bf2628c4f2620c49b3e70/pa/GP77578_5643178792d264339781176e5b7d24f9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_595f5cf4-61d6-5815-9ba7-f52cfee67d94/595f5cf4-61d6-5815-9ba7-f52cfee67d94_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52060,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/87/128791546d8bf2628c4f2620c49b3e70/pa/GP77578_ebb552ce8867031ccd78a80757c080a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_595f5cf4-61d6-5815-9ba7-f52cfee67d94/595f5cf4-61d6-5815-9ba7-f52cfee67d94_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58839,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/87/128791546d8bf2628c4f2620c49b3e70/pa/GP77578_b8146cf1ff7e3deec1e51bc434ccedb3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_595f5cf4-61d6-5815-9ba7-f52cfee67d94/595f5cf4-61d6-5815-9ba7-f52cfee67d94_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70382,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/87/128791546d8bf2628c4f2620c49b3e70/pa/GP77578_1baa83dcb5ea48d73bf2afcd15f03726.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_595f5cf4-61d6-5815-9ba7-f52cfee67d94/595f5cf4-61d6-5815-9ba7-f52cfee67d94_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50776,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/87/128791546d8bf2628c4f2620c49b3e70/pa/GP77578_0f5f3b68d1fe4ec8f820def2670a03bf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_595f5cf4-61d6-5815-9ba7-f52cfee67d94/595f5cf4-61d6-5815-9ba7-f52cfee67d94_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63936,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/87/128791546d8bf2628c4f2620c49b3e70/pa/GP77578_e06a465350130735558a2e1b297b96ab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_595f5cf4-61d6-5815-9ba7-f52cfee67d94/595f5cf4-61d6-5815-9ba7-f52cfee67d94_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67161,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/87/128791546d8bf2628c4f2620c49b3e70/pa/GP77578_bdb805429bbf90f4c3025c0d9dca6183.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_595f5cf4-61d6-5815-9ba7-f52cfee67d94/595f5cf4-61d6-5815-9ba7-f52cfee67d94_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67467,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/87/128791546d8bf2628c4f2620c49b3e70/pa/GP77578_6671374c78db43db24dd57404d27a7dd.jpg',
             'Width': 800}],
 'postal_code': '59251',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Nord',
 'province_code': 'FR-59',
 'region': 'Hauts-de-France',
 'region_code': 'FR-32',
 'registration_date': '2017-02-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi SQ5 3.0 V6 TDI quattro Competition',
 'transmission': 'automatic',
 'trim': 'quattro Competition',
 'year': 2017}
2026-04-27 07:56:01 [auto1.fr] INFO: Saving data for GP77578: {'created_time': 1777276561.861852, 'last_price_update_time': 1777276561.861861, 'has_photos': True, 'auction_closing_time': 1777389664.0}
2026-04-27 07:56:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 05f3eff2-1ffe-503d-b1ff-e2f8a844e609 with identifier: KV02757
2026-04-27 07:56:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 05f3eff2-1ffe-503d-b1ff-e2f8a844e609 with identifier: KV02757
2026-04-27 07:56:01 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 05f3eff2-1ffe-503d-b1ff-e2f8a844e609 with identifier: KV02757 to the API
2026-04-27 07:56:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:02 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6f/ba/6fbaac9b1ca3675f4d52986fa9ca20b5/pa/KV02757_1107ca323f402c6873e981097d7bf3f0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 88,
 'category': None,
 'city': 'Marckolsheim',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-04-28T15:54:09Z',
 'fuel_type': 'diesel',
 'id': '05f3eff2-1ffe-503d-b1ff-e2f8a844e609',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.1647,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV02757',
 'listing': 'auction',
 'location': 'FR, Marckolsheim',
 'location_confidence': 'geocoded',
 'longitude': 7.544,
 'make': 'Peugeot',
 'model': '308',
 'odometer': 243756,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_05f3eff2-1ffe-503d-b1ff-e2f8a844e609/05f3eff2-1ffe-503d-b1ff-e2f8a844e609_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62271,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/ba/6fbaac9b1ca3675f4d52986fa9ca20b5/pa/KV02757_e4605a8b5da83656995f25a3e5c7babb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_05f3eff2-1ffe-503d-b1ff-e2f8a844e609/05f3eff2-1ffe-503d-b1ff-e2f8a844e609_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64133,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/ba/6fbaac9b1ca3675f4d52986fa9ca20b5/pa/KV02757_2e1481d03913e6396d378852a99adc9b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_05f3eff2-1ffe-503d-b1ff-e2f8a844e609/05f3eff2-1ffe-503d-b1ff-e2f8a844e609_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68345,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/ba/6fbaac9b1ca3675f4d52986fa9ca20b5/pa/KV02757_b225b6fbe78174b1c96c0227d85a61a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_05f3eff2-1ffe-503d-b1ff-e2f8a844e609/05f3eff2-1ffe-503d-b1ff-e2f8a844e609_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57290,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/ba/6fbaac9b1ca3675f4d52986fa9ca20b5/pa/KV02757_df457194f2d21b450954d5c6edebd390.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_05f3eff2-1ffe-503d-b1ff-e2f8a844e609/05f3eff2-1ffe-503d-b1ff-e2f8a844e609_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53045,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/ba/6fbaac9b1ca3675f4d52986fa9ca20b5/pa/KV02757_8416c277f4fa5c1d5657f80ac2cf4afa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_05f3eff2-1ffe-503d-b1ff-e2f8a844e609/05f3eff2-1ffe-503d-b1ff-e2f8a844e609_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57970,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/ba/6fbaac9b1ca3675f4d52986fa9ca20b5/pa/KV02757_d78d7ae189319736454999efedd25900.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_05f3eff2-1ffe-503d-b1ff-e2f8a844e609/05f3eff2-1ffe-503d-b1ff-e2f8a844e609_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48202,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/ba/6fbaac9b1ca3675f4d52986fa9ca20b5/pa/KV02757_30dc47a57a9c091481985d118497417a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_05f3eff2-1ffe-503d-b1ff-e2f8a844e609/05f3eff2-1ffe-503d-b1ff-e2f8a844e609_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55003,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/ba/6fbaac9b1ca3675f4d52986fa9ca20b5/pa/KV02757_07a593ceb376c5cec836ed6e49fdd28b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_05f3eff2-1ffe-503d-b1ff-e2f8a844e609/05f3eff2-1ffe-503d-b1ff-e2f8a844e609_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60194,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/ba/6fbaac9b1ca3675f4d52986fa9ca20b5/pa/KV02757_53b4d2ed571a19165d57a5ce60456391.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_05f3eff2-1ffe-503d-b1ff-e2f8a844e609/05f3eff2-1ffe-503d-b1ff-e2f8a844e609_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48918,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/ba/6fbaac9b1ca3675f4d52986fa9ca20b5/pa/KV02757_1107ca323f402c6873e981097d7bf3f0.jpg',
             'Width': 800}],
 'postal_code': '67390',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Bas-Rhin',
 'province_code': 'FR-67',
 'region': 'Grand Est',
 'region_code': 'FR-44',
 'registration_date': '2016-03-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 308 1.6 Blue-HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2016}
2026-04-27 07:56:02 [auto1.fr] INFO: Saving data for KV02757: {'created_time': 1777276562.294133, 'last_price_update_time': 1777276562.294143, 'has_photos': True, 'auction_closing_time': 1777391649.0}
2026-04-27 07:56:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BW62863> (referer: https://www.auto1.com/v1/car-details-view/BW62863/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EC13815/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WP67872> (referer: https://www.auto1.com/v1/car-details-view/WP67872/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438bbd890>
2026-04-27 07:56:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04/c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/cd/1acd89f71810cf630e095a83740d3638/pa/YW08307_9031b0272cc525351dafb9769064d96a.jpg saved to cache
2026-04-27 07:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04
2026-04-27 07:56:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04, skipping ID generation
2026-04-27 07:56:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04 with scrape type 1
2026-04-27 07:56:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04 sending to next pipeline
2026-04-27 07:56:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04, identifier: YW08307
2026-04-27 07:56:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d79d90>
2026-04-27 07:56:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5726058e-63e1-5026-8464-654082bb2e7b/5726058e-63e1-5026-8464-654082bb2e7b_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/63/6c63f2c43a4fccd2b416b4bd083197ce/pa/RP08022_e1afe080fbc18e27f76877bac02b0bae.jpg saved to cache
2026-04-27 07:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5726058e-63e1-5026-8464-654082bb2e7b
2026-04-27 07:56:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438cbb410>
2026-04-27 07:56:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4827977b-3ae4-5fd4-8443-692d668c0268/4827977b-3ae4-5fd4-8443-692d668c0268_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/bb/62bbc7cf037431f83ae8ba3baf40753e/pa/ZM99861_c2c25231a20d6fd2cb5b4ccc076015fc.jpg saved to cache
2026-04-27 07:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4827977b-3ae4-5fd4-8443-692d668c0268
2026-04-27 07:56:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bf29490>
2026-04-27 07:56:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5726058e-63e1-5026-8464-654082bb2e7b/5726058e-63e1-5026-8464-654082bb2e7b_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/63/6c63f2c43a4fccd2b416b4bd083197ce/pa/RP08022_237a0e7eb74b3dc0b636c408de949851.jpg saved to cache
2026-04-27 07:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5726058e-63e1-5026-8464-654082bb2e7b
2026-04-27 07:56:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b41250>
2026-04-27 07:56:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_155c8fd5-d977-5582-a0bd-e0679c478b8d/155c8fd5-d977-5582-a0bd-e0679c478b8d_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/23/1823e6af665e4b2c83169fc52a485e0c/pa/YZ83641_1f6392ebe0d33725f711aeaf653bbbb5.jpg saved to cache
2026-04-27 07:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 155c8fd5-d977-5582-a0bd-e0679c478b8d
2026-04-27 07:56:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 155c8fd5-d977-5582-a0bd-e0679c478b8d, skipping ID generation
2026-04-27 07:56:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 155c8fd5-d977-5582-a0bd-e0679c478b8d with scrape type 1
2026-04-27 07:56:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 155c8fd5-d977-5582-a0bd-e0679c478b8d sending to next pipeline
2026-04-27 07:56:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 155c8fd5-d977-5582-a0bd-e0679c478b8d, identifier: YZ83641
2026-04-27 07:56:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bf6da10>
2026-04-27 07:56:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5726058e-63e1-5026-8464-654082bb2e7b/5726058e-63e1-5026-8464-654082bb2e7b_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/63/6c63f2c43a4fccd2b416b4bd083197ce/pa/RP08022_17c2190cdd1b7c040c69c07757abb50a.jpg saved to cache
2026-04-27 07:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5726058e-63e1-5026-8464-654082bb2e7b
2026-04-27 07:56:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/fb/d3fb6e092c8ae612cc276954dd3c7268/pa/TA08713_1bacf1163aa6e1a7467bb9c24fa34dda.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/fb/d3fb6e092c8ae612cc276954dd3c7268/pa/TA08713_eb672eedc7ba4d5a7aa8ec98120b0d26.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/26/1c26ea922860f7abb3c30306ae8d5a56/pa/CF81227_f79885782705818aaaa805d24af53c7d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/09/6e0972b07c3a1cbea9c95b25aa871a6b/pa/VF20612_077bf4a105858cbfc0f3091909150885.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04 with identifier: YW08307
2026-04-27 07:56:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04 with identifier: YW08307
2026-04-27 07:56:02 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04 with identifier: YW08307 to the API
2026-04-27 07:56:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:03 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1a/cd/1acd89f71810cf630e095a83740d3638/pa/YW08307_9031b0272cc525351dafb9769064d96a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'category': None,
 'city': 'Allennes-les-Marais',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-04-28T15:40:16Z',
 'fuel_type': 'diesel',
 'id': 'c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 50.5375,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YW08307',
 'listing': 'auction',
 'location': 'FR, Allennes-les-Marais',
 'location_confidence': 'geocoded',
 'longitude': 2.9536,
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 189267,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04/c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44388,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/cd/1acd89f71810cf630e095a83740d3638/pa/YW08307_f8608365da7d744b24da06789ac116dd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04/c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46696,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/cd/1acd89f71810cf630e095a83740d3638/pa/YW08307_893e34ea68c09c7e8b274c58337c2a15.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04/c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47989,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/cd/1acd89f71810cf630e095a83740d3638/pa/YW08307_b2a16445c81bc0d5f5c9bc19536984f7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04/c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34341,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/cd/1acd89f71810cf630e095a83740d3638/pa/YW08307_9031b0272cc525351dafb9769064d96a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04/c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46155,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/cd/1acd89f71810cf630e095a83740d3638/pa/YW08307_1e8c7e5f1f0053461bdafd0466526644.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04/c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46762,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/cd/1acd89f71810cf630e095a83740d3638/pa/YW08307_59f6c9f63aed7301240f88f1e6fc427d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04/c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41959,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/cd/1acd89f71810cf630e095a83740d3638/pa/YW08307_35d2d0c42b2ca05b56fd08f8964fce9a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04/c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90986,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/cd/1acd89f71810cf630e095a83740d3638/pa/YW08307_341eecffd2589a8dd46da98a1009e4d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04/c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60003,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/cd/1acd89f71810cf630e095a83740d3638/pa/YW08307_758997013546d9caca5eaf28f033020a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04/c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54796,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/cd/1acd89f71810cf630e095a83740d3638/pa/YW08307_a187da64c45a4602292843fbec4bce65.jpg',
             'Width': 800}],
 'postal_code': '59251',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Nord',
 'province_code': 'FR-59',
 'region': 'Hauts-de-France',
 'region_code': 'FR-32',
 'registration_date': '2018-01-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen Berlingo 1.6 Blue-HDi Shine',
 'transmission': 'manual',
 'trim': 'Shine',
 'year': 2018}
2026-04-27 07:56:03 [auto1.fr] INFO: Saving data for YW08307: {'created_time': 1777276563.195652, 'last_price_update_time': 1777276563.195662, 'has_photos': True, 'auction_closing_time': 1777390816.0}
2026-04-27 07:56:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 155c8fd5-d977-5582-a0bd-e0679c478b8d with identifier: YZ83641
2026-04-27 07:56:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 155c8fd5-d977-5582-a0bd-e0679c478b8d with identifier: YZ83641
2026-04-27 07:56:03 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 155c8fd5-d977-5582-a0bd-e0679c478b8d with identifier: YZ83641 to the API
2026-04-27 07:56:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:03 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img18/23/1823e6af665e4b2c83169fc52a485e0c/pa/YZ83641_1f6392ebe0d33725f711aeaf653bbbb5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'category': None,
 'city': 'Caluire et Cuire',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.5L',
 'engine_horse_power': 75,
 'expiration_date': '2026-04-28T15:20:22Z',
 'fuel_type': 'diesel',
 'id': '155c8fd5-d977-5582-a0bd-e0679c478b8d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 45.7946,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YZ83641',
 'listing': 'auction',
 'location': 'FR, Caluire et Cuire',
 'location_confidence': 'geocoded',
 'longitude': 4.8464,
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 121552,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_155c8fd5-d977-5582-a0bd-e0679c478b8d/155c8fd5-d977-5582-a0bd-e0679c478b8d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83795,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/23/1823e6af665e4b2c83169fc52a485e0c/pa/YZ83641_f73f3c8323edf468e671803a7541eeb0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_155c8fd5-d977-5582-a0bd-e0679c478b8d/155c8fd5-d977-5582-a0bd-e0679c478b8d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82837,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/23/1823e6af665e4b2c83169fc52a485e0c/pa/YZ83641_5146a1d899520f6a941682bafa21a3bd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_155c8fd5-d977-5582-a0bd-e0679c478b8d/155c8fd5-d977-5582-a0bd-e0679c478b8d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78135,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/23/1823e6af665e4b2c83169fc52a485e0c/pa/YZ83641_13813ae9eac96fcc355c845234277e0c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_155c8fd5-d977-5582-a0bd-e0679c478b8d/155c8fd5-d977-5582-a0bd-e0679c478b8d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70350,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/23/1823e6af665e4b2c83169fc52a485e0c/pa/YZ83641_1f6392ebe0d33725f711aeaf653bbbb5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_155c8fd5-d977-5582-a0bd-e0679c478b8d/155c8fd5-d977-5582-a0bd-e0679c478b8d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70971,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/23/1823e6af665e4b2c83169fc52a485e0c/pa/YZ83641_fd08ed39f793b7712f8d9bd96279617e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_155c8fd5-d977-5582-a0bd-e0679c478b8d/155c8fd5-d977-5582-a0bd-e0679c478b8d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77834,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/23/1823e6af665e4b2c83169fc52a485e0c/pa/YZ83641_5ac54e1d12942079a68b82af5b2940a5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_155c8fd5-d977-5582-a0bd-e0679c478b8d/155c8fd5-d977-5582-a0bd-e0679c478b8d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73088,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/23/1823e6af665e4b2c83169fc52a485e0c/pa/YZ83641_930eb1dae56ae5a1b37cd9b0fb2934ce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_155c8fd5-d977-5582-a0bd-e0679c478b8d/155c8fd5-d977-5582-a0bd-e0679c478b8d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2265418,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img18/23/1823e6af665e4b2c83169fc52a485e0c/pa/YZ83641_57153809236386930be32ed5ea38cb71.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_155c8fd5-d977-5582-a0bd-e0679c478b8d/155c8fd5-d977-5582-a0bd-e0679c478b8d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78472,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/23/1823e6af665e4b2c83169fc52a485e0c/pa/YZ83641_03850f3f7519ee30e041dfc1cfb1435a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_155c8fd5-d977-5582-a0bd-e0679c478b8d/155c8fd5-d977-5582-a0bd-e0679c478b8d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65583,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/23/1823e6af665e4b2c83169fc52a485e0c/pa/YZ83641_e190422c444681e9b568c5d3f2bb5320.jpg',
             'Width': 800}],
 'postal_code': '69300',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Rhône',
 'province_code': 'FR-69',
 'region': 'Auvergne-Rhône-Alpes',
 'region_code': 'FR-84',
 'registration_date': '2012-04-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Clio 1.5 dCi Expression Clim',
 'transmission': 'manual',
 'trim': 'Expression Clim',
 'year': 2012}
2026-04-27 07:56:03 [auto1.fr] INFO: Saving data for YZ83641: {'created_time': 1777276563.658602, 'last_price_update_time': 1777276563.658613, 'has_photos': True, 'auction_closing_time': 1777389622.0}
2026-04-27 07:56:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/bb/62bbc7cf037431f83ae8ba3baf40753e/pa/ZM99861_f4c124d3a25721356a3b054b88f96900.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bf7ab50>
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4827977b-3ae4-5fd4-8443-692d668c0268/4827977b-3ae4-5fd4-8443-692d668c0268_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/bb/62bbc7cf037431f83ae8ba3baf40753e/pa/ZM99861_d4d9e91c197adaa370f86715cb95122c.jpg saved to cache
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4827977b-3ae4-5fd4-8443-692d668c0268
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438dc9250>
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2232960-7d9b-5500-b9f0-f7813319ccc6/f2232960-7d9b-5500-b9f0-f7813319ccc6_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/d7/1ad74f32bd23044aac14ab5bfad0bff3/pa/SU49210_ce9bdcdd836cd705772e32f336bbc6eb.jpg saved to cache
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f2232960-7d9b-5500-b9f0-f7813319ccc6
2026-04-27 07:56:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/63/6c63f2c43a4fccd2b416b4bd083197ce/pa/RP08022_7ba7c7bdbff19c805c886e54bb7f52ee.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/63/6c63f2c43a4fccd2b416b4bd083197ce/pa/RP08022_dcd152fc39f0cee23675946124c62bf0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/bb/62bbc7cf037431f83ae8ba3baf40753e/pa/ZM99861_056d25f765fd4e35240d62268fd92d7b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JX55503> (referer: https://www.auto1.com/v1/car-details-view/JX55503/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/d7/1ad74f32bd23044aac14ab5bfad0bff3/pa/SU49210_70dcb68ff12d3fcc2a99e7a8eb451ec3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e247627-a6be-5002-b22e-a06d6c5231b8 with identifier: BW62863
2026-04-27 07:56:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e247627-a6be-5002-b22e-a06d6c5231b8 with scrape type 1
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2e247627-a6be-5002-b22e-a06d6c5231b8
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/a6/fda63dee049bdf0a09061fa121e181cb/pa/BW62863_538079cf3665a00132ccedbfdb3a0155.jpg not downloaded yet
2026-04-27 07:56:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c75a6acd-ea25-578e-aa83-a8b2c1a75356 with identifier: WP67872
2026-04-27 07:56:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c75a6acd-ea25-578e-aa83-a8b2c1a75356 with scrape type 1
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c75a6acd-ea25-578e-aa83-a8b2c1a75356
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/72/3e723e4507ba4def2358a37bd2442cb6/pa/WP67872_a7b458621a13321de304549506363574.jpg not downloaded yet
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14381ba2d0>
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0994b952-599e-52cc-89ea-c16e3404144e/0994b952-599e-52cc-89ea-c16e3404144e_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/fb/d3fb6e092c8ae612cc276954dd3c7268/pa/TA08713_1bacf1163aa6e1a7467bb9c24fa34dda.jpg saved to cache
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0994b952-599e-52cc-89ea-c16e3404144e
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438bbf190>
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0994b952-599e-52cc-89ea-c16e3404144e/0994b952-599e-52cc-89ea-c16e3404144e_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/fb/d3fb6e092c8ae612cc276954dd3c7268/pa/TA08713_eb672eedc7ba4d5a7aa8ec98120b0d26.jpg saved to cache
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0994b952-599e-52cc-89ea-c16e3404144e
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438e7fe90>
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7353ee17-53d0-5744-b24f-1f56deae3762/7353ee17-53d0-5744-b24f-1f56deae3762_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/26/1c26ea922860f7abb3c30306ae8d5a56/pa/CF81227_f79885782705818aaaa805d24af53c7d.jpg saved to cache
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7353ee17-53d0-5744-b24f-1f56deae3762
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438060510>
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61df9884-38a2-5c5b-8b45-b706541588c8/61df9884-38a2-5c5b-8b45-b706541588c8_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/09/6e0972b07c3a1cbea9c95b25aa871a6b/pa/VF20612_077bf4a105858cbfc0f3091909150885.jpg saved to cache
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 61df9884-38a2-5c5b-8b45-b706541588c8
2026-04-27 07:56:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/09/6e0972b07c3a1cbea9c95b25aa871a6b/pa/VF20612_64a924ce54bc8f1a3b8ab0b7657ecb14.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/fb/d3fb6e092c8ae612cc276954dd3c7268/pa/TA08713_3768493b07c99a16cce1f2010847c625.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/09/6e0972b07c3a1cbea9c95b25aa871a6b/pa/VF20612_a133f9169d1184cac79054bb98fb0a80.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/26/1c26ea922860f7abb3c30306ae8d5a56/pa/CF81227_a4ae5805279537325aacfd6585950a51.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/a6/fda63dee049bdf0a09061fa121e181cb/pa/BW62863_2cc035657b16b2db12bd81ef27232dfb.jpg not downloaded yet
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/72/3e723e4507ba4def2358a37bd2442cb6/pa/WP67872_79726e85f21eef4fca8558e2127bdccc.jpg not downloaded yet
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438e56d90>
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4827977b-3ae4-5fd4-8443-692d668c0268/4827977b-3ae4-5fd4-8443-692d668c0268_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/bb/62bbc7cf037431f83ae8ba3baf40753e/pa/ZM99861_f4c124d3a25721356a3b054b88f96900.jpg saved to cache
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4827977b-3ae4-5fd4-8443-692d668c0268
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a69690>
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5726058e-63e1-5026-8464-654082bb2e7b/5726058e-63e1-5026-8464-654082bb2e7b_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/63/6c63f2c43a4fccd2b416b4bd083197ce/pa/RP08022_7ba7c7bdbff19c805c886e54bb7f52ee.jpg saved to cache
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5726058e-63e1-5026-8464-654082bb2e7b
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a78410>
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5726058e-63e1-5026-8464-654082bb2e7b/5726058e-63e1-5026-8464-654082bb2e7b_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/63/6c63f2c43a4fccd2b416b4bd083197ce/pa/RP08022_dcd152fc39f0cee23675946124c62bf0.jpg saved to cache
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5726058e-63e1-5026-8464-654082bb2e7b
2026-04-27 07:56:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5726058e-63e1-5026-8464-654082bb2e7b, skipping ID generation
2026-04-27 07:56:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5726058e-63e1-5026-8464-654082bb2e7b with scrape type 1
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5726058e-63e1-5026-8464-654082bb2e7b sending to next pipeline
2026-04-27 07:56:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5726058e-63e1-5026-8464-654082bb2e7b, identifier: RP08022
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bf78e50>
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4827977b-3ae4-5fd4-8443-692d668c0268/4827977b-3ae4-5fd4-8443-692d668c0268_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/bb/62bbc7cf037431f83ae8ba3baf40753e/pa/ZM99861_056d25f765fd4e35240d62268fd92d7b.jpg saved to cache
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4827977b-3ae4-5fd4-8443-692d668c0268
2026-04-27 07:56:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4827977b-3ae4-5fd4-8443-692d668c0268, skipping ID generation
2026-04-27 07:56:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4827977b-3ae4-5fd4-8443-692d668c0268 with scrape type 1
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4827977b-3ae4-5fd4-8443-692d668c0268 sending to next pipeline
2026-04-27 07:56:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4827977b-3ae4-5fd4-8443-692d668c0268, identifier: ZM99861
2026-04-27 07:56:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b18616e2-001e-5485-951a-15f3b272e393 with identifier: JX55503
2026-04-27 07:56:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b18616e2-001e-5485-951a-15f3b272e393 with scrape type 1
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item b18616e2-001e-5485-951a-15f3b272e393
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/97/e197de11cd668d9c9eb18ec02674e5f4/pa/JX55503_3cb44558415ec6d2c2b012ecea095523.jpg not downloaded yet
2026-04-27 07:56:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/fb/d3fb6e092c8ae612cc276954dd3c7268/pa/TA08713_4e866879836f367981f611131136796c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/26/1c26ea922860f7abb3c30306ae8d5a56/pa/CF81227_d20d1ddb491632cf5019cafc20494aa1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/09/6e0972b07c3a1cbea9c95b25aa871a6b/pa/VF20612_0cfe051a2b4b45dd409b1637c3b59b47.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5726058e-63e1-5026-8464-654082bb2e7b with identifier: RP08022
2026-04-27 07:56:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5726058e-63e1-5026-8464-654082bb2e7b with identifier: RP08022
2026-04-27 07:56:05 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 5726058e-63e1-5026-8464-654082bb2e7b with identifier: RP08022 to the API
2026-04-27 07:56:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:05 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6c/63/6c63f2c43a4fccd2b416b4bd083197ce/pa/RP08022_dcd152fc39f0cee23675946124c62bf0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'city': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.0L',
 'engine_horse_power': 68,
 'expiration_date': '2026-04-28T15:15:35Z',
 'fuel_type': 'petrol',
 'id': '5726058e-63e1-5026-8464-654082bb2e7b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RP08022',
 'listing': 'auction',
 'location': 'FR',
 'location_confidence': None,
 'longitude': None,
 'make': 'Chevrolet',
 'model': 'Spark',
 'odometer': 122846,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5726058e-63e1-5026-8464-654082bb2e7b/5726058e-63e1-5026-8464-654082bb2e7b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56700,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/63/6c63f2c43a4fccd2b416b4bd083197ce/pa/RP08022_3ff8747057a2866e4f7b49a0209853e0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5726058e-63e1-5026-8464-654082bb2e7b/5726058e-63e1-5026-8464-654082bb2e7b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57309,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/63/6c63f2c43a4fccd2b416b4bd083197ce/pa/RP08022_1f1cb737b063d6f4443f8b67539f2021.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5726058e-63e1-5026-8464-654082bb2e7b/5726058e-63e1-5026-8464-654082bb2e7b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57923,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/63/6c63f2c43a4fccd2b416b4bd083197ce/pa/RP08022_193a844a343b8f420ab3edf69d807593.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5726058e-63e1-5026-8464-654082bb2e7b/5726058e-63e1-5026-8464-654082bb2e7b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52893,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/63/6c63f2c43a4fccd2b416b4bd083197ce/pa/RP08022_ea3a8f9b50bf183bf1bbbe17fff3aa1c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5726058e-63e1-5026-8464-654082bb2e7b/5726058e-63e1-5026-8464-654082bb2e7b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58713,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/63/6c63f2c43a4fccd2b416b4bd083197ce/pa/RP08022_46ec78b9b89a4430f8ba238e5e85ab2f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5726058e-63e1-5026-8464-654082bb2e7b/5726058e-63e1-5026-8464-654082bb2e7b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56822,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/63/6c63f2c43a4fccd2b416b4bd083197ce/pa/RP08022_e1afe080fbc18e27f76877bac02b0bae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5726058e-63e1-5026-8464-654082bb2e7b/5726058e-63e1-5026-8464-654082bb2e7b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56520,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/63/6c63f2c43a4fccd2b416b4bd083197ce/pa/RP08022_237a0e7eb74b3dc0b636c408de949851.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5726058e-63e1-5026-8464-654082bb2e7b/5726058e-63e1-5026-8464-654082bb2e7b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 123172,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/63/6c63f2c43a4fccd2b416b4bd083197ce/pa/RP08022_17c2190cdd1b7c040c69c07757abb50a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5726058e-63e1-5026-8464-654082bb2e7b/5726058e-63e1-5026-8464-654082bb2e7b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95533,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/63/6c63f2c43a4fccd2b416b4bd083197ce/pa/RP08022_dcd152fc39f0cee23675946124c62bf0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5726058e-63e1-5026-8464-654082bb2e7b/5726058e-63e1-5026-8464-654082bb2e7b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82126,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/63/6c63f2c43a4fccd2b416b4bd083197ce/pa/RP08022_7ba7c7bdbff19c805c886e54bb7f52ee.jpg',
             'Width': 800}],
 'postal_code': None,
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2011-02-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Chevrolet Spark 1.0 Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2011}
2026-04-27 07:56:05 [auto1.fr] INFO: Saving data for RP08022: {'created_time': 1777276565.308091, 'last_price_update_time': 1777276565.308102, 'has_photos': True, 'auction_closing_time': 1777389335.0}
2026-04-27 07:56:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4827977b-3ae4-5fd4-8443-692d668c0268 with identifier: ZM99861
2026-04-27 07:56:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4827977b-3ae4-5fd4-8443-692d668c0268 with identifier: ZM99861
2026-04-27 07:56:05 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 4827977b-3ae4-5fd4-8443-692d668c0268 with identifier: ZM99861 to the API
2026-04-27 07:56:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:05 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img62/bb/62bbc7cf037431f83ae8ba3baf40753e/pa/ZM99861_056d25f765fd4e35240d62268fd92d7b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 175,
 'category': None,
 'city': 'Loyettes',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2026-04-28T15:28:00Z',
 'fuel_type': 'diesel',
 'id': '4827977b-3ae4-5fd4-8443-692d668c0268',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'latitude': 45.7766,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZM99861',
 'listing': 'auction',
 'location': 'FR, Loyettes',
 'location_confidence': 'geocoded',
 'longitude': 5.2069,
 'make': 'Peugeot',
 'model': 'Expert',
 'odometer': 94652,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4827977b-3ae4-5fd4-8443-692d668c0268/4827977b-3ae4-5fd4-8443-692d668c0268_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44528,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/bb/62bbc7cf037431f83ae8ba3baf40753e/pa/ZM99861_e780936aacd920fd51e76fdb52d29f0e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4827977b-3ae4-5fd4-8443-692d668c0268/4827977b-3ae4-5fd4-8443-692d668c0268_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44487,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/bb/62bbc7cf037431f83ae8ba3baf40753e/pa/ZM99861_478c1fa3798c44b2752adc850929d2e9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4827977b-3ae4-5fd4-8443-692d668c0268/4827977b-3ae4-5fd4-8443-692d668c0268_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36581,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/bb/62bbc7cf037431f83ae8ba3baf40753e/pa/ZM99861_52821840642351317bcaf9643c6b92e3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4827977b-3ae4-5fd4-8443-692d668c0268/4827977b-3ae4-5fd4-8443-692d668c0268_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35979,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/bb/62bbc7cf037431f83ae8ba3baf40753e/pa/ZM99861_7ef062408c9b63bb6a5700604b36a172.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4827977b-3ae4-5fd4-8443-692d668c0268/4827977b-3ae4-5fd4-8443-692d668c0268_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42178,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/bb/62bbc7cf037431f83ae8ba3baf40753e/pa/ZM99861_9a05fc6b9eeefe7b02b4690b36d691fd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4827977b-3ae4-5fd4-8443-692d668c0268/4827977b-3ae4-5fd4-8443-692d668c0268_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45974,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/bb/62bbc7cf037431f83ae8ba3baf40753e/pa/ZM99861_eb657d3cfca17b1546a303e163a14dd3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4827977b-3ae4-5fd4-8443-692d668c0268/4827977b-3ae4-5fd4-8443-692d668c0268_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45781,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/bb/62bbc7cf037431f83ae8ba3baf40753e/pa/ZM99861_c2c25231a20d6fd2cb5b4ccc076015fc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4827977b-3ae4-5fd4-8443-692d668c0268/4827977b-3ae4-5fd4-8443-692d668c0268_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76732,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/bb/62bbc7cf037431f83ae8ba3baf40753e/pa/ZM99861_d4d9e91c197adaa370f86715cb95122c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4827977b-3ae4-5fd4-8443-692d668c0268/4827977b-3ae4-5fd4-8443-692d668c0268_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85313,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/bb/62bbc7cf037431f83ae8ba3baf40753e/pa/ZM99861_056d25f765fd4e35240d62268fd92d7b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4827977b-3ae4-5fd4-8443-692d668c0268/4827977b-3ae4-5fd4-8443-692d668c0268_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64721,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/bb/62bbc7cf037431f83ae8ba3baf40753e/pa/ZM99861_f4c124d3a25721356a3b054b88f96900.jpg',
             'Width': 800}],
 'postal_code': '01360',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Ain',
 'province_code': 'FR-01',
 'region': 'Auvergne-Rhône-Alpes',
 'region_code': 'FR-84',
 'registration_date': '2021-03-30',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Peugeot Expert 1.5 Blue-HDi Premium L1',
 'transmission': 'manual',
 'trim': 'Premium L1',
 'year': 2021}
2026-04-27 07:56:05 [auto1.fr] INFO: Saving data for ZM99861: {'created_time': 1777276565.690382, 'last_price_update_time': 1777276565.690392, 'has_photos': True, 'auction_closing_time': 1777390080.0}
2026-04-27 07:56:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a9e110>
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2232960-7d9b-5500-b9f0-f7813319ccc6/f2232960-7d9b-5500-b9f0-f7813319ccc6_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/d7/1ad74f32bd23044aac14ab5bfad0bff3/pa/SU49210_70dcb68ff12d3fcc2a99e7a8eb451ec3.jpg saved to cache
2026-04-27 07:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f2232960-7d9b-5500-b9f0-f7813319ccc6
2026-04-27 07:56:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f2232960-7d9b-5500-b9f0-f7813319ccc6, skipping ID generation
2026-04-27 07:56:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2232960-7d9b-5500-b9f0-f7813319ccc6 with scrape type 1
2026-04-27 07:56:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f2232960-7d9b-5500-b9f0-f7813319ccc6 sending to next pipeline
2026-04-27 07:56:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f2232960-7d9b-5500-b9f0-f7813319ccc6, identifier: SU49210
2026-04-27 07:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/a6/fda63dee049bdf0a09061fa121e181cb/pa/BW62863_f93772a53652c72b96d7c012e6a9ca03.jpg not downloaded yet
2026-04-27 07:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/72/3e723e4507ba4def2358a37bd2442cb6/pa/WP67872_e826305a8f1958d1fe69142b6f79eb34.jpg not downloaded yet
2026-04-27 07:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/97/e197de11cd668d9c9eb18ec02674e5f4/pa/JX55503_687f05517d1287d1d72d16ef4bf6f8ac.jpg not downloaded yet
2026-04-27 07:56:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f2232960-7d9b-5500-b9f0-f7813319ccc6 with identifier: SU49210
2026-04-27 07:56:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f2232960-7d9b-5500-b9f0-f7813319ccc6 with identifier: SU49210
2026-04-27 07:56:06 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f2232960-7d9b-5500-b9f0-f7813319ccc6 with identifier: SU49210 to the API
2026-04-27 07:56:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:06 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1a/d7/1ad74f32bd23044aac14ab5bfad0bff3/pa/SU49210_70dcb68ff12d3fcc2a99e7a8eb451ec3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'category': None,
 'city': 'Beaucaire',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 90,
 'expiration_date': '2026-04-28T15:11:00Z',
 'fuel_type': 'diesel',
 'id': 'f2232960-7d9b-5500-b9f0-f7813319ccc6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 43.8081,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SU49210',
 'listing': 'auction',
 'location': 'FR, Beaucaire',
 'location_confidence': 'geocoded',
 'longitude': 4.6442,
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 216741,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f2232960-7d9b-5500-b9f0-f7813319ccc6/f2232960-7d9b-5500-b9f0-f7813319ccc6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69049,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/d7/1ad74f32bd23044aac14ab5bfad0bff3/pa/SU49210_cec391c0a91888798bf0d48bcbb7acf3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f2232960-7d9b-5500-b9f0-f7813319ccc6/f2232960-7d9b-5500-b9f0-f7813319ccc6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60883,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/d7/1ad74f32bd23044aac14ab5bfad0bff3/pa/SU49210_bacd0a54a4825074c5b5337f0e314b82.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f2232960-7d9b-5500-b9f0-f7813319ccc6/f2232960-7d9b-5500-b9f0-f7813319ccc6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59455,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/d7/1ad74f32bd23044aac14ab5bfad0bff3/pa/SU49210_70dcb68ff12d3fcc2a99e7a8eb451ec3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f2232960-7d9b-5500-b9f0-f7813319ccc6/f2232960-7d9b-5500-b9f0-f7813319ccc6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71029,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/d7/1ad74f32bd23044aac14ab5bfad0bff3/pa/SU49210_82d2e42894b3890af71784aba9a6c954.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f2232960-7d9b-5500-b9f0-f7813319ccc6/f2232960-7d9b-5500-b9f0-f7813319ccc6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81043,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/d7/1ad74f32bd23044aac14ab5bfad0bff3/pa/SU49210_ce9bdcdd836cd705772e32f336bbc6eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f2232960-7d9b-5500-b9f0-f7813319ccc6/f2232960-7d9b-5500-b9f0-f7813319ccc6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38338,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/d7/1ad74f32bd23044aac14ab5bfad0bff3/pa/SU49210_89f15b21990c655fb6681aabb00a1d86.jpg',
             'Width': 800}],
 'postal_code': '30300',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Gard',
 'province_code': 'FR-30',
 'region': 'Occitanie',
 'region_code': 'FR-76',
 'registration_date': '2011-04-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Yaris 1.4 D-4D Confort Pack',
 'transmission': 'manual',
 'trim': 'Confort Pack',
 'year': 2011}
2026-04-27 07:56:06 [auto1.fr] INFO: Saving data for SU49210: {'created_time': 1777276566.265005, 'last_price_update_time': 1777276566.265015, 'has_photos': True, 'auction_closing_time': 1777389060.0}
2026-04-27 07:56:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/09/6e0972b07c3a1cbea9c95b25aa871a6b/pa/VF20612_6a894a50ec2d835692bd67d6dd5a1522.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/09/6e0972b07c3a1cbea9c95b25aa871a6b/pa/VF20612_70921968110d18fe31bcb48aed932d31.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/fb/d3fb6e092c8ae612cc276954dd3c7268/pa/TA08713_db99c99ac4ead898c7d63d004c35a491.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/26/1c26ea922860f7abb3c30306ae8d5a56/pa/CF81227_91404bdbe102b735b7398d0563bb9a13.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RM94372> (referer: https://www.auto1.com/v1/car-details-view/RM94372/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d36b10>
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61df9884-38a2-5c5b-8b45-b706541588c8/61df9884-38a2-5c5b-8b45-b706541588c8_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/09/6e0972b07c3a1cbea9c95b25aa871a6b/pa/VF20612_64a924ce54bc8f1a3b8ab0b7657ecb14.jpg saved to cache
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 61df9884-38a2-5c5b-8b45-b706541588c8
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438098150>
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0994b952-599e-52cc-89ea-c16e3404144e/0994b952-599e-52cc-89ea-c16e3404144e_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/fb/d3fb6e092c8ae612cc276954dd3c7268/pa/TA08713_3768493b07c99a16cce1f2010847c625.jpg saved to cache
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0994b952-599e-52cc-89ea-c16e3404144e
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143809c690>
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61df9884-38a2-5c5b-8b45-b706541588c8/61df9884-38a2-5c5b-8b45-b706541588c8_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/09/6e0972b07c3a1cbea9c95b25aa871a6b/pa/VF20612_a133f9169d1184cac79054bb98fb0a80.jpg saved to cache
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 61df9884-38a2-5c5b-8b45-b706541588c8
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143809a810>
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7353ee17-53d0-5744-b24f-1f56deae3762/7353ee17-53d0-5744-b24f-1f56deae3762_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/26/1c26ea922860f7abb3c30306ae8d5a56/pa/CF81227_a4ae5805279537325aacfd6585950a51.jpg saved to cache
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7353ee17-53d0-5744-b24f-1f56deae3762
2026-04-27 07:56:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/49/f8491f5cdebd17c919e5884d83616b41/pa/NH82777_d9a4754f062e686dac415602eb06252a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/a6/fda63dee049bdf0a09061fa121e181cb/pa/BW62863_c3f3d7e42d9014ba16e0c742732e4994.jpg not downloaded yet
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/72/3e723e4507ba4def2358a37bd2442cb6/pa/WP67872_3c949c7f8514762eb757fa14a4a3ea91.jpg not downloaded yet
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/97/e197de11cd668d9c9eb18ec02674e5f4/pa/JX55503_30b31baf28d9f1209e986bdee89eb898.jpg not downloaded yet
2026-04-27 07:56:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d92150>
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0994b952-599e-52cc-89ea-c16e3404144e/0994b952-599e-52cc-89ea-c16e3404144e_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/fb/d3fb6e092c8ae612cc276954dd3c7268/pa/TA08713_4e866879836f367981f611131136796c.jpg saved to cache
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0994b952-599e-52cc-89ea-c16e3404144e
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ccb610>
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7353ee17-53d0-5744-b24f-1f56deae3762/7353ee17-53d0-5744-b24f-1f56deae3762_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/26/1c26ea922860f7abb3c30306ae8d5a56/pa/CF81227_d20d1ddb491632cf5019cafc20494aa1.jpg saved to cache
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7353ee17-53d0-5744-b24f-1f56deae3762
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d32e90>
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61df9884-38a2-5c5b-8b45-b706541588c8/61df9884-38a2-5c5b-8b45-b706541588c8_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/09/6e0972b07c3a1cbea9c95b25aa871a6b/pa/VF20612_0cfe051a2b4b45dd409b1637c3b59b47.jpg saved to cache
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 61df9884-38a2-5c5b-8b45-b706541588c8
2026-04-27 07:56:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/72/3e723e4507ba4def2358a37bd2442cb6/pa/WP67872_a7b458621a13321de304549506363574.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/49/f8491f5cdebd17c919e5884d83616b41/pa/NH82777_6ab3d6873ec4aa42319e5784917c55e0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/a6/fda63dee049bdf0a09061fa121e181cb/pa/BW62863_538079cf3665a00132ccedbfdb3a0155.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/a6/fda63dee049bdf0a09061fa121e181cb/pa/BW62863_5f8e648e60ce2898c0657ebc730fdc0d.jpg not downloaded yet
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/72/3e723e4507ba4def2358a37bd2442cb6/pa/WP67872_d3efc089fc58cd1bbb83289039d427b0.jpg not downloaded yet
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/97/e197de11cd668d9c9eb18ec02674e5f4/pa/JX55503_b6cd87478a5363fd460087c728cf4c3e.jpg not downloaded yet
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a35dd0>
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61df9884-38a2-5c5b-8b45-b706541588c8/61df9884-38a2-5c5b-8b45-b706541588c8_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/09/6e0972b07c3a1cbea9c95b25aa871a6b/pa/VF20612_6a894a50ec2d835692bd67d6dd5a1522.jpg saved to cache
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 61df9884-38a2-5c5b-8b45-b706541588c8
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143811aa10>
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61df9884-38a2-5c5b-8b45-b706541588c8/61df9884-38a2-5c5b-8b45-b706541588c8_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/09/6e0972b07c3a1cbea9c95b25aa871a6b/pa/VF20612_70921968110d18fe31bcb48aed932d31.jpg saved to cache
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 61df9884-38a2-5c5b-8b45-b706541588c8
2026-04-27 07:56:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 61df9884-38a2-5c5b-8b45-b706541588c8, skipping ID generation
2026-04-27 07:56:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61df9884-38a2-5c5b-8b45-b706541588c8 with scrape type 1
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 61df9884-38a2-5c5b-8b45-b706541588c8 sending to next pipeline
2026-04-27 07:56:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 61df9884-38a2-5c5b-8b45-b706541588c8, identifier: VF20612
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c6ba50>
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0994b952-599e-52cc-89ea-c16e3404144e/0994b952-599e-52cc-89ea-c16e3404144e_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/fb/d3fb6e092c8ae612cc276954dd3c7268/pa/TA08713_db99c99ac4ead898c7d63d004c35a491.jpg saved to cache
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0994b952-599e-52cc-89ea-c16e3404144e
2026-04-27 07:56:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0994b952-599e-52cc-89ea-c16e3404144e, skipping ID generation
2026-04-27 07:56:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0994b952-599e-52cc-89ea-c16e3404144e with scrape type 1
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0994b952-599e-52cc-89ea-c16e3404144e sending to next pipeline
2026-04-27 07:56:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0994b952-599e-52cc-89ea-c16e3404144e, identifier: TA08713
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143809a3d0>
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7353ee17-53d0-5744-b24f-1f56deae3762/7353ee17-53d0-5744-b24f-1f56deae3762_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/26/1c26ea922860f7abb3c30306ae8d5a56/pa/CF81227_91404bdbe102b735b7398d0563bb9a13.jpg saved to cache
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7353ee17-53d0-5744-b24f-1f56deae3762
2026-04-27 07:56:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7353ee17-53d0-5744-b24f-1f56deae3762, skipping ID generation
2026-04-27 07:56:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7353ee17-53d0-5744-b24f-1f56deae3762 with scrape type 1
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7353ee17-53d0-5744-b24f-1f56deae3762 sending to next pipeline
2026-04-27 07:56:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7353ee17-53d0-5744-b24f-1f56deae3762, identifier: CF81227
2026-04-27 07:56:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 230e089d-130f-55f8-a503-037cdc6cf934 with identifier: RM94372
2026-04-27 07:56:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 230e089d-130f-55f8-a503-037cdc6cf934 with scrape type 1
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 230e089d-130f-55f8-a503-037cdc6cf934
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/05/bb05cf011c53a14d404bf668cd6c2ac3/pa/RM94372_5cd09f593d77f9213897152c0f37b32b.jpg not downloaded yet
2026-04-27 07:56:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 61df9884-38a2-5c5b-8b45-b706541588c8 with identifier: VF20612
2026-04-27 07:56:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 61df9884-38a2-5c5b-8b45-b706541588c8 with identifier: VF20612
2026-04-27 07:56:07 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 61df9884-38a2-5c5b-8b45-b706541588c8 with identifier: VF20612 to the API
2026-04-27 07:56:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:07 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6e/09/6e0972b07c3a1cbea9c95b25aa871a6b/pa/VF20612_70921968110d18fe31bcb48aed932d31.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 177,
 'category': None,
 'city': 'Houécourt',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.1L',
 'engine_horse_power': 190,
 'expiration_date': '2026-04-28T15:47:19Z',
 'fuel_type': 'diesel',
 'id': '61df9884-38a2-5c5b-8b45-b706541588c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.2985,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VF20612',
 'listing': 'auction',
 'location': 'FR, Houecourt',
 'location_confidence': 'geocoded',
 'longitude': 5.8931,
 'make': 'Mercedes-Benz',
 'model': 'V-Klasse',
 'odometer': 350703,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_61df9884-38a2-5c5b-8b45-b706541588c8/61df9884-38a2-5c5b-8b45-b706541588c8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93704,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/09/6e0972b07c3a1cbea9c95b25aa871a6b/pa/VF20612_0089ae023651bb2c546824ff4b3ce670.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_61df9884-38a2-5c5b-8b45-b706541588c8/61df9884-38a2-5c5b-8b45-b706541588c8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96314,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/09/6e0972b07c3a1cbea9c95b25aa871a6b/pa/VF20612_5833ede1bf298417fff0b29d984f237e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_61df9884-38a2-5c5b-8b45-b706541588c8/61df9884-38a2-5c5b-8b45-b706541588c8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96066,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/09/6e0972b07c3a1cbea9c95b25aa871a6b/pa/VF20612_70921968110d18fe31bcb48aed932d31.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_61df9884-38a2-5c5b-8b45-b706541588c8/61df9884-38a2-5c5b-8b45-b706541588c8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82214,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/09/6e0972b07c3a1cbea9c95b25aa871a6b/pa/VF20612_6a894a50ec2d835692bd67d6dd5a1522.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_61df9884-38a2-5c5b-8b45-b706541588c8/61df9884-38a2-5c5b-8b45-b706541588c8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89991,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/09/6e0972b07c3a1cbea9c95b25aa871a6b/pa/VF20612_0cfe051a2b4b45dd409b1637c3b59b47.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_61df9884-38a2-5c5b-8b45-b706541588c8/61df9884-38a2-5c5b-8b45-b706541588c8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81095,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/09/6e0972b07c3a1cbea9c95b25aa871a6b/pa/VF20612_73eb11d15ac3124e61fb76489dc58481.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_61df9884-38a2-5c5b-8b45-b706541588c8/61df9884-38a2-5c5b-8b45-b706541588c8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77240,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/09/6e0972b07c3a1cbea9c95b25aa871a6b/pa/VF20612_a133f9169d1184cac79054bb98fb0a80.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_61df9884-38a2-5c5b-8b45-b706541588c8/61df9884-38a2-5c5b-8b45-b706541588c8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97227,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/09/6e0972b07c3a1cbea9c95b25aa871a6b/pa/VF20612_64a924ce54bc8f1a3b8ab0b7657ecb14.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_61df9884-38a2-5c5b-8b45-b706541588c8/61df9884-38a2-5c5b-8b45-b706541588c8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96159,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/09/6e0972b07c3a1cbea9c95b25aa871a6b/pa/VF20612_077bf4a105858cbfc0f3091909150885.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_61df9884-38a2-5c5b-8b45-b706541588c8/61df9884-38a2-5c5b-8b45-b706541588c8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97409,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/09/6e0972b07c3a1cbea9c95b25aa871a6b/pa/VF20612_cc24eb2c18e9e1c77036d3e13ad1dec3.jpg',
             'Width': 800}],
 'postal_code': '88170',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Vosges',
 'province_code': 'FR-88',
 'region': 'Grand Est',
 'region_code': 'FR-44',
 'registration_date': '2016-07-20',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Mercedes-Benz V-Klasse V 250 d lang 4Matic Exclusive',
 'transmission': 'automatic',
 'trim': 'lang 4Matic Exclusive',
 'year': 2016}
2026-04-27 07:56:07 [auto1.fr] INFO: Saving data for VF20612: {'created_time': 1777276567.649859, 'last_price_update_time': 1777276567.64987, 'has_photos': True, 'auction_closing_time': 1777391239.0}
2026-04-27 07:56:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0994b952-599e-52cc-89ea-c16e3404144e with identifier: TA08713
2026-04-27 07:56:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0994b952-599e-52cc-89ea-c16e3404144e with identifier: TA08713
2026-04-27 07:56:07 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 0994b952-599e-52cc-89ea-c16e3404144e with identifier: TA08713 to the API
2026-04-27 07:56:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:07 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd3/fb/d3fb6e092c8ae612cc276954dd3c7268/pa/TA08713_db99c99ac4ead898c7d63d004c35a491.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 92,
 'category': None,
 'city': 'Pornichet',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-04-28T15:50:36Z',
 'fuel_type': 'diesel',
 'id': '0994b952-599e-52cc-89ea-c16e3404144e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 47.2668,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TA08713',
 'listing': 'auction',
 'location': 'Pornichet',
 'location_confidence': 'geocoded',
 'longitude': -2.3379,
 'make': 'Peugeot',
 'model': '308',
 'odometer': 185211,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0994b952-599e-52cc-89ea-c16e3404144e/0994b952-599e-52cc-89ea-c16e3404144e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87248,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/fb/d3fb6e092c8ae612cc276954dd3c7268/pa/TA08713_167cfa50def38dcdee4c91e8e320caa7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0994b952-599e-52cc-89ea-c16e3404144e/0994b952-599e-52cc-89ea-c16e3404144e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83201,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/fb/d3fb6e092c8ae612cc276954dd3c7268/pa/TA08713_f5aad987534d957191f985b5de340584.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0994b952-599e-52cc-89ea-c16e3404144e/0994b952-599e-52cc-89ea-c16e3404144e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78879,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/fb/d3fb6e092c8ae612cc276954dd3c7268/pa/TA08713_db99c99ac4ead898c7d63d004c35a491.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0994b952-599e-52cc-89ea-c16e3404144e/0994b952-599e-52cc-89ea-c16e3404144e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71673,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/fb/d3fb6e092c8ae612cc276954dd3c7268/pa/TA08713_24c7136a47edc44ec21dc0219072171a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0994b952-599e-52cc-89ea-c16e3404144e/0994b952-599e-52cc-89ea-c16e3404144e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66295,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/fb/d3fb6e092c8ae612cc276954dd3c7268/pa/TA08713_4e866879836f367981f611131136796c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0994b952-599e-52cc-89ea-c16e3404144e/0994b952-599e-52cc-89ea-c16e3404144e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86607,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/fb/d3fb6e092c8ae612cc276954dd3c7268/pa/TA08713_f1b816b81372cdfe0b98552cb3bcc95f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0994b952-599e-52cc-89ea-c16e3404144e/0994b952-599e-52cc-89ea-c16e3404144e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65748,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/fb/d3fb6e092c8ae612cc276954dd3c7268/pa/TA08713_3768493b07c99a16cce1f2010847c625.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0994b952-599e-52cc-89ea-c16e3404144e/0994b952-599e-52cc-89ea-c16e3404144e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83373,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/fb/d3fb6e092c8ae612cc276954dd3c7268/pa/TA08713_eb672eedc7ba4d5a7aa8ec98120b0d26.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0994b952-599e-52cc-89ea-c16e3404144e/0994b952-599e-52cc-89ea-c16e3404144e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70155,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/fb/d3fb6e092c8ae612cc276954dd3c7268/pa/TA08713_1bacf1163aa6e1a7467bb9c24fa34dda.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0994b952-599e-52cc-89ea-c16e3404144e/0994b952-599e-52cc-89ea-c16e3404144e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71373,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/fb/d3fb6e092c8ae612cc276954dd3c7268/pa/TA08713_0393c211352aa0dc7b79ae5615668e12.jpg',
             'Width': 800}],
 'postal_code': '44380',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Loire-Atlantique',
 'province_code': 'FR-44',
 'region': 'Pays de la Loire',
 'region_code': 'FR-52',
 'registration_date': '2019-04-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 308 1.5 Blue-HDi Active Business',
 'transmission': 'manual',
 'trim': 'Active Business',
 'year': 2019}
2026-04-27 07:56:08 [auto1.fr] INFO: Saving data for TA08713: {'created_time': 1777276568.013485, 'last_price_update_time': 1777276568.013495, 'has_photos': True, 'auction_closing_time': 1777391436.0}
2026-04-27 07:56:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7353ee17-53d0-5744-b24f-1f56deae3762 with identifier: CF81227
2026-04-27 07:56:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7353ee17-53d0-5744-b24f-1f56deae3762 with identifier: CF81227
2026-04-27 07:56:08 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 7353ee17-53d0-5744-b24f-1f56deae3762 with identifier: CF81227 to the API
2026-04-27 07:56:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:08 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1c/26/1c26ea922860f7abb3c30306ae8d5a56/pa/CF81227_91404bdbe102b735b7398d0563bb9a13.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'category': None,
 'city': 'Vezin-le-Coquet',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2026-04-28T15:44:21Z',
 'fuel_type': 'diesel',
 'id': '7353ee17-53d0-5744-b24f-1f56deae3762',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.119,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CF81227',
 'listing': 'auction',
 'location': 'FR, Vezin-le-Coquet',
 'location_confidence': 'geocoded',
 'longitude': -1.7563,
 'make': 'Peugeot',
 'model': '208',
 'odometer': 82206,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7353ee17-53d0-5744-b24f-1f56deae3762/7353ee17-53d0-5744-b24f-1f56deae3762_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94455,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/26/1c26ea922860f7abb3c30306ae8d5a56/pa/CF81227_cde681c9f8c71a27fed99950e4757216.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7353ee17-53d0-5744-b24f-1f56deae3762/7353ee17-53d0-5744-b24f-1f56deae3762_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88144,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/26/1c26ea922860f7abb3c30306ae8d5a56/pa/CF81227_8648c1d2004fcdd173898ffda717ff9b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7353ee17-53d0-5744-b24f-1f56deae3762/7353ee17-53d0-5744-b24f-1f56deae3762_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90316,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/26/1c26ea922860f7abb3c30306ae8d5a56/pa/CF81227_91404bdbe102b735b7398d0563bb9a13.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7353ee17-53d0-5744-b24f-1f56deae3762/7353ee17-53d0-5744-b24f-1f56deae3762_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83823,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/26/1c26ea922860f7abb3c30306ae8d5a56/pa/CF81227_bfc2765822ca16358a9dabff048e819d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7353ee17-53d0-5744-b24f-1f56deae3762/7353ee17-53d0-5744-b24f-1f56deae3762_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85327,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/26/1c26ea922860f7abb3c30306ae8d5a56/pa/CF81227_d20d1ddb491632cf5019cafc20494aa1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7353ee17-53d0-5744-b24f-1f56deae3762/7353ee17-53d0-5744-b24f-1f56deae3762_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89163,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/26/1c26ea922860f7abb3c30306ae8d5a56/pa/CF81227_038c0c4d12b35b61ac374076f59b5284.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7353ee17-53d0-5744-b24f-1f56deae3762/7353ee17-53d0-5744-b24f-1f56deae3762_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73927,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/26/1c26ea922860f7abb3c30306ae8d5a56/pa/CF81227_a4ae5805279537325aacfd6585950a51.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7353ee17-53d0-5744-b24f-1f56deae3762/7353ee17-53d0-5744-b24f-1f56deae3762_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86373,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/26/1c26ea922860f7abb3c30306ae8d5a56/pa/CF81227_473005c63baef8909ceeb60e5c54e7f7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7353ee17-53d0-5744-b24f-1f56deae3762/7353ee17-53d0-5744-b24f-1f56deae3762_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83136,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/26/1c26ea922860f7abb3c30306ae8d5a56/pa/CF81227_f79885782705818aaaa805d24af53c7d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7353ee17-53d0-5744-b24f-1f56deae3762/7353ee17-53d0-5744-b24f-1f56deae3762_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74971,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/26/1c26ea922860f7abb3c30306ae8d5a56/pa/CF81227_027f71d5e2420236d9db2b51d8a74138.jpg',
             'Width': 800}],
 'postal_code': '35132',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Ille-et-Vilaine',
 'province_code': 'FR-35',
 'region': 'Bretagne',
 'region_code': 'FR-53',
 'registration_date': '2021-02-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 208 1.5 Blue-HDi Active Business',
 'transmission': 'manual',
 'trim': 'Active Business',
 'year': 2021}
2026-04-27 07:56:08 [auto1.fr] INFO: Saving data for CF81227: {'created_time': 1777276568.465248, 'last_price_update_time': 1777276568.465259, 'has_photos': True, 'auction_closing_time': 1777391061.0}
2026-04-27 07:56:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d34210>
2026-04-27 07:56:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b155135f-8ca7-56e9-9ae2-be09ca0e2fa9/b155135f-8ca7-56e9-9ae2-be09ca0e2fa9_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/49/f8491f5cdebd17c919e5884d83616b41/pa/NH82777_d9a4754f062e686dac415602eb06252a.jpg saved to cache
2026-04-27 07:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b155135f-8ca7-56e9-9ae2-be09ca0e2fa9
2026-04-27 07:56:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/72/3e723e4507ba4def2358a37bd2442cb6/pa/WP67872_79726e85f21eef4fca8558e2127bdccc.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/72/3e723e4507ba4def2358a37bd2442cb6/pa/WP67872_e826305a8f1958d1fe69142b6f79eb34.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/a6/fda63dee049bdf0a09061fa121e181cb/pa/BW62863_85b9dc28d3f48fe9ca848895bbf747ac.jpg not downloaded yet
2026-04-27 07:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/72/3e723e4507ba4def2358a37bd2442cb6/pa/WP67872_697c3e9a94e78204639e4996bc2049c1.jpg not downloaded yet
2026-04-27 07:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/97/e197de11cd668d9c9eb18ec02674e5f4/pa/JX55503_6a1e226627ef5307d716e2ce4208ddab.jpg not downloaded yet
2026-04-27 07:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/05/bb05cf011c53a14d404bf668cd6c2ac3/pa/RM94372_7f6571946379d2e7637945d0452504b2.jpg not downloaded yet
2026-04-27 07:56:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/97/e197de11cd668d9c9eb18ec02674e5f4/pa/JX55503_3cb44558415ec6d2c2b012ecea095523.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/a6/fda63dee049bdf0a09061fa121e181cb/pa/BW62863_2cc035657b16b2db12bd81ef27232dfb.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/97/e197de11cd668d9c9eb18ec02674e5f4/pa/JX55503_687f05517d1287d1d72d16ef4bf6f8ac.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UG74072/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CS20843/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EC13815> (referer: https://www.auto1.com/v1/car-details-view/EC13815/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BV80652/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14381b9890>
2026-04-27 07:56:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c75a6acd-ea25-578e-aa83-a8b2c1a75356/c75a6acd-ea25-578e-aa83-a8b2c1a75356_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/72/3e723e4507ba4def2358a37bd2442cb6/pa/WP67872_a7b458621a13321de304549506363574.jpg saved to cache
2026-04-27 07:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c75a6acd-ea25-578e-aa83-a8b2c1a75356
2026-04-27 07:56:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438130850>
2026-04-27 07:56:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b155135f-8ca7-56e9-9ae2-be09ca0e2fa9/b155135f-8ca7-56e9-9ae2-be09ca0e2fa9_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/49/f8491f5cdebd17c919e5884d83616b41/pa/NH82777_6ab3d6873ec4aa42319e5784917c55e0.jpg saved to cache
2026-04-27 07:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b155135f-8ca7-56e9-9ae2-be09ca0e2fa9
2026-04-27 07:56:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b155135f-8ca7-56e9-9ae2-be09ca0e2fa9, skipping ID generation
2026-04-27 07:56:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b155135f-8ca7-56e9-9ae2-be09ca0e2fa9 with scrape type 1
2026-04-27 07:56:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b155135f-8ca7-56e9-9ae2-be09ca0e2fa9 sending to next pipeline
2026-04-27 07:56:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b155135f-8ca7-56e9-9ae2-be09ca0e2fa9, identifier: NH82777
2026-04-27 07:56:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b37d10>
2026-04-27 07:56:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e247627-a6be-5002-b22e-a06d6c5231b8/2e247627-a6be-5002-b22e-a06d6c5231b8_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/a6/fda63dee049bdf0a09061fa121e181cb/pa/BW62863_538079cf3665a00132ccedbfdb3a0155.jpg saved to cache
2026-04-27 07:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2e247627-a6be-5002-b22e-a06d6c5231b8
2026-04-27 07:56:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/a6/fda63dee049bdf0a09061fa121e181cb/pa/BW62863_f93772a53652c72b96d7c012e6a9ca03.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/a6/fda63dee049bdf0a09061fa121e181cb/pa/BW62863_7af8c61a835215570a06147707ed817c.jpg not downloaded yet
2026-04-27 07:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/72/3e723e4507ba4def2358a37bd2442cb6/pa/WP67872_49f1940ce1e43b41cfdfef1d771c3bca.jpg not downloaded yet
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/97/e197de11cd668d9c9eb18ec02674e5f4/pa/JX55503_b428bed03e9113d63d0ca73f8866034c.jpg not downloaded yet
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/05/bb05cf011c53a14d404bf668cd6c2ac3/pa/RM94372_cfdf094a90a65168e06f530f03049428.jpg not downloaded yet
2026-04-27 07:56:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b155135f-8ca7-56e9-9ae2-be09ca0e2fa9 with identifier: NH82777
2026-04-27 07:56:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b155135f-8ca7-56e9-9ae2-be09ca0e2fa9 with identifier: NH82777
2026-04-27 07:56:09 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b155135f-8ca7-56e9-9ae2-be09ca0e2fa9 with identifier: NH82777 to the API
2026-04-27 07:56:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:09 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf8/49/f8491f5cdebd17c919e5884d83616b41/pa/NH82777_6ab3d6873ec4aa42319e5784917c55e0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 98,
 'category': None,
 'city': 'Saint-Maximin',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 90,
 'expiration_date': '2026-04-28T15:13:45Z',
 'fuel_type': 'diesel',
 'id': 'b155135f-8ca7-56e9-9ae2-be09ca0e2fa9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 49.2218,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NH82777',
 'listing': 'auction',
 'location': 'FR, Saint-Maximin',
 'location_confidence': 'geocoded',
 'longitude': 2.4536,
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 191515,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b155135f-8ca7-56e9-9ae2-be09ca0e2fa9/b155135f-8ca7-56e9-9ae2-be09ca0e2fa9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88382,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/49/f8491f5cdebd17c919e5884d83616b41/pa/NH82777_6ab3d6873ec4aa42319e5784917c55e0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b155135f-8ca7-56e9-9ae2-be09ca0e2fa9/b155135f-8ca7-56e9-9ae2-be09ca0e2fa9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83380,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/49/f8491f5cdebd17c919e5884d83616b41/pa/NH82777_d9a4754f062e686dac415602eb06252a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b155135f-8ca7-56e9-9ae2-be09ca0e2fa9/b155135f-8ca7-56e9-9ae2-be09ca0e2fa9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67975,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/49/f8491f5cdebd17c919e5884d83616b41/pa/NH82777_322ba23eafc002cd14e971a36956ef24.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b155135f-8ca7-56e9-9ae2-be09ca0e2fa9/b155135f-8ca7-56e9-9ae2-be09ca0e2fa9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75825,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/49/f8491f5cdebd17c919e5884d83616b41/pa/NH82777_fce7aec10f240edfd7f25071472d8aea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b155135f-8ca7-56e9-9ae2-be09ca0e2fa9/b155135f-8ca7-56e9-9ae2-be09ca0e2fa9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105714,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/49/f8491f5cdebd17c919e5884d83616b41/pa/NH82777_9b869309f8d8a7b86d6e39341d05fbc1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b155135f-8ca7-56e9-9ae2-be09ca0e2fa9/b155135f-8ca7-56e9-9ae2-be09ca0e2fa9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41920,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/49/f8491f5cdebd17c919e5884d83616b41/pa/NH82777_7d03634f3fe253535706546b626951b1.jpg',
             'Width': 800}],
 'postal_code': '60740',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Oise',
 'province_code': 'FR-60',
 'region': 'Hauts-de-France',
 'region_code': 'FR-32',
 'registration_date': '2009-10-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.6 TDCi ECOnetic',
 'transmission': 'manual',
 'trim': 'ECOnetic',
 'year': 2009}
2026-04-27 07:56:09 [auto1.fr] INFO: Saving data for NH82777: {'created_time': 1777276569.356009, 'last_price_update_time': 1777276569.356021, 'has_photos': True, 'auction_closing_time': 1777389225.0}
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bf83a50>
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c75a6acd-ea25-578e-aa83-a8b2c1a75356/c75a6acd-ea25-578e-aa83-a8b2c1a75356_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/72/3e723e4507ba4def2358a37bd2442cb6/pa/WP67872_79726e85f21eef4fca8558e2127bdccc.jpg saved to cache
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c75a6acd-ea25-578e-aa83-a8b2c1a75356
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380e3d10>
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c75a6acd-ea25-578e-aa83-a8b2c1a75356/c75a6acd-ea25-578e-aa83-a8b2c1a75356_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/72/3e723e4507ba4def2358a37bd2442cb6/pa/WP67872_e826305a8f1958d1fe69142b6f79eb34.jpg saved to cache
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c75a6acd-ea25-578e-aa83-a8b2c1a75356
2026-04-27 07:56:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/97/e197de11cd668d9c9eb18ec02674e5f4/pa/JX55503_30b31baf28d9f1209e986bdee89eb898.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/a6/fda63dee049bdf0a09061fa121e181cb/pa/BW62863_074ecaeca891fffedcad86c49a4261bb.jpg not downloaded yet
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/72/3e723e4507ba4def2358a37bd2442cb6/pa/WP67872_a65ffe6969054aa255c0e87ad03ff58d.jpg not downloaded yet
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/05/bb05cf011c53a14d404bf668cd6c2ac3/pa/RM94372_068fed6df4bbd5ec900d141a6012fd31.jpg not downloaded yet
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1439c775d0>
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b18616e2-001e-5485-951a-15f3b272e393/b18616e2-001e-5485-951a-15f3b272e393_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/97/e197de11cd668d9c9eb18ec02674e5f4/pa/JX55503_3cb44558415ec6d2c2b012ecea095523.jpg saved to cache
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b18616e2-001e-5485-951a-15f3b272e393
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1439c775d0>
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e247627-a6be-5002-b22e-a06d6c5231b8/2e247627-a6be-5002-b22e-a06d6c5231b8_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/a6/fda63dee049bdf0a09061fa121e181cb/pa/BW62863_2cc035657b16b2db12bd81ef27232dfb.jpg saved to cache
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2e247627-a6be-5002-b22e-a06d6c5231b8
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438fb1bd0>
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b18616e2-001e-5485-951a-15f3b272e393/b18616e2-001e-5485-951a-15f3b272e393_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/97/e197de11cd668d9c9eb18ec02674e5f4/pa/JX55503_687f05517d1287d1d72d16ef4bf6f8ac.jpg saved to cache
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b18616e2-001e-5485-951a-15f3b272e393
2026-04-27 07:56:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83a3b0a0-68c4-580d-bb13-e8983a46a85d with identifier: EC13815
2026-04-27 07:56:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83a3b0a0-68c4-580d-bb13-e8983a46a85d with scrape type 1
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 83a3b0a0-68c4-580d-bb13-e8983a46a85d
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/c3/9ac3b8c1c51b62eca0fdc5557b8ef270/pa/EC13815_ed6002bd75f2bc1c4408dfa233c2db33.jpg not downloaded yet
2026-04-27 07:56:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/72/3e723e4507ba4def2358a37bd2442cb6/pa/WP67872_3c949c7f8514762eb757fa14a4a3ea91.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/72/3e723e4507ba4def2358a37bd2442cb6/pa/WP67872_d3efc089fc58cd1bbb83289039d427b0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/97/e197de11cd668d9c9eb18ec02674e5f4/pa/JX55503_b6cd87478a5363fd460087c728cf4c3e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ET93179/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438be23d0>
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e247627-a6be-5002-b22e-a06d6c5231b8/2e247627-a6be-5002-b22e-a06d6c5231b8_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/a6/fda63dee049bdf0a09061fa121e181cb/pa/BW62863_f93772a53652c72b96d7c012e6a9ca03.jpg saved to cache
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2e247627-a6be-5002-b22e-a06d6c5231b8
2026-04-27 07:56:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/05/bb05cf011c53a14d404bf668cd6c2ac3/pa/RM94372_7f6571946379d2e7637945d0452504b2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/97/e197de11cd668d9c9eb18ec02674e5f4/pa/JX55503_6a1e226627ef5307d716e2ce4208ddab.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/a6/fda63dee049bdf0a09061fa121e181cb/pa/BW62863_5f8e648e60ce2898c0657ebc730fdc0d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/05/bb05cf011c53a14d404bf668cd6c2ac3/pa/RM94372_5cd09f593d77f9213897152c0f37b32b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/a6/fda63dee049bdf0a09061fa121e181cb/pa/BW62863_98d45c0e53b873239c1ddc7db4ed5ef1.jpg not downloaded yet
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/72/3e723e4507ba4def2358a37bd2442cb6/pa/WP67872_f560c573054ba2babff9a58f78421b7b.jpg not downloaded yet
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/05/bb05cf011c53a14d404bf668cd6c2ac3/pa/RM94372_a133073f673743b893abb2ede0935f84.jpg not downloaded yet
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/c3/9ac3b8c1c51b62eca0fdc5557b8ef270/pa/EC13815_34e4a8298e197aeec3c107e1bbd0487d.jpg not downloaded yet
2026-04-27 07:56:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FF87313/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FE78243> (referer: https://www.auto1.com/v1/car-details-view/FE78243/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438164610>
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b18616e2-001e-5485-951a-15f3b272e393/b18616e2-001e-5485-951a-15f3b272e393_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/97/e197de11cd668d9c9eb18ec02674e5f4/pa/JX55503_30b31baf28d9f1209e986bdee89eb898.jpg saved to cache
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b18616e2-001e-5485-951a-15f3b272e393
2026-04-27 07:56:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/72/3e723e4507ba4def2358a37bd2442cb6/pa/WP67872_697c3e9a94e78204639e4996bc2049c1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/a6/fda63dee049bdf0a09061fa121e181cb/pa/BW62863_012e305ca1f12806cec36076a265b2fd.jpg not downloaded yet
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/72/3e723e4507ba4def2358a37bd2442cb6/pa/WP67872_c6fb3df927cfa25f9a4bb4274ea361c3.jpg not downloaded yet
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/05/bb05cf011c53a14d404bf668cd6c2ac3/pa/RM94372_6422e46538e685a37dbe4c574b923b6d.jpg not downloaded yet
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/c3/9ac3b8c1c51b62eca0fdc5557b8ef270/pa/EC13815_d9c3b3cc601ba5b692a42ba6d2a1f394.jpg not downloaded yet
2026-04-27 07:56:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/a6/fda63dee049bdf0a09061fa121e181cb/pa/BW62863_c3f3d7e42d9014ba16e0c742732e4994.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/a6/fda63dee049bdf0a09061fa121e181cb/pa/BW62863_85b9dc28d3f48fe9ca848895bbf747ac.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a18410>
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c75a6acd-ea25-578e-aa83-a8b2c1a75356/c75a6acd-ea25-578e-aa83-a8b2c1a75356_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/72/3e723e4507ba4def2358a37bd2442cb6/pa/WP67872_3c949c7f8514762eb757fa14a4a3ea91.jpg saved to cache
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c75a6acd-ea25-578e-aa83-a8b2c1a75356
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d44710>
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c75a6acd-ea25-578e-aa83-a8b2c1a75356/c75a6acd-ea25-578e-aa83-a8b2c1a75356_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/72/3e723e4507ba4def2358a37bd2442cb6/pa/WP67872_d3efc089fc58cd1bbb83289039d427b0.jpg saved to cache
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c75a6acd-ea25-578e-aa83-a8b2c1a75356
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d63090>
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b18616e2-001e-5485-951a-15f3b272e393/b18616e2-001e-5485-951a-15f3b272e393_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/97/e197de11cd668d9c9eb18ec02674e5f4/pa/JX55503_b6cd87478a5363fd460087c728cf4c3e.jpg saved to cache
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b18616e2-001e-5485-951a-15f3b272e393
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/05/bb05cf011c53a14d404bf668cd6c2ac3/pa/RM94372_f44a4cc5bbf9b10cd13a7962dfe015c2.jpg not downloaded yet
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/c3/9ac3b8c1c51b62eca0fdc5557b8ef270/pa/EC13815_bc2265baa8da7b5d020abaca709ceb73.jpg not downloaded yet
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438014d10>
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_230e089d-130f-55f8-a503-037cdc6cf934/230e089d-130f-55f8-a503-037cdc6cf934_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/05/bb05cf011c53a14d404bf668cd6c2ac3/pa/RM94372_7f6571946379d2e7637945d0452504b2.jpg saved to cache
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 230e089d-130f-55f8-a503-037cdc6cf934
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380e44d0>
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b18616e2-001e-5485-951a-15f3b272e393/b18616e2-001e-5485-951a-15f3b272e393_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/97/e197de11cd668d9c9eb18ec02674e5f4/pa/JX55503_6a1e226627ef5307d716e2ce4208ddab.jpg saved to cache
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b18616e2-001e-5485-951a-15f3b272e393
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438af2510>
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e247627-a6be-5002-b22e-a06d6c5231b8/2e247627-a6be-5002-b22e-a06d6c5231b8_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/a6/fda63dee049bdf0a09061fa121e181cb/pa/BW62863_5f8e648e60ce2898c0657ebc730fdc0d.jpg saved to cache
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2e247627-a6be-5002-b22e-a06d6c5231b8
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438131cd0>
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_230e089d-130f-55f8-a503-037cdc6cf934/230e089d-130f-55f8-a503-037cdc6cf934_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/05/bb05cf011c53a14d404bf668cd6c2ac3/pa/RM94372_5cd09f593d77f9213897152c0f37b32b.jpg saved to cache
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 230e089d-130f-55f8-a503-037cdc6cf934
2026-04-27 07:56:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/72/3e723e4507ba4def2358a37bd2442cb6/pa/WP67872_49f1940ce1e43b41cfdfef1d771c3bca.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/97/e197de11cd668d9c9eb18ec02674e5f4/pa/JX55503_b428bed03e9113d63d0ca73f8866034c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/a6/fda63dee049bdf0a09061fa121e181cb/pa/BW62863_7af8c61a835215570a06147707ed817c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/05/bb05cf011c53a14d404bf668cd6c2ac3/pa/RM94372_068fed6df4bbd5ec900d141a6012fd31.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/05/bb05cf011c53a14d404bf668cd6c2ac3/pa/RM94372_cfdf094a90a65168e06f530f03049428.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UB37186> (referer: https://www.auto1.com/v1/car-details-view/UB37186/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/c3/9ac3b8c1c51b62eca0fdc5557b8ef270/pa/EC13815_ed6002bd75f2bc1c4408dfa233c2db33.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/05/bb05cf011c53a14d404bf668cd6c2ac3/pa/RM94372_2413db6b43d2dc94edec9248ae5ce848.jpg not downloaded yet
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/c3/9ac3b8c1c51b62eca0fdc5557b8ef270/pa/EC13815_46810d4ab213cfdf5abee59ede4cec51.jpg not downloaded yet
2026-04-27 07:56:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4d7999b-31fa-5ce7-9f4a-1ac176bdebec with identifier: FE78243
2026-04-27 07:56:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4d7999b-31fa-5ce7-9f4a-1ac176bdebec with scrape type 1
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a4d7999b-31fa-5ce7-9f4a-1ac176bdebec
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/5e/4b5ec50a8c2f64a57be79a7e0965e7a1/pa/FE78243_c90bf06022131aa099dca4aace1e9cba.jpg not downloaded yet
2026-04-27 07:56:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c6e890>
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c75a6acd-ea25-578e-aa83-a8b2c1a75356/c75a6acd-ea25-578e-aa83-a8b2c1a75356_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/72/3e723e4507ba4def2358a37bd2442cb6/pa/WP67872_697c3e9a94e78204639e4996bc2049c1.jpg saved to cache
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c75a6acd-ea25-578e-aa83-a8b2c1a75356
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d83710>
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e247627-a6be-5002-b22e-a06d6c5231b8/2e247627-a6be-5002-b22e-a06d6c5231b8_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/a6/fda63dee049bdf0a09061fa121e181cb/pa/BW62863_c3f3d7e42d9014ba16e0c742732e4994.jpg saved to cache
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2e247627-a6be-5002-b22e-a06d6c5231b8
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1439c74150>
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e247627-a6be-5002-b22e-a06d6c5231b8/2e247627-a6be-5002-b22e-a06d6c5231b8_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/a6/fda63dee049bdf0a09061fa121e181cb/pa/BW62863_85b9dc28d3f48fe9ca848895bbf747ac.jpg saved to cache
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2e247627-a6be-5002-b22e-a06d6c5231b8
2026-04-27 07:56:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/a6/fda63dee049bdf0a09061fa121e181cb/pa/BW62863_074ecaeca891fffedcad86c49a4261bb.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/72/3e723e4507ba4def2358a37bd2442cb6/pa/WP67872_a65ffe6969054aa255c0e87ad03ff58d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/05/bb05cf011c53a14d404bf668cd6c2ac3/pa/RM94372_7f240978256f64348d0c7128cb694371.jpg not downloaded yet
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/c3/9ac3b8c1c51b62eca0fdc5557b8ef270/pa/EC13815_03e3ad0e6cd5f81adf5b3cf66f31e970.jpg not downloaded yet
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/5e/4b5ec50a8c2f64a57be79a7e0965e7a1/pa/FE78243_067c1a696b51ff0955c61e709db980ec.jpg not downloaded yet
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438bac910>
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c75a6acd-ea25-578e-aa83-a8b2c1a75356/c75a6acd-ea25-578e-aa83-a8b2c1a75356_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/72/3e723e4507ba4def2358a37bd2442cb6/pa/WP67872_49f1940ce1e43b41cfdfef1d771c3bca.jpg saved to cache
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c75a6acd-ea25-578e-aa83-a8b2c1a75356
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438018b90>
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b18616e2-001e-5485-951a-15f3b272e393/b18616e2-001e-5485-951a-15f3b272e393_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/97/e197de11cd668d9c9eb18ec02674e5f4/pa/JX55503_b428bed03e9113d63d0ca73f8866034c.jpg saved to cache
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b18616e2-001e-5485-951a-15f3b272e393
2026-04-27 07:56:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b18616e2-001e-5485-951a-15f3b272e393, skipping ID generation
2026-04-27 07:56:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b18616e2-001e-5485-951a-15f3b272e393 with scrape type 1
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b18616e2-001e-5485-951a-15f3b272e393 sending to next pipeline
2026-04-27 07:56:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b18616e2-001e-5485-951a-15f3b272e393, identifier: JX55503
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143804b6d0>
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e247627-a6be-5002-b22e-a06d6c5231b8/2e247627-a6be-5002-b22e-a06d6c5231b8_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/a6/fda63dee049bdf0a09061fa121e181cb/pa/BW62863_7af8c61a835215570a06147707ed817c.jpg saved to cache
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2e247627-a6be-5002-b22e-a06d6c5231b8
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a5b950>
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_230e089d-130f-55f8-a503-037cdc6cf934/230e089d-130f-55f8-a503-037cdc6cf934_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/05/bb05cf011c53a14d404bf668cd6c2ac3/pa/RM94372_068fed6df4bbd5ec900d141a6012fd31.jpg saved to cache
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 230e089d-130f-55f8-a503-037cdc6cf934
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438fc21d0>
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_230e089d-130f-55f8-a503-037cdc6cf934/230e089d-130f-55f8-a503-037cdc6cf934_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/05/bb05cf011c53a14d404bf668cd6c2ac3/pa/RM94372_cfdf094a90a65168e06f530f03049428.jpg saved to cache
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 230e089d-130f-55f8-a503-037cdc6cf934
2026-04-27 07:56:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eae6a4b4-f761-5d80-b9ec-2b4b956638ac with identifier: UB37186
2026-04-27 07:56:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eae6a4b4-f761-5d80-b9ec-2b4b956638ac with scrape type 1
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item eae6a4b4-f761-5d80-b9ec-2b4b956638ac
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/47/a347737c2f4b6a209001c2ee5aa3e95b/pa/UB37186_7f5d27555cb5d7a354c6031c44dda0ae.jpg not downloaded yet
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d38e90>
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83a3b0a0-68c4-580d-bb13-e8983a46a85d/83a3b0a0-68c4-580d-bb13-e8983a46a85d_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/c3/9ac3b8c1c51b62eca0fdc5557b8ef270/pa/EC13815_ed6002bd75f2bc1c4408dfa233c2db33.jpg saved to cache
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 83a3b0a0-68c4-580d-bb13-e8983a46a85d
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/05/bb05cf011c53a14d404bf668cd6c2ac3/pa/RM94372_205a1c88fb702ffbebc21b7e345ca831.jpg not downloaded yet
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/c3/9ac3b8c1c51b62eca0fdc5557b8ef270/pa/EC13815_94d31b289cc2ae674a3f3493f352dfd4.jpg not downloaded yet
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/5e/4b5ec50a8c2f64a57be79a7e0965e7a1/pa/FE78243_1e5eb06358077404ab6db91d6c0380c0.jpg not downloaded yet
2026-04-27 07:56:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b18616e2-001e-5485-951a-15f3b272e393 with identifier: JX55503
2026-04-27 07:56:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b18616e2-001e-5485-951a-15f3b272e393 with identifier: JX55503
2026-04-27 07:56:11 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b18616e2-001e-5485-951a-15f3b272e393 with identifier: JX55503 to the API
2026-04-27 07:56:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:12 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge1/97/e197de11cd668d9c9eb18ec02674e5f4/pa/JX55503_b428bed03e9113d63d0ca73f8866034c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 179,
 'category': None,
 'city': 'Beaucaire',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 163,
 'expiration_date': '2026-04-28T15:05:10Z',
 'fuel_type': 'diesel',
 'id': 'b18616e2-001e-5485-951a-15f3b272e393',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 43.8081,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JX55503',
 'listing': 'auction',
 'location': 'FR, Beaucaire',
 'location_confidence': 'geocoded',
 'longitude': 4.6442,
 'make': 'Citroen',
 'model': 'C5',
 'odometer': 267240,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b18616e2-001e-5485-951a-15f3b272e393/b18616e2-001e-5485-951a-15f3b272e393_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78855,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/97/e197de11cd668d9c9eb18ec02674e5f4/pa/JX55503_3cb44558415ec6d2c2b012ecea095523.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b18616e2-001e-5485-951a-15f3b272e393/b18616e2-001e-5485-951a-15f3b272e393_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70982,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/97/e197de11cd668d9c9eb18ec02674e5f4/pa/JX55503_687f05517d1287d1d72d16ef4bf6f8ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b18616e2-001e-5485-951a-15f3b272e393/b18616e2-001e-5485-951a-15f3b272e393_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79263,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/97/e197de11cd668d9c9eb18ec02674e5f4/pa/JX55503_30b31baf28d9f1209e986bdee89eb898.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b18616e2-001e-5485-951a-15f3b272e393/b18616e2-001e-5485-951a-15f3b272e393_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59238,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/97/e197de11cd668d9c9eb18ec02674e5f4/pa/JX55503_b6cd87478a5363fd460087c728cf4c3e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b18616e2-001e-5485-951a-15f3b272e393/b18616e2-001e-5485-951a-15f3b272e393_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85088,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/97/e197de11cd668d9c9eb18ec02674e5f4/pa/JX55503_6a1e226627ef5307d716e2ce4208ddab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b18616e2-001e-5485-951a-15f3b272e393/b18616e2-001e-5485-951a-15f3b272e393_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42080,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/97/e197de11cd668d9c9eb18ec02674e5f4/pa/JX55503_b428bed03e9113d63d0ca73f8866034c.jpg',
             'Width': 800}],
 'postal_code': '30300',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Gard',
 'province_code': 'FR-30',
 'region': 'Occitanie',
 'region_code': 'FR-76',
 'registration_date': '2010-07-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C5 2.0 HDi Exclusive',
 'transmission': 'automatic',
 'trim': 'Exclusive',
 'year': 2010}
2026-04-27 07:56:12 [auto1.fr] INFO: Saving data for JX55503: {'created_time': 1777276572.225298, 'last_price_update_time': 1777276572.225311, 'has_photos': True, 'auction_closing_time': 1777388710.0}
2026-04-27 07:56:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/05/bb05cf011c53a14d404bf668cd6c2ac3/pa/RM94372_f44a4cc5bbf9b10cd13a7962dfe015c2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/c3/9ac3b8c1c51b62eca0fdc5557b8ef270/pa/EC13815_bc2265baa8da7b5d020abaca709ceb73.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/c3/9ac3b8c1c51b62eca0fdc5557b8ef270/pa/EC13815_d9c3b3cc601ba5b692a42ba6d2a1f394.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/47/a347737c2f4b6a209001c2ee5aa3e95b/pa/UB37186_d4af987f6f1fe40f0f9ba297fcf19473.jpg not downloaded yet
2026-04-27 07:56:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/05/bb05cf011c53a14d404bf668cd6c2ac3/pa/RM94372_6422e46538e685a37dbe4c574b923b6d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/05/bb05cf011c53a14d404bf668cd6c2ac3/pa/RM94372_a133073f673743b893abb2ede0935f84.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/72/3e723e4507ba4def2358a37bd2442cb6/pa/WP67872_c6fb3df927cfa25f9a4bb4274ea361c3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/c3/9ac3b8c1c51b62eca0fdc5557b8ef270/pa/EC13815_34e4a8298e197aeec3c107e1bbd0487d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/72/3e723e4507ba4def2358a37bd2442cb6/pa/WP67872_f560c573054ba2babff9a58f78421b7b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/c3/9ac3b8c1c51b62eca0fdc5557b8ef270/pa/EC13815_e4a9a6d65d721729110883a8427c4a0b.jpg not downloaded yet
2026-04-27 07:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/5e/4b5ec50a8c2f64a57be79a7e0965e7a1/pa/FE78243_d8fc77d52e155cf0450cadf5e581fe8f.jpg not downloaded yet
2026-04-27 07:56:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UG74072> (referer: https://www.auto1.com/v1/car-details-view/UG74072/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CS20843> (referer: https://www.auto1.com/v1/car-details-view/CS20843/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SK23170> (referer: https://www.auto1.com/v1/car-details-view/SK23170/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/47/a347737c2f4b6a209001c2ee5aa3e95b/pa/UB37186_241dfa7268b4fd795da7f87fda145f2d.jpg not downloaded yet
2026-04-27 07:56:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14381b8a50>
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e247627-a6be-5002-b22e-a06d6c5231b8/2e247627-a6be-5002-b22e-a06d6c5231b8_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/a6/fda63dee049bdf0a09061fa121e181cb/pa/BW62863_074ecaeca891fffedcad86c49a4261bb.jpg saved to cache
2026-04-27 07:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2e247627-a6be-5002-b22e-a06d6c5231b8
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f144750c310>
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c75a6acd-ea25-578e-aa83-a8b2c1a75356/c75a6acd-ea25-578e-aa83-a8b2c1a75356_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/72/3e723e4507ba4def2358a37bd2442cb6/pa/WP67872_a65ffe6969054aa255c0e87ad03ff58d.jpg saved to cache
2026-04-27 07:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c75a6acd-ea25-578e-aa83-a8b2c1a75356
2026-04-27 07:56:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/a6/fda63dee049bdf0a09061fa121e181cb/pa/BW62863_012e305ca1f12806cec36076a265b2fd.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/c3/9ac3b8c1c51b62eca0fdc5557b8ef270/pa/EC13815_41e6abb4e77e0e238757976d39fa17f2.jpg not downloaded yet
2026-04-27 07:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/5e/4b5ec50a8c2f64a57be79a7e0965e7a1/pa/FE78243_d1bb6a7f67332f4b7663c3b39fb335c8.jpg not downloaded yet
2026-04-27 07:56:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/47/a347737c2f4b6a209001c2ee5aa3e95b/pa/UB37186_7f5d27555cb5d7a354c6031c44dda0ae.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/5e/4b5ec50a8c2f64a57be79a7e0965e7a1/pa/FE78243_067c1a696b51ff0955c61e709db980ec.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/a6/fda63dee049bdf0a09061fa121e181cb/pa/BW62863_98d45c0e53b873239c1ddc7db4ed5ef1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/47/a347737c2f4b6a209001c2ee5aa3e95b/pa/UB37186_fe06be1cd55a4bf41c8600e2b334fb0f.jpg not downloaded yet
2026-04-27 07:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/c3/9ac3b8c1c51b62eca0fdc5557b8ef270/pa/EC13815_0aebdbd60ad7a77fda29f396b88f7331.jpg not downloaded yet
2026-04-27 07:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/5e/4b5ec50a8c2f64a57be79a7e0965e7a1/pa/FE78243_458c926583f940c05b795b7f2ef482fb.jpg not downloaded yet
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438e69d50>
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_230e089d-130f-55f8-a503-037cdc6cf934/230e089d-130f-55f8-a503-037cdc6cf934_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/05/bb05cf011c53a14d404bf668cd6c2ac3/pa/RM94372_f44a4cc5bbf9b10cd13a7962dfe015c2.jpg saved to cache
2026-04-27 07:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 230e089d-130f-55f8-a503-037cdc6cf934
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ea1210>
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83a3b0a0-68c4-580d-bb13-e8983a46a85d/83a3b0a0-68c4-580d-bb13-e8983a46a85d_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/c3/9ac3b8c1c51b62eca0fdc5557b8ef270/pa/EC13815_bc2265baa8da7b5d020abaca709ceb73.jpg saved to cache
2026-04-27 07:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 83a3b0a0-68c4-580d-bb13-e8983a46a85d
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c92b50>
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83a3b0a0-68c4-580d-bb13-e8983a46a85d/83a3b0a0-68c4-580d-bb13-e8983a46a85d_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/c3/9ac3b8c1c51b62eca0fdc5557b8ef270/pa/EC13815_d9c3b3cc601ba5b692a42ba6d2a1f394.jpg saved to cache
2026-04-27 07:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 83a3b0a0-68c4-580d-bb13-e8983a46a85d
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a185d0>
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_230e089d-130f-55f8-a503-037cdc6cf934/230e089d-130f-55f8-a503-037cdc6cf934_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/05/bb05cf011c53a14d404bf668cd6c2ac3/pa/RM94372_6422e46538e685a37dbe4c574b923b6d.jpg saved to cache
2026-04-27 07:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 230e089d-130f-55f8-a503-037cdc6cf934
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143820fbd0>
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_230e089d-130f-55f8-a503-037cdc6cf934/230e089d-130f-55f8-a503-037cdc6cf934_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/05/bb05cf011c53a14d404bf668cd6c2ac3/pa/RM94372_a133073f673743b893abb2ede0935f84.jpg saved to cache
2026-04-27 07:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 230e089d-130f-55f8-a503-037cdc6cf934
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a78610>
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c75a6acd-ea25-578e-aa83-a8b2c1a75356/c75a6acd-ea25-578e-aa83-a8b2c1a75356_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/72/3e723e4507ba4def2358a37bd2442cb6/pa/WP67872_c6fb3df927cfa25f9a4bb4274ea361c3.jpg saved to cache
2026-04-27 07:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c75a6acd-ea25-578e-aa83-a8b2c1a75356
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14381cb890>
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83a3b0a0-68c4-580d-bb13-e8983a46a85d/83a3b0a0-68c4-580d-bb13-e8983a46a85d_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/c3/9ac3b8c1c51b62eca0fdc5557b8ef270/pa/EC13815_34e4a8298e197aeec3c107e1bbd0487d.jpg saved to cache
2026-04-27 07:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 83a3b0a0-68c4-580d-bb13-e8983a46a85d
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143817e250>
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c75a6acd-ea25-578e-aa83-a8b2c1a75356/c75a6acd-ea25-578e-aa83-a8b2c1a75356_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/72/3e723e4507ba4def2358a37bd2442cb6/pa/WP67872_f560c573054ba2babff9a58f78421b7b.jpg saved to cache
2026-04-27 07:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c75a6acd-ea25-578e-aa83-a8b2c1a75356
2026-04-27 07:56:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c75a6acd-ea25-578e-aa83-a8b2c1a75356, skipping ID generation
2026-04-27 07:56:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c75a6acd-ea25-578e-aa83-a8b2c1a75356 with scrape type 1
2026-04-27 07:56:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c75a6acd-ea25-578e-aa83-a8b2c1a75356 sending to next pipeline
2026-04-27 07:56:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c75a6acd-ea25-578e-aa83-a8b2c1a75356, identifier: WP67872
2026-04-27 07:56:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 35add949-7342-5c84-9f06-2ff009c31f2c with identifier: UG74072
2026-04-27 07:56:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35add949-7342-5c84-9f06-2ff009c31f2c with scrape type 1
2026-04-27 07:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 35add949-7342-5c84-9f06-2ff009c31f2c
2026-04-27 07:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/c7/20c788e248dbf8200cfc3a133b16506a/pa/UG74072_fb2f5ca8ddf98a1d434355829b2685e3.jpg not downloaded yet
2026-04-27 07:56:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9553f7b8-ee36-5bec-a2f7-dfdb650475bd with identifier: CS20843
2026-04-27 07:56:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9553f7b8-ee36-5bec-a2f7-dfdb650475bd with scrape type 1
2026-04-27 07:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9553f7b8-ee36-5bec-a2f7-dfdb650475bd
2026-04-27 07:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/b1/92b1b39878d78959e20d49b9d3a5b8b1/pa/CS20843_4bd7263cfd77ac0ce655523c2a39d418.jpg not downloaded yet
2026-04-27 07:56:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4be63aaf-524d-54ce-9992-806335a828c2 with identifier: SK23170
2026-04-27 07:56:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4be63aaf-524d-54ce-9992-806335a828c2 with scrape type 1
2026-04-27 07:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4be63aaf-524d-54ce-9992-806335a828c2
2026-04-27 07:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/94/dd944bb36870e441ff274d743d0b3462/pa/SK23170_42ee2737afaefb6c6575b9d0af163054.jpg not downloaded yet
2026-04-27 07:56:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/c3/9ac3b8c1c51b62eca0fdc5557b8ef270/pa/EC13815_03e3ad0e6cd5f81adf5b3cf66f31e970.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/c3/9ac3b8c1c51b62eca0fdc5557b8ef270/pa/EC13815_94d31b289cc2ae674a3f3493f352dfd4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/47/a347737c2f4b6a209001c2ee5aa3e95b/pa/UB37186_49acb63b918c338242136dd441da5687.jpg not downloaded yet
2026-04-27 07:56:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c75a6acd-ea25-578e-aa83-a8b2c1a75356 with identifier: WP67872
2026-04-27 07:56:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c75a6acd-ea25-578e-aa83-a8b2c1a75356 with identifier: WP67872
2026-04-27 07:56:13 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c75a6acd-ea25-578e-aa83-a8b2c1a75356 with identifier: WP67872 to the API
2026-04-27 07:56:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:13 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3e/72/3e723e4507ba4def2358a37bd2442cb6/pa/WP67872_f560c573054ba2babff9a58f78421b7b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'category': None,
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 105,
 'expiration_date': '2026-04-28T15:34:53Z',
 'fuel_type': 'diesel',
 'id': 'c75a6acd-ea25-578e-aa83-a8b2c1a75356',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP67872',
 'listing': 'auction',
 'location': 'FR',
 'location_confidence': None,
 'longitude': None,
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 295279,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c75a6acd-ea25-578e-aa83-a8b2c1a75356/c75a6acd-ea25-578e-aa83-a8b2c1a75356_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58962,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/72/3e723e4507ba4def2358a37bd2442cb6/pa/WP67872_a7b458621a13321de304549506363574.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c75a6acd-ea25-578e-aa83-a8b2c1a75356/c75a6acd-ea25-578e-aa83-a8b2c1a75356_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55596,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/72/3e723e4507ba4def2358a37bd2442cb6/pa/WP67872_79726e85f21eef4fca8558e2127bdccc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c75a6acd-ea25-578e-aa83-a8b2c1a75356/c75a6acd-ea25-578e-aa83-a8b2c1a75356_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64066,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/72/3e723e4507ba4def2358a37bd2442cb6/pa/WP67872_e826305a8f1958d1fe69142b6f79eb34.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c75a6acd-ea25-578e-aa83-a8b2c1a75356/c75a6acd-ea25-578e-aa83-a8b2c1a75356_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61019,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/72/3e723e4507ba4def2358a37bd2442cb6/pa/WP67872_3c949c7f8514762eb757fa14a4a3ea91.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c75a6acd-ea25-578e-aa83-a8b2c1a75356/c75a6acd-ea25-578e-aa83-a8b2c1a75356_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62399,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/72/3e723e4507ba4def2358a37bd2442cb6/pa/WP67872_d3efc089fc58cd1bbb83289039d427b0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c75a6acd-ea25-578e-aa83-a8b2c1a75356/c75a6acd-ea25-578e-aa83-a8b2c1a75356_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50348,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/72/3e723e4507ba4def2358a37bd2442cb6/pa/WP67872_697c3e9a94e78204639e4996bc2049c1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c75a6acd-ea25-578e-aa83-a8b2c1a75356/c75a6acd-ea25-578e-aa83-a8b2c1a75356_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51213,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/72/3e723e4507ba4def2358a37bd2442cb6/pa/WP67872_49f1940ce1e43b41cfdfef1d771c3bca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c75a6acd-ea25-578e-aa83-a8b2c1a75356/c75a6acd-ea25-578e-aa83-a8b2c1a75356_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108527,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/72/3e723e4507ba4def2358a37bd2442cb6/pa/WP67872_a65ffe6969054aa255c0e87ad03ff58d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c75a6acd-ea25-578e-aa83-a8b2c1a75356/c75a6acd-ea25-578e-aa83-a8b2c1a75356_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106584,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/72/3e723e4507ba4def2358a37bd2442cb6/pa/WP67872_f560c573054ba2babff9a58f78421b7b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c75a6acd-ea25-578e-aa83-a8b2c1a75356/c75a6acd-ea25-578e-aa83-a8b2c1a75356_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80836,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/72/3e723e4507ba4def2358a37bd2442cb6/pa/WP67872_c6fb3df927cfa25f9a4bb4274ea361c3.jpg',
             'Width': 800}],
 'postal_code': None,
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2011-06-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.6 TDI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2011}
2026-04-27 07:56:13 [auto1.fr] INFO: Saving data for WP67872: {'created_time': 1777276573.762999, 'last_price_update_time': 1777276573.763009, 'has_photos': True, 'auction_closing_time': 1777390493.0}
2026-04-27 07:56:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/5e/4b5ec50a8c2f64a57be79a7e0965e7a1/pa/FE78243_1e5eb06358077404ab6db91d6c0380c0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/5e/4b5ec50a8c2f64a57be79a7e0965e7a1/pa/FE78243_c9bb3eb3b903a82468aae70e13552eaa.jpg not downloaded yet
2026-04-27 07:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/c7/20c788e248dbf8200cfc3a133b16506a/pa/UG74072_2c4f88589db6fbe834a48b00c60f1eb6.jpg not downloaded yet
2026-04-27 07:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/b1/92b1b39878d78959e20d49b9d3a5b8b1/pa/CS20843_1b75890b7af0e893c0cd6e2f5ec8a731.jpg not downloaded yet
2026-04-27 07:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/94/dd944bb36870e441ff274d743d0b3462/pa/SK23170_b85f71515ecc6431c8cbda8f6acb0719.jpg not downloaded yet
2026-04-27 07:56:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/5e/4b5ec50a8c2f64a57be79a7e0965e7a1/pa/FE78243_c90bf06022131aa099dca4aace1e9cba.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/47/a347737c2f4b6a209001c2ee5aa3e95b/pa/UB37186_d4af987f6f1fe40f0f9ba297fcf19473.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/05/bb05cf011c53a14d404bf668cd6c2ac3/pa/RM94372_205a1c88fb702ffbebc21b7e345ca831.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/05/bb05cf011c53a14d404bf668cd6c2ac3/pa/RM94372_7f240978256f64348d0c7128cb694371.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/47/a347737c2f4b6a209001c2ee5aa3e95b/pa/UB37186_9b9d573c5daeac3a665ce22ad928f987.jpg not downloaded yet
2026-04-27 07:56:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ET93179> (referer: https://www.auto1.com/v1/car-details-view/ET93179/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bfac410>
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e247627-a6be-5002-b22e-a06d6c5231b8/2e247627-a6be-5002-b22e-a06d6c5231b8_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/a6/fda63dee049bdf0a09061fa121e181cb/pa/BW62863_012e305ca1f12806cec36076a265b2fd.jpg saved to cache
2026-04-27 07:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2e247627-a6be-5002-b22e-a06d6c5231b8
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ffb990>
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eae6a4b4-f761-5d80-b9ec-2b4b956638ac/eae6a4b4-f761-5d80-b9ec-2b4b956638ac_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/47/a347737c2f4b6a209001c2ee5aa3e95b/pa/UB37186_7f5d27555cb5d7a354c6031c44dda0ae.jpg saved to cache
2026-04-27 07:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item eae6a4b4-f761-5d80-b9ec-2b4b956638ac
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d86dd0>
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4d7999b-31fa-5ce7-9f4a-1ac176bdebec/a4d7999b-31fa-5ce7-9f4a-1ac176bdebec_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/5e/4b5ec50a8c2f64a57be79a7e0965e7a1/pa/FE78243_067c1a696b51ff0955c61e709db980ec.jpg saved to cache
2026-04-27 07:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a4d7999b-31fa-5ce7-9f4a-1ac176bdebec
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a67710>
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e247627-a6be-5002-b22e-a06d6c5231b8/2e247627-a6be-5002-b22e-a06d6c5231b8_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/a6/fda63dee049bdf0a09061fa121e181cb/pa/BW62863_98d45c0e53b873239c1ddc7db4ed5ef1.jpg saved to cache
2026-04-27 07:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2e247627-a6be-5002-b22e-a06d6c5231b8
2026-04-27 07:56:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2e247627-a6be-5002-b22e-a06d6c5231b8, skipping ID generation
2026-04-27 07:56:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e247627-a6be-5002-b22e-a06d6c5231b8 with scrape type 1
2026-04-27 07:56:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2e247627-a6be-5002-b22e-a06d6c5231b8 sending to next pipeline
2026-04-27 07:56:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2e247627-a6be-5002-b22e-a06d6c5231b8, identifier: BW62863
2026-04-27 07:56:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/c3/9ac3b8c1c51b62eca0fdc5557b8ef270/pa/EC13815_46810d4ab213cfdf5abee59ede4cec51.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/5e/4b5ec50a8c2f64a57be79a7e0965e7a1/pa/FE78243_ffaba87ccdd027717301530b31fb66e0.jpg not downloaded yet
2026-04-27 07:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/c7/20c788e248dbf8200cfc3a133b16506a/pa/UG74072_aa0a465ad6f931767733f93c31617121.jpg not downloaded yet
2026-04-27 07:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/b1/92b1b39878d78959e20d49b9d3a5b8b1/pa/CS20843_f3a879bb4823dc2c5cacf057000f49b0.jpg not downloaded yet
2026-04-27 07:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/94/dd944bb36870e441ff274d743d0b3462/pa/SK23170_e5f688ad94f7b99fa0b6865f5caabc09.jpg not downloaded yet
2026-04-27 07:56:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2e247627-a6be-5002-b22e-a06d6c5231b8 with identifier: BW62863
2026-04-27 07:56:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2e247627-a6be-5002-b22e-a06d6c5231b8 with identifier: BW62863
2026-04-27 07:56:14 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2e247627-a6be-5002-b22e-a06d6c5231b8 with identifier: BW62863 to the API
2026-04-27 07:56:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:14 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgfd/a6/fda63dee049bdf0a09061fa121e181cb/pa/BW62863_98d45c0e53b873239c1ddc7db4ed5ef1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'city': 'Anthy-sur-Léman',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.5L',
 'engine_horse_power': 107,
 'expiration_date': '2026-04-28T15:38:50Z',
 'fuel_type': 'diesel',
 'id': '2e247627-a6be-5002-b22e-a06d6c5231b8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 46.3553,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BW62863',
 'listing': 'auction',
 'location': 'FR, Anthy-sur-Léman',
 'location_confidence': 'geocoded',
 'longitude': 6.4273,
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 242382,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2e247627-a6be-5002-b22e-a06d6c5231b8/2e247627-a6be-5002-b22e-a06d6c5231b8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84452,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/a6/fda63dee049bdf0a09061fa121e181cb/pa/BW62863_538079cf3665a00132ccedbfdb3a0155.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2e247627-a6be-5002-b22e-a06d6c5231b8/2e247627-a6be-5002-b22e-a06d6c5231b8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76024,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/a6/fda63dee049bdf0a09061fa121e181cb/pa/BW62863_2cc035657b16b2db12bd81ef27232dfb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2e247627-a6be-5002-b22e-a06d6c5231b8/2e247627-a6be-5002-b22e-a06d6c5231b8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75139,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/a6/fda63dee049bdf0a09061fa121e181cb/pa/BW62863_f93772a53652c72b96d7c012e6a9ca03.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2e247627-a6be-5002-b22e-a06d6c5231b8/2e247627-a6be-5002-b22e-a06d6c5231b8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45683,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/a6/fda63dee049bdf0a09061fa121e181cb/pa/BW62863_c3f3d7e42d9014ba16e0c742732e4994.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2e247627-a6be-5002-b22e-a06d6c5231b8/2e247627-a6be-5002-b22e-a06d6c5231b8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67053,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/a6/fda63dee049bdf0a09061fa121e181cb/pa/BW62863_5f8e648e60ce2898c0657ebc730fdc0d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2e247627-a6be-5002-b22e-a06d6c5231b8/2e247627-a6be-5002-b22e-a06d6c5231b8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74413,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/a6/fda63dee049bdf0a09061fa121e181cb/pa/BW62863_85b9dc28d3f48fe9ca848895bbf747ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2e247627-a6be-5002-b22e-a06d6c5231b8/2e247627-a6be-5002-b22e-a06d6c5231b8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51525,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/a6/fda63dee049bdf0a09061fa121e181cb/pa/BW62863_7af8c61a835215570a06147707ed817c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2e247627-a6be-5002-b22e-a06d6c5231b8/2e247627-a6be-5002-b22e-a06d6c5231b8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72147,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/a6/fda63dee049bdf0a09061fa121e181cb/pa/BW62863_074ecaeca891fffedcad86c49a4261bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2e247627-a6be-5002-b22e-a06d6c5231b8/2e247627-a6be-5002-b22e-a06d6c5231b8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105706,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/a6/fda63dee049bdf0a09061fa121e181cb/pa/BW62863_98d45c0e53b873239c1ddc7db4ed5ef1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2e247627-a6be-5002-b22e-a06d6c5231b8/2e247627-a6be-5002-b22e-a06d6c5231b8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61459,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/a6/fda63dee049bdf0a09061fa121e181cb/pa/BW62863_012e305ca1f12806cec36076a265b2fd.jpg',
             'Width': 800}],
 'postal_code': '74200',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Haute-Savoie',
 'province_code': 'FR-74',
 'region': 'Auvergne-Rhône-Alpes',
 'region_code': 'FR-84',
 'registration_date': '2014-03-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Duster 1.5 dCi Prestige 4x2',
 'transmission': 'manual',
 'trim': 'Prestige 4x2',
 'year': 2014}
2026-04-27 07:56:14 [auto1.fr] INFO: Saving data for BW62863: {'created_time': 1777276574.51592, 'last_price_update_time': 1777276574.515929, 'has_photos': True, 'auction_closing_time': 1777390730.0}
2026-04-27 07:56:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/5e/4b5ec50a8c2f64a57be79a7e0965e7a1/pa/FE78243_d1bb6a7f67332f4b7663c3b39fb335c8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/5e/4b5ec50a8c2f64a57be79a7e0965e7a1/pa/FE78243_d8fc77d52e155cf0450cadf5e581fe8f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/47/a347737c2f4b6a209001c2ee5aa3e95b/pa/UB37186_810a64564d3cc17cd5eaed903bc13cb9.jpg not downloaded yet
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d84a10>
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83a3b0a0-68c4-580d-bb13-e8983a46a85d/83a3b0a0-68c4-580d-bb13-e8983a46a85d_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/c3/9ac3b8c1c51b62eca0fdc5557b8ef270/pa/EC13815_03e3ad0e6cd5f81adf5b3cf66f31e970.jpg saved to cache
2026-04-27 07:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 83a3b0a0-68c4-580d-bb13-e8983a46a85d
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d39610>
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83a3b0a0-68c4-580d-bb13-e8983a46a85d/83a3b0a0-68c4-580d-bb13-e8983a46a85d_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/c3/9ac3b8c1c51b62eca0fdc5557b8ef270/pa/EC13815_94d31b289cc2ae674a3f3493f352dfd4.jpg saved to cache
2026-04-27 07:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 83a3b0a0-68c4-580d-bb13-e8983a46a85d
2026-04-27 07:56:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/47/a347737c2f4b6a209001c2ee5aa3e95b/pa/UB37186_fe06be1cd55a4bf41c8600e2b334fb0f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/47/a347737c2f4b6a209001c2ee5aa3e95b/pa/UB37186_241dfa7268b4fd795da7f87fda145f2d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/5e/4b5ec50a8c2f64a57be79a7e0965e7a1/pa/FE78243_c27aa3e126eb7687f4c0dda65ff36aa0.jpg not downloaded yet
2026-04-27 07:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/c7/20c788e248dbf8200cfc3a133b16506a/pa/UG74072_5aba9389ca70ba66ec374f2b59a8a8e0.jpg not downloaded yet
2026-04-27 07:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/b1/92b1b39878d78959e20d49b9d3a5b8b1/pa/CS20843_73877cd53e0d16a07d47a992d135789d.jpg not downloaded yet
2026-04-27 07:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/94/dd944bb36870e441ff274d743d0b3462/pa/SK23170_1bbf33daf5a2dfc699e7ed589f9bdf8b.jpg not downloaded yet
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438135b50>
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4d7999b-31fa-5ce7-9f4a-1ac176bdebec/a4d7999b-31fa-5ce7-9f4a-1ac176bdebec_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/5e/4b5ec50a8c2f64a57be79a7e0965e7a1/pa/FE78243_1e5eb06358077404ab6db91d6c0380c0.jpg saved to cache
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a4d7999b-31fa-5ce7-9f4a-1ac176bdebec
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438bae610>
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4d7999b-31fa-5ce7-9f4a-1ac176bdebec/a4d7999b-31fa-5ce7-9f4a-1ac176bdebec_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/5e/4b5ec50a8c2f64a57be79a7e0965e7a1/pa/FE78243_c90bf06022131aa099dca4aace1e9cba.jpg saved to cache
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a4d7999b-31fa-5ce7-9f4a-1ac176bdebec
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438aef9d0>
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eae6a4b4-f761-5d80-b9ec-2b4b956638ac/eae6a4b4-f761-5d80-b9ec-2b4b956638ac_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/47/a347737c2f4b6a209001c2ee5aa3e95b/pa/UB37186_d4af987f6f1fe40f0f9ba297fcf19473.jpg saved to cache
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item eae6a4b4-f761-5d80-b9ec-2b4b956638ac
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14381b93d0>
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_230e089d-130f-55f8-a503-037cdc6cf934/230e089d-130f-55f8-a503-037cdc6cf934_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/05/bb05cf011c53a14d404bf668cd6c2ac3/pa/RM94372_205a1c88fb702ffbebc21b7e345ca831.jpg saved to cache
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 230e089d-130f-55f8-a503-037cdc6cf934
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380765d0>
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_230e089d-130f-55f8-a503-037cdc6cf934/230e089d-130f-55f8-a503-037cdc6cf934_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/05/bb05cf011c53a14d404bf668cd6c2ac3/pa/RM94372_7f240978256f64348d0c7128cb694371.jpg saved to cache
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 230e089d-130f-55f8-a503-037cdc6cf934
2026-04-27 07:56:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3aef08ca-3219-5855-8bd9-a3431e008b63 with identifier: ET93179
2026-04-27 07:56:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3aef08ca-3219-5855-8bd9-a3431e008b63 with scrape type 1
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3aef08ca-3219-5855-8bd9-a3431e008b63
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/30/9f3084297de33006f2f74240aed167e5/pa/ET93179_44e08b0400ab7f5332050659b834b0d4.jpg not downloaded yet
2026-04-27 07:56:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/94/dd944bb36870e441ff274d743d0b3462/pa/SK23170_42ee2737afaefb6c6575b9d0af163054.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/47/a347737c2f4b6a209001c2ee5aa3e95b/pa/UB37186_49acb63b918c338242136dd441da5687.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/c3/9ac3b8c1c51b62eca0fdc5557b8ef270/pa/EC13815_e4a9a6d65d721729110883a8427c4a0b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/c3/9ac3b8c1c51b62eca0fdc5557b8ef270/pa/EC13815_41e6abb4e77e0e238757976d39fa17f2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/47/a347737c2f4b6a209001c2ee5aa3e95b/pa/UB37186_2592a36263ef34b3e075932e0e118883.jpg not downloaded yet
2026-04-27 07:56:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GN80196> (referer: https://www.auto1.com/v1/car-details-view/GN80196/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/5e/4b5ec50a8c2f64a57be79a7e0965e7a1/pa/FE78243_2a1b063f71172ca54b27db5321b23094.jpg not downloaded yet
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/c7/20c788e248dbf8200cfc3a133b16506a/pa/UG74072_255676c784aaee697b3262e470471d78.jpg not downloaded yet
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/b1/92b1b39878d78959e20d49b9d3a5b8b1/pa/CS20843_47be64f9197ea94180e5dee2de21197a.jpg not downloaded yet
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/94/dd944bb36870e441ff274d743d0b3462/pa/SK23170_024c305647de5458ece6e61bdaefb4dc.jpg not downloaded yet
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/30/9f3084297de33006f2f74240aed167e5/pa/ET93179_a4450f6340e9d7be772ef84937a75e20.jpg not downloaded yet
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143819df50>
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83a3b0a0-68c4-580d-bb13-e8983a46a85d/83a3b0a0-68c4-580d-bb13-e8983a46a85d_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/c3/9ac3b8c1c51b62eca0fdc5557b8ef270/pa/EC13815_46810d4ab213cfdf5abee59ede4cec51.jpg saved to cache
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 83a3b0a0-68c4-580d-bb13-e8983a46a85d
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14381cd590>
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4d7999b-31fa-5ce7-9f4a-1ac176bdebec/a4d7999b-31fa-5ce7-9f4a-1ac176bdebec_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/5e/4b5ec50a8c2f64a57be79a7e0965e7a1/pa/FE78243_d1bb6a7f67332f4b7663c3b39fb335c8.jpg saved to cache
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a4d7999b-31fa-5ce7-9f4a-1ac176bdebec
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438151750>
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4d7999b-31fa-5ce7-9f4a-1ac176bdebec/a4d7999b-31fa-5ce7-9f4a-1ac176bdebec_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/5e/4b5ec50a8c2f64a57be79a7e0965e7a1/pa/FE78243_d8fc77d52e155cf0450cadf5e581fe8f.jpg saved to cache
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a4d7999b-31fa-5ce7-9f4a-1ac176bdebec
2026-04-27 07:56:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/c7/20c788e248dbf8200cfc3a133b16506a/pa/UG74072_fb2f5ca8ddf98a1d434355829b2685e3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/47/a347737c2f4b6a209001c2ee5aa3e95b/pa/UB37186_e1719861510f76d2f893ac8bce3687ea.jpg not downloaded yet
2026-04-27 07:56:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FF87313> (referer: https://www.auto1.com/v1/car-details-view/FF87313/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/94/dd944bb36870e441ff274d743d0b3462/pa/SK23170_b85f71515ecc6431c8cbda8f6acb0719.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/5e/4b5ec50a8c2f64a57be79a7e0965e7a1/pa/FE78243_458c926583f940c05b795b7f2ef482fb.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/c7/20c788e248dbf8200cfc3a133b16506a/pa/UG74072_6502d4e9840942bc2f56141153273ac0.jpg not downloaded yet
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/b1/92b1b39878d78959e20d49b9d3a5b8b1/pa/CS20843_da10d28a9eaed46502e6e9c7362377e3.jpg not downloaded yet
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/94/dd944bb36870e441ff274d743d0b3462/pa/SK23170_651f92983e77a17fef823e37dd8b4f0b.jpg not downloaded yet
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/30/9f3084297de33006f2f74240aed167e5/pa/ET93179_3259a7107013e707573b63707a938881.jpg not downloaded yet
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/47/a347737c2f4b6a209001c2ee5aa3e95b/pa/UB37186_29e9f2a3c6a65e670050ef8f5122c95b.jpg not downloaded yet
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143819c290>
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eae6a4b4-f761-5d80-b9ec-2b4b956638ac/eae6a4b4-f761-5d80-b9ec-2b4b956638ac_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/47/a347737c2f4b6a209001c2ee5aa3e95b/pa/UB37186_fe06be1cd55a4bf41c8600e2b334fb0f.jpg saved to cache
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item eae6a4b4-f761-5d80-b9ec-2b4b956638ac
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143806d1d0>
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eae6a4b4-f761-5d80-b9ec-2b4b956638ac/eae6a4b4-f761-5d80-b9ec-2b4b956638ac_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/47/a347737c2f4b6a209001c2ee5aa3e95b/pa/UB37186_241dfa7268b4fd795da7f87fda145f2d.jpg saved to cache
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item eae6a4b4-f761-5d80-b9ec-2b4b956638ac
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bf6a5d0>
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4be63aaf-524d-54ce-9992-806335a828c2/4be63aaf-524d-54ce-9992-806335a828c2_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/94/dd944bb36870e441ff274d743d0b3462/pa/SK23170_42ee2737afaefb6c6575b9d0af163054.jpg saved to cache
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4be63aaf-524d-54ce-9992-806335a828c2
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bf7af50>
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eae6a4b4-f761-5d80-b9ec-2b4b956638ac/eae6a4b4-f761-5d80-b9ec-2b4b956638ac_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/47/a347737c2f4b6a209001c2ee5aa3e95b/pa/UB37186_49acb63b918c338242136dd441da5687.jpg saved to cache
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item eae6a4b4-f761-5d80-b9ec-2b4b956638ac
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bf6b9d0>
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83a3b0a0-68c4-580d-bb13-e8983a46a85d/83a3b0a0-68c4-580d-bb13-e8983a46a85d_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/c3/9ac3b8c1c51b62eca0fdc5557b8ef270/pa/EC13815_e4a9a6d65d721729110883a8427c4a0b.jpg saved to cache
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 83a3b0a0-68c4-580d-bb13-e8983a46a85d
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438e17c10>
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83a3b0a0-68c4-580d-bb13-e8983a46a85d/83a3b0a0-68c4-580d-bb13-e8983a46a85d_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/c3/9ac3b8c1c51b62eca0fdc5557b8ef270/pa/EC13815_41e6abb4e77e0e238757976d39fa17f2.jpg saved to cache
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 83a3b0a0-68c4-580d-bb13-e8983a46a85d
2026-04-27 07:56:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75e4a66b-f217-5f59-ab91-630e51c71ed0 with identifier: GN80196
2026-04-27 07:56:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75e4a66b-f217-5f59-ab91-630e51c71ed0 with scrape type 1
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 75e4a66b-f217-5f59-ab91-630e51c71ed0
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/82/5f821418a22ffa039872ca9ffbe6250b/pa/GN80196_20806e8065509548c87941f1f9aefd33.jpg not downloaded yet
2026-04-27 07:56:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/94/dd944bb36870e441ff274d743d0b3462/pa/SK23170_e5f688ad94f7b99fa0b6865f5caabc09.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/c7/20c788e248dbf8200cfc3a133b16506a/pa/UG74072_c02ca1ab8e05778cb660a39dd8c4e006.jpg not downloaded yet
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/b1/92b1b39878d78959e20d49b9d3a5b8b1/pa/CS20843_cc6073b31cd825816162765113c24fee.jpg not downloaded yet
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/94/dd944bb36870e441ff274d743d0b3462/pa/SK23170_33f854b28ccbf4b021f1e979878069c8.jpg not downloaded yet
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/30/9f3084297de33006f2f74240aed167e5/pa/ET93179_b53cd04d4ecdd31a4a3ab27fafc76491.jpg not downloaded yet
2026-04-27 07:56:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/47/a347737c2f4b6a209001c2ee5aa3e95b/pa/UB37186_9b9d573c5daeac3a665ce22ad928f987.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/c7/20c788e248dbf8200cfc3a133b16506a/pa/UG74072_2c4f88589db6fbe834a48b00c60f1eb6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/b1/92b1b39878d78959e20d49b9d3a5b8b1/pa/CS20843_1b75890b7af0e893c0cd6e2f5ec8a731.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/b1/92b1b39878d78959e20d49b9d3a5b8b1/pa/CS20843_f3a879bb4823dc2c5cacf057000f49b0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/82/5f821418a22ffa039872ca9ffbe6250b/pa/GN80196_2714a9d6a328ad5b8687da1deea98c34.jpg not downloaded yet
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438e2d9d0>
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35add949-7342-5c84-9f06-2ff009c31f2c/35add949-7342-5c84-9f06-2ff009c31f2c_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/c7/20c788e248dbf8200cfc3a133b16506a/pa/UG74072_fb2f5ca8ddf98a1d434355829b2685e3.jpg saved to cache
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 35add949-7342-5c84-9f06-2ff009c31f2c
2026-04-27 07:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/c7/20c788e248dbf8200cfc3a133b16506a/pa/UG74072_7addbe437bb7613e596fdc86490953a6.jpg not downloaded yet
2026-04-27 07:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/b1/92b1b39878d78959e20d49b9d3a5b8b1/pa/CS20843_4465fa50252936be8890f3ab263632e2.jpg not downloaded yet
2026-04-27 07:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/94/dd944bb36870e441ff274d743d0b3462/pa/SK23170_9d5c7b67a6e88f21dadf9010c1e7a886.jpg not downloaded yet
2026-04-27 07:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/30/9f3084297de33006f2f74240aed167e5/pa/ET93179_59a951a80f10273831ac2ee4aa532142.jpg not downloaded yet
2026-04-27 07:56:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17985263-abb2-5255-ba92-64cfbe8d3900 with identifier: FF87313
2026-04-27 07:56:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17985263-abb2-5255-ba92-64cfbe8d3900 with scrape type 1
2026-04-27 07:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 17985263-abb2-5255-ba92-64cfbe8d3900
2026-04-27 07:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/e3/22e3676f4165528159021523661f1cfb/pa/FF87313_38771d9f1f87abedc3f9900bdbd28013.jpg not downloaded yet
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a67f10>
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4be63aaf-524d-54ce-9992-806335a828c2/4be63aaf-524d-54ce-9992-806335a828c2_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/94/dd944bb36870e441ff274d743d0b3462/pa/SK23170_b85f71515ecc6431c8cbda8f6acb0719.jpg saved to cache
2026-04-27 07:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4be63aaf-524d-54ce-9992-806335a828c2
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bf80d10>
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4d7999b-31fa-5ce7-9f4a-1ac176bdebec/a4d7999b-31fa-5ce7-9f4a-1ac176bdebec_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/5e/4b5ec50a8c2f64a57be79a7e0965e7a1/pa/FE78243_458c926583f940c05b795b7f2ef482fb.jpg saved to cache
2026-04-27 07:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a4d7999b-31fa-5ce7-9f4a-1ac176bdebec
2026-04-27 07:56:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/30/9f3084297de33006f2f74240aed167e5/pa/ET93179_44e08b0400ab7f5332050659b834b0d4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/82/5f821418a22ffa039872ca9ffbe6250b/pa/GN80196_0a00d0080e314a66c1fbe70ad971edac.jpg not downloaded yet
2026-04-27 07:56:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/b1/92b1b39878d78959e20d49b9d3a5b8b1/pa/CS20843_4bd7263cfd77ac0ce655523c2a39d418.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/94/dd944bb36870e441ff274d743d0b3462/pa/SK23170_1bbf33daf5a2dfc699e7ed589f9bdf8b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/b1/92b1b39878d78959e20d49b9d3a5b8b1/pa/CS20843_73877cd53e0d16a07d47a992d135789d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/c7/20c788e248dbf8200cfc3a133b16506a/pa/UG74072_1e40b64e60e22321dee25d9b2f9dc8cf.jpg not downloaded yet
2026-04-27 07:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/b1/92b1b39878d78959e20d49b9d3a5b8b1/pa/CS20843_adb900e43fd480ee72a67cca2c76ad78.jpg not downloaded yet
2026-04-27 07:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/94/dd944bb36870e441ff274d743d0b3462/pa/SK23170_1b352e4596e52dbd16ad53580bef027a.jpg not downloaded yet
2026-04-27 07:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/30/9f3084297de33006f2f74240aed167e5/pa/ET93179_bf9d1b6d2b46be61514ef1fa29786eaa.jpg not downloaded yet
2026-04-27 07:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/e3/22e3676f4165528159021523661f1cfb/pa/FF87313_cabe2e96380c772a144ffbc5f1aa6327.jpg not downloaded yet
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a66ad0>
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4be63aaf-524d-54ce-9992-806335a828c2/4be63aaf-524d-54ce-9992-806335a828c2_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/94/dd944bb36870e441ff274d743d0b3462/pa/SK23170_e5f688ad94f7b99fa0b6865f5caabc09.jpg saved to cache
2026-04-27 07:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4be63aaf-524d-54ce-9992-806335a828c2
2026-04-27 07:56:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/c7/20c788e248dbf8200cfc3a133b16506a/pa/UG74072_5aba9389ca70ba66ec374f2b59a8a8e0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/5e/4b5ec50a8c2f64a57be79a7e0965e7a1/pa/FE78243_c27aa3e126eb7687f4c0dda65ff36aa0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/82/5f821418a22ffa039872ca9ffbe6250b/pa/GN80196_5cb815197112849ccfc4d1acab2295c9.jpg not downloaded yet
2026-04-27 07:56:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/47/a347737c2f4b6a209001c2ee5aa3e95b/pa/UB37186_e1719861510f76d2f893ac8bce3687ea.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/47/a347737c2f4b6a209001c2ee5aa3e95b/pa/UB37186_2592a36263ef34b3e075932e0e118883.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/c7/20c788e248dbf8200cfc3a133b16506a/pa/UG74072_0b1b51f366cc1795e292f164e7c01566.jpg not downloaded yet
2026-04-27 07:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/b1/92b1b39878d78959e20d49b9d3a5b8b1/pa/CS20843_cffb84e8d44a047b3cc128ad6a0a9547.jpg not downloaded yet
2026-04-27 07:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/94/dd944bb36870e441ff274d743d0b3462/pa/SK23170_dca7d9c2da35d1e250e90e19198a71c6.jpg not downloaded yet
2026-04-27 07:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/30/9f3084297de33006f2f74240aed167e5/pa/ET93179_016374ab58b9bee4771bdd656814b6df.jpg not downloaded yet
2026-04-27 07:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/e3/22e3676f4165528159021523661f1cfb/pa/FF87313_b9c6389eb99b45b3d2b169027311e2ca.jpg not downloaded yet
2026-04-27 07:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/82/5f821418a22ffa039872ca9ffbe6250b/pa/GN80196_4581cd45fa0873e65783ba858e9cc567.jpg already downloaded
2026-04-27 07:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/82/5f821418a22ffa039872ca9ffbe6250b/pa/GN80196_125bd59af700e4ae21e9af0835dd1989.jpg not downloaded yet
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438fb4a10>
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eae6a4b4-f761-5d80-b9ec-2b4b956638ac/eae6a4b4-f761-5d80-b9ec-2b4b956638ac_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/47/a347737c2f4b6a209001c2ee5aa3e95b/pa/UB37186_9b9d573c5daeac3a665ce22ad928f987.jpg saved to cache
2026-04-27 07:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item eae6a4b4-f761-5d80-b9ec-2b4b956638ac
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438075a10>
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35add949-7342-5c84-9f06-2ff009c31f2c/35add949-7342-5c84-9f06-2ff009c31f2c_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/c7/20c788e248dbf8200cfc3a133b16506a/pa/UG74072_2c4f88589db6fbe834a48b00c60f1eb6.jpg saved to cache
2026-04-27 07:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 35add949-7342-5c84-9f06-2ff009c31f2c
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438e4ed50>
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9553f7b8-ee36-5bec-a2f7-dfdb650475bd/9553f7b8-ee36-5bec-a2f7-dfdb650475bd_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/b1/92b1b39878d78959e20d49b9d3a5b8b1/pa/CS20843_1b75890b7af0e893c0cd6e2f5ec8a731.jpg saved to cache
2026-04-27 07:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9553f7b8-ee36-5bec-a2f7-dfdb650475bd
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438075310>
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9553f7b8-ee36-5bec-a2f7-dfdb650475bd/9553f7b8-ee36-5bec-a2f7-dfdb650475bd_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/b1/92b1b39878d78959e20d49b9d3a5b8b1/pa/CS20843_f3a879bb4823dc2c5cacf057000f49b0.jpg saved to cache
2026-04-27 07:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9553f7b8-ee36-5bec-a2f7-dfdb650475bd
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b59b10>
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3aef08ca-3219-5855-8bd9-a3431e008b63/3aef08ca-3219-5855-8bd9-a3431e008b63_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/30/9f3084297de33006f2f74240aed167e5/pa/ET93179_44e08b0400ab7f5332050659b834b0d4.jpg saved to cache
2026-04-27 07:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3aef08ca-3219-5855-8bd9-a3431e008b63
2026-04-27 07:56:16 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-04-27 07:56:16 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-04-27 07:56:16 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-04-27 07:56:16 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-04-27 07:56:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438077fd0>
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9553f7b8-ee36-5bec-a2f7-dfdb650475bd/9553f7b8-ee36-5bec-a2f7-dfdb650475bd_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/b1/92b1b39878d78959e20d49b9d3a5b8b1/pa/CS20843_4bd7263cfd77ac0ce655523c2a39d418.jpg saved to cache
2026-04-27 07:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9553f7b8-ee36-5bec-a2f7-dfdb650475bd
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ba5310>
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4be63aaf-524d-54ce-9992-806335a828c2/4be63aaf-524d-54ce-9992-806335a828c2_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/94/dd944bb36870e441ff274d743d0b3462/pa/SK23170_1bbf33daf5a2dfc699e7ed589f9bdf8b.jpg saved to cache
2026-04-27 07:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4be63aaf-524d-54ce-9992-806335a828c2
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b5a810>
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9553f7b8-ee36-5bec-a2f7-dfdb650475bd/9553f7b8-ee36-5bec-a2f7-dfdb650475bd_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/b1/92b1b39878d78959e20d49b9d3a5b8b1/pa/CS20843_73877cd53e0d16a07d47a992d135789d.jpg saved to cache
2026-04-27 07:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9553f7b8-ee36-5bec-a2f7-dfdb650475bd
2026-04-27 07:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/30/9f3084297de33006f2f74240aed167e5/pa/ET93179_d91146ab6cc53483e90236d99506893b.jpg not downloaded yet
2026-04-27 07:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/e3/22e3676f4165528159021523661f1cfb/pa/FF87313_d1c9dfd1eb2989925ebf82864bc5b66d.jpg not downloaded yet
2026-04-27 07:56:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/94/dd944bb36870e441ff274d743d0b3462/pa/SK23170_651f92983e77a17fef823e37dd8b4f0b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/82/5f821418a22ffa039872ca9ffbe6250b/pa/GN80196_20806e8065509548c87941f1f9aefd33.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/94/dd944bb36870e441ff274d743d0b3462/pa/SK23170_024c305647de5458ece6e61bdaefb4dc.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/82/5f821418a22ffa039872ca9ffbe6250b/pa/GN80196_03e3003060e3b42eada59670916626e2.jpg already downloaded
2026-04-27 07:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/82/5f821418a22ffa039872ca9ffbe6250b/pa/GN80196_6684fa499215f08d4fbca8ebe37e30e3.jpg not downloaded yet
2026-04-27 07:56:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/30/9f3084297de33006f2f74240aed167e5/pa/ET93179_3259a7107013e707573b63707a938881.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/30/9f3084297de33006f2f74240aed167e5/pa/ET93179_a4450f6340e9d7be772ef84937a75e20.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/47/a347737c2f4b6a209001c2ee5aa3e95b/pa/UB37186_29e9f2a3c6a65e670050ef8f5122c95b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/30/9f3084297de33006f2f74240aed167e5/pa/ET93179_589f0c205799c9ab7a34b9ffb4c9b0f5.jpg not downloaded yet
2026-04-27 07:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/e3/22e3676f4165528159021523661f1cfb/pa/FF87313_b010772fe296fd2ae4e591f2ac8e29e3.jpg not downloaded yet
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143807b410>
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35add949-7342-5c84-9f06-2ff009c31f2c/35add949-7342-5c84-9f06-2ff009c31f2c_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/c7/20c788e248dbf8200cfc3a133b16506a/pa/UG74072_5aba9389ca70ba66ec374f2b59a8a8e0.jpg saved to cache
2026-04-27 07:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 35add949-7342-5c84-9f06-2ff009c31f2c
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b8c450>
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4d7999b-31fa-5ce7-9f4a-1ac176bdebec/a4d7999b-31fa-5ce7-9f4a-1ac176bdebec_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/5e/4b5ec50a8c2f64a57be79a7e0965e7a1/pa/FE78243_c27aa3e126eb7687f4c0dda65ff36aa0.jpg saved to cache
2026-04-27 07:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a4d7999b-31fa-5ce7-9f4a-1ac176bdebec
2026-04-27 07:56:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a83550>
2026-04-27 07:56:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eae6a4b4-f761-5d80-b9ec-2b4b956638ac/eae6a4b4-f761-5d80-b9ec-2b4b956638ac_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/47/a347737c2f4b6a209001c2ee5aa3e95b/pa/UB37186_e1719861510f76d2f893ac8bce3687ea.jpg saved to cache
2026-04-27 07:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item eae6a4b4-f761-5d80-b9ec-2b4b956638ac
2026-04-27 07:56:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d2ee50>
2026-04-27 07:56:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eae6a4b4-f761-5d80-b9ec-2b4b956638ac/eae6a4b4-f761-5d80-b9ec-2b4b956638ac_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/47/a347737c2f4b6a209001c2ee5aa3e95b/pa/UB37186_2592a36263ef34b3e075932e0e118883.jpg saved to cache
2026-04-27 07:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item eae6a4b4-f761-5d80-b9ec-2b4b956638ac
2026-04-27 07:56:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/b1/92b1b39878d78959e20d49b9d3a5b8b1/pa/CS20843_da10d28a9eaed46502e6e9c7362377e3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/e3/22e3676f4165528159021523661f1cfb/pa/FF87313_38771d9f1f87abedc3f9900bdbd28013.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/82/5f821418a22ffa039872ca9ffbe6250b/pa/GN80196_9fe204bdbfacaa8d49eac0a78fc4da3e.jpg already downloaded
2026-04-27 07:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/82/5f821418a22ffa039872ca9ffbe6250b/pa/GN80196_43d5eac03749d4b0b5501da270359766.jpg already downloaded
2026-04-27 07:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/30/9f3084297de33006f2f74240aed167e5/pa/ET93179_3dca8171047c300d82d224d489e26746.jpg not downloaded yet
2026-04-27 07:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/e3/22e3676f4165528159021523661f1cfb/pa/FF87313_2db48a0f857cf840c89babc90e1ff01b.jpg not downloaded yet
2026-04-27 07:56:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1447ba1c50>
2026-04-27 07:56:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4be63aaf-524d-54ce-9992-806335a828c2/4be63aaf-524d-54ce-9992-806335a828c2_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/94/dd944bb36870e441ff274d743d0b3462/pa/SK23170_651f92983e77a17fef823e37dd8b4f0b.jpg saved to cache
2026-04-27 07:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4be63aaf-524d-54ce-9992-806335a828c2
2026-04-27 07:56:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c89490>
2026-04-27 07:56:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75e4a66b-f217-5f59-ab91-630e51c71ed0/75e4a66b-f217-5f59-ab91-630e51c71ed0_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/82/5f821418a22ffa039872ca9ffbe6250b/pa/GN80196_20806e8065509548c87941f1f9aefd33.jpg saved to cache
2026-04-27 07:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 75e4a66b-f217-5f59-ab91-630e51c71ed0
2026-04-27 07:56:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b58710>
2026-04-27 07:56:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4be63aaf-524d-54ce-9992-806335a828c2/4be63aaf-524d-54ce-9992-806335a828c2_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/94/dd944bb36870e441ff274d743d0b3462/pa/SK23170_024c305647de5458ece6e61bdaefb4dc.jpg saved to cache
2026-04-27 07:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4be63aaf-524d-54ce-9992-806335a828c2
2026-04-27 07:56:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438eb6650>
2026-04-27 07:56:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3aef08ca-3219-5855-8bd9-a3431e008b63/3aef08ca-3219-5855-8bd9-a3431e008b63_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/30/9f3084297de33006f2f74240aed167e5/pa/ET93179_3259a7107013e707573b63707a938881.jpg saved to cache
2026-04-27 07:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3aef08ca-3219-5855-8bd9-a3431e008b63
2026-04-27 07:56:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438eb6f90>
2026-04-27 07:56:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3aef08ca-3219-5855-8bd9-a3431e008b63/3aef08ca-3219-5855-8bd9-a3431e008b63_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/30/9f3084297de33006f2f74240aed167e5/pa/ET93179_a4450f6340e9d7be772ef84937a75e20.jpg saved to cache
2026-04-27 07:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3aef08ca-3219-5855-8bd9-a3431e008b63
2026-04-27 07:56:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438f0add0>
2026-04-27 07:56:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eae6a4b4-f761-5d80-b9ec-2b4b956638ac/eae6a4b4-f761-5d80-b9ec-2b4b956638ac_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/47/a347737c2f4b6a209001c2ee5aa3e95b/pa/UB37186_29e9f2a3c6a65e670050ef8f5122c95b.jpg saved to cache
2026-04-27 07:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item eae6a4b4-f761-5d80-b9ec-2b4b956638ac
2026-04-27 07:56:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/e3/22e3676f4165528159021523661f1cfb/pa/FF87313_d1c9dfd1eb2989925ebf82864bc5b66d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/94/dd944bb36870e441ff274d743d0b3462/pa/SK23170_9d5c7b67a6e88f21dadf9010c1e7a886.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/b1/92b1b39878d78959e20d49b9d3a5b8b1/pa/CS20843_4465fa50252936be8890f3ab263632e2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/c7/20c788e248dbf8200cfc3a133b16506a/pa/UG74072_7addbe437bb7613e596fdc86490953a6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/e3/22e3676f4165528159021523661f1cfb/pa/FF87313_106ce36a5ce5bd6a736f649c19f03863.jpg not downloaded yet
2026-04-27 07:56:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/82/5f821418a22ffa039872ca9ffbe6250b/pa/GN80196_5cb815197112849ccfc4d1acab2295c9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/82/5f821418a22ffa039872ca9ffbe6250b/pa/GN80196_0a00d0080e314a66c1fbe70ad971edac.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/30/9f3084297de33006f2f74240aed167e5/pa/ET93179_59a951a80f10273831ac2ee4aa532142.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/e3/22e3676f4165528159021523661f1cfb/pa/FF87313_cabe2e96380c772a144ffbc5f1aa6327.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/e3/22e3676f4165528159021523661f1cfb/pa/FF87313_b0bfccf412c32fe2051e3bbe143889f1.jpg not downloaded yet
2026-04-27 07:56:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380a4790>
2026-04-27 07:56:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9553f7b8-ee36-5bec-a2f7-dfdb650475bd/9553f7b8-ee36-5bec-a2f7-dfdb650475bd_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/b1/92b1b39878d78959e20d49b9d3a5b8b1/pa/CS20843_da10d28a9eaed46502e6e9c7362377e3.jpg saved to cache
2026-04-27 07:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9553f7b8-ee36-5bec-a2f7-dfdb650475bd
2026-04-27 07:56:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14381f9f10>
2026-04-27 07:56:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17985263-abb2-5255-ba92-64cfbe8d3900/17985263-abb2-5255-ba92-64cfbe8d3900_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/e3/22e3676f4165528159021523661f1cfb/pa/FF87313_38771d9f1f87abedc3f9900bdbd28013.jpg saved to cache
2026-04-27 07:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 17985263-abb2-5255-ba92-64cfbe8d3900
2026-04-27 07:56:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/82/5f821418a22ffa039872ca9ffbe6250b/pa/GN80196_125bd59af700e4ae21e9af0835dd1989.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/e3/22e3676f4165528159021523661f1cfb/pa/FF87313_cb2602f65b0645ccb3e71858d0f76a61.jpg not downloaded yet
2026-04-27 07:56:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438bfda50>
2026-04-27 07:56:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17985263-abb2-5255-ba92-64cfbe8d3900/17985263-abb2-5255-ba92-64cfbe8d3900_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/e3/22e3676f4165528159021523661f1cfb/pa/FF87313_d1c9dfd1eb2989925ebf82864bc5b66d.jpg saved to cache
2026-04-27 07:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 17985263-abb2-5255-ba92-64cfbe8d3900
2026-04-27 07:56:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438cf9150>
2026-04-27 07:56:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4be63aaf-524d-54ce-9992-806335a828c2/4be63aaf-524d-54ce-9992-806335a828c2_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/94/dd944bb36870e441ff274d743d0b3462/pa/SK23170_9d5c7b67a6e88f21dadf9010c1e7a886.jpg saved to cache
2026-04-27 07:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4be63aaf-524d-54ce-9992-806335a828c2
2026-04-27 07:56:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c5be90>
2026-04-27 07:56:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9553f7b8-ee36-5bec-a2f7-dfdb650475bd/9553f7b8-ee36-5bec-a2f7-dfdb650475bd_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/b1/92b1b39878d78959e20d49b9d3a5b8b1/pa/CS20843_4465fa50252936be8890f3ab263632e2.jpg saved to cache
2026-04-27 07:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9553f7b8-ee36-5bec-a2f7-dfdb650475bd
2026-04-27 07:56:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143804ce50>
2026-04-27 07:56:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35add949-7342-5c84-9f06-2ff009c31f2c/35add949-7342-5c84-9f06-2ff009c31f2c_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/c7/20c788e248dbf8200cfc3a133b16506a/pa/UG74072_7addbe437bb7613e596fdc86490953a6.jpg saved to cache
2026-04-27 07:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 35add949-7342-5c84-9f06-2ff009c31f2c
2026-04-27 07:56:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438cfb550>
2026-04-27 07:56:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75e4a66b-f217-5f59-ab91-630e51c71ed0/75e4a66b-f217-5f59-ab91-630e51c71ed0_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/82/5f821418a22ffa039872ca9ffbe6250b/pa/GN80196_5cb815197112849ccfc4d1acab2295c9.jpg saved to cache
2026-04-27 07:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 75e4a66b-f217-5f59-ab91-630e51c71ed0
2026-04-27 07:56:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438af9210>
2026-04-27 07:56:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75e4a66b-f217-5f59-ab91-630e51c71ed0/75e4a66b-f217-5f59-ab91-630e51c71ed0_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/82/5f821418a22ffa039872ca9ffbe6250b/pa/GN80196_0a00d0080e314a66c1fbe70ad971edac.jpg saved to cache
2026-04-27 07:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 75e4a66b-f217-5f59-ab91-630e51c71ed0
2026-04-27 07:56:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438cf9350>
2026-04-27 07:56:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3aef08ca-3219-5855-8bd9-a3431e008b63/3aef08ca-3219-5855-8bd9-a3431e008b63_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/30/9f3084297de33006f2f74240aed167e5/pa/ET93179_59a951a80f10273831ac2ee4aa532142.jpg saved to cache
2026-04-27 07:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3aef08ca-3219-5855-8bd9-a3431e008b63
2026-04-27 07:56:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438aedfd0>
2026-04-27 07:56:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17985263-abb2-5255-ba92-64cfbe8d3900/17985263-abb2-5255-ba92-64cfbe8d3900_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/e3/22e3676f4165528159021523661f1cfb/pa/FF87313_cabe2e96380c772a144ffbc5f1aa6327.jpg saved to cache
2026-04-27 07:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 17985263-abb2-5255-ba92-64cfbe8d3900
2026-04-27 07:56:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/e3/22e3676f4165528159021523661f1cfb/pa/FF87313_2db48a0f857cf840c89babc90e1ff01b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/e3/22e3676f4165528159021523661f1cfb/pa/FF87313_b9c6389eb99b45b3d2b169027311e2ca.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/82/5f821418a22ffa039872ca9ffbe6250b/pa/GN80196_6684fa499215f08d4fbca8ebe37e30e3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/94/dd944bb36870e441ff274d743d0b3462/pa/SK23170_dca7d9c2da35d1e250e90e19198a71c6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/e3/22e3676f4165528159021523661f1cfb/pa/FF87313_8e6a59b8465e56c02a925e054a75fb0c.jpg not downloaded yet
2026-04-27 07:56:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/30/9f3084297de33006f2f74240aed167e5/pa/ET93179_016374ab58b9bee4771bdd656814b6df.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/30/9f3084297de33006f2f74240aed167e5/pa/ET93179_d91146ab6cc53483e90236d99506893b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/b1/92b1b39878d78959e20d49b9d3a5b8b1/pa/CS20843_cffb84e8d44a047b3cc128ad6a0a9547.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438df92d0>
2026-04-27 07:56:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75e4a66b-f217-5f59-ab91-630e51c71ed0/75e4a66b-f217-5f59-ab91-630e51c71ed0_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/82/5f821418a22ffa039872ca9ffbe6250b/pa/GN80196_125bd59af700e4ae21e9af0835dd1989.jpg saved to cache
2026-04-27 07:56:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 75e4a66b-f217-5f59-ab91-630e51c71ed0
2026-04-27 07:56:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143812c510>
2026-04-27 07:56:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17985263-abb2-5255-ba92-64cfbe8d3900/17985263-abb2-5255-ba92-64cfbe8d3900_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/e3/22e3676f4165528159021523661f1cfb/pa/FF87313_2db48a0f857cf840c89babc90e1ff01b.jpg saved to cache
2026-04-27 07:56:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 17985263-abb2-5255-ba92-64cfbe8d3900
2026-04-27 07:56:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438e4ef10>
2026-04-27 07:56:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17985263-abb2-5255-ba92-64cfbe8d3900/17985263-abb2-5255-ba92-64cfbe8d3900_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/e3/22e3676f4165528159021523661f1cfb/pa/FF87313_b9c6389eb99b45b3d2b169027311e2ca.jpg saved to cache
2026-04-27 07:56:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 17985263-abb2-5255-ba92-64cfbe8d3900
2026-04-27 07:56:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/30/9f3084297de33006f2f74240aed167e5/pa/ET93179_3dca8171047c300d82d224d489e26746.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143ade5050>
2026-04-27 07:56:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75e4a66b-f217-5f59-ab91-630e51c71ed0/75e4a66b-f217-5f59-ab91-630e51c71ed0_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/82/5f821418a22ffa039872ca9ffbe6250b/pa/GN80196_6684fa499215f08d4fbca8ebe37e30e3.jpg saved to cache
2026-04-27 07:56:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 75e4a66b-f217-5f59-ab91-630e51c71ed0
2026-04-27 07:56:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14381cd350>
2026-04-27 07:56:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4be63aaf-524d-54ce-9992-806335a828c2/4be63aaf-524d-54ce-9992-806335a828c2_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/94/dd944bb36870e441ff274d743d0b3462/pa/SK23170_dca7d9c2da35d1e250e90e19198a71c6.jpg saved to cache
2026-04-27 07:56:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4be63aaf-524d-54ce-9992-806335a828c2
2026-04-27 07:56:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438eb40d0>
2026-04-27 07:56:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3aef08ca-3219-5855-8bd9-a3431e008b63/3aef08ca-3219-5855-8bd9-a3431e008b63_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/30/9f3084297de33006f2f74240aed167e5/pa/ET93179_016374ab58b9bee4771bdd656814b6df.jpg saved to cache
2026-04-27 07:56:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3aef08ca-3219-5855-8bd9-a3431e008b63
2026-04-27 07:56:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438dfa0d0>
2026-04-27 07:56:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3aef08ca-3219-5855-8bd9-a3431e008b63/3aef08ca-3219-5855-8bd9-a3431e008b63_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/30/9f3084297de33006f2f74240aed167e5/pa/ET93179_d91146ab6cc53483e90236d99506893b.jpg saved to cache
2026-04-27 07:56:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3aef08ca-3219-5855-8bd9-a3431e008b63
2026-04-27 07:56:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438e4e250>
2026-04-27 07:56:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9553f7b8-ee36-5bec-a2f7-dfdb650475bd/9553f7b8-ee36-5bec-a2f7-dfdb650475bd_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/b1/92b1b39878d78959e20d49b9d3a5b8b1/pa/CS20843_cffb84e8d44a047b3cc128ad6a0a9547.jpg saved to cache
2026-04-27 07:56:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9553f7b8-ee36-5bec-a2f7-dfdb650475bd
2026-04-27 07:56:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/e3/22e3676f4165528159021523661f1cfb/pa/FF87313_b010772fe296fd2ae4e591f2ac8e29e3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/e3/22e3676f4165528159021523661f1cfb/pa/FF87313_106ce36a5ce5bd6a736f649c19f03863.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/30/9f3084297de33006f2f74240aed167e5/pa/ET93179_589f0c205799c9ab7a34b9ffb4c9b0f5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/c7/20c788e248dbf8200cfc3a133b16506a/pa/UG74072_0b1b51f366cc1795e292f164e7c01566.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/30/9f3084297de33006f2f74240aed167e5/pa/ET93179_bf9d1b6d2b46be61514ef1fa29786eaa.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/94/dd944bb36870e441ff274d743d0b3462/pa/SK23170_1b352e4596e52dbd16ad53580bef027a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/e3/22e3676f4165528159021523661f1cfb/pa/FF87313_b0bfccf412c32fe2051e3bbe143889f1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14478e6c10>
2026-04-27 07:56:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3aef08ca-3219-5855-8bd9-a3431e008b63/3aef08ca-3219-5855-8bd9-a3431e008b63_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/30/9f3084297de33006f2f74240aed167e5/pa/ET93179_3dca8171047c300d82d224d489e26746.jpg saved to cache
2026-04-27 07:56:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3aef08ca-3219-5855-8bd9-a3431e008b63
2026-04-27 07:56:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/b1/92b1b39878d78959e20d49b9d3a5b8b1/pa/CS20843_adb900e43fd480ee72a67cca2c76ad78.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/82/5f821418a22ffa039872ca9ffbe6250b/pa/GN80196_2714a9d6a328ad5b8687da1deea98c34.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/c7/20c788e248dbf8200cfc3a133b16506a/pa/UG74072_1e40b64e60e22321dee25d9b2f9dc8cf.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143806d790>
2026-04-27 07:56:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17985263-abb2-5255-ba92-64cfbe8d3900/17985263-abb2-5255-ba92-64cfbe8d3900_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/e3/22e3676f4165528159021523661f1cfb/pa/FF87313_b010772fe296fd2ae4e591f2ac8e29e3.jpg saved to cache
2026-04-27 07:56:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 17985263-abb2-5255-ba92-64cfbe8d3900
2026-04-27 07:56:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/b1/92b1b39878d78959e20d49b9d3a5b8b1/pa/CS20843_cc6073b31cd825816162765113c24fee.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b34f90>
2026-04-27 07:56:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17985263-abb2-5255-ba92-64cfbe8d3900/17985263-abb2-5255-ba92-64cfbe8d3900_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/e3/22e3676f4165528159021523661f1cfb/pa/FF87313_106ce36a5ce5bd6a736f649c19f03863.jpg saved to cache
2026-04-27 07:56:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 17985263-abb2-5255-ba92-64cfbe8d3900
2026-04-27 07:56:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/c7/20c788e248dbf8200cfc3a133b16506a/pa/UG74072_c02ca1ab8e05778cb660a39dd8c4e006.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/e3/22e3676f4165528159021523661f1cfb/pa/FF87313_cb2602f65b0645ccb3e71858d0f76a61.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/e3/22e3676f4165528159021523661f1cfb/pa/FF87313_8e6a59b8465e56c02a925e054a75fb0c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/30/9f3084297de33006f2f74240aed167e5/pa/ET93179_b53cd04d4ecdd31a4a3ab27fafc76491.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1447517e50>
2026-04-27 07:56:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3aef08ca-3219-5855-8bd9-a3431e008b63/3aef08ca-3219-5855-8bd9-a3431e008b63_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/30/9f3084297de33006f2f74240aed167e5/pa/ET93179_589f0c205799c9ab7a34b9ffb4c9b0f5.jpg saved to cache
2026-04-27 07:56:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3aef08ca-3219-5855-8bd9-a3431e008b63
2026-04-27 07:56:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b03550>
2026-04-27 07:56:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35add949-7342-5c84-9f06-2ff009c31f2c/35add949-7342-5c84-9f06-2ff009c31f2c_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/c7/20c788e248dbf8200cfc3a133b16506a/pa/UG74072_0b1b51f366cc1795e292f164e7c01566.jpg saved to cache
2026-04-27 07:56:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 35add949-7342-5c84-9f06-2ff009c31f2c
2026-04-27 07:56:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143806d310>
2026-04-27 07:56:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3aef08ca-3219-5855-8bd9-a3431e008b63/3aef08ca-3219-5855-8bd9-a3431e008b63_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/30/9f3084297de33006f2f74240aed167e5/pa/ET93179_bf9d1b6d2b46be61514ef1fa29786eaa.jpg saved to cache
2026-04-27 07:56:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3aef08ca-3219-5855-8bd9-a3431e008b63
2026-04-27 07:56:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c9a050>
2026-04-27 07:56:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4be63aaf-524d-54ce-9992-806335a828c2/4be63aaf-524d-54ce-9992-806335a828c2_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/94/dd944bb36870e441ff274d743d0b3462/pa/SK23170_1b352e4596e52dbd16ad53580bef027a.jpg saved to cache
2026-04-27 07:56:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4be63aaf-524d-54ce-9992-806335a828c2
2026-04-27 07:56:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438e7e890>
2026-04-27 07:56:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17985263-abb2-5255-ba92-64cfbe8d3900/17985263-abb2-5255-ba92-64cfbe8d3900_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/e3/22e3676f4165528159021523661f1cfb/pa/FF87313_b0bfccf412c32fe2051e3bbe143889f1.jpg saved to cache
2026-04-27 07:56:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 17985263-abb2-5255-ba92-64cfbe8d3900
2026-04-27 07:56:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/c7/20c788e248dbf8200cfc3a133b16506a/pa/UG74072_6502d4e9840942bc2f56141153273ac0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/94/dd944bb36870e441ff274d743d0b3462/pa/SK23170_33f854b28ccbf4b021f1e979878069c8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/c7/20c788e248dbf8200cfc3a133b16506a/pa/UG74072_255676c784aaee697b3262e470471d78.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/b1/92b1b39878d78959e20d49b9d3a5b8b1/pa/CS20843_47be64f9197ea94180e5dee2de21197a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438e7df90>
2026-04-27 07:56:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9553f7b8-ee36-5bec-a2f7-dfdb650475bd/9553f7b8-ee36-5bec-a2f7-dfdb650475bd_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/b1/92b1b39878d78959e20d49b9d3a5b8b1/pa/CS20843_adb900e43fd480ee72a67cca2c76ad78.jpg saved to cache
2026-04-27 07:56:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9553f7b8-ee36-5bec-a2f7-dfdb650475bd
2026-04-27 07:56:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c7b4d0>
2026-04-27 07:56:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75e4a66b-f217-5f59-ab91-630e51c71ed0/75e4a66b-f217-5f59-ab91-630e51c71ed0_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/82/5f821418a22ffa039872ca9ffbe6250b/pa/GN80196_2714a9d6a328ad5b8687da1deea98c34.jpg saved to cache
2026-04-27 07:56:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 75e4a66b-f217-5f59-ab91-630e51c71ed0
2026-04-27 07:56:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 75e4a66b-f217-5f59-ab91-630e51c71ed0, skipping ID generation
2026-04-27 07:56:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75e4a66b-f217-5f59-ab91-630e51c71ed0 with scrape type 1
2026-04-27 07:56:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 75e4a66b-f217-5f59-ab91-630e51c71ed0 sending to next pipeline
2026-04-27 07:56:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 75e4a66b-f217-5f59-ab91-630e51c71ed0, identifier: GN80196
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d09710>
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35add949-7342-5c84-9f06-2ff009c31f2c/35add949-7342-5c84-9f06-2ff009c31f2c_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/c7/20c788e248dbf8200cfc3a133b16506a/pa/UG74072_1e40b64e60e22321dee25d9b2f9dc8cf.jpg saved to cache
2026-04-27 07:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 35add949-7342-5c84-9f06-2ff009c31f2c
2026-04-27 07:56:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bf1b7d0>
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9553f7b8-ee36-5bec-a2f7-dfdb650475bd/9553f7b8-ee36-5bec-a2f7-dfdb650475bd_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/b1/92b1b39878d78959e20d49b9d3a5b8b1/pa/CS20843_cc6073b31cd825816162765113c24fee.jpg saved to cache
2026-04-27 07:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9553f7b8-ee36-5bec-a2f7-dfdb650475bd
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438aed850>
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35add949-7342-5c84-9f06-2ff009c31f2c/35add949-7342-5c84-9f06-2ff009c31f2c_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/c7/20c788e248dbf8200cfc3a133b16506a/pa/UG74072_c02ca1ab8e05778cb660a39dd8c4e006.jpg saved to cache
2026-04-27 07:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 35add949-7342-5c84-9f06-2ff009c31f2c
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a728d0>
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17985263-abb2-5255-ba92-64cfbe8d3900/17985263-abb2-5255-ba92-64cfbe8d3900_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/e3/22e3676f4165528159021523661f1cfb/pa/FF87313_cb2602f65b0645ccb3e71858d0f76a61.jpg saved to cache
2026-04-27 07:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 17985263-abb2-5255-ba92-64cfbe8d3900
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438dc9610>
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17985263-abb2-5255-ba92-64cfbe8d3900/17985263-abb2-5255-ba92-64cfbe8d3900_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/e3/22e3676f4165528159021523661f1cfb/pa/FF87313_8e6a59b8465e56c02a925e054a75fb0c.jpg saved to cache
2026-04-27 07:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 17985263-abb2-5255-ba92-64cfbe8d3900
2026-04-27 07:56:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 17985263-abb2-5255-ba92-64cfbe8d3900, skipping ID generation
2026-04-27 07:56:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17985263-abb2-5255-ba92-64cfbe8d3900 with scrape type 1
2026-04-27 07:56:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 17985263-abb2-5255-ba92-64cfbe8d3900 sending to next pipeline
2026-04-27 07:56:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 17985263-abb2-5255-ba92-64cfbe8d3900, identifier: FF87313
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143809fcd0>
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3aef08ca-3219-5855-8bd9-a3431e008b63/3aef08ca-3219-5855-8bd9-a3431e008b63_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/30/9f3084297de33006f2f74240aed167e5/pa/ET93179_b53cd04d4ecdd31a4a3ab27fafc76491.jpg saved to cache
2026-04-27 07:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3aef08ca-3219-5855-8bd9-a3431e008b63
2026-04-27 07:56:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3aef08ca-3219-5855-8bd9-a3431e008b63, skipping ID generation
2026-04-27 07:56:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3aef08ca-3219-5855-8bd9-a3431e008b63 with scrape type 1
2026-04-27 07:56:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3aef08ca-3219-5855-8bd9-a3431e008b63 sending to next pipeline
2026-04-27 07:56:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3aef08ca-3219-5855-8bd9-a3431e008b63, identifier: ET93179
2026-04-27 07:56:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 75e4a66b-f217-5f59-ab91-630e51c71ed0 with identifier: GN80196
2026-04-27 07:56:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 75e4a66b-f217-5f59-ab91-630e51c71ed0 with identifier: GN80196
2026-04-27 07:56:20 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 75e4a66b-f217-5f59-ab91-630e51c71ed0 with identifier: GN80196 to the API
2026-04-27 07:56:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:20 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5f/82/5f821418a22ffa039872ca9ffbe6250b/pa/GN80196_2714a9d6a328ad5b8687da1deea98c34.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'category': None,
 'city': 'Bruz',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-04-28T15:18:08Z',
 'fuel_type': 'diesel',
 'id': '75e4a66b-f217-5f59-ab91-630e51c71ed0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.0246,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GN80196',
 'listing': 'auction',
 'location': 'FR, Bruz',
 'location_confidence': 'geocoded',
 'longitude': -1.7471,
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 158572,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_75e4a66b-f217-5f59-ab91-630e51c71ed0/75e4a66b-f217-5f59-ab91-630e51c71ed0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65199,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/82/5f821418a22ffa039872ca9ffbe6250b/pa/GN80196_20806e8065509548c87941f1f9aefd33.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_75e4a66b-f217-5f59-ab91-630e51c71ed0/75e4a66b-f217-5f59-ab91-630e51c71ed0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66682,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/82/5f821418a22ffa039872ca9ffbe6250b/pa/GN80196_2714a9d6a328ad5b8687da1deea98c34.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_75e4a66b-f217-5f59-ab91-630e51c71ed0/75e4a66b-f217-5f59-ab91-630e51c71ed0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61113,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/82/5f821418a22ffa039872ca9ffbe6250b/pa/GN80196_0a00d0080e314a66c1fbe70ad971edac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_75e4a66b-f217-5f59-ab91-630e51c71ed0/75e4a66b-f217-5f59-ab91-630e51c71ed0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49044,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/82/5f821418a22ffa039872ca9ffbe6250b/pa/GN80196_5cb815197112849ccfc4d1acab2295c9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_75e4a66b-f217-5f59-ab91-630e51c71ed0/75e4a66b-f217-5f59-ab91-630e51c71ed0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51314,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/82/5f821418a22ffa039872ca9ffbe6250b/pa/GN80196_4581cd45fa0873e65783ba858e9cc567.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_75e4a66b-f217-5f59-ab91-630e51c71ed0/75e4a66b-f217-5f59-ab91-630e51c71ed0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63062,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/82/5f821418a22ffa039872ca9ffbe6250b/pa/GN80196_125bd59af700e4ae21e9af0835dd1989.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_75e4a66b-f217-5f59-ab91-630e51c71ed0/75e4a66b-f217-5f59-ab91-630e51c71ed0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46414,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/82/5f821418a22ffa039872ca9ffbe6250b/pa/GN80196_03e3003060e3b42eada59670916626e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_75e4a66b-f217-5f59-ab91-630e51c71ed0/75e4a66b-f217-5f59-ab91-630e51c71ed0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61243,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/82/5f821418a22ffa039872ca9ffbe6250b/pa/GN80196_6684fa499215f08d4fbca8ebe37e30e3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_75e4a66b-f217-5f59-ab91-630e51c71ed0/75e4a66b-f217-5f59-ab91-630e51c71ed0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55467,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/82/5f821418a22ffa039872ca9ffbe6250b/pa/GN80196_9fe204bdbfacaa8d49eac0a78fc4da3e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_75e4a66b-f217-5f59-ab91-630e51c71ed0/75e4a66b-f217-5f59-ab91-630e51c71ed0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58282,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/82/5f821418a22ffa039872ca9ffbe6250b/pa/GN80196_43d5eac03749d4b0b5501da270359766.jpg',
             'Width': 800}],
 'postal_code': '35170',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Ille-et-Vilaine',
 'province_code': 'FR-35',
 'region': 'Bretagne',
 'region_code': 'FR-53',
 'registration_date': '2019-10-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI Countryman Cooper D ALL4',
 'transmission': 'automatic',
 'trim': 'ALL4',
 'year': 2019}
2026-04-27 07:56:21 [auto1.fr] INFO: Saving data for GN80196: {'created_time': 1777276581.037647, 'last_price_update_time': 1777276581.037655, 'has_photos': True, 'auction_closing_time': 1777389488.0}
2026-04-27 07:56:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 17985263-abb2-5255-ba92-64cfbe8d3900 with identifier: FF87313
2026-04-27 07:56:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 17985263-abb2-5255-ba92-64cfbe8d3900 with identifier: FF87313
2026-04-27 07:56:21 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 17985263-abb2-5255-ba92-64cfbe8d3900 with identifier: FF87313 to the API
2026-04-27 07:56:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:21 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img22/e3/22e3676f4165528159021523661f1cfb/pa/FF87313_8e6a59b8465e56c02a925e054a75fb0c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'category': None,
 'city': 'Marckolsheim',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 258,
 'expiration_date': '2026-04-28T15:51:21Z',
 'fuel_type': 'diesel',
 'id': '17985263-abb2-5255-ba92-64cfbe8d3900',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.1647,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FF87313',
 'listing': 'auction',
 'location': 'FR, Marckolsheim',
 'location_confidence': 'geocoded',
 'longitude': 7.544,
 'make': 'BMW',
 'model': '5er',
 'odometer': 258645,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_17985263-abb2-5255-ba92-64cfbe8d3900/17985263-abb2-5255-ba92-64cfbe8d3900_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71117,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/e3/22e3676f4165528159021523661f1cfb/pa/FF87313_38771d9f1f87abedc3f9900bdbd28013.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_17985263-abb2-5255-ba92-64cfbe8d3900/17985263-abb2-5255-ba92-64cfbe8d3900_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68411,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/e3/22e3676f4165528159021523661f1cfb/pa/FF87313_cabe2e96380c772a144ffbc5f1aa6327.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_17985263-abb2-5255-ba92-64cfbe8d3900/17985263-abb2-5255-ba92-64cfbe8d3900_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56311,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/e3/22e3676f4165528159021523661f1cfb/pa/FF87313_b9c6389eb99b45b3d2b169027311e2ca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_17985263-abb2-5255-ba92-64cfbe8d3900/17985263-abb2-5255-ba92-64cfbe8d3900_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52195,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/e3/22e3676f4165528159021523661f1cfb/pa/FF87313_d1c9dfd1eb2989925ebf82864bc5b66d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_17985263-abb2-5255-ba92-64cfbe8d3900/17985263-abb2-5255-ba92-64cfbe8d3900_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55077,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/e3/22e3676f4165528159021523661f1cfb/pa/FF87313_b010772fe296fd2ae4e591f2ac8e29e3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_17985263-abb2-5255-ba92-64cfbe8d3900/17985263-abb2-5255-ba92-64cfbe8d3900_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58191,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/e3/22e3676f4165528159021523661f1cfb/pa/FF87313_2db48a0f857cf840c89babc90e1ff01b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_17985263-abb2-5255-ba92-64cfbe8d3900/17985263-abb2-5255-ba92-64cfbe8d3900_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58377,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/e3/22e3676f4165528159021523661f1cfb/pa/FF87313_106ce36a5ce5bd6a736f649c19f03863.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_17985263-abb2-5255-ba92-64cfbe8d3900/17985263-abb2-5255-ba92-64cfbe8d3900_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69544,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/e3/22e3676f4165528159021523661f1cfb/pa/FF87313_b0bfccf412c32fe2051e3bbe143889f1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_17985263-abb2-5255-ba92-64cfbe8d3900/17985263-abb2-5255-ba92-64cfbe8d3900_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62018,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/e3/22e3676f4165528159021523661f1cfb/pa/FF87313_cb2602f65b0645ccb3e71858d0f76a61.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_17985263-abb2-5255-ba92-64cfbe8d3900/17985263-abb2-5255-ba92-64cfbe8d3900_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45204,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/e3/22e3676f4165528159021523661f1cfb/pa/FF87313_8e6a59b8465e56c02a925e054a75fb0c.jpg',
             'Width': 800}],
 'postal_code': '67390',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Bas-Rhin',
 'province_code': 'FR-67',
 'region': 'Grand Est',
 'region_code': 'FR-44',
 'registration_date': '2013-12-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5er 530d xDrive Modern',
 'transmission': 'automatic',
 'trim': 'xDrive Modern',
 'year': 2013}
2026-04-27 07:56:21 [auto1.fr] INFO: Saving data for FF87313: {'created_time': 1777276581.484201, 'last_price_update_time': 1777276581.48421, 'has_photos': True, 'auction_closing_time': 1777391481.0}
2026-04-27 07:56:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3aef08ca-3219-5855-8bd9-a3431e008b63 with identifier: ET93179
2026-04-27 07:56:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3aef08ca-3219-5855-8bd9-a3431e008b63 with identifier: ET93179
2026-04-27 07:56:21 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 3aef08ca-3219-5855-8bd9-a3431e008b63 with identifier: ET93179 to the API
2026-04-27 07:56:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:21 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img9f/30/9f3084297de33006f2f74240aed167e5/pa/ET93179_b53cd04d4ecdd31a4a3ab27fafc76491.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'category': None,
 'city': 'Marseille',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-04-28T15:58:20Z',
 'fuel_type': 'petrol',
 'id': '3aef08ca-3219-5855-8bd9-a3431e008b63',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 43.2969,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ET93179',
 'listing': 'auction',
 'location': 'FR, Marseille',
 'location_confidence': 'geocoded',
 'longitude': 5.3811,
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 184540,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3aef08ca-3219-5855-8bd9-a3431e008b63/3aef08ca-3219-5855-8bd9-a3431e008b63_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85614,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/30/9f3084297de33006f2f74240aed167e5/pa/ET93179_44e08b0400ab7f5332050659b834b0d4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3aef08ca-3219-5855-8bd9-a3431e008b63/3aef08ca-3219-5855-8bd9-a3431e008b63_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87762,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/30/9f3084297de33006f2f74240aed167e5/pa/ET93179_a4450f6340e9d7be772ef84937a75e20.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3aef08ca-3219-5855-8bd9-a3431e008b63/3aef08ca-3219-5855-8bd9-a3431e008b63_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76554,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/30/9f3084297de33006f2f74240aed167e5/pa/ET93179_3259a7107013e707573b63707a938881.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3aef08ca-3219-5855-8bd9-a3431e008b63/3aef08ca-3219-5855-8bd9-a3431e008b63_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72109,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/30/9f3084297de33006f2f74240aed167e5/pa/ET93179_b53cd04d4ecdd31a4a3ab27fafc76491.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3aef08ca-3219-5855-8bd9-a3431e008b63/3aef08ca-3219-5855-8bd9-a3431e008b63_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69066,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/30/9f3084297de33006f2f74240aed167e5/pa/ET93179_59a951a80f10273831ac2ee4aa532142.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3aef08ca-3219-5855-8bd9-a3431e008b63/3aef08ca-3219-5855-8bd9-a3431e008b63_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78608,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/30/9f3084297de33006f2f74240aed167e5/pa/ET93179_bf9d1b6d2b46be61514ef1fa29786eaa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3aef08ca-3219-5855-8bd9-a3431e008b63/3aef08ca-3219-5855-8bd9-a3431e008b63_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79471,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/30/9f3084297de33006f2f74240aed167e5/pa/ET93179_016374ab58b9bee4771bdd656814b6df.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3aef08ca-3219-5855-8bd9-a3431e008b63/3aef08ca-3219-5855-8bd9-a3431e008b63_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80066,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/30/9f3084297de33006f2f74240aed167e5/pa/ET93179_d91146ab6cc53483e90236d99506893b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3aef08ca-3219-5855-8bd9-a3431e008b63/3aef08ca-3219-5855-8bd9-a3431e008b63_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88730,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/30/9f3084297de33006f2f74240aed167e5/pa/ET93179_589f0c205799c9ab7a34b9ffb4c9b0f5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3aef08ca-3219-5855-8bd9-a3431e008b63/3aef08ca-3219-5855-8bd9-a3431e008b63_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53027,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/30/9f3084297de33006f2f74240aed167e5/pa/ET93179_3dca8171047c300d82d224d489e26746.jpg',
             'Width': 800}],
 'postal_code': '13000',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Bouches-du-Rhône',
 'province_code': 'FR-13',
 'region': "Provence-Alpes-Côte d'Azur",
 'region_code': 'FR-93',
 'registration_date': '2019-12-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.5 TSI ACT Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2019}
2026-04-27 07:56:22 [auto1.fr] INFO: Saving data for ET93179: {'created_time': 1777276582.037474, 'last_price_update_time': 1777276582.037488, 'has_photos': True, 'auction_closing_time': 1777391900.0}
2026-04-27 07:56:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/5e/4b5ec50a8c2f64a57be79a7e0965e7a1/pa/FE78243_c9bb3eb3b903a82468aae70e13552eaa.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/5e/4b5ec50a8c2f64a57be79a7e0965e7a1/pa/FE78243_2a1b063f71172ca54b27db5321b23094.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/5e/4b5ec50a8c2f64a57be79a7e0965e7a1/pa/FE78243_ffaba87ccdd027717301530b31fb66e0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/47/a347737c2f4b6a209001c2ee5aa3e95b/pa/UB37186_810a64564d3cc17cd5eaed903bc13cb9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/c7/20c788e248dbf8200cfc3a133b16506a/pa/UG74072_aa0a465ad6f931767733f93c31617121.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-04-27 07:56:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-04-27 07:56:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-04-27 07:56:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-04-27 07:56:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-04-27 07:56:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438fa4a50>
2026-04-27 07:56:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35add949-7342-5c84-9f06-2ff009c31f2c/35add949-7342-5c84-9f06-2ff009c31f2c_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/c7/20c788e248dbf8200cfc3a133b16506a/pa/UG74072_6502d4e9840942bc2f56141153273ac0.jpg saved to cache
2026-04-27 07:56:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 35add949-7342-5c84-9f06-2ff009c31f2c
2026-04-27 07:56:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438fa6ad0>
2026-04-27 07:56:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4be63aaf-524d-54ce-9992-806335a828c2/4be63aaf-524d-54ce-9992-806335a828c2_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/94/dd944bb36870e441ff274d743d0b3462/pa/SK23170_33f854b28ccbf4b021f1e979878069c8.jpg saved to cache
2026-04-27 07:56:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4be63aaf-524d-54ce-9992-806335a828c2
2026-04-27 07:56:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4be63aaf-524d-54ce-9992-806335a828c2, skipping ID generation
2026-04-27 07:56:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4be63aaf-524d-54ce-9992-806335a828c2 with scrape type 1
2026-04-27 07:56:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4be63aaf-524d-54ce-9992-806335a828c2 sending to next pipeline
2026-04-27 07:56:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4be63aaf-524d-54ce-9992-806335a828c2, identifier: SK23170
2026-04-27 07:56:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c7b950>
2026-04-27 07:56:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35add949-7342-5c84-9f06-2ff009c31f2c/35add949-7342-5c84-9f06-2ff009c31f2c_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/c7/20c788e248dbf8200cfc3a133b16506a/pa/UG74072_255676c784aaee697b3262e470471d78.jpg saved to cache
2026-04-27 07:56:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 35add949-7342-5c84-9f06-2ff009c31f2c
2026-04-27 07:56:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bf6e090>
2026-04-27 07:56:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9553f7b8-ee36-5bec-a2f7-dfdb650475bd/9553f7b8-ee36-5bec-a2f7-dfdb650475bd_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/b1/92b1b39878d78959e20d49b9d3a5b8b1/pa/CS20843_47be64f9197ea94180e5dee2de21197a.jpg saved to cache
2026-04-27 07:56:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9553f7b8-ee36-5bec-a2f7-dfdb650475bd
2026-04-27 07:56:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9553f7b8-ee36-5bec-a2f7-dfdb650475bd, skipping ID generation
2026-04-27 07:56:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9553f7b8-ee36-5bec-a2f7-dfdb650475bd with scrape type 1
2026-04-27 07:56:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9553f7b8-ee36-5bec-a2f7-dfdb650475bd sending to next pipeline
2026-04-27 07:56:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 9553f7b8-ee36-5bec-a2f7-dfdb650475bd, identifier: CS20843
2026-04-27 07:56:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/c3/9ac3b8c1c51b62eca0fdc5557b8ef270/pa/EC13815_0aebdbd60ad7a77fda29f396b88f7331.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/05/bb05cf011c53a14d404bf668cd6c2ac3/pa/RM94372_2413db6b43d2dc94edec9248ae5ce848.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4be63aaf-524d-54ce-9992-806335a828c2 with identifier: SK23170
2026-04-27 07:56:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4be63aaf-524d-54ce-9992-806335a828c2 with identifier: SK23170
2026-04-27 07:56:22 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 4be63aaf-524d-54ce-9992-806335a828c2 with identifier: SK23170 to the API
2026-04-27 07:56:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:22 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgdd/94/dd944bb36870e441ff274d743d0b3462/pa/SK23170_33f854b28ccbf4b021f1e979878069c8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'city': 'Le Cellier',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-04-28T15:20:15Z',
 'fuel_type': 'diesel',
 'id': '4be63aaf-524d-54ce-9992-806335a828c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 47.3196,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SK23170',
 'listing': 'auction',
 'location': 'FR, Le Cellier',
 'location_confidence': 'geocoded',
 'longitude': -1.3472,
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 263970,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4be63aaf-524d-54ce-9992-806335a828c2/4be63aaf-524d-54ce-9992-806335a828c2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61462,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/94/dd944bb36870e441ff274d743d0b3462/pa/SK23170_42ee2737afaefb6c6575b9d0af163054.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4be63aaf-524d-54ce-9992-806335a828c2/4be63aaf-524d-54ce-9992-806335a828c2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60678,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/94/dd944bb36870e441ff274d743d0b3462/pa/SK23170_b85f71515ecc6431c8cbda8f6acb0719.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4be63aaf-524d-54ce-9992-806335a828c2/4be63aaf-524d-54ce-9992-806335a828c2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61514,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/94/dd944bb36870e441ff274d743d0b3462/pa/SK23170_e5f688ad94f7b99fa0b6865f5caabc09.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4be63aaf-524d-54ce-9992-806335a828c2/4be63aaf-524d-54ce-9992-806335a828c2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43151,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/94/dd944bb36870e441ff274d743d0b3462/pa/SK23170_1bbf33daf5a2dfc699e7ed589f9bdf8b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4be63aaf-524d-54ce-9992-806335a828c2/4be63aaf-524d-54ce-9992-806335a828c2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77169,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/94/dd944bb36870e441ff274d743d0b3462/pa/SK23170_024c305647de5458ece6e61bdaefb4dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4be63aaf-524d-54ce-9992-806335a828c2/4be63aaf-524d-54ce-9992-806335a828c2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63986,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/94/dd944bb36870e441ff274d743d0b3462/pa/SK23170_651f92983e77a17fef823e37dd8b4f0b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4be63aaf-524d-54ce-9992-806335a828c2/4be63aaf-524d-54ce-9992-806335a828c2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69514,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/94/dd944bb36870e441ff274d743d0b3462/pa/SK23170_33f854b28ccbf4b021f1e979878069c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4be63aaf-524d-54ce-9992-806335a828c2/4be63aaf-524d-54ce-9992-806335a828c2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69951,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/94/dd944bb36870e441ff274d743d0b3462/pa/SK23170_9d5c7b67a6e88f21dadf9010c1e7a886.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4be63aaf-524d-54ce-9992-806335a828c2/4be63aaf-524d-54ce-9992-806335a828c2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74700,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/94/dd944bb36870e441ff274d743d0b3462/pa/SK23170_1b352e4596e52dbd16ad53580bef027a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4be63aaf-524d-54ce-9992-806335a828c2/4be63aaf-524d-54ce-9992-806335a828c2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64213,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/94/dd944bb36870e441ff274d743d0b3462/pa/SK23170_dca7d9c2da35d1e250e90e19198a71c6.jpg',
             'Width': 800}],
 'postal_code': '44850',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Loire-Atlantique',
 'province_code': 'FR-44',
 'region': 'Pays de la Loire',
 'region_code': 'FR-52',
 'registration_date': '2014-07-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI Cup BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Cup BlueMotion Tech',
 'year': 2014}
2026-04-27 07:56:22 [auto1.fr] INFO: Saving data for SK23170: {'created_time': 1777276582.957347, 'last_price_update_time': 1777276582.957357, 'has_photos': True, 'auction_closing_time': 1777389615.0}
2026-04-27 07:56:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 9553f7b8-ee36-5bec-a2f7-dfdb650475bd with identifier: CS20843
2026-04-27 07:56:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 9553f7b8-ee36-5bec-a2f7-dfdb650475bd with identifier: CS20843
2026-04-27 07:56:23 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 9553f7b8-ee36-5bec-a2f7-dfdb650475bd with identifier: CS20843 to the API
2026-04-27 07:56:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:23 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img92/b1/92b1b39878d78959e20d49b9d3a5b8b1/pa/CS20843_47be64f9197ea94180e5dee2de21197a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'category': None,
 'city': 'Saint-Dizier',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-04-28T15:36:58Z',
 'fuel_type': 'petrol',
 'id': '9553f7b8-ee36-5bec-a2f7-dfdb650475bd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.6377,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CS20843',
 'listing': 'auction',
 'location': 'FR, Saint-Dizier',
 'location_confidence': 'geocoded',
 'longitude': 4.9489,
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 64825,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9553f7b8-ee36-5bec-a2f7-dfdb650475bd/9553f7b8-ee36-5bec-a2f7-dfdb650475bd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 556744,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img92/b1/92b1b39878d78959e20d49b9d3a5b8b1/pa/CS20843_4bd7263cfd77ac0ce655523c2a39d418.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9553f7b8-ee36-5bec-a2f7-dfdb650475bd/9553f7b8-ee36-5bec-a2f7-dfdb650475bd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95356,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/b1/92b1b39878d78959e20d49b9d3a5b8b1/pa/CS20843_1b75890b7af0e893c0cd6e2f5ec8a731.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9553f7b8-ee36-5bec-a2f7-dfdb650475bd/9553f7b8-ee36-5bec-a2f7-dfdb650475bd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80716,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/b1/92b1b39878d78959e20d49b9d3a5b8b1/pa/CS20843_f3a879bb4823dc2c5cacf057000f49b0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9553f7b8-ee36-5bec-a2f7-dfdb650475bd/9553f7b8-ee36-5bec-a2f7-dfdb650475bd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71153,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/b1/92b1b39878d78959e20d49b9d3a5b8b1/pa/CS20843_73877cd53e0d16a07d47a992d135789d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9553f7b8-ee36-5bec-a2f7-dfdb650475bd/9553f7b8-ee36-5bec-a2f7-dfdb650475bd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69509,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/b1/92b1b39878d78959e20d49b9d3a5b8b1/pa/CS20843_47be64f9197ea94180e5dee2de21197a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9553f7b8-ee36-5bec-a2f7-dfdb650475bd/9553f7b8-ee36-5bec-a2f7-dfdb650475bd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75446,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/b1/92b1b39878d78959e20d49b9d3a5b8b1/pa/CS20843_da10d28a9eaed46502e6e9c7362377e3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9553f7b8-ee36-5bec-a2f7-dfdb650475bd/9553f7b8-ee36-5bec-a2f7-dfdb650475bd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62966,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/b1/92b1b39878d78959e20d49b9d3a5b8b1/pa/CS20843_cc6073b31cd825816162765113c24fee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9553f7b8-ee36-5bec-a2f7-dfdb650475bd/9553f7b8-ee36-5bec-a2f7-dfdb650475bd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90206,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/b1/92b1b39878d78959e20d49b9d3a5b8b1/pa/CS20843_4465fa50252936be8890f3ab263632e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9553f7b8-ee36-5bec-a2f7-dfdb650475bd/9553f7b8-ee36-5bec-a2f7-dfdb650475bd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90603,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/b1/92b1b39878d78959e20d49b9d3a5b8b1/pa/CS20843_adb900e43fd480ee72a67cca2c76ad78.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9553f7b8-ee36-5bec-a2f7-dfdb650475bd/9553f7b8-ee36-5bec-a2f7-dfdb650475bd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68415,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/b1/92b1b39878d78959e20d49b9d3a5b8b1/pa/CS20843_cffb84e8d44a047b3cc128ad6a0a9547.jpg',
             'Width': 800}],
 'postal_code': '52100',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Haute-Marne',
 'province_code': 'FR-52',
 'region': 'Grand Est',
 'region_code': 'FR-44',
 'registration_date': '2020-11-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A3 Sportback 35 TFSI S line',
 'transmission': 'manual',
 'trim': 'S line',
 'year': 2020}
2026-04-27 07:56:23 [auto1.fr] INFO: Saving data for CS20843: {'created_time': 1777276583.585147, 'last_price_update_time': 1777276583.585156, 'has_photos': True, 'auction_closing_time': 1777390618.0}
2026-04-27 07:56:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/f5/49f5a2b3f4cdda74c12da23ed4884d10/pa/BL55245_77c6da2699c0f6996fa30f9ace61f694.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/c8/45c8bb809f6f5f9c5c04fda13454ff2c/pa/KU94506_44694dd7119074c2229fff5dee5586ec.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/d5/83d52bbb58e8e2509dfb7a53c7a157a0/pa/CU39401_cd9fb5af89bc52e389381df8ea21220c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/d5/83d52bbb58e8e2509dfb7a53c7a157a0/pa/CU39401_c8e085cc8743f7b34cbea04a351b5807.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/f5/49f5a2b3f4cdda74c12da23ed4884d10/pa/BL55245_91d55fbb3217082920c10564e3e81289.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143809ce10>
2026-04-27 07:56:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4d7999b-31fa-5ce7-9f4a-1ac176bdebec/a4d7999b-31fa-5ce7-9f4a-1ac176bdebec_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/5e/4b5ec50a8c2f64a57be79a7e0965e7a1/pa/FE78243_c9bb3eb3b903a82468aae70e13552eaa.jpg saved to cache
2026-04-27 07:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a4d7999b-31fa-5ce7-9f4a-1ac176bdebec
2026-04-27 07:56:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d08790>
2026-04-27 07:56:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4d7999b-31fa-5ce7-9f4a-1ac176bdebec/a4d7999b-31fa-5ce7-9f4a-1ac176bdebec_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/5e/4b5ec50a8c2f64a57be79a7e0965e7a1/pa/FE78243_2a1b063f71172ca54b27db5321b23094.jpg saved to cache
2026-04-27 07:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a4d7999b-31fa-5ce7-9f4a-1ac176bdebec
2026-04-27 07:56:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380bafd0>
2026-04-27 07:56:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4d7999b-31fa-5ce7-9f4a-1ac176bdebec/a4d7999b-31fa-5ce7-9f4a-1ac176bdebec_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/5e/4b5ec50a8c2f64a57be79a7e0965e7a1/pa/FE78243_ffaba87ccdd027717301530b31fb66e0.jpg saved to cache
2026-04-27 07:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a4d7999b-31fa-5ce7-9f4a-1ac176bdebec
2026-04-27 07:56:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a4d7999b-31fa-5ce7-9f4a-1ac176bdebec, skipping ID generation
2026-04-27 07:56:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4d7999b-31fa-5ce7-9f4a-1ac176bdebec with scrape type 1
2026-04-27 07:56:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a4d7999b-31fa-5ce7-9f4a-1ac176bdebec sending to next pipeline
2026-04-27 07:56:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a4d7999b-31fa-5ce7-9f4a-1ac176bdebec, identifier: FE78243
2026-04-27 07:56:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14381187d0>
2026-04-27 07:56:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eae6a4b4-f761-5d80-b9ec-2b4b956638ac/eae6a4b4-f761-5d80-b9ec-2b4b956638ac_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/47/a347737c2f4b6a209001c2ee5aa3e95b/pa/UB37186_810a64564d3cc17cd5eaed903bc13cb9.jpg saved to cache
2026-04-27 07:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item eae6a4b4-f761-5d80-b9ec-2b4b956638ac
2026-04-27 07:56:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: eae6a4b4-f761-5d80-b9ec-2b4b956638ac, skipping ID generation
2026-04-27 07:56:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eae6a4b4-f761-5d80-b9ec-2b4b956638ac with scrape type 1
2026-04-27 07:56:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item eae6a4b4-f761-5d80-b9ec-2b4b956638ac sending to next pipeline
2026-04-27 07:56:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: eae6a4b4-f761-5d80-b9ec-2b4b956638ac, identifier: UB37186
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c36b50>
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35add949-7342-5c84-9f06-2ff009c31f2c/35add949-7342-5c84-9f06-2ff009c31f2c_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/c7/20c788e248dbf8200cfc3a133b16506a/pa/UG74072_aa0a465ad6f931767733f93c31617121.jpg saved to cache
2026-04-27 07:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 35add949-7342-5c84-9f06-2ff009c31f2c
2026-04-27 07:56:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 35add949-7342-5c84-9f06-2ff009c31f2c, skipping ID generation
2026-04-27 07:56:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35add949-7342-5c84-9f06-2ff009c31f2c with scrape type 1
2026-04-27 07:56:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 35add949-7342-5c84-9f06-2ff009c31f2c sending to next pipeline
2026-04-27 07:56:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 35add949-7342-5c84-9f06-2ff009c31f2c, identifier: UG74072
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438054150>
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83a3b0a0-68c4-580d-bb13-e8983a46a85d/83a3b0a0-68c4-580d-bb13-e8983a46a85d_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/c3/9ac3b8c1c51b62eca0fdc5557b8ef270/pa/EC13815_0aebdbd60ad7a77fda29f396b88f7331.jpg saved to cache
2026-04-27 07:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 83a3b0a0-68c4-580d-bb13-e8983a46a85d
2026-04-27 07:56:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 83a3b0a0-68c4-580d-bb13-e8983a46a85d, skipping ID generation
2026-04-27 07:56:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83a3b0a0-68c4-580d-bb13-e8983a46a85d with scrape type 1
2026-04-27 07:56:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 83a3b0a0-68c4-580d-bb13-e8983a46a85d sending to next pipeline
2026-04-27 07:56:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 83a3b0a0-68c4-580d-bb13-e8983a46a85d, identifier: EC13815
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143804f890>
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_230e089d-130f-55f8-a503-037cdc6cf934/230e089d-130f-55f8-a503-037cdc6cf934_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/05/bb05cf011c53a14d404bf668cd6c2ac3/pa/RM94372_2413db6b43d2dc94edec9248ae5ce848.jpg saved to cache
2026-04-27 07:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 230e089d-130f-55f8-a503-037cdc6cf934
2026-04-27 07:56:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 230e089d-130f-55f8-a503-037cdc6cf934, skipping ID generation
2026-04-27 07:56:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 230e089d-130f-55f8-a503-037cdc6cf934 with scrape type 1
2026-04-27 07:56:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 230e089d-130f-55f8-a503-037cdc6cf934 sending to next pipeline
2026-04-27 07:56:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 230e089d-130f-55f8-a503-037cdc6cf934, identifier: RM94372
2026-04-27 07:56:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a4d7999b-31fa-5ce7-9f4a-1ac176bdebec with identifier: FE78243
2026-04-27 07:56:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a4d7999b-31fa-5ce7-9f4a-1ac176bdebec with identifier: FE78243
2026-04-27 07:56:24 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a4d7999b-31fa-5ce7-9f4a-1ac176bdebec with identifier: FE78243 to the API
2026-04-27 07:56:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:24 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4b/5e/4b5ec50a8c2f64a57be79a7e0965e7a1/pa/FE78243_ffaba87ccdd027717301530b31fb66e0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'city': 'Le Havre',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 130,
 'expiration_date': '2026-04-28T15:30:31Z',
 'fuel_type': 'diesel',
 'id': 'a4d7999b-31fa-5ce7-9f4a-1ac176bdebec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 49.4935,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FE78243',
 'listing': 'auction',
 'location': 'FR, LE HAVRE',
 'location_confidence': 'geocoded',
 'longitude': 0.1079,
 'make': 'Renault',
 'model': 'Grand Scenic',
 'odometer': 168094,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a4d7999b-31fa-5ce7-9f4a-1ac176bdebec/a4d7999b-31fa-5ce7-9f4a-1ac176bdebec_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63558,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/5e/4b5ec50a8c2f64a57be79a7e0965e7a1/pa/FE78243_c90bf06022131aa099dca4aace1e9cba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a4d7999b-31fa-5ce7-9f4a-1ac176bdebec/a4d7999b-31fa-5ce7-9f4a-1ac176bdebec_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58097,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/5e/4b5ec50a8c2f64a57be79a7e0965e7a1/pa/FE78243_067c1a696b51ff0955c61e709db980ec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a4d7999b-31fa-5ce7-9f4a-1ac176bdebec/a4d7999b-31fa-5ce7-9f4a-1ac176bdebec_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60577,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/5e/4b5ec50a8c2f64a57be79a7e0965e7a1/pa/FE78243_1e5eb06358077404ab6db91d6c0380c0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a4d7999b-31fa-5ce7-9f4a-1ac176bdebec/a4d7999b-31fa-5ce7-9f4a-1ac176bdebec_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48484,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/5e/4b5ec50a8c2f64a57be79a7e0965e7a1/pa/FE78243_d8fc77d52e155cf0450cadf5e581fe8f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a4d7999b-31fa-5ce7-9f4a-1ac176bdebec/a4d7999b-31fa-5ce7-9f4a-1ac176bdebec_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54675,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/5e/4b5ec50a8c2f64a57be79a7e0965e7a1/pa/FE78243_d1bb6a7f67332f4b7663c3b39fb335c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a4d7999b-31fa-5ce7-9f4a-1ac176bdebec/a4d7999b-31fa-5ce7-9f4a-1ac176bdebec_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61869,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/5e/4b5ec50a8c2f64a57be79a7e0965e7a1/pa/FE78243_458c926583f940c05b795b7f2ef482fb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a4d7999b-31fa-5ce7-9f4a-1ac176bdebec/a4d7999b-31fa-5ce7-9f4a-1ac176bdebec_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48331,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/5e/4b5ec50a8c2f64a57be79a7e0965e7a1/pa/FE78243_c9bb3eb3b903a82468aae70e13552eaa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a4d7999b-31fa-5ce7-9f4a-1ac176bdebec/a4d7999b-31fa-5ce7-9f4a-1ac176bdebec_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60744,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/5e/4b5ec50a8c2f64a57be79a7e0965e7a1/pa/FE78243_ffaba87ccdd027717301530b31fb66e0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a4d7999b-31fa-5ce7-9f4a-1ac176bdebec/a4d7999b-31fa-5ce7-9f4a-1ac176bdebec_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63839,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/5e/4b5ec50a8c2f64a57be79a7e0965e7a1/pa/FE78243_c27aa3e126eb7687f4c0dda65ff36aa0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a4d7999b-31fa-5ce7-9f4a-1ac176bdebec/a4d7999b-31fa-5ce7-9f4a-1ac176bdebec_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50869,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/5e/4b5ec50a8c2f64a57be79a7e0965e7a1/pa/FE78243_2a1b063f71172ca54b27db5321b23094.jpg',
             'Width': 800}],
 'postal_code': '76050 CEDEX',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Seine-Maritime',
 'province_code': 'FR-76',
 'region': 'Normandie',
 'region_code': 'FR-28',
 'registration_date': '2013-07-31',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Renault Grand Scenic 1.6 dCi BOSE Edition',
 'transmission': 'manual',
 'trim': 'BOSE Edition',
 'year': 2013}
2026-04-27 07:56:24 [auto1.fr] INFO: Saving data for FE78243: {'created_time': 1777276584.886517, 'last_price_update_time': 1777276584.886529, 'has_photos': True, 'auction_closing_time': 1777390231.0}
2026-04-27 07:56:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: eae6a4b4-f761-5d80-b9ec-2b4b956638ac with identifier: UB37186
2026-04-27 07:56:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: eae6a4b4-f761-5d80-b9ec-2b4b956638ac with identifier: UB37186
2026-04-27 07:56:25 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: eae6a4b4-f761-5d80-b9ec-2b4b956638ac with identifier: UB37186 to the API
2026-04-27 07:56:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:25 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga3/47/a347737c2f4b6a209001c2ee5aa3e95b/pa/UB37186_810a64564d3cc17cd5eaed903bc13cb9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 180,
 'expiration_date': '2026-04-28T15:56:11Z',
 'fuel_type': 'diesel',
 'id': 'eae6a4b4-f761-5d80-b9ec-2b4b956638ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB37186',
 'listing': 'auction',
 'location': 'FR',
 'location_confidence': None,
 'longitude': None,
 'make': 'Citroen',
 'model': 'C5',
 'odometer': 265782,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_eae6a4b4-f761-5d80-b9ec-2b4b956638ac/eae6a4b4-f761-5d80-b9ec-2b4b956638ac_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37477,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/47/a347737c2f4b6a209001c2ee5aa3e95b/pa/UB37186_7f5d27555cb5d7a354c6031c44dda0ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_eae6a4b4-f761-5d80-b9ec-2b4b956638ac/eae6a4b4-f761-5d80-b9ec-2b4b956638ac_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37477,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/47/a347737c2f4b6a209001c2ee5aa3e95b/pa/UB37186_d4af987f6f1fe40f0f9ba297fcf19473.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_eae6a4b4-f761-5d80-b9ec-2b4b956638ac/eae6a4b4-f761-5d80-b9ec-2b4b956638ac_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44928,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/47/a347737c2f4b6a209001c2ee5aa3e95b/pa/UB37186_241dfa7268b4fd795da7f87fda145f2d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_eae6a4b4-f761-5d80-b9ec-2b4b956638ac/eae6a4b4-f761-5d80-b9ec-2b4b956638ac_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42077,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/47/a347737c2f4b6a209001c2ee5aa3e95b/pa/UB37186_fe06be1cd55a4bf41c8600e2b334fb0f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_eae6a4b4-f761-5d80-b9ec-2b4b956638ac/eae6a4b4-f761-5d80-b9ec-2b4b956638ac_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46912,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/47/a347737c2f4b6a209001c2ee5aa3e95b/pa/UB37186_49acb63b918c338242136dd441da5687.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_eae6a4b4-f761-5d80-b9ec-2b4b956638ac/eae6a4b4-f761-5d80-b9ec-2b4b956638ac_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45282,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/47/a347737c2f4b6a209001c2ee5aa3e95b/pa/UB37186_9b9d573c5daeac3a665ce22ad928f987.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_eae6a4b4-f761-5d80-b9ec-2b4b956638ac/eae6a4b4-f761-5d80-b9ec-2b4b956638ac_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41558,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/47/a347737c2f4b6a209001c2ee5aa3e95b/pa/UB37186_810a64564d3cc17cd5eaed903bc13cb9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_eae6a4b4-f761-5d80-b9ec-2b4b956638ac/eae6a4b4-f761-5d80-b9ec-2b4b956638ac_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90863,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/47/a347737c2f4b6a209001c2ee5aa3e95b/pa/UB37186_2592a36263ef34b3e075932e0e118883.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_eae6a4b4-f761-5d80-b9ec-2b4b956638ac/eae6a4b4-f761-5d80-b9ec-2b4b956638ac_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82411,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/47/a347737c2f4b6a209001c2ee5aa3e95b/pa/UB37186_e1719861510f76d2f893ac8bce3687ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_eae6a4b4-f761-5d80-b9ec-2b4b956638ac/eae6a4b4-f761-5d80-b9ec-2b4b956638ac_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84870,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/47/a347737c2f4b6a209001c2ee5aa3e95b/pa/UB37186_29e9f2a3c6a65e670050ef8f5122c95b.jpg',
             'Width': 800}],
 'postal_code': None,
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2015-12-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C5 2.0 Blue-HDi Exclusive',
 'transmission': 'automatic',
 'trim': 'Exclusive',
 'year': 2015}
2026-04-27 07:56:25 [auto1.fr] INFO: Saving data for UB37186: {'created_time': 1777276585.237654, 'last_price_update_time': 1777276585.237664, 'has_photos': True, 'auction_closing_time': 1777391771.0}
2026-04-27 07:56:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 35add949-7342-5c84-9f06-2ff009c31f2c with identifier: UG74072
2026-04-27 07:56:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 35add949-7342-5c84-9f06-2ff009c31f2c with identifier: UG74072
2026-04-27 07:56:25 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 35add949-7342-5c84-9f06-2ff009c31f2c with identifier: UG74072 to the API
2026-04-27 07:56:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:25 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img20/c7/20c788e248dbf8200cfc3a133b16506a/pa/UG74072_aa0a465ad6f931767733f93c31617121.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'category': None,
 'city': 'Montivillier',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 92,
 'expiration_date': '2026-04-28T15:49:56Z',
 'fuel_type': 'diesel',
 'id': '35add949-7342-5c84-9f06-2ff009c31f2c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 49.5452,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UG74072',
 'listing': 'auction',
 'location': 'FR, Montivillier',
 'location_confidence': 'geocoded',
 'longitude': 0.1877,
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 135944,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_35add949-7342-5c84-9f06-2ff009c31f2c/35add949-7342-5c84-9f06-2ff009c31f2c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66738,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/c7/20c788e248dbf8200cfc3a133b16506a/pa/UG74072_fb2f5ca8ddf98a1d434355829b2685e3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_35add949-7342-5c84-9f06-2ff009c31f2c/35add949-7342-5c84-9f06-2ff009c31f2c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78396,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/c7/20c788e248dbf8200cfc3a133b16506a/pa/UG74072_2c4f88589db6fbe834a48b00c60f1eb6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_35add949-7342-5c84-9f06-2ff009c31f2c/35add949-7342-5c84-9f06-2ff009c31f2c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68099,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/c7/20c788e248dbf8200cfc3a133b16506a/pa/UG74072_aa0a465ad6f931767733f93c31617121.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_35add949-7342-5c84-9f06-2ff009c31f2c/35add949-7342-5c84-9f06-2ff009c31f2c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66694,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/c7/20c788e248dbf8200cfc3a133b16506a/pa/UG74072_5aba9389ca70ba66ec374f2b59a8a8e0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_35add949-7342-5c84-9f06-2ff009c31f2c/35add949-7342-5c84-9f06-2ff009c31f2c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62121,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/c7/20c788e248dbf8200cfc3a133b16506a/pa/UG74072_255676c784aaee697b3262e470471d78.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_35add949-7342-5c84-9f06-2ff009c31f2c/35add949-7342-5c84-9f06-2ff009c31f2c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 323625,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img20/c7/20c788e248dbf8200cfc3a133b16506a/pa/UG74072_6502d4e9840942bc2f56141153273ac0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_35add949-7342-5c84-9f06-2ff009c31f2c/35add949-7342-5c84-9f06-2ff009c31f2c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63772,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/c7/20c788e248dbf8200cfc3a133b16506a/pa/UG74072_c02ca1ab8e05778cb660a39dd8c4e006.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_35add949-7342-5c84-9f06-2ff009c31f2c/35add949-7342-5c84-9f06-2ff009c31f2c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79867,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/c7/20c788e248dbf8200cfc3a133b16506a/pa/UG74072_7addbe437bb7613e596fdc86490953a6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_35add949-7342-5c84-9f06-2ff009c31f2c/35add949-7342-5c84-9f06-2ff009c31f2c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73588,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/c7/20c788e248dbf8200cfc3a133b16506a/pa/UG74072_1e40b64e60e22321dee25d9b2f9dc8cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_35add949-7342-5c84-9f06-2ff009c31f2c/35add949-7342-5c84-9f06-2ff009c31f2c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62471,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/c7/20c788e248dbf8200cfc3a133b16506a/pa/UG74072_0b1b51f366cc1795e292f164e7c01566.jpg',
             'Width': 800}],
 'postal_code': '76290',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Seine-Maritime',
 'province_code': 'FR-76',
 'region': 'Normandie',
 'region_code': 'FR-28',
 'registration_date': '2014-04-27',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Peugeot Partner 1.6 HDi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2014}
2026-04-27 07:56:25 [auto1.fr] INFO: Saving data for UG74072: {'created_time': 1777276585.649209, 'last_price_update_time': 1777276585.649219, 'has_photos': True, 'auction_closing_time': 1777391396.0}
2026-04-27 07:56:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 83a3b0a0-68c4-580d-bb13-e8983a46a85d with identifier: EC13815
2026-04-27 07:56:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 83a3b0a0-68c4-580d-bb13-e8983a46a85d with identifier: EC13815
2026-04-27 07:56:25 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 83a3b0a0-68c4-580d-bb13-e8983a46a85d with identifier: EC13815 to the API
2026-04-27 07:56:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:26 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img9a/c3/9ac3b8c1c51b62eca0fdc5557b8ef270/pa/EC13815_0aebdbd60ad7a77fda29f396b88f7331.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 164,
 'category': None,
 'city': 'LA CHAPELLE LONGUEVILLE',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 120,
 'expiration_date': '2026-04-28T15:41:56Z',
 'fuel_type': 'diesel',
 'id': '83a3b0a0-68c4-580d-bb13-e8983a46a85d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EC13815',
 'listing': 'auction',
 'location': 'FR, LA CHAPELLE LONGUEVILLE',
 'location_confidence': None,
 'longitude': None,
 'make': 'Citroen',
 'model': 'Jumpy',
 'odometer': 105437,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 18,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_83a3b0a0-68c4-580d-bb13-e8983a46a85d/83a3b0a0-68c4-580d-bb13-e8983a46a85d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117431,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/c3/9ac3b8c1c51b62eca0fdc5557b8ef270/pa/EC13815_ed6002bd75f2bc1c4408dfa233c2db33.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_83a3b0a0-68c4-580d-bb13-e8983a46a85d/83a3b0a0-68c4-580d-bb13-e8983a46a85d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109636,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/c3/9ac3b8c1c51b62eca0fdc5557b8ef270/pa/EC13815_34e4a8298e197aeec3c107e1bbd0487d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_83a3b0a0-68c4-580d-bb13-e8983a46a85d/83a3b0a0-68c4-580d-bb13-e8983a46a85d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57457,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/c3/9ac3b8c1c51b62eca0fdc5557b8ef270/pa/EC13815_d9c3b3cc601ba5b692a42ba6d2a1f394.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_83a3b0a0-68c4-580d-bb13-e8983a46a85d/83a3b0a0-68c4-580d-bb13-e8983a46a85d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50921,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/c3/9ac3b8c1c51b62eca0fdc5557b8ef270/pa/EC13815_bc2265baa8da7b5d020abaca709ceb73.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_83a3b0a0-68c4-580d-bb13-e8983a46a85d/83a3b0a0-68c4-580d-bb13-e8983a46a85d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71466,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/c3/9ac3b8c1c51b62eca0fdc5557b8ef270/pa/EC13815_46810d4ab213cfdf5abee59ede4cec51.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_83a3b0a0-68c4-580d-bb13-e8983a46a85d/83a3b0a0-68c4-580d-bb13-e8983a46a85d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90196,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/c3/9ac3b8c1c51b62eca0fdc5557b8ef270/pa/EC13815_03e3ad0e6cd5f81adf5b3cf66f31e970.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_83a3b0a0-68c4-580d-bb13-e8983a46a85d/83a3b0a0-68c4-580d-bb13-e8983a46a85d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108355,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/c3/9ac3b8c1c51b62eca0fdc5557b8ef270/pa/EC13815_94d31b289cc2ae674a3f3493f352dfd4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_83a3b0a0-68c4-580d-bb13-e8983a46a85d/83a3b0a0-68c4-580d-bb13-e8983a46a85d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75407,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/c3/9ac3b8c1c51b62eca0fdc5557b8ef270/pa/EC13815_e4a9a6d65d721729110883a8427c4a0b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_83a3b0a0-68c4-580d-bb13-e8983a46a85d/83a3b0a0-68c4-580d-bb13-e8983a46a85d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84384,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/c3/9ac3b8c1c51b62eca0fdc5557b8ef270/pa/EC13815_41e6abb4e77e0e238757976d39fa17f2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_83a3b0a0-68c4-580d-bb13-e8983a46a85d/83a3b0a0-68c4-580d-bb13-e8983a46a85d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69868,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/c3/9ac3b8c1c51b62eca0fdc5557b8ef270/pa/EC13815_0aebdbd60ad7a77fda29f396b88f7331.jpg',
             'Width': 800}],
 'postal_code': None,
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2020-10-26',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Citroen Jumpy 1.5 Blue-HDi Driver M',
 'transmission': 'manual',
 'trim': 'Driver M',
 'year': 2020}
2026-04-27 07:56:26 [auto1.fr] INFO: Saving data for EC13815: {'created_time': 1777276586.194282, 'last_price_update_time': 1777276586.19429, 'has_photos': True, 'auction_closing_time': 1777390916.0}
2026-04-27 07:56:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 230e089d-130f-55f8-a503-037cdc6cf934 with identifier: RM94372
2026-04-27 07:56:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 230e089d-130f-55f8-a503-037cdc6cf934 with identifier: RM94372
2026-04-27 07:56:26 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 230e089d-130f-55f8-a503-037cdc6cf934 with identifier: RM94372 to the API
2026-04-27 07:56:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:26 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgbb/05/bb05cf011c53a14d404bf668cd6c2ac3/pa/RM94372_2413db6b43d2dc94edec9248ae5ce848.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'category': None,
 'city': 'Villenoy',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-04-28T15:57:11Z',
 'fuel_type': 'diesel',
 'id': '230e089d-130f-55f8-a503-037cdc6cf934',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.9411,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RM94372',
 'listing': 'auction',
 'location': 'FR, Villenoy',
 'location_confidence': 'geocoded',
 'longitude': 2.8602,
 'make': 'Audi',
 'model': 'A4',
 'odometer': 224039,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_230e089d-130f-55f8-a503-037cdc6cf934/230e089d-130f-55f8-a503-037cdc6cf934_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75228,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/05/bb05cf011c53a14d404bf668cd6c2ac3/pa/RM94372_5cd09f593d77f9213897152c0f37b32b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_230e089d-130f-55f8-a503-037cdc6cf934/230e089d-130f-55f8-a503-037cdc6cf934_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69183,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/05/bb05cf011c53a14d404bf668cd6c2ac3/pa/RM94372_7f6571946379d2e7637945d0452504b2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_230e089d-130f-55f8-a503-037cdc6cf934/230e089d-130f-55f8-a503-037cdc6cf934_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73033,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/05/bb05cf011c53a14d404bf668cd6c2ac3/pa/RM94372_cfdf094a90a65168e06f530f03049428.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_230e089d-130f-55f8-a503-037cdc6cf934/230e089d-130f-55f8-a503-037cdc6cf934_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63363,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/05/bb05cf011c53a14d404bf668cd6c2ac3/pa/RM94372_068fed6df4bbd5ec900d141a6012fd31.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_230e089d-130f-55f8-a503-037cdc6cf934/230e089d-130f-55f8-a503-037cdc6cf934_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69108,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/05/bb05cf011c53a14d404bf668cd6c2ac3/pa/RM94372_a133073f673743b893abb2ede0935f84.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_230e089d-130f-55f8-a503-037cdc6cf934/230e089d-130f-55f8-a503-037cdc6cf934_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75699,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/05/bb05cf011c53a14d404bf668cd6c2ac3/pa/RM94372_6422e46538e685a37dbe4c574b923b6d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_230e089d-130f-55f8-a503-037cdc6cf934/230e089d-130f-55f8-a503-037cdc6cf934_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64690,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/05/bb05cf011c53a14d404bf668cd6c2ac3/pa/RM94372_f44a4cc5bbf9b10cd13a7962dfe015c2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_230e089d-130f-55f8-a503-037cdc6cf934/230e089d-130f-55f8-a503-037cdc6cf934_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75375,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/05/bb05cf011c53a14d404bf668cd6c2ac3/pa/RM94372_2413db6b43d2dc94edec9248ae5ce848.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_230e089d-130f-55f8-a503-037cdc6cf934/230e089d-130f-55f8-a503-037cdc6cf934_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76996,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/05/bb05cf011c53a14d404bf668cd6c2ac3/pa/RM94372_7f240978256f64348d0c7128cb694371.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_230e089d-130f-55f8-a503-037cdc6cf934/230e089d-130f-55f8-a503-037cdc6cf934_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70739,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/05/bb05cf011c53a14d404bf668cd6c2ac3/pa/RM94372_205a1c88fb702ffbebc21b7e345ca831.jpg',
             'Width': 800}],
 'postal_code': '77124',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Seine-et-Marne',
 'province_code': 'FR-77',
 'region': 'Île-de-France',
 'region_code': 'FR-11',
 'registration_date': '2018-06-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI design luxe',
 'transmission': 'automatic',
 'trim': 'design luxe',
 'year': 2018}
2026-04-27 07:56:26 [auto1.fr] INFO: Saving data for RM94372: {'created_time': 1777276586.561501, 'last_price_update_time': 1777276586.561511, 'has_photos': True, 'auction_closing_time': 1777391831.0}
2026-04-27 07:56:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/c8/45c8bb809f6f5f9c5c04fda13454ff2c/pa/KU94506_a0193ad6939ce5415a08de924afecd27.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14477da190>
2026-04-27 07:56:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac2e882b-3ac7-54a4-8742-a09a07f150cd/ac2e882b-3ac7-54a4-8742-a09a07f150cd_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/f5/49f5a2b3f4cdda74c12da23ed4884d10/pa/BL55245_77c6da2699c0f6996fa30f9ace61f694.jpg saved to cache
2026-04-27 07:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ac2e882b-3ac7-54a4-8742-a09a07f150cd
2026-04-27 07:56:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c850d0>
2026-04-27 07:56:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43d1cee6-66cb-5992-b289-2b653dc37a1c/43d1cee6-66cb-5992-b289-2b653dc37a1c_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/c8/45c8bb809f6f5f9c5c04fda13454ff2c/pa/KU94506_44694dd7119074c2229fff5dee5586ec.jpg saved to cache
2026-04-27 07:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 43d1cee6-66cb-5992-b289-2b653dc37a1c
2026-04-27 07:56:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380b8fd0>
2026-04-27 07:56:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_308936d8-9358-5614-8cf5-9a92ec62ed9e/308936d8-9358-5614-8cf5-9a92ec62ed9e_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/d5/83d52bbb58e8e2509dfb7a53c7a157a0/pa/CU39401_cd9fb5af89bc52e389381df8ea21220c.jpg saved to cache
2026-04-27 07:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 308936d8-9358-5614-8cf5-9a92ec62ed9e
2026-04-27 07:56:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b1e410>
2026-04-27 07:56:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_308936d8-9358-5614-8cf5-9a92ec62ed9e/308936d8-9358-5614-8cf5-9a92ec62ed9e_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/d5/83d52bbb58e8e2509dfb7a53c7a157a0/pa/CU39401_c8e085cc8743f7b34cbea04a351b5807.jpg saved to cache
2026-04-27 07:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 308936d8-9358-5614-8cf5-9a92ec62ed9e
2026-04-27 07:56:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bfd56d0>
2026-04-27 07:56:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac2e882b-3ac7-54a4-8742-a09a07f150cd/ac2e882b-3ac7-54a4-8742-a09a07f150cd_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/f5/49f5a2b3f4cdda74c12da23ed4884d10/pa/BL55245_91d55fbb3217082920c10564e3e81289.jpg saved to cache
2026-04-27 07:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ac2e882b-3ac7-54a4-8742-a09a07f150cd
2026-04-27 07:56:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/d5/83d52bbb58e8e2509dfb7a53c7a157a0/pa/CU39401_5c400fd44990a7fcaf8c85338ea988b6.png> (referer: https://www.auto1.com/)
2026-04-27 07:56:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/c8/45c8bb809f6f5f9c5c04fda13454ff2c/pa/KU94506_e1e60a61bf3916f024011fd901e0e65a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/d5/83d52bbb58e8e2509dfb7a53c7a157a0/pa/CU39401_db1d3b16b4cf093c2b779471becd4d22.png> (referer: https://www.auto1.com/)
2026-04-27 07:56:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14381cd810>
2026-04-27 07:56:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43d1cee6-66cb-5992-b289-2b653dc37a1c/43d1cee6-66cb-5992-b289-2b653dc37a1c_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/c8/45c8bb809f6f5f9c5c04fda13454ff2c/pa/KU94506_a0193ad6939ce5415a08de924afecd27.jpg saved to cache
2026-04-27 07:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 43d1cee6-66cb-5992-b289-2b653dc37a1c
2026-04-27 07:56:27 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-04-27 07:56:27 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-04-27 07:56:27 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2026-04-27 07:56:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438effb10>
2026-04-27 07:56:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_308936d8-9358-5614-8cf5-9a92ec62ed9e/308936d8-9358-5614-8cf5-9a92ec62ed9e_image_7.png HTTP/1.1" 201 0
2026-04-27 07:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/d5/83d52bbb58e8e2509dfb7a53c7a157a0/pa/CU39401_5c400fd44990a7fcaf8c85338ea988b6.png saved to cache
2026-04-27 07:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 308936d8-9358-5614-8cf5-9a92ec62ed9e
2026-04-27 07:56:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/f5/49f5a2b3f4cdda74c12da23ed4884d10/pa/BL55245_864fd7f97ba45e1892ce8871a34dc996.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14381f8d90>
2026-04-27 07:56:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43d1cee6-66cb-5992-b289-2b653dc37a1c/43d1cee6-66cb-5992-b289-2b653dc37a1c_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/c8/45c8bb809f6f5f9c5c04fda13454ff2c/pa/KU94506_e1e60a61bf3916f024011fd901e0e65a.jpg saved to cache
2026-04-27 07:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 43d1cee6-66cb-5992-b289-2b653dc37a1c
2026-04-27 07:56:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 43d1cee6-66cb-5992-b289-2b653dc37a1c, skipping ID generation
2026-04-27 07:56:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43d1cee6-66cb-5992-b289-2b653dc37a1c with scrape type 1
2026-04-27 07:56:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 43d1cee6-66cb-5992-b289-2b653dc37a1c sending to next pipeline
2026-04-27 07:56:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 43d1cee6-66cb-5992-b289-2b653dc37a1c, identifier: KU94506
2026-04-27 07:56:27 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-04-27 07:56:27 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-04-27 07:56:27 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2026-04-27 07:56:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438efd590>
2026-04-27 07:56:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_308936d8-9358-5614-8cf5-9a92ec62ed9e/308936d8-9358-5614-8cf5-9a92ec62ed9e_image_6.png HTTP/1.1" 201 0
2026-04-27 07:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/d5/83d52bbb58e8e2509dfb7a53c7a157a0/pa/CU39401_db1d3b16b4cf093c2b779471becd4d22.png saved to cache
2026-04-27 07:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 308936d8-9358-5614-8cf5-9a92ec62ed9e
2026-04-27 07:56:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 43d1cee6-66cb-5992-b289-2b653dc37a1c with identifier: KU94506
2026-04-27 07:56:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 43d1cee6-66cb-5992-b289-2b653dc37a1c with identifier: KU94506
2026-04-27 07:56:27 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 43d1cee6-66cb-5992-b289-2b653dc37a1c with identifier: KU94506 to the API
2026-04-27 07:56:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:27 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img45/c8/45c8bb809f6f5f9c5c04fda13454ff2c/pa/KU94506_e1e60a61bf3916f024011fd901e0e65a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'city': 'Villefranche-sur-Saône',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2026-04-28T15:53:26Z',
 'fuel_type': 'diesel',
 'id': '43d1cee6-66cb-5992-b289-2b653dc37a1c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 45.9897,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KU94506',
 'listing': 'auction',
 'location': 'FR, Villefranche-sur-Saône',
 'location_confidence': 'geocoded',
 'longitude': 4.7196,
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 246854,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_43d1cee6-66cb-5992-b289-2b653dc37a1c/43d1cee6-66cb-5992-b289-2b653dc37a1c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75309,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img45/c8/45c8bb809f6f5f9c5c04fda13454ff2c/pa/KU94506_e1e60a61bf3916f024011fd901e0e65a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_43d1cee6-66cb-5992-b289-2b653dc37a1c/43d1cee6-66cb-5992-b289-2b653dc37a1c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87287,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img45/c8/45c8bb809f6f5f9c5c04fda13454ff2c/pa/KU94506_a0193ad6939ce5415a08de924afecd27.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_43d1cee6-66cb-5992-b289-2b653dc37a1c/43d1cee6-66cb-5992-b289-2b653dc37a1c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66323,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img45/c8/45c8bb809f6f5f9c5c04fda13454ff2c/pa/KU94506_f33d4ecf50bd90170744bba5b7732acd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_43d1cee6-66cb-5992-b289-2b653dc37a1c/43d1cee6-66cb-5992-b289-2b653dc37a1c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78507,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img45/c8/45c8bb809f6f5f9c5c04fda13454ff2c/pa/KU94506_501218577fa9b2fabe19609614209283.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_43d1cee6-66cb-5992-b289-2b653dc37a1c/43d1cee6-66cb-5992-b289-2b653dc37a1c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94135,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img45/c8/45c8bb809f6f5f9c5c04fda13454ff2c/pa/KU94506_44694dd7119074c2229fff5dee5586ec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_43d1cee6-66cb-5992-b289-2b653dc37a1c/43d1cee6-66cb-5992-b289-2b653dc37a1c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80986,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img45/c8/45c8bb809f6f5f9c5c04fda13454ff2c/pa/KU94506_8fde1581a086e269d9be1ee3b3f43c5f.jpg',
             'Width': 800}],
 'postal_code': '69400',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Rhône',
 'province_code': 'FR-69',
 'region': 'Auvergne-Rhône-Alpes',
 'region_code': 'FR-84',
 'registration_date': '2011-06-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 1.6 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2011}
2026-04-27 07:56:27 [auto1.fr] INFO: Saving data for KU94506: {'created_time': 1777276587.809124, 'last_price_update_time': 1777276587.809137, 'has_photos': True, 'auction_closing_time': 1777391606.0}
2026-04-27 07:56:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/f5/49f5a2b3f4cdda74c12da23ed4884d10/pa/BL55245_d6c666ba556640f565075d596348f970.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/d5/83d52bbb58e8e2509dfb7a53c7a157a0/pa/CU39401_b6bb6f9c8c230ce196b79b809be5c6d0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 07:56:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1439c37d10>
2026-04-27 07:56:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac2e882b-3ac7-54a4-8742-a09a07f150cd/ac2e882b-3ac7-54a4-8742-a09a07f150cd_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/f5/49f5a2b3f4cdda74c12da23ed4884d10/pa/BL55245_864fd7f97ba45e1892ce8871a34dc996.jpg saved to cache
2026-04-27 07:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ac2e882b-3ac7-54a4-8742-a09a07f150cd
2026-04-27 07:56:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EA73513> (referer: https://www.auto1.com/v1/car-details-view/EA73513/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DY54580> (referer: https://www.auto1.com/v1/car-details-view/DY54580/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LJ30136/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/f5/49f5a2b3f4cdda74c12da23ed4884d10/pa/BL55245_6e65015af6bbb2300353ef6e308fa1af.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438df8b90>
2026-04-27 07:56:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac2e882b-3ac7-54a4-8742-a09a07f150cd/ac2e882b-3ac7-54a4-8742-a09a07f150cd_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/f5/49f5a2b3f4cdda74c12da23ed4884d10/pa/BL55245_d6c666ba556640f565075d596348f970.jpg saved to cache
2026-04-27 07:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ac2e882b-3ac7-54a4-8742-a09a07f150cd
2026-04-27 07:56:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HP74277> (referer: https://www.auto1.com/v1/car-details-view/HP74277/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14381fb8d0>
2026-04-27 07:56:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_308936d8-9358-5614-8cf5-9a92ec62ed9e/308936d8-9358-5614-8cf5-9a92ec62ed9e_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/d5/83d52bbb58e8e2509dfb7a53c7a157a0/pa/CU39401_b6bb6f9c8c230ce196b79b809be5c6d0.jpg saved to cache
2026-04-27 07:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 308936d8-9358-5614-8cf5-9a92ec62ed9e
2026-04-27 07:56:28 [auto1.fr] INFO: Channel: 24h | Page: 5 | totalHits: 4726 | hits on page: 40
2026-04-27 07:56:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/f5/49f5a2b3f4cdda74c12da23ed4884d10/pa/BL55245_2ad3d2ca8e9643e54b6733c71d21ca71.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/d5/83d52bbb58e8e2509dfb7a53c7a157a0/pa/CU39401_5cb1a4a65d8c39f0fc3c074921d07aa9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:28 [auto1.fr] INFO: Found listing with ID: WP67872
2026-04-27 07:56:28 [auto1.fr] INFO: Scrape type for WP67872: 0
2026-04-27 07:56:28 [auto1.fr] INFO: Found listing with ID: BY44228
2026-04-27 07:56:28 [auto1.fr] INFO: Scrape type for BY44228: 0
2026-04-27 07:56:28 [auto1.fr] INFO: Found listing with ID: KR98436
2026-04-27 07:56:28 [auto1.fr] INFO: Scrape type for KR98436: 0
2026-04-27 07:56:28 [auto1.fr] INFO: Found listing with ID: UV38858
2026-04-27 07:56:28 [auto1.fr] INFO: Scrape type for UV38858: 0
2026-04-27 07:56:28 [auto1.fr] INFO: Found listing with ID: ZM99861
2026-04-27 07:56:28 [auto1.fr] INFO: Scrape type for ZM99861: 0
2026-04-27 07:56:28 [auto1.fr] INFO: Found listing with ID: KV02757
2026-04-27 07:56:28 [auto1.fr] INFO: Scrape type for KV02757: 0
2026-04-27 07:56:28 [auto1.fr] INFO: Found listing with ID: WY50698
2026-04-27 07:56:28 [auto1.fr] INFO: Scrape type for WY50698: 0
2026-04-27 07:56:28 [auto1.fr] INFO: Found listing with ID: XR12990
2026-04-27 07:56:28 [auto1.fr] INFO: Scrape type for XR12990: 1
2026-04-27 07:56:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/f5/49f5a2b3f4cdda74c12da23ed4884d10/pa/BL55245_8aed3cf8afceed4569d9ff1ea6c30cda.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/d5/83d52bbb58e8e2509dfb7a53c7a157a0/pa/CU39401_acc007da37c21defb9c8d7ce229d378d.png> (referer: https://www.auto1.com/)
2026-04-27 07:56:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/d5/83d52bbb58e8e2509dfb7a53c7a157a0/pa/CU39401_b24d471819ac2d5169e8a37c7a69b61d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:28 [auto1.fr] INFO: Found listing with ID: KW15757
2026-04-27 07:56:28 [auto1.fr] INFO: Scrape type for KW15757: 2
2026-04-27 07:56:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f8eecf5-f536-527a-b049-8278e0ca5880 with identifier: KW15757
2026-04-27 07:56:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f8eecf5-f536-527a-b049-8278e0ca5880 with scrape type 2
2026-04-27 07:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5f8eecf5-f536-527a-b049-8278e0ca5880 with scrape type 2
2026-04-27 07:56:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5f8eecf5-f536-527a-b049-8278e0ca5880, identifier: KW15757
2026-04-27 07:56:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5f8eecf5-f536-527a-b049-8278e0ca5880 with identifier: KW15757
2026-04-27 07:56:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5f8eecf5-f536-527a-b049-8278e0ca5880 with identifier: KW15757
2026-04-27 07:56:28 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 5f8eecf5-f536-527a-b049-8278e0ca5880 with identifier: KW15757 to the API
2026-04-27 07:56:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:28 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-04-28T15:04:58Z',
 'fuel_type': 'diesel',
 'id': '5f8eecf5-f536-527a-b049-8278e0ca5880',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KW15757',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Mercedes-Benz',
 'model': 'Viano',
 'odometer': 231576,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2008-11-11',
 'seller_name': None,
 'title': 'Mercedes-Benz Viano 2.1 CDI lang Ambiente',
 'transmission': 'automatic',
 'trim': 'lang Ambiente',
 'year': 2008}
2026-04-27 07:56:28 [auto1.fr] INFO: Saving data for KW15757: {'auction_closing_time': 1777388698.0, 'created_time': 1777022609.146187, 'has_photos': True, 'last_price_update_time': 1777276588.649569}
2026-04-27 07:56:28 [auto1.fr] INFO: Found listing with ID: JK52044
2026-04-27 07:56:28 [auto1.fr] INFO: Scrape type for JK52044: 1
2026-04-27 07:56:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a17137e6-d78f-5734-8693-6c5556c369e0 with identifier: EA73513
2026-04-27 07:56:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a17137e6-d78f-5734-8693-6c5556c369e0 with scrape type 1
2026-04-27 07:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item a17137e6-d78f-5734-8693-6c5556c369e0
2026-04-27 07:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/0e/580ee59c43e4d67de8e0c049ac2fadab/pa/EA73513_5be52b0297d8be33906555380925caa8.jpg not downloaded yet
2026-04-27 07:56:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8bb51b26-4d04-5ea2-88dc-76e5343cfe26 with identifier: DY54580
2026-04-27 07:56:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8bb51b26-4d04-5ea2-88dc-76e5343cfe26 with scrape type 1
2026-04-27 07:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 8bb51b26-4d04-5ea2-88dc-76e5343cfe26
2026-04-27 07:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/2f/cc2ff6c6d387f96da132b1a9acd4dffb/pa/DY54580_1ae9e1c3542ff052bfeb0b824387b947.jpg not downloaded yet
2026-04-27 07:56:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 07:56:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14381867d0>
2026-04-27 07:56:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac2e882b-3ac7-54a4-8742-a09a07f150cd/ac2e882b-3ac7-54a4-8742-a09a07f150cd_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/f5/49f5a2b3f4cdda74c12da23ed4884d10/pa/BL55245_6e65015af6bbb2300353ef6e308fa1af.jpg saved to cache
2026-04-27 07:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ac2e882b-3ac7-54a4-8742-a09a07f150cd
2026-04-27 07:56:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c43656a-ee4f-5a0d-a285-c7b5b2253e23 with identifier: HP74277
2026-04-27 07:56:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c43656a-ee4f-5a0d-a285-c7b5b2253e23 with scrape type 1
2026-04-27 07:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2c43656a-ee4f-5a0d-a285-c7b5b2253e23
2026-04-27 07:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/d9/7ed9a7ceaea1f9633ac167b882ae3f7f/pa/HP74277_f4c9d3f3448df55acd26d27af7d00a9c.jpg not downloaded yet
2026-04-27 07:56:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a4e710>
2026-04-27 07:56:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac2e882b-3ac7-54a4-8742-a09a07f150cd/ac2e882b-3ac7-54a4-8742-a09a07f150cd_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/f5/49f5a2b3f4cdda74c12da23ed4884d10/pa/BL55245_2ad3d2ca8e9643e54b6733c71d21ca71.jpg saved to cache
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ac2e882b-3ac7-54a4-8742-a09a07f150cd
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438e4ef10>
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_308936d8-9358-5614-8cf5-9a92ec62ed9e/308936d8-9358-5614-8cf5-9a92ec62ed9e_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/d5/83d52bbb58e8e2509dfb7a53c7a157a0/pa/CU39401_5cb1a4a65d8c39f0fc3c074921d07aa9.jpg saved to cache
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 308936d8-9358-5614-8cf5-9a92ec62ed9e
2026-04-27 07:56:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/cc/a0cc985089452ef520cd829adac8a2be/pa/NN14660_7b60a79eefa629b1e584f31692ca5ecb.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/cc/a0cc985089452ef520cd829adac8a2be/pa/NN14660_04f7074477fc5b85fe912e6e21411801.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:29 [auto1.fr] INFO: Found listing with ID: ZZ63110
2026-04-27 07:56:29 [auto1.fr] INFO: Scrape type for ZZ63110: 1
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/0e/580ee59c43e4d67de8e0c049ac2fadab/pa/EA73513_84f888e386a20d12f83a65612f8d3a34.jpg not downloaded yet
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/2f/cc2ff6c6d387f96da132b1a9acd4dffb/pa/DY54580_594c0882a0c2a0fa9cedaf15afddff31.jpg not downloaded yet
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/d9/7ed9a7ceaea1f9633ac167b882ae3f7f/pa/HP74277_97a43d71f0e6522027db6091a58b2f71.jpg not downloaded yet
2026-04-27 07:56:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RA48817/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143803d510>
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac2e882b-3ac7-54a4-8742-a09a07f150cd/ac2e882b-3ac7-54a4-8742-a09a07f150cd_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/f5/49f5a2b3f4cdda74c12da23ed4884d10/pa/BL55245_8aed3cf8afceed4569d9ff1ea6c30cda.jpg saved to cache
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ac2e882b-3ac7-54a4-8742-a09a07f150cd
2026-04-27 07:56:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ac2e882b-3ac7-54a4-8742-a09a07f150cd, skipping ID generation
2026-04-27 07:56:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac2e882b-3ac7-54a4-8742-a09a07f150cd with scrape type 1
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ac2e882b-3ac7-54a4-8742-a09a07f150cd sending to next pipeline
2026-04-27 07:56:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ac2e882b-3ac7-54a4-8742-a09a07f150cd, identifier: BL55245
2026-04-27 07:56:29 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-04-27 07:56:29 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-04-27 07:56:29 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438dcae10>
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_308936d8-9358-5614-8cf5-9a92ec62ed9e/308936d8-9358-5614-8cf5-9a92ec62ed9e_image_1.png HTTP/1.1" 201 0
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/d5/83d52bbb58e8e2509dfb7a53c7a157a0/pa/CU39401_acc007da37c21defb9c8d7ce229d378d.png saved to cache
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 308936d8-9358-5614-8cf5-9a92ec62ed9e
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a4f310>
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_308936d8-9358-5614-8cf5-9a92ec62ed9e/308936d8-9358-5614-8cf5-9a92ec62ed9e_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/d5/83d52bbb58e8e2509dfb7a53c7a157a0/pa/CU39401_b24d471819ac2d5169e8a37c7a69b61d.jpg saved to cache
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 308936d8-9358-5614-8cf5-9a92ec62ed9e
2026-04-27 07:56:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 308936d8-9358-5614-8cf5-9a92ec62ed9e, skipping ID generation
2026-04-27 07:56:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 308936d8-9358-5614-8cf5-9a92ec62ed9e with scrape type 1
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 308936d8-9358-5614-8cf5-9a92ec62ed9e sending to next pipeline
2026-04-27 07:56:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 308936d8-9358-5614-8cf5-9a92ec62ed9e, identifier: CU39401
2026-04-27 07:56:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ac2e882b-3ac7-54a4-8742-a09a07f150cd with identifier: BL55245
2026-04-27 07:56:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ac2e882b-3ac7-54a4-8742-a09a07f150cd with identifier: BL55245
2026-04-27 07:56:29 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ac2e882b-3ac7-54a4-8742-a09a07f150cd with identifier: BL55245 to the API
2026-04-27 07:56:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:29 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img49/f5/49f5a2b3f4cdda74c12da23ed4884d10/pa/BL55245_8aed3cf8afceed4569d9ff1ea6c30cda.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'category': None,
 'city': 'Toulouse',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 170,
 'expiration_date': '2026-04-28T15:03:59Z',
 'fuel_type': 'diesel',
 'id': 'ac2e882b-3ac7-54a4-8742-a09a07f150cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 43.6043,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BL55245',
 'listing': 'auction',
 'location': 'FR, Toulouse',
 'location_confidence': 'geocoded',
 'longitude': 1.4437,
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 256069,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ac2e882b-3ac7-54a4-8742-a09a07f150cd/ac2e882b-3ac7-54a4-8742-a09a07f150cd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75441,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/f5/49f5a2b3f4cdda74c12da23ed4884d10/pa/BL55245_2ad3d2ca8e9643e54b6733c71d21ca71.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ac2e882b-3ac7-54a4-8742-a09a07f150cd/ac2e882b-3ac7-54a4-8742-a09a07f150cd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72483,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/f5/49f5a2b3f4cdda74c12da23ed4884d10/pa/BL55245_1a52825f6b06901d2b9aece263f0cc25.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ac2e882b-3ac7-54a4-8742-a09a07f150cd/ac2e882b-3ac7-54a4-8742-a09a07f150cd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62336,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/f5/49f5a2b3f4cdda74c12da23ed4884d10/pa/BL55245_8aed3cf8afceed4569d9ff1ea6c30cda.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ac2e882b-3ac7-54a4-8742-a09a07f150cd/ac2e882b-3ac7-54a4-8742-a09a07f150cd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58562,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/f5/49f5a2b3f4cdda74c12da23ed4884d10/pa/BL55245_d6c666ba556640f565075d596348f970.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ac2e882b-3ac7-54a4-8742-a09a07f150cd/ac2e882b-3ac7-54a4-8742-a09a07f150cd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 374012,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img49/f5/49f5a2b3f4cdda74c12da23ed4884d10/pa/BL55245_afb1824d2294d1be2a426e5c24f2342b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ac2e882b-3ac7-54a4-8742-a09a07f150cd/ac2e882b-3ac7-54a4-8742-a09a07f150cd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69935,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/f5/49f5a2b3f4cdda74c12da23ed4884d10/pa/BL55245_cf77645c04a1a7c89ca5428b56a306de.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ac2e882b-3ac7-54a4-8742-a09a07f150cd/ac2e882b-3ac7-54a4-8742-a09a07f150cd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2264619,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img49/f5/49f5a2b3f4cdda74c12da23ed4884d10/pa/BL55245_864fd7f97ba45e1892ce8871a34dc996.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ac2e882b-3ac7-54a4-8742-a09a07f150cd/ac2e882b-3ac7-54a4-8742-a09a07f150cd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2377701,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img49/f5/49f5a2b3f4cdda74c12da23ed4884d10/pa/BL55245_6e65015af6bbb2300353ef6e308fa1af.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ac2e882b-3ac7-54a4-8742-a09a07f150cd/ac2e882b-3ac7-54a4-8742-a09a07f150cd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65437,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/f5/49f5a2b3f4cdda74c12da23ed4884d10/pa/BL55245_91d55fbb3217082920c10564e3e81289.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ac2e882b-3ac7-54a4-8742-a09a07f150cd/ac2e882b-3ac7-54a4-8742-a09a07f150cd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61223,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/f5/49f5a2b3f4cdda74c12da23ed4884d10/pa/BL55245_77c6da2699c0f6996fa30f9ace61f694.jpg',
             'Width': 800}],
 'postal_code': '31000',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Haute-Garonne',
 'province_code': 'FR-31',
 'region': 'Occitanie',
 'region_code': 'FR-76',
 'registration_date': '2011-09-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VI 2.0 TDI GTD',
 'transmission': 'automatic',
 'trim': 'GTD',
 'year': 2011}
2026-04-27 07:56:29 [auto1.fr] INFO: Saving data for BL55245: {'created_time': 1777276589.85085, 'last_price_update_time': 1777276589.850859, 'has_photos': True, 'auction_closing_time': 1777388639.0}
2026-04-27 07:56:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 308936d8-9358-5614-8cf5-9a92ec62ed9e with identifier: CU39401
2026-04-27 07:56:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 308936d8-9358-5614-8cf5-9a92ec62ed9e with identifier: CU39401
2026-04-27 07:56:29 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 308936d8-9358-5614-8cf5-9a92ec62ed9e with identifier: CU39401 to the API
2026-04-27 07:56:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:30 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img83/d5/83d52bbb58e8e2509dfb7a53c7a157a0/pa/CU39401_b24d471819ac2d5169e8a37c7a69b61d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'city': 'Warluis',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO N\\/A',
 'engine': '1.3L',
 'engine_horse_power': 218,
 'expiration_date': '2026-04-28T15:51:43Z',
 'fuel_type': 'hybrid',
 'id': '308936d8-9358-5614-8cf5-9a92ec62ed9e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'latitude': 49.3887,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CU39401',
 'listing': 'auction',
 'location': 'FR, Warluis',
 'location_confidence': 'geocoded',
 'longitude': 2.1422,
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 81937,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_308936d8-9358-5614-8cf5-9a92ec62ed9e/308936d8-9358-5614-8cf5-9a92ec62ed9e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58145,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/d5/83d52bbb58e8e2509dfb7a53c7a157a0/pa/CU39401_5cb1a4a65d8c39f0fc3c074921d07aa9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_308936d8-9358-5614-8cf5-9a92ec62ed9e/308936d8-9358-5614-8cf5-9a92ec62ed9e_image_1.png',
             'Extension': 'png',
             'FileSizeInBytes': 180722,
             'Height': 512,
             'OriginUrl': 'https://img-pa.auto1.com/img83/d5/83d52bbb58e8e2509dfb7a53c7a157a0/pa/CU39401_acc007da37c21defb9c8d7ce229d378d.png',
             'Width': 512},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_308936d8-9358-5614-8cf5-9a92ec62ed9e/308936d8-9358-5614-8cf5-9a92ec62ed9e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54907,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/d5/83d52bbb58e8e2509dfb7a53c7a157a0/pa/CU39401_b24d471819ac2d5169e8a37c7a69b61d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_308936d8-9358-5614-8cf5-9a92ec62ed9e/308936d8-9358-5614-8cf5-9a92ec62ed9e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93119,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/d5/83d52bbb58e8e2509dfb7a53c7a157a0/pa/CU39401_b6bb6f9c8c230ce196b79b809be5c6d0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_308936d8-9358-5614-8cf5-9a92ec62ed9e/308936d8-9358-5614-8cf5-9a92ec62ed9e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62670,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/d5/83d52bbb58e8e2509dfb7a53c7a157a0/pa/CU39401_c0f032ba096661b4faf517ad3683bed7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_308936d8-9358-5614-8cf5-9a92ec62ed9e/308936d8-9358-5614-8cf5-9a92ec62ed9e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57745,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/d5/83d52bbb58e8e2509dfb7a53c7a157a0/pa/CU39401_2cc0f9924c1c74171619c3dfe6fbb824.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_308936d8-9358-5614-8cf5-9a92ec62ed9e/308936d8-9358-5614-8cf5-9a92ec62ed9e_image_6.png',
             'Extension': 'png',
             'FileSizeInBytes': 180722,
             'Height': 512,
             'OriginUrl': 'https://img-pa.auto1.com/img83/d5/83d52bbb58e8e2509dfb7a53c7a157a0/pa/CU39401_db1d3b16b4cf093c2b779471becd4d22.png',
             'Width': 512},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_308936d8-9358-5614-8cf5-9a92ec62ed9e/308936d8-9358-5614-8cf5-9a92ec62ed9e_image_7.png',
             'Extension': 'png',
             'FileSizeInBytes': 180722,
             'Height': 512,
             'OriginUrl': 'https://img-pa.auto1.com/img83/d5/83d52bbb58e8e2509dfb7a53c7a157a0/pa/CU39401_5c400fd44990a7fcaf8c85338ea988b6.png',
             'Width': 512},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_308936d8-9358-5614-8cf5-9a92ec62ed9e/308936d8-9358-5614-8cf5-9a92ec62ed9e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94581,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/d5/83d52bbb58e8e2509dfb7a53c7a157a0/pa/CU39401_cd9fb5af89bc52e389381df8ea21220c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_308936d8-9358-5614-8cf5-9a92ec62ed9e/308936d8-9358-5614-8cf5-9a92ec62ed9e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85727,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/d5/83d52bbb58e8e2509dfb7a53c7a157a0/pa/CU39401_c8e085cc8743f7b34cbea04a351b5807.jpg',
             'Width': 800}],
 'postal_code': '60430',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Oise',
 'province_code': 'FR-60',
 'region': 'Hauts-de-France',
 'region_code': 'FR-32',
 'registration_date': '2022-08-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 250e AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2022}
2026-04-27 07:56:30 [auto1.fr] INFO: Saving data for CU39401: {'created_time': 1777276590.206011, 'last_price_update_time': 1777276590.206023, 'has_photos': True, 'auction_closing_time': 1777391503.0}
2026-04-27 07:56:30 [auto1.fr] INFO: Found listing with ID: SY66421
2026-04-27 07:56:30 [auto1.fr] INFO: Scrape type for SY66421: 1
2026-04-27 07:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/0e/580ee59c43e4d67de8e0c049ac2fadab/pa/EA73513_393eae5b094b740ee31f52956f783d5e.jpg not downloaded yet
2026-04-27 07:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/2f/cc2ff6c6d387f96da132b1a9acd4dffb/pa/DY54580_de15cca8130cc932a0e41649781fbb87.jpg not downloaded yet
2026-04-27 07:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/d9/7ed9a7ceaea1f9633ac167b882ae3f7f/pa/HP74277_397c0634cd79b6228baf0d43c794f1ab.jpg not downloaded yet
2026-04-27 07:56:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SR18679/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bf2afd0>
2026-04-27 07:56:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7eef059c-ef2d-5c37-bb2e-2758fa114d0d/7eef059c-ef2d-5c37-bb2e-2758fa114d0d_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/cc/a0cc985089452ef520cd829adac8a2be/pa/NN14660_7b60a79eefa629b1e584f31692ca5ecb.jpg saved to cache
2026-04-27 07:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7eef059c-ef2d-5c37-bb2e-2758fa114d0d
2026-04-27 07:56:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c56710>
2026-04-27 07:56:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7eef059c-ef2d-5c37-bb2e-2758fa114d0d/7eef059c-ef2d-5c37-bb2e-2758fa114d0d_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/cc/a0cc985089452ef520cd829adac8a2be/pa/NN14660_04f7074477fc5b85fe912e6e21411801.jpg saved to cache
2026-04-27 07:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7eef059c-ef2d-5c37-bb2e-2758fa114d0d
2026-04-27 07:56:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/d9/7ed9a7ceaea1f9633ac167b882ae3f7f/pa/HP74277_f4c9d3f3448df55acd26d27af7d00a9c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:30 [auto1.fr] INFO: Found listing with ID: AF31669
2026-04-27 07:56:30 [auto1.fr] INFO: Scrape type for AF31669: 2
2026-04-27 07:56:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc7b5f8d-e6bb-5543-aa3a-7991f835635d with identifier: AF31669
2026-04-27 07:56:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc7b5f8d-e6bb-5543-aa3a-7991f835635d with scrape type 2
2026-04-27 07:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bc7b5f8d-e6bb-5543-aa3a-7991f835635d with scrape type 2
2026-04-27 07:56:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: bc7b5f8d-e6bb-5543-aa3a-7991f835635d, identifier: AF31669
2026-04-27 07:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/0e/580ee59c43e4d67de8e0c049ac2fadab/pa/EA73513_ce35fe6e8381cd07ae8bb80b57fe9704.jpg not downloaded yet
2026-04-27 07:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/2f/cc2ff6c6d387f96da132b1a9acd4dffb/pa/DY54580_399d4c024a7e34f64d7a0dccc5b3367a.jpg not downloaded yet
2026-04-27 07:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/d9/7ed9a7ceaea1f9633ac167b882ae3f7f/pa/HP74277_4d6ca886b76e74ad5bc380e48f6072e4.jpg not downloaded yet
2026-04-27 07:56:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CE05021/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: bc7b5f8d-e6bb-5543-aa3a-7991f835635d with identifier: AF31669
2026-04-27 07:56:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: bc7b5f8d-e6bb-5543-aa3a-7991f835635d with identifier: AF31669
2026-04-27 07:56:30 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: bc7b5f8d-e6bb-5543-aa3a-7991f835635d with identifier: AF31669 to the API
2026-04-27 07:56:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:30 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-04-28T15:25:49Z',
 'fuel_type': 'diesel',
 'id': 'bc7b5f8d-e6bb-5543-aa3a-7991f835635d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AF31669',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 215828,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2019-09-23',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Carat Exclusive BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Carat Exclusive BlueMotion Tech',
 'year': 2019}
2026-04-27 07:56:30 [auto1.fr] INFO: Saving data for AF31669: {'auction_closing_time': 1777389949.0, 'created_time': 1777020905.208391, 'has_photos': True, 'last_price_update_time': 1777276590.925847}
2026-04-27 07:56:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LW72658> (referer: https://www.auto1.com/v1/car-details-view/LW72658/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YX93325> (referer: https://www.auto1.com/v1/car-details-view/YX93325/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/2f/cc2ff6c6d387f96da132b1a9acd4dffb/pa/DY54580_1ae9e1c3542ff052bfeb0b824387b947.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:30 [auto1.fr] INFO: Found listing with ID: HK32421
2026-04-27 07:56:30 [auto1.fr] INFO: Scrape type for HK32421: 2
2026-04-27 07:56:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9cfb35b-d653-55e3-b772-e2472e7affe8 with identifier: HK32421
2026-04-27 07:56:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9cfb35b-d653-55e3-b772-e2472e7affe8 with scrape type 2
2026-04-27 07:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f9cfb35b-d653-55e3-b772-e2472e7affe8 with scrape type 2
2026-04-27 07:56:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f9cfb35b-d653-55e3-b772-e2472e7affe8, identifier: HK32421
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/0e/580ee59c43e4d67de8e0c049ac2fadab/pa/EA73513_1407fe8cbfacf400e18a9f218e9226e2.jpg not downloaded yet
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/2f/cc2ff6c6d387f96da132b1a9acd4dffb/pa/DY54580_82cc7b8d12dd3715bb69cc5cf00123ae.jpg not downloaded yet
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/d9/7ed9a7ceaea1f9633ac167b882ae3f7f/pa/HP74277_233e80ca1dba8d54e154058350f208d6.jpg not downloaded yet
2026-04-27 07:56:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f9cfb35b-d653-55e3-b772-e2472e7affe8 with identifier: HK32421
2026-04-27 07:56:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f9cfb35b-d653-55e3-b772-e2472e7affe8 with identifier: HK32421
2026-04-27 07:56:31 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f9cfb35b-d653-55e3-b772-e2472e7affe8 with identifier: HK32421 to the API
2026-04-27 07:56:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:31 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-04-28T15:53:23Z',
 'fuel_type': 'petrol',
 'id': 'f9cfb35b-d653-55e3-b772-e2472e7affe8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HK32421',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 96507,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2016-04-14',
 'seller_name': None,
 'title': 'Citroen C3 1.0 VTi Confort',
 'transmission': 'manual',
 'trim': 'Confort',
 'year': 2016}
2026-04-27 07:56:32 [auto1.fr] INFO: Saving data for HK32421: {'auction_closing_time': 1777391603.0, 'created_time': 1777022139.713592, 'has_photos': True, 'last_price_update_time': 1777276592.013775}
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c5f210>
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c43656a-ee4f-5a0d-a285-c7b5b2253e23/2c43656a-ee4f-5a0d-a285-c7b5b2253e23_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/d9/7ed9a7ceaea1f9633ac167b882ae3f7f/pa/HP74277_f4c9d3f3448df55acd26d27af7d00a9c.jpg saved to cache
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2c43656a-ee4f-5a0d-a285-c7b5b2253e23
2026-04-27 07:56:32 [auto1.fr] INFO: Found listing with ID: ZV63731
2026-04-27 07:56:32 [auto1.fr] INFO: Scrape type for ZV63731: 1
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/0e/580ee59c43e4d67de8e0c049ac2fadab/pa/EA73513_402a107ae5c0b5b3c4153e6fe635220a.jpg not downloaded yet
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/2f/cc2ff6c6d387f96da132b1a9acd4dffb/pa/DY54580_21a71e3ab8004e5b0df9ed3cf2d79631.jpg not downloaded yet
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/d9/7ed9a7ceaea1f9633ac167b882ae3f7f/pa/HP74277_77e985b77ed8523090722f9b04be8754.jpg not downloaded yet
2026-04-27 07:56:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DM72572/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/2f/cc2ff6c6d387f96da132b1a9acd4dffb/pa/DY54580_399d4c024a7e34f64d7a0dccc5b3367a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/d9/7ed9a7ceaea1f9633ac167b882ae3f7f/pa/HP74277_4d6ca886b76e74ad5bc380e48f6072e4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/2f/cc2ff6c6d387f96da132b1a9acd4dffb/pa/DY54580_de15cca8130cc932a0e41649781fbb87.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/d9/7ed9a7ceaea1f9633ac167b882ae3f7f/pa/HP74277_397c0634cd79b6228baf0d43c794f1ab.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:32 [auto1.fr] INFO: Found listing with ID: DZ43932
2026-04-27 07:56:32 [auto1.fr] INFO: Scrape type for DZ43932: 2
2026-04-27 07:56:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58d8c5b4-8ea1-50ee-bb36-cc39b2acead7 with identifier: DZ43932
2026-04-27 07:56:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58d8c5b4-8ea1-50ee-bb36-cc39b2acead7 with scrape type 2
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 58d8c5b4-8ea1-50ee-bb36-cc39b2acead7 with scrape type 2
2026-04-27 07:56:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 58d8c5b4-8ea1-50ee-bb36-cc39b2acead7, identifier: DZ43932
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/d9/7ed9a7ceaea1f9633ac167b882ae3f7f/pa/HP74277_3e14bf716e01157a8dd77ac193442732.jpg not downloaded yet
2026-04-27 07:56:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RM20778/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab79b201-5299-5180-a9f9-70564d67c83d with identifier: LW72658
2026-04-27 07:56:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab79b201-5299-5180-a9f9-70564d67c83d with scrape type 1
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ab79b201-5299-5180-a9f9-70564d67c83d
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/e0/7de0207df3c3822f293520ec5b7c6844/pa/LW72658_468e9806d2d939e651d64012e417d790.jpg not downloaded yet
2026-04-27 07:56:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c1ceac8-bb84-5ecb-956c-df216b19a37d with identifier: YX93325
2026-04-27 07:56:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c1ceac8-bb84-5ecb-956c-df216b19a37d with scrape type 1
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 3c1ceac8-bb84-5ecb-956c-df216b19a37d
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/1c/841cec14fd4f67af8557d3ec12a213c0/pa/YX93325_998560c660ffa642a0fb48e31853f3a9.jpg not downloaded yet
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143806dc50>
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bb51b26-4d04-5ea2-88dc-76e5343cfe26/8bb51b26-4d04-5ea2-88dc-76e5343cfe26_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/2f/cc2ff6c6d387f96da132b1a9acd4dffb/pa/DY54580_1ae9e1c3542ff052bfeb0b824387b947.jpg saved to cache
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8bb51b26-4d04-5ea2-88dc-76e5343cfe26
2026-04-27 07:56:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/0e/580ee59c43e4d67de8e0c049ac2fadab/pa/EA73513_ce35fe6e8381cd07ae8bb80b57fe9704.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 58d8c5b4-8ea1-50ee-bb36-cc39b2acead7 with identifier: DZ43932
2026-04-27 07:56:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 58d8c5b4-8ea1-50ee-bb36-cc39b2acead7 with identifier: DZ43932
2026-04-27 07:56:32 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 58d8c5b4-8ea1-50ee-bb36-cc39b2acead7 with identifier: DZ43932 to the API
2026-04-27 07:56:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:32 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-04-28T15:55:01Z',
 'fuel_type': 'diesel',
 'id': '58d8c5b4-8ea1-50ee-bb36-cc39b2acead7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DZ43932',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Peugeot',
 'model': '308',
 'odometer': 134717,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2017-06-14',
 'seller_name': None,
 'title': 'Peugeot 308 1.6 Blue-HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2017}
2026-04-27 07:56:32 [auto1.fr] INFO: Saving data for DZ43932: {'auction_closing_time': 1777391701.0, 'created_time': 1777022297.997601, 'has_photos': True, 'last_price_update_time': 1777276592.803481}
2026-04-27 07:56:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:32 [auto1.fr] INFO: Found listing with ID: LB50904
2026-04-27 07:56:32 [auto1.fr] INFO: Scrape type for LB50904: 1
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/d9/7ed9a7ceaea1f9633ac167b882ae3f7f/pa/HP74277_61431f25713f1587ceb40c9c969eb21e.jpg not downloaded yet
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/e0/7de0207df3c3822f293520ec5b7c6844/pa/LW72658_6b405749d8c0fddbf7648f3354fc588f.jpg not downloaded yet
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/1c/841cec14fd4f67af8557d3ec12a213c0/pa/YX93325_edb95af92c9f816e0db8de1109ee24e2.jpg not downloaded yet
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14381df090>
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bb51b26-4d04-5ea2-88dc-76e5343cfe26/8bb51b26-4d04-5ea2-88dc-76e5343cfe26_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/2f/cc2ff6c6d387f96da132b1a9acd4dffb/pa/DY54580_399d4c024a7e34f64d7a0dccc5b3367a.jpg saved to cache
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8bb51b26-4d04-5ea2-88dc-76e5343cfe26
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14381fc490>
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c43656a-ee4f-5a0d-a285-c7b5b2253e23/2c43656a-ee4f-5a0d-a285-c7b5b2253e23_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/d9/7ed9a7ceaea1f9633ac167b882ae3f7f/pa/HP74277_4d6ca886b76e74ad5bc380e48f6072e4.jpg saved to cache
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2c43656a-ee4f-5a0d-a285-c7b5b2253e23
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380499d0>
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bb51b26-4d04-5ea2-88dc-76e5343cfe26/8bb51b26-4d04-5ea2-88dc-76e5343cfe26_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/2f/cc2ff6c6d387f96da132b1a9acd4dffb/pa/DY54580_de15cca8130cc932a0e41649781fbb87.jpg saved to cache
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8bb51b26-4d04-5ea2-88dc-76e5343cfe26
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143804a290>
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c43656a-ee4f-5a0d-a285-c7b5b2253e23/2c43656a-ee4f-5a0d-a285-c7b5b2253e23_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/d9/7ed9a7ceaea1f9633ac167b882ae3f7f/pa/HP74277_397c0634cd79b6228baf0d43c794f1ab.jpg saved to cache
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2c43656a-ee4f-5a0d-a285-c7b5b2253e23
2026-04-27 07:56:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/0e/580ee59c43e4d67de8e0c049ac2fadab/pa/EA73513_402a107ae5c0b5b3c4153e6fe635220a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:33 [auto1.fr] INFO: Found listing with ID: WX31823
2026-04-27 07:56:33 [auto1.fr] INFO: Scrape type for WX31823: 2
2026-04-27 07:56:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df55f012-bd3a-5e0c-8f08-022e6d1cc690 with identifier: WX31823
2026-04-27 07:56:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df55f012-bd3a-5e0c-8f08-022e6d1cc690 with scrape type 2
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item df55f012-bd3a-5e0c-8f08-022e6d1cc690 with scrape type 2
2026-04-27 07:56:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: df55f012-bd3a-5e0c-8f08-022e6d1cc690, identifier: WX31823
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/d9/7ed9a7ceaea1f9633ac167b882ae3f7f/pa/HP74277_b30c597a5950b01758d0b817a2d75c6a.jpg not downloaded yet
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/e0/7de0207df3c3822f293520ec5b7c6844/pa/LW72658_499d601a2fd89823e26069001bddf36a.jpg not downloaded yet
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/1c/841cec14fd4f67af8557d3ec12a213c0/pa/YX93325_b958fc0e0fa7d92c18b1d73d55304ce2.jpg not downloaded yet
2026-04-27 07:56:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YJ22330/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/2f/cc2ff6c6d387f96da132b1a9acd4dffb/pa/DY54580_21a71e3ab8004e5b0df9ed3cf2d79631.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/d9/7ed9a7ceaea1f9633ac167b882ae3f7f/pa/HP74277_77e985b77ed8523090722f9b04be8754.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: df55f012-bd3a-5e0c-8f08-022e6d1cc690 with identifier: WX31823
2026-04-27 07:56:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: df55f012-bd3a-5e0c-8f08-022e6d1cc690 with identifier: WX31823
2026-04-27 07:56:33 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: df55f012-bd3a-5e0c-8f08-022e6d1cc690 with identifier: WX31823 to the API
2026-04-27 07:56:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:33 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 92,
 'expiration_date': '2026-04-28T15:44:38Z',
 'fuel_type': 'diesel',
 'id': 'df55f012-bd3a-5e0c-8f08-022e6d1cc690',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WX31823',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Peugeot',
 'model': '308',
 'odometer': 118311,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2012-05-06',
 'seller_name': None,
 'title': 'Peugeot 308 1.6 HDi Business',
 'transmission': 'manual',
 'trim': 'Business',
 'year': 2012}
2026-04-27 07:56:33 [auto1.fr] INFO: Saving data for WX31823: {'auction_closing_time': 1777391078.0, 'created_time': 1777021234.752759, 'has_photos': True, 'last_price_update_time': 1777276593.578758}
2026-04-27 07:56:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c95490>
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a17137e6-d78f-5734-8693-6c5556c369e0/a17137e6-d78f-5734-8693-6c5556c369e0_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/0e/580ee59c43e4d67de8e0c049ac2fadab/pa/EA73513_ce35fe6e8381cd07ae8bb80b57fe9704.jpg saved to cache
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a17137e6-d78f-5734-8693-6c5556c369e0
2026-04-27 07:56:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/d9/7ed9a7ceaea1f9633ac167b882ae3f7f/pa/HP74277_233e80ca1dba8d54e154058350f208d6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:33 [auto1.fr] INFO: Found listing with ID: BH08048
2026-04-27 07:56:33 [auto1.fr] INFO: Scrape type for BH08048: 2
2026-04-27 07:56:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 731c9964-96df-5d13-8ce3-57c2393b1315 with identifier: BH08048
2026-04-27 07:56:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 731c9964-96df-5d13-8ce3-57c2393b1315 with scrape type 2
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 731c9964-96df-5d13-8ce3-57c2393b1315 with scrape type 2
2026-04-27 07:56:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 731c9964-96df-5d13-8ce3-57c2393b1315, identifier: BH08048
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/d9/7ed9a7ceaea1f9633ac167b882ae3f7f/pa/HP74277_31f7243f564cdd24b57eff6b63561315.jpg not downloaded yet
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/e0/7de0207df3c3822f293520ec5b7c6844/pa/LW72658_8f7039640fd93953c812b1bf5a4c0173.jpg not downloaded yet
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/1c/841cec14fd4f67af8557d3ec12a213c0/pa/YX93325_1714b5e54a78bec8dc40f3264ddd2b9f.jpg not downloaded yet
2026-04-27 07:56:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 731c9964-96df-5d13-8ce3-57c2393b1315 with identifier: BH08048
2026-04-27 07:56:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 731c9964-96df-5d13-8ce3-57c2393b1315 with identifier: BH08048
2026-04-27 07:56:33 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 731c9964-96df-5d13-8ce3-57c2393b1315 with identifier: BH08048 to the API
2026-04-27 07:56:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:33 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-04-28T15:06:40Z',
 'fuel_type': 'diesel',
 'id': '731c9964-96df-5d13-8ce3-57c2393b1315',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BH08048',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 176321,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2018-03-28',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Comfortline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2018}
2026-04-27 07:56:34 [auto1.fr] INFO: Saving data for BH08048: {'auction_closing_time': 1777388800.0, 'created_time': 1777020923.176602, 'has_photos': True, 'last_price_update_time': 1777276594.121191}
2026-04-27 07:56:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14551b2e50>
2026-04-27 07:56:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a17137e6-d78f-5734-8693-6c5556c369e0/a17137e6-d78f-5734-8693-6c5556c369e0_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/0e/580ee59c43e4d67de8e0c049ac2fadab/pa/EA73513_402a107ae5c0b5b3c4153e6fe635220a.jpg saved to cache
2026-04-27 07:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a17137e6-d78f-5734-8693-6c5556c369e0
2026-04-27 07:56:34 [auto1.fr] INFO: Found listing with ID: BS88666
2026-04-27 07:56:34 [auto1.fr] INFO: Scrape type for BS88666: 1
2026-04-27 07:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/e0/7de0207df3c3822f293520ec5b7c6844/pa/LW72658_d99d5dd06b2e52aad2a9d2c76f741ddd.jpg not downloaded yet
2026-04-27 07:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/1c/841cec14fd4f67af8557d3ec12a213c0/pa/YX93325_3f8876be0713d61f6274062ac4e0485f.jpg not downloaded yet
2026-04-27 07:56:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b772d0>
2026-04-27 07:56:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bb51b26-4d04-5ea2-88dc-76e5343cfe26/8bb51b26-4d04-5ea2-88dc-76e5343cfe26_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/2f/cc2ff6c6d387f96da132b1a9acd4dffb/pa/DY54580_21a71e3ab8004e5b0df9ed3cf2d79631.jpg saved to cache
2026-04-27 07:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8bb51b26-4d04-5ea2-88dc-76e5343cfe26
2026-04-27 07:56:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a4e7d0>
2026-04-27 07:56:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c43656a-ee4f-5a0d-a285-c7b5b2253e23/2c43656a-ee4f-5a0d-a285-c7b5b2253e23_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/d9/7ed9a7ceaea1f9633ac167b882ae3f7f/pa/HP74277_77e985b77ed8523090722f9b04be8754.jpg saved to cache
2026-04-27 07:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2c43656a-ee4f-5a0d-a285-c7b5b2253e23
2026-04-27 07:56:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XR12990/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BZ74074/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/1c/841cec14fd4f67af8557d3ec12a213c0/pa/YX93325_edb95af92c9f816e0db8de1109ee24e2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/e0/7de0207df3c3822f293520ec5b7c6844/pa/LW72658_6b405749d8c0fddbf7648f3354fc588f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:34 [auto1.fr] INFO: Found listing with ID: MD88959
2026-04-27 07:56:34 [auto1.fr] INFO: Scrape type for MD88959: 1
2026-04-27 07:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/e0/7de0207df3c3822f293520ec5b7c6844/pa/LW72658_57819e03358f4847d7633bf1db1eb712.jpg not downloaded yet
2026-04-27 07:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/1c/841cec14fd4f67af8557d3ec12a213c0/pa/YX93325_2a46042f4a1321e37895959e6a49a2b6.jpg not downloaded yet
2026-04-27 07:56:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438fc0850>
2026-04-27 07:56:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c43656a-ee4f-5a0d-a285-c7b5b2253e23/2c43656a-ee4f-5a0d-a285-c7b5b2253e23_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/d9/7ed9a7ceaea1f9633ac167b882ae3f7f/pa/HP74277_233e80ca1dba8d54e154058350f208d6.jpg saved to cache
2026-04-27 07:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2c43656a-ee4f-5a0d-a285-c7b5b2253e23
2026-04-27 07:56:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/1c/841cec14fd4f67af8557d3ec12a213c0/pa/YX93325_b958fc0e0fa7d92c18b1d73d55304ce2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:34 [auto1.fr] INFO: Found listing with ID: DX32517
2026-04-27 07:56:34 [auto1.fr] INFO: Scrape type for DX32517: 2
2026-04-27 07:56:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8855faea-6e4f-5beb-ba24-d7967a03f2ed with identifier: DX32517
2026-04-27 07:56:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8855faea-6e4f-5beb-ba24-d7967a03f2ed with scrape type 2
2026-04-27 07:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8855faea-6e4f-5beb-ba24-d7967a03f2ed with scrape type 2
2026-04-27 07:56:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8855faea-6e4f-5beb-ba24-d7967a03f2ed, identifier: DX32517
2026-04-27 07:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/e0/7de0207df3c3822f293520ec5b7c6844/pa/LW72658_536b61bc1602cbdfd976e53baa3d375f.jpg not downloaded yet
2026-04-27 07:56:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8855faea-6e4f-5beb-ba24-d7967a03f2ed with identifier: DX32517
2026-04-27 07:56:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8855faea-6e4f-5beb-ba24-d7967a03f2ed with identifier: DX32517
2026-04-27 07:56:34 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 8855faea-6e4f-5beb-ba24-d7967a03f2ed with identifier: DX32517 to the API
2026-04-27 07:56:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:34 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-04-28T15:15:49Z',
 'fuel_type': 'petrol',
 'id': '8855faea-6e4f-5beb-ba24-d7967a03f2ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DX32517',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Peugeot',
 'model': '208',
 'odometer': 164894,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2015-05-27',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2015}
2026-04-27 07:56:34 [auto1.fr] INFO: Saving data for DX32517: {'auction_closing_time': 1777389349.0, 'created_time': 1777019963.859136, 'has_photos': True, 'last_price_update_time': 1777276594.898551}
2026-04-27 07:56:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/1c/841cec14fd4f67af8557d3ec12a213c0/pa/YX93325_3f8876be0713d61f6274062ac4e0485f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:35 [auto1.fr] INFO: Found listing with ID: WE27785
2026-04-27 07:56:35 [auto1.fr] INFO: Scrape type for WE27785: 1
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/e0/7de0207df3c3822f293520ec5b7c6844/pa/LW72658_fe286a21d37fcc1c068f3bd61e3730b6.jpg not downloaded yet
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438fc2290>
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c1ceac8-bb84-5ecb-956c-df216b19a37d/3c1ceac8-bb84-5ecb-956c-df216b19a37d_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/1c/841cec14fd4f67af8557d3ec12a213c0/pa/YX93325_edb95af92c9f816e0db8de1109ee24e2.jpg saved to cache
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3c1ceac8-bb84-5ecb-956c-df216b19a37d
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438be1a10>
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab79b201-5299-5180-a9f9-70564d67c83d/ab79b201-5299-5180-a9f9-70564d67c83d_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/e0/7de0207df3c3822f293520ec5b7c6844/pa/LW72658_6b405749d8c0fddbf7648f3354fc588f.jpg saved to cache
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ab79b201-5299-5180-a9f9-70564d67c83d
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bfd4f90>
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c1ceac8-bb84-5ecb-956c-df216b19a37d/3c1ceac8-bb84-5ecb-956c-df216b19a37d_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/1c/841cec14fd4f67af8557d3ec12a213c0/pa/YX93325_b958fc0e0fa7d92c18b1d73d55304ce2.jpg saved to cache
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3c1ceac8-bb84-5ecb-956c-df216b19a37d
2026-04-27 07:56:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/e0/7de0207df3c3822f293520ec5b7c6844/pa/LW72658_d99d5dd06b2e52aad2a9d2c76f741ddd.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/1c/841cec14fd4f67af8557d3ec12a213c0/pa/YX93325_1714b5e54a78bec8dc40f3264ddd2b9f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:35 [auto1.fr] INFO: Found listing with ID: GR61820
2026-04-27 07:56:35 [auto1.fr] INFO: Scrape type for GR61820: 1
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/e0/7de0207df3c3822f293520ec5b7c6844/pa/LW72658_5cc06859324590dac764eb24258598ea.jpg not downloaded yet
2026-04-27 07:56:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PN81338> (referer: https://www.auto1.com/v1/car-details-view/PN81338/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:35 [auto1.fr] INFO: Found listing with ID: UY82141
2026-04-27 07:56:35 [auto1.fr] INFO: Scrape type for UY82141: 1
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/e0/7de0207df3c3822f293520ec5b7c6844/pa/LW72658_67931308c7fc320558192f78918b279d.jpg not downloaded yet
2026-04-27 07:56:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14477da8d0>
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c1ceac8-bb84-5ecb-956c-df216b19a37d/3c1ceac8-bb84-5ecb-956c-df216b19a37d_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/1c/841cec14fd4f67af8557d3ec12a213c0/pa/YX93325_3f8876be0713d61f6274062ac4e0485f.jpg saved to cache
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3c1ceac8-bb84-5ecb-956c-df216b19a37d
2026-04-27 07:56:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:35 [auto1.fr] INFO: Found listing with ID: HN87071
2026-04-27 07:56:35 [auto1.fr] INFO: Scrape type for HN87071: 1
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1448204ad0>
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab79b201-5299-5180-a9f9-70564d67c83d/ab79b201-5299-5180-a9f9-70564d67c83d_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/e0/7de0207df3c3822f293520ec5b7c6844/pa/LW72658_d99d5dd06b2e52aad2a9d2c76f741ddd.jpg saved to cache
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ab79b201-5299-5180-a9f9-70564d67c83d
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438e22150>
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c1ceac8-bb84-5ecb-956c-df216b19a37d/3c1ceac8-bb84-5ecb-956c-df216b19a37d_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/1c/841cec14fd4f67af8557d3ec12a213c0/pa/YX93325_1714b5e54a78bec8dc40f3264ddd2b9f.jpg saved to cache
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3c1ceac8-bb84-5ecb-956c-df216b19a37d
2026-04-27 07:56:35 [auto1.fr] INFO: Found listing with ID: JL00228
2026-04-27 07:56:35 [auto1.fr] INFO: Scrape type for JL00228: 1
2026-04-27 07:56:35 [auto1.fr] INFO: Found listing with ID: LB91000
2026-04-27 07:56:35 [auto1.fr] INFO: Scrape type for LB91000: 2
2026-04-27 07:56:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28e07f63-c4ec-570e-af59-2d1d23339fca with identifier: LB91000
2026-04-27 07:56:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28e07f63-c4ec-570e-af59-2d1d23339fca with scrape type 2
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 28e07f63-c4ec-570e-af59-2d1d23339fca with scrape type 2
2026-04-27 07:56:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 28e07f63-c4ec-570e-af59-2d1d23339fca, identifier: LB91000
2026-04-27 07:56:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82344178-3344-5f25-b0c4-52331fce312d with identifier: PN81338
2026-04-27 07:56:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82344178-3344-5f25-b0c4-52331fce312d with scrape type 1
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 82344178-3344-5f25-b0c4-52331fce312d
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/ba/a4baabff777b5750a8ba6d7e52f76e20/pa/PN81338_3bcf63776a9833ffc61e323b1516fc81.jpg not downloaded yet
2026-04-27 07:56:35 [auto1.fr] INFO: Channel: 24h | Page: 6 | totalHits: 4727 | hits on page: 40
2026-04-27 07:56:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 28e07f63-c4ec-570e-af59-2d1d23339fca with identifier: LB91000
2026-04-27 07:56:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 28e07f63-c4ec-570e-af59-2d1d23339fca with identifier: LB91000
2026-04-27 07:56:35 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 28e07f63-c4ec-570e-af59-2d1d23339fca with identifier: LB91000 to the API
2026-04-27 07:56:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:35 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-04-28T15:50:36Z',
 'fuel_type': 'diesel',
 'id': '28e07f63-c4ec-570e-af59-2d1d23339fca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LB91000',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 110701,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2010-12-16',
 'seller_name': None,
 'title': 'Renault Megane 1.5 dCi Dynamique',
 'transmission': 'automatic',
 'trim': 'Dynamique',
 'year': 2010}
2026-04-27 07:56:35 [auto1.fr] INFO: Saving data for LB91000: {'auction_closing_time': 1777391436.0, 'created_time': 1777020796.625385, 'has_photos': True, 'last_price_update_time': 1777276595.962138}
2026-04-27 07:56:35 [auto1.fr] INFO: Found listing with ID: FZ00906
2026-04-27 07:56:35 [auto1.fr] INFO: Scrape type for FZ00906: 2
2026-04-27 07:56:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b882630-d265-5477-a05b-897a94887b17 with identifier: FZ00906
2026-04-27 07:56:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b882630-d265-5477-a05b-897a94887b17 with scrape type 2
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b882630-d265-5477-a05b-897a94887b17 with scrape type 2
2026-04-27 07:56:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 1b882630-d265-5477-a05b-897a94887b17, identifier: FZ00906
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/ba/a4baabff777b5750a8ba6d7e52f76e20/pa/PN81338_b6f371d4a0ce2916a06b0a2848200d45.jpg not downloaded yet
2026-04-27 07:56:36 [auto1.fr] INFO: Found listing with ID: UX62486
2026-04-27 07:56:36 [auto1.fr] INFO: Scrape type for UX62486: 2
2026-04-27 07:56:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bda0982f-e6b3-5103-9085-78b5377946e6 with identifier: UX62486
2026-04-27 07:56:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bda0982f-e6b3-5103-9085-78b5377946e6 with scrape type 2
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bda0982f-e6b3-5103-9085-78b5377946e6 with scrape type 2
2026-04-27 07:56:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: bda0982f-e6b3-5103-9085-78b5377946e6, identifier: UX62486
2026-04-27 07:56:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/e0/7de0207df3c3822f293520ec5b7c6844/pa/LW72658_fe286a21d37fcc1c068f3bd61e3730b6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/e0/7de0207df3c3822f293520ec5b7c6844/pa/LW72658_5cc06859324590dac764eb24258598ea.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 1b882630-d265-5477-a05b-897a94887b17 with identifier: FZ00906
2026-04-27 07:56:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 1b882630-d265-5477-a05b-897a94887b17 with identifier: FZ00906
2026-04-27 07:56:36 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 1b882630-d265-5477-a05b-897a94887b17 with identifier: FZ00906 to the API
2026-04-27 07:56:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:36 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-04-28T15:17:06Z',
 'fuel_type': 'petrol',
 'id': '1b882630-d265-5477-a05b-897a94887b17',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FZ00906',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Citroen',
 'model': 'C5 Aircross',
 'odometer': 97769,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2019-11-03',
 'seller_name': None,
 'title': 'Citroen C5 Aircross 1.2 PureTech Shine',
 'transmission': 'manual',
 'trim': 'Shine',
 'year': 2019}
2026-04-27 07:56:36 [auto1.fr] INFO: Saving data for FZ00906: {'auction_closing_time': 1777389426.0, 'created_time': 1777021762.92357, 'has_photos': True, 'last_price_update_time': 1777276596.795183}
2026-04-27 07:56:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: bda0982f-e6b3-5103-9085-78b5377946e6 with identifier: UX62486
2026-04-27 07:56:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: bda0982f-e6b3-5103-9085-78b5377946e6 with identifier: UX62486
2026-04-27 07:56:36 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: bda0982f-e6b3-5103-9085-78b5377946e6 with identifier: UX62486 to the API
2026-04-27 07:56:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:37 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 92,
 'expiration_date': '2026-04-28T15:56:52Z',
 'fuel_type': 'diesel',
 'id': 'bda0982f-e6b3-5103-9085-78b5377946e6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UX62486',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Citroen',
 'model': 'C3 Picasso',
 'odometer': 277319,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2012-10-22',
 'seller_name': None,
 'title': 'Citroen C3 Picasso 1.6 HDi Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2012}
2026-04-27 07:56:37 [auto1.fr] INFO: Saving data for UX62486: {'auction_closing_time': 1777391812.0, 'created_time': 1777020830.412154, 'has_photos': True, 'last_price_update_time': 1777276597.153567}
2026-04-27 07:56:37 [auto1.fr] INFO: Found listing with ID: DJ08565
2026-04-27 07:56:37 [auto1.fr] INFO: Scrape type for DJ08565: 1
2026-04-27 07:56:37 [crawlers.middlewares.monitoring_spider_middleware] ERROR: invalid literal for int() with base 10: 'other'
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/auto1.py", line 231, in parse_api_search
    item = self._listing_from_search_result(car, channel, car_stock_number)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/auto1.py", line 346, in _listing_from_search_result
    item["doors_number"] = int(car.get("doors"))
                           ^^^^^^^^^^^^^^^^^^^^^
ValueError: invalid literal for int() with base 10: 'other'
2026-04-27 07:56:37 [crawlers.middlewares.monitoring_spider_middleware] ERROR: invalid literal for int() with base 10: 'other'
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/auto1.py", line 231, in parse_api_search
    item = self._listing_from_search_result(car, channel, car_stock_number)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/auto1.py", line 346, in _listing_from_search_result
    item["doors_number"] = int(car.get("doors"))
                           ^^^^^^^^^^^^^^^^^^^^^
ValueError: invalid literal for int() with base 10: 'other'
2026-04-27 07:56:37 [crawlers.middlewares.monitoring_spider_middleware] ERROR: invalid literal for int() with base 10: 'other'
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/auto1.py", line 231, in parse_api_search
    item = self._listing_from_search_result(car, channel, car_stock_number)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/auto1.py", line 346, in _listing_from_search_result
    item["doors_number"] = int(car.get("doors"))
                           ^^^^^^^^^^^^^^^^^^^^^
ValueError: invalid literal for int() with base 10: 'other'
2026-04-27 07:56:37 [crawlers.middlewares.monitoring_spider_middleware] ERROR: invalid literal for int() with base 10: 'other'
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/auto1.py", line 231, in parse_api_search
    item = self._listing_from_search_result(car, channel, car_stock_number)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/auto1.py", line 346, in _listing_from_search_result
    item["doors_number"] = int(car.get("doors"))
                           ^^^^^^^^^^^^^^^^^^^^^
ValueError: invalid literal for int() with base 10: 'other'
2026-04-27 07:56:37 [crawlers.middlewares.monitoring_spider_middleware] ERROR: invalid literal for int() with base 10: 'other'
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/auto1.py", line 231, in parse_api_search
    item = self._listing_from_search_result(car, channel, car_stock_number)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/auto1.py", line 346, in _listing_from_search_result
    item["doors_number"] = int(car.get("doors"))
                           ^^^^^^^^^^^^^^^^^^^^^
ValueError: invalid literal for int() with base 10: 'other'
2026-04-27 07:56:37 [crawlers.middlewares.monitoring_spider_middleware] ERROR: invalid literal for int() with base 10: 'other'
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/auto1.py", line 231, in parse_api_search
    item = self._listing_from_search_result(car, channel, car_stock_number)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/auto1.py", line 346, in _listing_from_search_result
    item["doors_number"] = int(car.get("doors"))
                           ^^^^^^^^^^^^^^^^^^^^^
ValueError: invalid literal for int() with base 10: 'other'
2026-04-27 07:56:37 [crawlers.middlewares.monitoring_spider_middleware] ERROR: invalid literal for int() with base 10: 'other'
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/auto1.py", line 231, in parse_api_search
    item = self._listing_from_search_result(car, channel, car_stock_number)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/auto1.py", line 346, in _listing_from_search_result
    item["doors_number"] = int(car.get("doors"))
                           ^^^^^^^^^^^^^^^^^^^^^
ValueError: invalid literal for int() with base 10: 'other'
2026-04-27 07:56:37 [scrapy.core.scraper] ERROR: Spider error processing <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 295, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 374, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 355, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 374, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 355, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy_zyte_api/_middlewares.py", line 206, in process_spider_output_async
    async for item_or_request in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/auto1.py", line 231, in parse_api_search
    item = self._listing_from_search_result(car, channel, car_stock_number)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/auto1.py", line 346, in _listing_from_search_result
    item["doors_number"] = int(car.get("doors"))
                           ^^^^^^^^^^^^^^^^^^^^^
ValueError: invalid literal for int() with base 10: 'other'
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/ba/a4baabff777b5750a8ba6d7e52f76e20/pa/PN81338_a598d6b77e7b284fb86486392f251b2f.jpg not downloaded yet
2026-04-27 07:56:37 [auto1.fr] INFO: Found listing with ID: NE25520
2026-04-27 07:56:38 [auto1.fr] INFO: Scrape type for NE25520: 2
2026-04-27 07:56:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9055dd5b-e287-54b3-9d59-ff5cc8cd07b1 with identifier: NE25520
2026-04-27 07:56:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9055dd5b-e287-54b3-9d59-ff5cc8cd07b1 with scrape type 2
2026-04-27 07:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9055dd5b-e287-54b3-9d59-ff5cc8cd07b1 with scrape type 2
2026-04-27 07:56:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 9055dd5b-e287-54b3-9d59-ff5cc8cd07b1, identifier: NE25520
2026-04-27 07:56:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZV63731/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RA48817> (referer: https://www.auto1.com/v1/car-details-view/RA48817/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JR90965> (referer: https://www.auto1.com/v1/car-details-view/JR90965/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LJ30136> (referer: https://www.auto1.com/v1/car-details-view/LJ30136/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 9055dd5b-e287-54b3-9d59-ff5cc8cd07b1 with identifier: NE25520
2026-04-27 07:56:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 9055dd5b-e287-54b3-9d59-ff5cc8cd07b1 with identifier: NE25520
2026-04-27 07:56:38 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 9055dd5b-e287-54b3-9d59-ff5cc8cd07b1 with identifier: NE25520 to the API
2026-04-27 07:56:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:38 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-04-28T15:20:27Z',
 'fuel_type': 'diesel',
 'id': '9055dd5b-e287-54b3-9d59-ff5cc8cd07b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NE25520',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 135596,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2021-08-26',
 'seller_name': None,
 'title': 'Ford Focus 1.5 TDCi EcoBlue Titanium X Business',
 'transmission': 'automatic',
 'trim': 'Titanium X Business',
 'year': 2021}
2026-04-27 07:56:38 [auto1.fr] INFO: Saving data for NE25520: {'auction_closing_time': 1777389627.0, 'created_time': 1777022575.856492, 'has_photos': True, 'last_price_update_time': 1777276598.764817}
2026-04-27 07:56:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CE05021> (referer: https://www.auto1.com/v1/car-details-view/CE05021/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/ba/a4baabff777b5750a8ba6d7e52f76e20/pa/PN81338_6e639e95d9a19a32fbba0c685551bad5.jpg not downloaded yet
2026-04-27 07:56:38 [auto1.fr] INFO: Found listing with ID: YR21354
2026-04-27 07:56:38 [auto1.fr] INFO: Scrape type for YR21354: 1
2026-04-27 07:56:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a75050>
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab79b201-5299-5180-a9f9-70564d67c83d/ab79b201-5299-5180-a9f9-70564d67c83d_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/e0/7de0207df3c3822f293520ec5b7c6844/pa/LW72658_fe286a21d37fcc1c068f3bd61e3730b6.jpg saved to cache
2026-04-27 07:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ab79b201-5299-5180-a9f9-70564d67c83d
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d71dd0>
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab79b201-5299-5180-a9f9-70564d67c83d/ab79b201-5299-5180-a9f9-70564d67c83d_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/e0/7de0207df3c3822f293520ec5b7c6844/pa/LW72658_5cc06859324590dac764eb24258598ea.jpg saved to cache
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ab79b201-5299-5180-a9f9-70564d67c83d
2026-04-27 07:56:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/ba/a4baabff777b5750a8ba6d7e52f76e20/pa/PN81338_3bcf63776a9833ffc61e323b1516fc81.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/ba/a4baabff777b5750a8ba6d7e52f76e20/pa/PN81338_8a446a6faae5805da6392bd02ea3c75f.jpg not downloaded yet
2026-04-27 07:56:39 [auto1.fr] INFO: Found listing with ID: EC48292
2026-04-27 07:56:39 [auto1.fr] INFO: Scrape type for EC48292: 1
2026-04-27 07:56:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b6db2aa-a13b-5258-9184-fcd66967a3f2 with identifier: RA48817
2026-04-27 07:56:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b6db2aa-a13b-5258-9184-fcd66967a3f2 with scrape type 1
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3b6db2aa-a13b-5258-9184-fcd66967a3f2
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/c5/bec5fe900bd1d6bcca9f7c1e81307c83/pa/RA48817_80f6360d3129790cf80789ce3d2a6047.jpg not downloaded yet
2026-04-27 07:56:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57911ee8-138c-588b-8507-69741a4da4e0 with identifier: JR90965
2026-04-27 07:56:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57911ee8-138c-588b-8507-69741a4da4e0 with scrape type 1
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 57911ee8-138c-588b-8507-69741a4da4e0
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/b0/c5b0f352cca26d80df8f31069d70fda4/pa/JR90965_72de8e91cde7a9ebf95488389b6ff9ba.jpg not downloaded yet
2026-04-27 07:56:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3d3341b-9999-571a-906b-ecf1a9f0fffb with identifier: LJ30136
2026-04-27 07:56:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3d3341b-9999-571a-906b-ecf1a9f0fffb with scrape type 1
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e3d3341b-9999-571a-906b-ecf1a9f0fffb
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/73/0e734a47005bb8d1203491c837f146b6/pa/LJ30136_09efcb6c8a21fddf257d0efb9a6ec5bd.jpg not downloaded yet
2026-04-27 07:56:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4026182-ba9b-50a8-b8b8-9ebd7f15e5a0 with identifier: CE05021
2026-04-27 07:56:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4026182-ba9b-50a8-b8b8-9ebd7f15e5a0 with scrape type 1
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item d4026182-ba9b-50a8-b8b8-9ebd7f15e5a0
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/0f/5c0fc85c32bf51f2de6eda436d8aa637/pa/CE05021_17aed512ded1eca14284635ae0b80f0a.jpg not downloaded yet
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/ba/a4baabff777b5750a8ba6d7e52f76e20/pa/PN81338_630462051ec233126e45c48cd133d38f.jpg not downloaded yet
2026-04-27 07:56:39 [auto1.fr] INFO: Found listing with ID: FR18447
2026-04-27 07:56:39 [auto1.fr] INFO: Scrape type for FR18447: 1
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/c5/bec5fe900bd1d6bcca9f7c1e81307c83/pa/RA48817_f017ff4985ef72a4f92c7a61a6ea94ba.jpg not downloaded yet
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/b0/c5b0f352cca26d80df8f31069d70fda4/pa/JR90965_0936679a901f4df721c30ddcc2102a68.jpg not downloaded yet
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/73/0e734a47005bb8d1203491c837f146b6/pa/LJ30136_3cba40a741d3bd27e4fcc0a5a32ff79f.jpg not downloaded yet
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/0f/5c0fc85c32bf51f2de6eda436d8aa637/pa/CE05021_df4c993f5ca6226c39904a15ee828f20.jpg not downloaded yet
2026-04-27 07:56:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/ba/a4baabff777b5750a8ba6d7e52f76e20/pa/PN81338_a598d6b77e7b284fb86486392f251b2f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/ba/a4baabff777b5750a8ba6d7e52f76e20/pa/PN81338_b6f371d4a0ce2916a06b0a2848200d45.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/e0/7de0207df3c3822f293520ec5b7c6844/pa/LW72658_67931308c7fc320558192f78918b279d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/ba/a4baabff777b5750a8ba6d7e52f76e20/pa/PN81338_e59707acc2972a1c687d1a286035caf4.jpg not downloaded yet
2026-04-27 07:56:39 [auto1.fr] INFO: Found listing with ID: EJ68168
2026-04-27 07:56:39 [auto1.fr] INFO: Scrape type for EJ68168: 1
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438089f10>
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82344178-3344-5f25-b0c4-52331fce312d/82344178-3344-5f25-b0c4-52331fce312d_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/ba/a4baabff777b5750a8ba6d7e52f76e20/pa/PN81338_3bcf63776a9833ffc61e323b1516fc81.jpg saved to cache
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 82344178-3344-5f25-b0c4-52331fce312d
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/c5/bec5fe900bd1d6bcca9f7c1e81307c83/pa/RA48817_bc284ecde36c6d3c0c2448e7d7a05762.jpg not downloaded yet
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/b0/c5b0f352cca26d80df8f31069d70fda4/pa/JR90965_4817ec653c7fcf347b1ad0795af07131.jpg not downloaded yet
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/73/0e734a47005bb8d1203491c837f146b6/pa/LJ30136_9c6dc4ef7df01307e41ca50a7787b447.jpg not downloaded yet
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/0f/5c0fc85c32bf51f2de6eda436d8aa637/pa/CE05021_4f7e10ab90a58c76e8869e251a3ee486.jpg not downloaded yet
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/ba/a4baabff777b5750a8ba6d7e52f76e20/pa/PN81338_85fa0df173135481f5999745e4c836fe.jpg not downloaded yet
2026-04-27 07:56:39 [auto1.fr] INFO: Found listing with ID: WC48174
2026-04-27 07:56:39 [auto1.fr] INFO: Scrape type for WC48174: 2
2026-04-27 07:56:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5067be82-33c5-5062-88c8-6911d1fceafb with identifier: WC48174
2026-04-27 07:56:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5067be82-33c5-5062-88c8-6911d1fceafb with scrape type 2
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5067be82-33c5-5062-88c8-6911d1fceafb with scrape type 2
2026-04-27 07:56:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5067be82-33c5-5062-88c8-6911d1fceafb, identifier: WC48174
2026-04-27 07:56:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5067be82-33c5-5062-88c8-6911d1fceafb with identifier: WC48174
2026-04-27 07:56:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5067be82-33c5-5062-88c8-6911d1fceafb with identifier: WC48174
2026-04-27 07:56:39 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 5067be82-33c5-5062-88c8-6911d1fceafb with identifier: WC48174 to the API
2026-04-27 07:56:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:40 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-04-28T15:25:40Z',
 'fuel_type': 'diesel',
 'id': '5067be82-33c5-5062-88c8-6911d1fceafb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC48174',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Renault',
 'model': 'Koleos',
 'odometer': 249437,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2010-09-29',
 'seller_name': None,
 'title': 'Renault Koleos 2.0 dCi BOSE Edition',
 'transmission': 'manual',
 'trim': 'BOSE Edition',
 'year': 2010}
2026-04-27 07:56:40 [auto1.fr] INFO: Saving data for WC48174: {'auction_closing_time': 1777389940.0, 'created_time': 1777022522.655671, 'has_photos': True, 'last_price_update_time': 1777276600.183253}
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/c5/bec5fe900bd1d6bcca9f7c1e81307c83/pa/RA48817_e1380ac876f1fd646e393d3a1be554fa.jpg not downloaded yet
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/b0/c5b0f352cca26d80df8f31069d70fda4/pa/JR90965_848e4dd798b19d9148094bcf5a93c92c.jpg not downloaded yet
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/73/0e734a47005bb8d1203491c837f146b6/pa/LJ30136_43f7ee815c9dc9fb3d087f2dd3d8373a.jpg not downloaded yet
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/0f/5c0fc85c32bf51f2de6eda436d8aa637/pa/CE05021_1b54545c415f909d6cfbeee580535ff3.jpg not downloaded yet
2026-04-27 07:56:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SR18679> (referer: https://www.auto1.com/v1/car-details-view/SR18679/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a3d5d0>
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82344178-3344-5f25-b0c4-52331fce312d/82344178-3344-5f25-b0c4-52331fce312d_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/ba/a4baabff777b5750a8ba6d7e52f76e20/pa/PN81338_a598d6b77e7b284fb86486392f251b2f.jpg saved to cache
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 82344178-3344-5f25-b0c4-52331fce312d
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438af0f90>
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82344178-3344-5f25-b0c4-52331fce312d/82344178-3344-5f25-b0c4-52331fce312d_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/ba/a4baabff777b5750a8ba6d7e52f76e20/pa/PN81338_b6f371d4a0ce2916a06b0a2848200d45.jpg saved to cache
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 82344178-3344-5f25-b0c4-52331fce312d
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bf44f50>
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab79b201-5299-5180-a9f9-70564d67c83d/ab79b201-5299-5180-a9f9-70564d67c83d_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/e0/7de0207df3c3822f293520ec5b7c6844/pa/LW72658_67931308c7fc320558192f78918b279d.jpg saved to cache
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ab79b201-5299-5180-a9f9-70564d67c83d
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/ba/a4baabff777b5750a8ba6d7e52f76e20/pa/PN81338_5efe2cd07e5518f8d29408584a5ac5a1.jpg not downloaded yet
2026-04-27 07:56:40 [auto1.fr] INFO: Found listing with ID: EJ92308
2026-04-27 07:56:40 [auto1.fr] INFO: Scrape type for EJ92308: 1
2026-04-27 07:56:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/0f/5c0fc85c32bf51f2de6eda436d8aa637/pa/CE05021_17aed512ded1eca14284635ae0b80f0a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/ba/a4baabff777b5750a8ba6d7e52f76e20/pa/PN81338_630462051ec233126e45c48cd133d38f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/c5/bec5fe900bd1d6bcca9f7c1e81307c83/pa/RA48817_24d89effc4693a58b430a4d121f065ff.jpg not downloaded yet
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/b0/c5b0f352cca26d80df8f31069d70fda4/pa/JR90965_e8f9597e201ad3302773a6cb0a74f75c.jpg not downloaded yet
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/73/0e734a47005bb8d1203491c837f146b6/pa/LJ30136_6947563701e9c457b236f859f3a61ffb.jpg not downloaded yet
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/0f/5c0fc85c32bf51f2de6eda436d8aa637/pa/CE05021_78dbf89377c42fe23c51645c9c5b1b48.jpg not downloaded yet
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/ba/a4baabff777b5750a8ba6d7e52f76e20/pa/PN81338_fdc4dae95e832223bc3146c68b30ec91.jpg not downloaded yet
2026-04-27 07:56:40 [auto1.fr] INFO: Found listing with ID: GN48177
2026-04-27 07:56:40 [auto1.fr] INFO: Scrape type for GN48177: 1
2026-04-27 07:56:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BS88666/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DM72572> (referer: https://www.auto1.com/v1/car-details-view/DM72572/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BZ74074> (referer: https://www.auto1.com/v1/car-details-view/BZ74074/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YJ22330> (referer: https://www.auto1.com/v1/car-details-view/YJ22330/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83a9c299-5f22-570f-bd67-75bf22661eae with identifier: SR18679
2026-04-27 07:56:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83a9c299-5f22-570f-bd67-75bf22661eae with scrape type 1
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 83a9c299-5f22-570f-bd67-75bf22661eae
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/80/fe80e7677fbbad7e352e755b990fe68e/pa/SR18679_8c208d32453a42fb42aeeb24958c2955.jpg not downloaded yet
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/c5/bec5fe900bd1d6bcca9f7c1e81307c83/pa/RA48817_03a9ebe9baf00517ad2013650d8c46d4.jpg not downloaded yet
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/b0/c5b0f352cca26d80df8f31069d70fda4/pa/JR90965_5a71546349f2e82734ece5e5a2cade91.jpg not downloaded yet
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/73/0e734a47005bb8d1203491c837f146b6/pa/LJ30136_2575115993ce33b1a53708cd92b69662.jpg not downloaded yet
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/0f/5c0fc85c32bf51f2de6eda436d8aa637/pa/CE05021_682f998a2569b45b573dee967556962f.jpg not downloaded yet
2026-04-27 07:56:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:40 [auto1.fr] INFO: Found listing with ID: RH66789
2026-04-27 07:56:40 [auto1.fr] INFO: Scrape type for RH66789: 2
2026-04-27 07:56:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab79f006-1ef6-5d6b-98cd-df121e21a627 with identifier: RH66789
2026-04-27 07:56:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab79f006-1ef6-5d6b-98cd-df121e21a627 with scrape type 2
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab79f006-1ef6-5d6b-98cd-df121e21a627 with scrape type 2
2026-04-27 07:56:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ab79f006-1ef6-5d6b-98cd-df121e21a627, identifier: RH66789
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/80/fe80e7677fbbad7e352e755b990fe68e/pa/SR18679_cfd38aa70cd7072115e1b3dabef89a3f.jpg not downloaded yet
2026-04-27 07:56:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ab79f006-1ef6-5d6b-98cd-df121e21a627 with identifier: RH66789
2026-04-27 07:56:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ab79f006-1ef6-5d6b-98cd-df121e21a627 with identifier: RH66789
2026-04-27 07:56:41 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ab79f006-1ef6-5d6b-98cd-df121e21a627 with identifier: RH66789 to the API
2026-04-27 07:56:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:41 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-04-28T15:26:06Z',
 'fuel_type': 'diesel',
 'id': 'ab79f006-1ef6-5d6b-98cd-df121e21a627',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RH66789',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Renault',
 'model': 'Talisman',
 'odometer': 214632,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2017-12-06',
 'seller_name': None,
 'title': 'Renault Talisman 1.5 dCi Energy Intens',
 'transmission': 'manual',
 'trim': 'Intens',
 'year': 2017}
2026-04-27 07:56:41 [auto1.fr] INFO: Saving data for RH66789: {'auction_closing_time': 1777389966.0, 'created_time': 1777020703.962329, 'has_photos': True, 'last_price_update_time': 1777276601.225258}
2026-04-27 07:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/c5/bec5fe900bd1d6bcca9f7c1e81307c83/pa/RA48817_720c1d584a9f00846908e43bb37df85a.jpg not downloaded yet
2026-04-27 07:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/73/0e734a47005bb8d1203491c837f146b6/pa/LJ30136_ebfe8b84ac306bc335c3b5c6898fe742.jpg not downloaded yet
2026-04-27 07:56:41 [auto1.fr] INFO: Found listing with ID: EA19907
2026-04-27 07:56:41 [auto1.fr] INFO: Scrape type for EA19907: 2
2026-04-27 07:56:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4290ff9-fc4a-5228-8b5c-8a093ce3a181 with identifier: EA19907
2026-04-27 07:56:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4290ff9-fc4a-5228-8b5c-8a093ce3a181 with scrape type 2
2026-04-27 07:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c4290ff9-fc4a-5228-8b5c-8a093ce3a181 with scrape type 2
2026-04-27 07:56:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c4290ff9-fc4a-5228-8b5c-8a093ce3a181, identifier: EA19907
2026-04-27 07:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/80/fe80e7677fbbad7e352e755b990fe68e/pa/SR18679_311908888f58c525e8b36462140663c8.jpg not downloaded yet
2026-04-27 07:56:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/ba/a4baabff777b5750a8ba6d7e52f76e20/pa/PN81338_85fa0df173135481f5999745e4c836fe.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/73/0e734a47005bb8d1203491c837f146b6/pa/LJ30136_43f7ee815c9dc9fb3d087f2dd3d8373a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/0f/5c0fc85c32bf51f2de6eda436d8aa637/pa/CE05021_1b54545c415f909d6cfbeee580535ff3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c4290ff9-fc4a-5228-8b5c-8a093ce3a181 with identifier: EA19907
2026-04-27 07:56:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c4290ff9-fc4a-5228-8b5c-8a093ce3a181 with identifier: EA19907
2026-04-27 07:56:41 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c4290ff9-fc4a-5228-8b5c-8a093ce3a181 with identifier: EA19907 to the API
2026-04-27 07:56:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:41 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 313,
 'expiration_date': '2026-04-28T15:20:43Z',
 'fuel_type': 'diesel',
 'id': 'c4290ff9-fc4a-5228-8b5c-8a093ce3a181',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EA19907',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'BMW',
 'model': 'X4',
 'odometer': 276006,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2015-02-15',
 'seller_name': None,
 'title': 'BMW X4 xDrive 35d Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2015}
2026-04-27 07:56:41 [auto1.fr] INFO: Saving data for EA19907: {'auction_closing_time': 1777389643.0, 'created_time': 1777022179.613872, 'has_photos': True, 'last_price_update_time': 1777276601.757533}
2026-04-27 07:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/c5/bec5fe900bd1d6bcca9f7c1e81307c83/pa/RA48817_0e30b6787e048787ae28987d78bc1fc1.jpg not downloaded yet
2026-04-27 07:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/73/0e734a47005bb8d1203491c837f146b6/pa/LJ30136_7225d1eeb46a0f81fa950aed10d64c26.jpg not downloaded yet
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ec9390>
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4026182-ba9b-50a8-b8b8-9ebd7f15e5a0/d4026182-ba9b-50a8-b8b8-9ebd7f15e5a0_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/0f/5c0fc85c32bf51f2de6eda436d8aa637/pa/CE05021_17aed512ded1eca14284635ae0b80f0a.jpg saved to cache
2026-04-27 07:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d4026182-ba9b-50a8-b8b8-9ebd7f15e5a0
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438168e90>
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82344178-3344-5f25-b0c4-52331fce312d/82344178-3344-5f25-b0c4-52331fce312d_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/ba/a4baabff777b5750a8ba6d7e52f76e20/pa/PN81338_630462051ec233126e45c48cd133d38f.jpg saved to cache
2026-04-27 07:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 82344178-3344-5f25-b0c4-52331fce312d
2026-04-27 07:56:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08743775-3902-5767-bb6e-9e5f10ffbe6e with identifier: DM72572
2026-04-27 07:56:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08743775-3902-5767-bb6e-9e5f10ffbe6e with scrape type 1
2026-04-27 07:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 08743775-3902-5767-bb6e-9e5f10ffbe6e
2026-04-27 07:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/c3/e2c37fe0f35ef80f35b4abeec42e917c/pa/DM72572_2e63e7fa8620b4c0b079ce0cc7c5ed8c.jpg not downloaded yet
2026-04-27 07:56:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d1a0922-da79-5947-a1cf-3ef1420e1b2e with identifier: BZ74074
2026-04-27 07:56:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d1a0922-da79-5947-a1cf-3ef1420e1b2e with scrape type 1
2026-04-27 07:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9d1a0922-da79-5947-a1cf-3ef1420e1b2e
2026-04-27 07:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/43/4e43238f55e519095f9519eb6ca0a055/pa/BZ74074_64704058820cee1e2b0b47a55072f7b5.jpg not downloaded yet
2026-04-27 07:56:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25983589-8f70-5628-8773-c87541ecdcfc with identifier: YJ22330
2026-04-27 07:56:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25983589-8f70-5628-8773-c87541ecdcfc with scrape type 1
2026-04-27 07:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 25983589-8f70-5628-8773-c87541ecdcfc
2026-04-27 07:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/4e/ab4e2a97cadca600a0658a64a72bf36c/pa/YJ22330_d80e1c39920073e5deb68b493ab36f00.jpg not downloaded yet
2026-04-27 07:56:41 [auto1.fr] INFO: Found listing with ID: HU94052
2026-04-27 07:56:41 [auto1.fr] INFO: Scrape type for HU94052: 2
2026-04-27 07:56:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76c3b1d4-356f-511d-96c3-285cb9995450 with identifier: HU94052
2026-04-27 07:56:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76c3b1d4-356f-511d-96c3-285cb9995450 with scrape type 2
2026-04-27 07:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 76c3b1d4-356f-511d-96c3-285cb9995450 with scrape type 2
2026-04-27 07:56:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 76c3b1d4-356f-511d-96c3-285cb9995450, identifier: HU94052
2026-04-27 07:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/80/fe80e7677fbbad7e352e755b990fe68e/pa/SR18679_255c32a9577e69b7a3ae7c449d4eaee1.jpg not downloaded yet
2026-04-27 07:56:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/80/fe80e7677fbbad7e352e755b990fe68e/pa/SR18679_8c208d32453a42fb42aeeb24958c2955.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/ba/a4baabff777b5750a8ba6d7e52f76e20/pa/PN81338_fdc4dae95e832223bc3146c68b30ec91.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 76c3b1d4-356f-511d-96c3-285cb9995450 with identifier: HU94052
2026-04-27 07:56:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 76c3b1d4-356f-511d-96c3-285cb9995450 with identifier: HU94052
2026-04-27 07:56:42 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 76c3b1d4-356f-511d-96c3-285cb9995450 with identifier: HU94052 to the API
2026-04-27 07:56:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:42 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 230,
 'expiration_date': '2026-04-28T15:18:11Z',
 'fuel_type': 'hybrid',
 'id': '76c3b1d4-356f-511d-96c3-285cb9995450',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HU94052',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 67322,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2024-05-22',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 T-GDI Hybrid N Line Executive 2WD',
 'transmission': 'automatic',
 'trim': 'N Line Executive 2WD',
 'year': 2024}
2026-04-27 07:56:42 [auto1.fr] INFO: Saving data for HU94052: {'auction_closing_time': 1777389491.0, 'created_time': 1777021469.925126, 'has_photos': True, 'last_price_update_time': 1777276602.465088}
2026-04-27 07:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/c5/bec5fe900bd1d6bcca9f7c1e81307c83/pa/RA48817_1ee0ffdc161888dd2c055efe045122d2.jpg not downloaded yet
2026-04-27 07:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/73/0e734a47005bb8d1203491c837f146b6/pa/LJ30136_fee4582aae763143910af0ece174edb0.jpg not downloaded yet
2026-04-27 07:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/c3/e2c37fe0f35ef80f35b4abeec42e917c/pa/DM72572_82a492d3a56006bea8b2e187508d4028.jpg not downloaded yet
2026-04-27 07:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/43/4e43238f55e519095f9519eb6ca0a055/pa/BZ74074_30554f69b1e8592cf0bf3a9251acbb84.jpg not downloaded yet
2026-04-27 07:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/4e/ab4e2a97cadca600a0658a64a72bf36c/pa/YJ22330_ee1e6d66a021895bd490bd907df75f44.jpg not downloaded yet
2026-04-27 07:56:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WE27785/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/0f/5c0fc85c32bf51f2de6eda436d8aa637/pa/CE05021_78dbf89377c42fe23c51645c9c5b1b48.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:42 [auto1.fr] INFO: Found listing with ID: EY84083
2026-04-27 07:56:42 [auto1.fr] INFO: Scrape type for EY84083: 2
2026-04-27 07:56:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff74c4dc-06a3-5f15-911d-be3958e30cab with identifier: EY84083
2026-04-27 07:56:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff74c4dc-06a3-5f15-911d-be3958e30cab with scrape type 2
2026-04-27 07:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ff74c4dc-06a3-5f15-911d-be3958e30cab with scrape type 2
2026-04-27 07:56:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ff74c4dc-06a3-5f15-911d-be3958e30cab, identifier: EY84083
2026-04-27 07:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/80/fe80e7677fbbad7e352e755b990fe68e/pa/SR18679_7ebb292416f334d7a952b26dd5562272.jpg not downloaded yet
2026-04-27 07:56:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BV80652> (referer: https://www.auto1.com/v1/car-details-view/BV80652/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438054190>
2026-04-27 07:56:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82344178-3344-5f25-b0c4-52331fce312d/82344178-3344-5f25-b0c4-52331fce312d_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/ba/a4baabff777b5750a8ba6d7e52f76e20/pa/PN81338_85fa0df173135481f5999745e4c836fe.jpg saved to cache
2026-04-27 07:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 82344178-3344-5f25-b0c4-52331fce312d
2026-04-27 07:56:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438125210>
2026-04-27 07:56:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3d3341b-9999-571a-906b-ecf1a9f0fffb/e3d3341b-9999-571a-906b-ecf1a9f0fffb_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/73/0e734a47005bb8d1203491c837f146b6/pa/LJ30136_43f7ee815c9dc9fb3d087f2dd3d8373a.jpg saved to cache
2026-04-27 07:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e3d3341b-9999-571a-906b-ecf1a9f0fffb
2026-04-27 07:56:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438e35010>
2026-04-27 07:56:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4026182-ba9b-50a8-b8b8-9ebd7f15e5a0/d4026182-ba9b-50a8-b8b8-9ebd7f15e5a0_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/0f/5c0fc85c32bf51f2de6eda436d8aa637/pa/CE05021_1b54545c415f909d6cfbeee580535ff3.jpg saved to cache
2026-04-27 07:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d4026182-ba9b-50a8-b8b8-9ebd7f15e5a0
2026-04-27 07:56:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ff74c4dc-06a3-5f15-911d-be3958e30cab with identifier: EY84083
2026-04-27 07:56:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ff74c4dc-06a3-5f15-911d-be3958e30cab with identifier: EY84083
2026-04-27 07:56:42 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ff74c4dc-06a3-5f15-911d-be3958e30cab with identifier: EY84083 to the API
2026-04-27 07:56:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:43 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 218,
 'expiration_date': '2026-04-28T15:15:02Z',
 'fuel_type': 'diesel',
 'id': 'ff74c4dc-06a3-5f15-911d-be3958e30cab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EY84083',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Chrysler',
 'model': '300 C',
 'odometer': 251697,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2008-08-25',
 'seller_name': None,
 'title': 'Chrysler 300 C 3.0 CRD',
 'transmission': 'automatic',
 'trim': '',
 'year': 2008}
2026-04-27 07:56:43 [auto1.fr] INFO: Saving data for EY84083: {'auction_closing_time': 1777389302.0, 'created_time': 1777020056.266014, 'has_photos': True, 'last_price_update_time': 1777276603.193514}
2026-04-27 07:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/c5/bec5fe900bd1d6bcca9f7c1e81307c83/pa/RA48817_e2648d9b5745bf9183ea7837a923fd5f.jpg not downloaded yet
2026-04-27 07:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/73/0e734a47005bb8d1203491c837f146b6/pa/LJ30136_44f76982ccf154779c912512c755607c.jpg not downloaded yet
2026-04-27 07:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/c3/e2c37fe0f35ef80f35b4abeec42e917c/pa/DM72572_af5fa9654749176bc09e99ee1cb0ed5f.jpg not downloaded yet
2026-04-27 07:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/43/4e43238f55e519095f9519eb6ca0a055/pa/BZ74074_e3a69d0916071a19b90d38a77785e055.jpg not downloaded yet
2026-04-27 07:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/4e/ab4e2a97cadca600a0658a64a72bf36c/pa/YJ22330_84b751e1cba29c6ec8e08c3ff7505462.jpg not downloaded yet
2026-04-27 07:56:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/c5/bec5fe900bd1d6bcca9f7c1e81307c83/pa/RA48817_720c1d584a9f00846908e43bb37df85a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/80/fe80e7677fbbad7e352e755b990fe68e/pa/SR18679_cfd38aa70cd7072115e1b3dabef89a3f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/73/0e734a47005bb8d1203491c837f146b6/pa/LJ30136_ebfe8b84ac306bc335c3b5c6898fe742.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:43 [auto1.fr] INFO: Found listing with ID: MY38669
2026-04-27 07:56:43 [auto1.fr] INFO: Scrape type for MY38669: 1
2026-04-27 07:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/80/fe80e7677fbbad7e352e755b990fe68e/pa/SR18679_afbe8603d5c28162babf85a9ddc4a76f.jpg not downloaded yet
2026-04-27 07:56:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RM20778> (referer: https://www.auto1.com/v1/car-details-view/RM20778/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438074ad0>
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83a9c299-5f22-570f-bd67-75bf22661eae/83a9c299-5f22-570f-bd67-75bf22661eae_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/80/fe80e7677fbbad7e352e755b990fe68e/pa/SR18679_8c208d32453a42fb42aeeb24958c2955.jpg saved to cache
2026-04-27 07:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 83a9c299-5f22-570f-bd67-75bf22661eae
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bf9bbd0>
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82344178-3344-5f25-b0c4-52331fce312d/82344178-3344-5f25-b0c4-52331fce312d_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/ba/a4baabff777b5750a8ba6d7e52f76e20/pa/PN81338_fdc4dae95e832223bc3146c68b30ec91.jpg saved to cache
2026-04-27 07:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 82344178-3344-5f25-b0c4-52331fce312d
2026-04-27 07:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/c3/e2c37fe0f35ef80f35b4abeec42e917c/pa/DM72572_fd4b8d8ec080d915a8e044dde776e7f4.jpg not downloaded yet
2026-04-27 07:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/43/4e43238f55e519095f9519eb6ca0a055/pa/BZ74074_7a2b70556345bd4fe9502daac8e3d7dc.jpg not downloaded yet
2026-04-27 07:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/4e/ab4e2a97cadca600a0658a64a72bf36c/pa/YJ22330_a4dfe70045472de9966bf66e9503a4c4.jpg not downloaded yet
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143804b8d0>
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4026182-ba9b-50a8-b8b8-9ebd7f15e5a0/d4026182-ba9b-50a8-b8b8-9ebd7f15e5a0_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/0f/5c0fc85c32bf51f2de6eda436d8aa637/pa/CE05021_78dbf89377c42fe23c51645c9c5b1b48.jpg saved to cache
2026-04-27 07:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d4026182-ba9b-50a8-b8b8-9ebd7f15e5a0
2026-04-27 07:56:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97f77e89-6691-5e3b-a6fa-2af0cb5c989b with identifier: BV80652
2026-04-27 07:56:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97f77e89-6691-5e3b-a6fa-2af0cb5c989b with scrape type 1
2026-04-27 07:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 97f77e89-6691-5e3b-a6fa-2af0cb5c989b
2026-04-27 07:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/b0/12b06e24b200e0bfaadb3fcf5f847bfb/pa/BV80652_e907331812e79208b44d8a7db8e7df20.jpg not downloaded yet
2026-04-27 07:56:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/80/fe80e7677fbbad7e352e755b990fe68e/pa/SR18679_255c32a9577e69b7a3ae7c449d4eaee1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:43 [auto1.fr] INFO: Found listing with ID: XT28721
2026-04-27 07:56:43 [auto1.fr] INFO: Scrape type for XT28721: 1
2026-04-27 07:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/80/fe80e7677fbbad7e352e755b990fe68e/pa/SR18679_4877c86992e5b198da5bae7f96da9cd5.jpg not downloaded yet
2026-04-27 07:56:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/43/4e43238f55e519095f9519eb6ca0a055/pa/BZ74074_64704058820cee1e2b0b47a55072f7b5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/c3/e2c37fe0f35ef80f35b4abeec42e917c/pa/DM72572_2e63e7fa8620b4c0b079ce0cc7c5ed8c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/4e/ab4e2a97cadca600a0658a64a72bf36c/pa/YJ22330_d80e1c39920073e5deb68b493ab36f00.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/c3/e2c37fe0f35ef80f35b4abeec42e917c/pa/DM72572_6f72ad6471c638915c529460875cec7c.jpg not downloaded yet
2026-04-27 07:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/43/4e43238f55e519095f9519eb6ca0a055/pa/BZ74074_776b509e83bf98fe8fde64044732b70c.jpg not downloaded yet
2026-04-27 07:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/4e/ab4e2a97cadca600a0658a64a72bf36c/pa/YJ22330_488aa72775012b52db2d0455e96a87b4.jpg not downloaded yet
2026-04-27 07:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/b0/12b06e24b200e0bfaadb3fcf5f847bfb/pa/BV80652_822b0ffd9adf20b90af750572836cf6b.jpg not downloaded yet
2026-04-27 07:56:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GR61820/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438badbd0>
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b6db2aa-a13b-5258-9184-fcd66967a3f2/3b6db2aa-a13b-5258-9184-fcd66967a3f2_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/c5/bec5fe900bd1d6bcca9f7c1e81307c83/pa/RA48817_720c1d584a9f00846908e43bb37df85a.jpg saved to cache
2026-04-27 07:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3b6db2aa-a13b-5258-9184-fcd66967a3f2
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c95290>
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83a9c299-5f22-570f-bd67-75bf22661eae/83a9c299-5f22-570f-bd67-75bf22661eae_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/80/fe80e7677fbbad7e352e755b990fe68e/pa/SR18679_cfd38aa70cd7072115e1b3dabef89a3f.jpg saved to cache
2026-04-27 07:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 83a9c299-5f22-570f-bd67-75bf22661eae
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438aeba50>
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3d3341b-9999-571a-906b-ecf1a9f0fffb/e3d3341b-9999-571a-906b-ecf1a9f0fffb_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/73/0e734a47005bb8d1203491c837f146b6/pa/LJ30136_ebfe8b84ac306bc335c3b5c6898fe742.jpg saved to cache
2026-04-27 07:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e3d3341b-9999-571a-906b-ecf1a9f0fffb
2026-04-27 07:56:43 [auto1.fr] INFO: Found listing with ID: UV16444
2026-04-27 07:56:43 [auto1.fr] INFO: Scrape type for UV16444: 2
2026-04-27 07:56:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6b50a29-9078-52ba-ba19-e5e83a7d6105 with identifier: UV16444
2026-04-27 07:56:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6b50a29-9078-52ba-ba19-e5e83a7d6105 with scrape type 2
2026-04-27 07:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f6b50a29-9078-52ba-ba19-e5e83a7d6105 with scrape type 2
2026-04-27 07:56:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f6b50a29-9078-52ba-ba19-e5e83a7d6105, identifier: UV16444
2026-04-27 07:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/80/fe80e7677fbbad7e352e755b990fe68e/pa/SR18679_8f5bd150dcd694471fbb17f9b55b8ff2.jpg not downloaded yet
2026-04-27 07:56:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/80/fe80e7677fbbad7e352e755b990fe68e/pa/SR18679_7ebb292416f334d7a952b26dd5562272.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/4e/ab4e2a97cadca600a0658a64a72bf36c/pa/YJ22330_ee1e6d66a021895bd490bd907df75f44.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f6b50a29-9078-52ba-ba19-e5e83a7d6105 with identifier: UV16444
2026-04-27 07:56:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f6b50a29-9078-52ba-ba19-e5e83a7d6105 with identifier: UV16444
2026-04-27 07:56:44 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f6b50a29-9078-52ba-ba19-e5e83a7d6105 with identifier: UV16444 to the API
2026-04-27 07:56:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:44 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-04-28T15:45:06Z',
 'fuel_type': 'hybrid',
 'id': 'f6b50a29-9078-52ba-ba19-e5e83a7d6105',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UV16444',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Peugeot',
 'model': '508',
 'odometer': 121610,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2021-04-28',
 'seller_name': None,
 'title': 'Peugeot 508 1.6 Hybrid 225 GT',
 'transmission': 'automatic',
 'trim': '225 GT',
 'year': 2021}
2026-04-27 07:56:44 [auto1.fr] INFO: Saving data for UV16444: {'auction_closing_time': 1777391106.0, 'created_time': 1777021996.437136, 'has_photos': True, 'last_price_update_time': 1777276604.377195}
2026-04-27 07:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/c3/e2c37fe0f35ef80f35b4abeec42e917c/pa/DM72572_66321652a2b653c80c9ce343e2d2511f.jpg not downloaded yet
2026-04-27 07:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/43/4e43238f55e519095f9519eb6ca0a055/pa/BZ74074_995bdc3530834408e9abf05f20adff02.jpg not downloaded yet
2026-04-27 07:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/4e/ab4e2a97cadca600a0658a64a72bf36c/pa/YJ22330_d5165b4345d26304d2d7b7b925803185.jpg not downloaded yet
2026-04-27 07:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/b0/12b06e24b200e0bfaadb3fcf5f847bfb/pa/BV80652_fe4c1ec4a27ebb0fc01a72a3e708f9e1.jpg not downloaded yet
2026-04-27 07:56:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/43/4e43238f55e519095f9519eb6ca0a055/pa/BZ74074_30554f69b1e8592cf0bf3a9251acbb84.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/c3/e2c37fe0f35ef80f35b4abeec42e917c/pa/DM72572_82a492d3a56006bea8b2e187508d4028.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:44 [auto1.fr] INFO: Found listing with ID: EF42157
2026-04-27 07:56:44 [auto1.fr] INFO: Scrape type for EF42157: 1
2026-04-27 07:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/80/fe80e7677fbbad7e352e755b990fe68e/pa/SR18679_96391651848855a87dbe69b6e02392c3.jpg not downloaded yet
2026-04-27 07:56:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YR21354/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6dd2c18-b668-5728-a326-d20c13c257bc with identifier: RM20778
2026-04-27 07:56:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6dd2c18-b668-5728-a326-d20c13c257bc with scrape type 1
2026-04-27 07:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item b6dd2c18-b668-5728-a326-d20c13c257bc
2026-04-27 07:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/29/1f29cb4b74bf86cf5151b56bbb07ea8d/pa/RM20778_b2d5a3a9b25095952f492de240a43e4c.jpg not downloaded yet
2026-04-27 07:56:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c54b90>
2026-04-27 07:56:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83a9c299-5f22-570f-bd67-75bf22661eae/83a9c299-5f22-570f-bd67-75bf22661eae_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/80/fe80e7677fbbad7e352e755b990fe68e/pa/SR18679_255c32a9577e69b7a3ae7c449d4eaee1.jpg saved to cache
2026-04-27 07:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 83a9c299-5f22-570f-bd67-75bf22661eae
2026-04-27 07:56:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b7e390>
2026-04-27 07:56:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d1a0922-da79-5947-a1cf-3ef1420e1b2e/9d1a0922-da79-5947-a1cf-3ef1420e1b2e_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/43/4e43238f55e519095f9519eb6ca0a055/pa/BZ74074_64704058820cee1e2b0b47a55072f7b5.jpg saved to cache
2026-04-27 07:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9d1a0922-da79-5947-a1cf-3ef1420e1b2e
2026-04-27 07:56:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14381df0d0>
2026-04-27 07:56:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08743775-3902-5767-bb6e-9e5f10ffbe6e/08743775-3902-5767-bb6e-9e5f10ffbe6e_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/c3/e2c37fe0f35ef80f35b4abeec42e917c/pa/DM72572_2e63e7fa8620b4c0b079ce0cc7c5ed8c.jpg saved to cache
2026-04-27 07:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 08743775-3902-5767-bb6e-9e5f10ffbe6e
2026-04-27 07:56:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438016ad0>
2026-04-27 07:56:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25983589-8f70-5628-8773-c87541ecdcfc/25983589-8f70-5628-8773-c87541ecdcfc_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/4e/ab4e2a97cadca600a0658a64a72bf36c/pa/YJ22330_d80e1c39920073e5deb68b493ab36f00.jpg saved to cache
2026-04-27 07:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 25983589-8f70-5628-8773-c87541ecdcfc
2026-04-27 07:56:44 [auto1.fr] INFO: Channel: 24h | Page: 7 | totalHits: 4728 | hits on page: 40
2026-04-27 07:56:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/4e/ab4e2a97cadca600a0658a64a72bf36c/pa/YJ22330_a4dfe70045472de9966bf66e9503a4c4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/4e/ab4e2a97cadca600a0658a64a72bf36c/pa/YJ22330_84b751e1cba29c6ec8e08c3ff7505462.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/c3/e2c37fe0f35ef80f35b4abeec42e917c/pa/DM72572_e2a7670abee155887455796d7f3acb66.jpg not downloaded yet
2026-04-27 07:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/43/4e43238f55e519095f9519eb6ca0a055/pa/BZ74074_eab5d97149beab524e0f54df21464750.jpg not downloaded yet
2026-04-27 07:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/4e/ab4e2a97cadca600a0658a64a72bf36c/pa/YJ22330_2bda755d7857622b63f54bf708d6ec2b.jpg not downloaded yet
2026-04-27 07:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/b0/12b06e24b200e0bfaadb3fcf5f847bfb/pa/BV80652_49a58bfb7d4acce37e155732f0ca6e94.jpg already downloaded
2026-04-27 07:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/b0/12b06e24b200e0bfaadb3fcf5f847bfb/pa/BV80652_1cde6c629cdfeb1537910c752fcf7427.jpg already downloaded
2026-04-27 07:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/b0/12b06e24b200e0bfaadb3fcf5f847bfb/pa/BV80652_21fb8c57bd5ca58ea130b21f59136ea6.jpg already downloaded
2026-04-27 07:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/b0/12b06e24b200e0bfaadb3fcf5f847bfb/pa/BV80652_a3f14e6502023a0d93b799b513741b1e.jpg already downloaded
2026-04-27 07:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/b0/12b06e24b200e0bfaadb3fcf5f847bfb/pa/BV80652_57e1c56de324bfde05b6b37d25396339.jpg already downloaded
2026-04-27 07:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/b0/12b06e24b200e0bfaadb3fcf5f847bfb/pa/BV80652_af0ae5d050460ccd22ed002456906492.jpg already downloaded
2026-04-27 07:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/b0/12b06e24b200e0bfaadb3fcf5f847bfb/pa/BV80652_ed4bb03ae162dfabdb8b07bf7e6a7c7f.jpg already downloaded
2026-04-27 07:56:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/b0/12b06e24b200e0bfaadb3fcf5f847bfb/pa/BV80652_e907331812e79208b44d8a7db8e7df20.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/43/4e43238f55e519095f9519eb6ca0a055/pa/BZ74074_7a2b70556345bd4fe9502daac8e3d7dc.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:45 [auto1.fr] INFO: Found listing with ID: KG84192
2026-04-27 07:56:45 [auto1.fr] INFO: Scrape type for KG84192: 2
2026-04-27 07:56:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e227204-ae7d-59b1-ab9b-0b683d5ade57 with identifier: KG84192
2026-04-27 07:56:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e227204-ae7d-59b1-ab9b-0b683d5ade57 with scrape type 2
2026-04-27 07:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8e227204-ae7d-59b1-ab9b-0b683d5ade57 with scrape type 2
2026-04-27 07:56:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8e227204-ae7d-59b1-ab9b-0b683d5ade57, identifier: KG84192
2026-04-27 07:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/80/fe80e7677fbbad7e352e755b990fe68e/pa/SR18679_e15e057ba32eeb0e25573773cb16af9c.jpg not downloaded yet
2026-04-27 07:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/29/1f29cb4b74bf86cf5151b56bbb07ea8d/pa/RM20778_81e54df8ecc607acdb64fe546d808179.jpg not downloaded yet
2026-04-27 07:56:45 [auto1.fr] INFO: Found listing with ID: FK21242
2026-04-27 07:56:45 [auto1.fr] INFO: Scrape type for FK21242: 1
2026-04-27 07:56:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b7e710>
2026-04-27 07:56:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83a9c299-5f22-570f-bd67-75bf22661eae/83a9c299-5f22-570f-bd67-75bf22661eae_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/80/fe80e7677fbbad7e352e755b990fe68e/pa/SR18679_7ebb292416f334d7a952b26dd5562272.jpg saved to cache
2026-04-27 07:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 83a9c299-5f22-570f-bd67-75bf22661eae
2026-04-27 07:56:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438e973d0>
2026-04-27 07:56:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25983589-8f70-5628-8773-c87541ecdcfc/25983589-8f70-5628-8773-c87541ecdcfc_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/4e/ab4e2a97cadca600a0658a64a72bf36c/pa/YJ22330_ee1e6d66a021895bd490bd907df75f44.jpg saved to cache
2026-04-27 07:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 25983589-8f70-5628-8773-c87541ecdcfc
2026-04-27 07:56:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/80/fe80e7677fbbad7e352e755b990fe68e/pa/SR18679_4877c86992e5b198da5bae7f96da9cd5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8e227204-ae7d-59b1-ab9b-0b683d5ade57 with identifier: KG84192
2026-04-27 07:56:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8e227204-ae7d-59b1-ab9b-0b683d5ade57 with identifier: KG84192
2026-04-27 07:56:45 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 8e227204-ae7d-59b1-ab9b-0b683d5ade57 with identifier: KG84192 to the API
2026-04-27 07:56:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:45 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-04-28T15:57:47Z',
 'fuel_type': 'diesel',
 'id': '8e227204-ae7d-59b1-ab9b-0b683d5ade57',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KG84192',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Peugeot',
 'model': '308',
 'odometer': 366892,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2016-03-30',
 'seller_name': None,
 'title': 'Peugeot 308 1.6 Blue-HDi Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2016}
2026-04-27 07:56:45 [auto1.fr] INFO: Saving data for KG84192: {'auction_closing_time': 1777391867.0, 'created_time': 1777020915.888044, 'has_photos': True, 'last_price_update_time': 1777276605.755816}
2026-04-27 07:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/c3/e2c37fe0f35ef80f35b4abeec42e917c/pa/DM72572_af773fc9979c496c845c0c5dafaa7d64.jpg not downloaded yet
2026-04-27 07:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/43/4e43238f55e519095f9519eb6ca0a055/pa/BZ74074_8b2b1c2c8254dac44f2b89063bedde4a.jpg not downloaded yet
2026-04-27 07:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/4e/ab4e2a97cadca600a0658a64a72bf36c/pa/YJ22330_a90810b5cd4cab7274154bae3cedd925.jpg not downloaded yet
2026-04-27 07:56:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438044fd0>
2026-04-27 07:56:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d1a0922-da79-5947-a1cf-3ef1420e1b2e/9d1a0922-da79-5947-a1cf-3ef1420e1b2e_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/43/4e43238f55e519095f9519eb6ca0a055/pa/BZ74074_30554f69b1e8592cf0bf3a9251acbb84.jpg saved to cache
2026-04-27 07:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9d1a0922-da79-5947-a1cf-3ef1420e1b2e
2026-04-27 07:56:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143804f490>
2026-04-27 07:56:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08743775-3902-5767-bb6e-9e5f10ffbe6e/08743775-3902-5767-bb6e-9e5f10ffbe6e_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/c3/e2c37fe0f35ef80f35b4abeec42e917c/pa/DM72572_82a492d3a56006bea8b2e187508d4028.jpg saved to cache
2026-04-27 07:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 08743775-3902-5767-bb6e-9e5f10ffbe6e
2026-04-27 07:56:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/4e/ab4e2a97cadca600a0658a64a72bf36c/pa/YJ22330_488aa72775012b52db2d0455e96a87b4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:46 [auto1.fr] INFO: Found listing with ID: KL48145
2026-04-27 07:56:46 [auto1.fr] INFO: Scrape type for KL48145: 2
2026-04-27 07:56:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38c15883-ba92-5a94-9e25-5860d3247636 with identifier: KL48145
2026-04-27 07:56:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38c15883-ba92-5a94-9e25-5860d3247636 with scrape type 2
2026-04-27 07:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 38c15883-ba92-5a94-9e25-5860d3247636 with scrape type 2
2026-04-27 07:56:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 38c15883-ba92-5a94-9e25-5860d3247636, identifier: KL48145
2026-04-27 07:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/29/1f29cb4b74bf86cf5151b56bbb07ea8d/pa/RM20778_62be7efdab54e7dbba79ca84a8dac294.jpg not downloaded yet
2026-04-27 07:56:46 [auto1.fr] INFO: Found listing with ID: SL94657
2026-04-27 07:56:46 [auto1.fr] INFO: Scrape type for SL94657: 2
2026-04-27 07:56:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3cfd3f3e-6037-5c7f-b648-85a3cbf8ec2e with identifier: SL94657
2026-04-27 07:56:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3cfd3f3e-6037-5c7f-b648-85a3cbf8ec2e with scrape type 2
2026-04-27 07:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3cfd3f3e-6037-5c7f-b648-85a3cbf8ec2e with scrape type 2
2026-04-27 07:56:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3cfd3f3e-6037-5c7f-b648-85a3cbf8ec2e, identifier: SL94657
2026-04-27 07:56:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FR18447/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bf55b10>
2026-04-27 07:56:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25983589-8f70-5628-8773-c87541ecdcfc/25983589-8f70-5628-8773-c87541ecdcfc_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/4e/ab4e2a97cadca600a0658a64a72bf36c/pa/YJ22330_a4dfe70045472de9966bf66e9503a4c4.jpg saved to cache
2026-04-27 07:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 25983589-8f70-5628-8773-c87541ecdcfc
2026-04-27 07:56:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438185290>
2026-04-27 07:56:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25983589-8f70-5628-8773-c87541ecdcfc/25983589-8f70-5628-8773-c87541ecdcfc_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/4e/ab4e2a97cadca600a0658a64a72bf36c/pa/YJ22330_84b751e1cba29c6ec8e08c3ff7505462.jpg saved to cache
2026-04-27 07:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 25983589-8f70-5628-8773-c87541ecdcfc
2026-04-27 07:56:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/b0/12b06e24b200e0bfaadb3fcf5f847bfb/pa/BV80652_822b0ffd9adf20b90af750572836cf6b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/80/fe80e7677fbbad7e352e755b990fe68e/pa/SR18679_8f5bd150dcd694471fbb17f9b55b8ff2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/43/4e43238f55e519095f9519eb6ca0a055/pa/BZ74074_776b509e83bf98fe8fde64044732b70c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 38c15883-ba92-5a94-9e25-5860d3247636 with identifier: KL48145
2026-04-27 07:56:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 38c15883-ba92-5a94-9e25-5860d3247636 with identifier: KL48145
2026-04-27 07:56:46 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 38c15883-ba92-5a94-9e25-5860d3247636 with identifier: KL48145 to the API
2026-04-27 07:56:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:46 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-04-28T15:57:15Z',
 'fuel_type': 'petrol',
 'id': '38c15883-ba92-5a94-9e25-5860d3247636',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KL48145',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Peugeot',
 'model': '308',
 'odometer': 184130,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2016-04-10',
 'seller_name': None,
 'title': 'Peugeot 308 1.2 e-THP Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2016}
2026-04-27 07:56:46 [auto1.fr] INFO: Saving data for KL48145: {'auction_closing_time': 1777391835.0, 'created_time': 1777022142.531231, 'has_photos': True, 'last_price_update_time': 1777276606.733228}
2026-04-27 07:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/c3/e2c37fe0f35ef80f35b4abeec42e917c/pa/DM72572_6e8a2fb0a04c0d59eca0589b19c97c3f.jpg not downloaded yet
2026-04-27 07:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/43/4e43238f55e519095f9519eb6ca0a055/pa/BZ74074_9fd3353e73a35305aa2fe7ff585b36a4.jpg not downloaded yet
2026-04-27 07:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/4e/ab4e2a97cadca600a0658a64a72bf36c/pa/YJ22330_5853b43911b5f5dd2db152b1986526bf.jpg not downloaded yet
2026-04-27 07:56:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3cfd3f3e-6037-5c7f-b648-85a3cbf8ec2e with identifier: SL94657
2026-04-27 07:56:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3cfd3f3e-6037-5c7f-b648-85a3cbf8ec2e with identifier: SL94657
2026-04-27 07:56:46 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 3cfd3f3e-6037-5c7f-b648-85a3cbf8ec2e with identifier: SL94657 to the API
2026-04-27 07:56:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:47 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 120,
 'expiration_date': '2026-04-28T15:35:02Z',
 'fuel_type': 'petrol',
 'id': '3cfd3f3e-6037-5c7f-b648-85a3cbf8ec2e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SL94657',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Citroen',
 'model': 'DS3',
 'odometer': 92794,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2011-04-04',
 'seller_name': None,
 'title': 'Citroen DS3 1.6 VTi SoChic',
 'transmission': 'manual',
 'trim': 'SoChic',
 'year': 2011}
2026-04-27 07:56:47 [auto1.fr] INFO: Saving data for SL94657: {'auction_closing_time': 1777390502.0, 'created_time': 1777020815.17678, 'has_photos': True, 'last_price_update_time': 1777276607.255872}
2026-04-27 07:56:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JL00228/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HN87071/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438bd28d0>
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97f77e89-6691-5e3b-a6fa-2af0cb5c989b/97f77e89-6691-5e3b-a6fa-2af0cb5c989b_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/b0/12b06e24b200e0bfaadb3fcf5f847bfb/pa/BV80652_e907331812e79208b44d8a7db8e7df20.jpg saved to cache
2026-04-27 07:56:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 97f77e89-6691-5e3b-a6fa-2af0cb5c989b
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d31dd0>
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d1a0922-da79-5947-a1cf-3ef1420e1b2e/9d1a0922-da79-5947-a1cf-3ef1420e1b2e_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/43/4e43238f55e519095f9519eb6ca0a055/pa/BZ74074_7a2b70556345bd4fe9502daac8e3d7dc.jpg saved to cache
2026-04-27 07:56:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9d1a0922-da79-5947-a1cf-3ef1420e1b2e
2026-04-27 07:56:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/4e/ab4e2a97cadca600a0658a64a72bf36c/pa/YJ22330_d5165b4345d26304d2d7b7b925803185.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/b0/12b06e24b200e0bfaadb3fcf5f847bfb/pa/BV80652_fe4c1ec4a27ebb0fc01a72a3e708f9e1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/43/4e43238f55e519095f9519eb6ca0a055/pa/BZ74074_995bdc3530834408e9abf05f20adff02.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:47 [auto1.fr] INFO: Found listing with ID: WV49369
2026-04-27 07:56:47 [auto1.fr] INFO: Scrape type for WV49369: 2
2026-04-27 07:56:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b22f09e-6471-5736-9834-8d7237692768 with identifier: WV49369
2026-04-27 07:56:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b22f09e-6471-5736-9834-8d7237692768 with scrape type 2
2026-04-27 07:56:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5b22f09e-6471-5736-9834-8d7237692768 with scrape type 2
2026-04-27 07:56:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5b22f09e-6471-5736-9834-8d7237692768, identifier: WV49369
2026-04-27 07:56:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/29/1f29cb4b74bf86cf5151b56bbb07ea8d/pa/RM20778_cfbcab752ce1caf45f1583cd118f4e14.jpg not downloaded yet
2026-04-27 07:56:47 [auto1.fr] INFO: Found listing with ID: XD50705
2026-04-27 07:56:47 [auto1.fr] INFO: Scrape type for XD50705: 2
2026-04-27 07:56:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bec64981-2789-525b-becf-e7bd280c3a85 with identifier: XD50705
2026-04-27 07:56:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bec64981-2789-525b-becf-e7bd280c3a85 with scrape type 2
2026-04-27 07:56:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bec64981-2789-525b-becf-e7bd280c3a85 with scrape type 2
2026-04-27 07:56:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: bec64981-2789-525b-becf-e7bd280c3a85, identifier: XD50705
2026-04-27 07:56:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ce9f50>
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83a9c299-5f22-570f-bd67-75bf22661eae/83a9c299-5f22-570f-bd67-75bf22661eae_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/80/fe80e7677fbbad7e352e755b990fe68e/pa/SR18679_4877c86992e5b198da5bae7f96da9cd5.jpg saved to cache
2026-04-27 07:56:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 83a9c299-5f22-570f-bd67-75bf22661eae
2026-04-27 07:56:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/4e/ab4e2a97cadca600a0658a64a72bf36c/pa/YJ22330_2bda755d7857622b63f54bf708d6ec2b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5b22f09e-6471-5736-9834-8d7237692768 with identifier: WV49369
2026-04-27 07:56:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5b22f09e-6471-5736-9834-8d7237692768 with identifier: WV49369
2026-04-27 07:56:47 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 5b22f09e-6471-5736-9834-8d7237692768 with identifier: WV49369 to the API
2026-04-27 07:56:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:47 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 250,
 'expiration_date': '2026-04-28T15:59:32Z',
 'fuel_type': 'diesel',
 'id': '5b22f09e-6471-5736-9834-8d7237692768',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WV49369',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Mercedes-Benz',
 'model': 'M-Klasse',
 'odometer': 271958,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2001-12-18',
 'seller_name': None,
 'title': 'Mercedes-Benz M-Klasse ML 400 CDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2001}
2026-04-27 07:56:48 [auto1.fr] INFO: Saving data for WV49369: {'auction_closing_time': 1777391972.0, 'created_time': 1777020914.531436, 'has_photos': True, 'last_price_update_time': 1777276608.070213}
2026-04-27 07:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/c3/e2c37fe0f35ef80f35b4abeec42e917c/pa/DM72572_e34f5672af98e035df4cb5a3a7dab15c.jpg not downloaded yet
2026-04-27 07:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/43/4e43238f55e519095f9519eb6ca0a055/pa/BZ74074_22681a5c3f63410cefb41257a64cd89b.jpg not downloaded yet
2026-04-27 07:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/4e/ab4e2a97cadca600a0658a64a72bf36c/pa/YJ22330_60e64a92f6c8a9549d55cd37a5e6b4e1.jpg not downloaded yet
2026-04-27 07:56:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: bec64981-2789-525b-becf-e7bd280c3a85 with identifier: XD50705
2026-04-27 07:56:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: bec64981-2789-525b-becf-e7bd280c3a85 with identifier: XD50705
2026-04-27 07:56:48 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: bec64981-2789-525b-becf-e7bd280c3a85 with identifier: XD50705 to the API
2026-04-27 07:56:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:48 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-04-28T15:47:59Z',
 'fuel_type': 'petrol',
 'id': 'bec64981-2789-525b-becf-e7bd280c3a85',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XD50705',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Citroen',
 'model': 'C3 Picasso',
 'odometer': 138558,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2016-11-14',
 'seller_name': None,
 'title': 'Citroen C3 Picasso 1.2 PureTech Exclusive',
 'transmission': 'manual',
 'trim': 'Exclusive',
 'year': 2016}
2026-04-27 07:56:48 [auto1.fr] INFO: Saving data for XD50705: {'auction_closing_time': 1777391279.0, 'created_time': 1777021765.024612, 'has_photos': True, 'last_price_update_time': 1777276608.585755}
2026-04-27 07:56:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438e00f10>
2026-04-27 07:56:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25983589-8f70-5628-8773-c87541ecdcfc/25983589-8f70-5628-8773-c87541ecdcfc_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/4e/ab4e2a97cadca600a0658a64a72bf36c/pa/YJ22330_488aa72775012b52db2d0455e96a87b4.jpg saved to cache
2026-04-27 07:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 25983589-8f70-5628-8773-c87541ecdcfc
2026-04-27 07:56:48 [auto1.fr] INFO: Found listing with ID: GS97356
2026-04-27 07:56:48 [auto1.fr] INFO: Scrape type for GS97356: 2
2026-04-27 07:56:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c44390af-ce76-5c5b-bbde-2bbae900c214 with identifier: GS97356
2026-04-27 07:56:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c44390af-ce76-5c5b-bbde-2bbae900c214 with scrape type 2
2026-04-27 07:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c44390af-ce76-5c5b-bbde-2bbae900c214 with scrape type 2
2026-04-27 07:56:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c44390af-ce76-5c5b-bbde-2bbae900c214, identifier: GS97356
2026-04-27 07:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/29/1f29cb4b74bf86cf5151b56bbb07ea8d/pa/RM20778_adb5e71f7ab7b45629cea9c15cf09475.jpg not downloaded yet
2026-04-27 07:56:48 [auto1.fr] INFO: Found listing with ID: DF10648
2026-04-27 07:56:48 [auto1.fr] INFO: Scrape type for DF10648: 2
2026-04-27 07:56:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2dec1af-5137-5b05-9f07-d200cbcdccd0 with identifier: DF10648
2026-04-27 07:56:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2dec1af-5137-5b05-9f07-d200cbcdccd0 with scrape type 2
2026-04-27 07:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f2dec1af-5137-5b05-9f07-d200cbcdccd0 with scrape type 2
2026-04-27 07:56:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f2dec1af-5137-5b05-9f07-d200cbcdccd0, identifier: DF10648
2026-04-27 07:56:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WE27785> (referer: https://www.auto1.com/v1/car-details-view/WE27785/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a56890>
2026-04-27 07:56:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97f77e89-6691-5e3b-a6fa-2af0cb5c989b/97f77e89-6691-5e3b-a6fa-2af0cb5c989b_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/b0/12b06e24b200e0bfaadb3fcf5f847bfb/pa/BV80652_822b0ffd9adf20b90af750572836cf6b.jpg saved to cache
2026-04-27 07:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 97f77e89-6691-5e3b-a6fa-2af0cb5c989b
2026-04-27 07:56:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b03750>
2026-04-27 07:56:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83a9c299-5f22-570f-bd67-75bf22661eae/83a9c299-5f22-570f-bd67-75bf22661eae_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/80/fe80e7677fbbad7e352e755b990fe68e/pa/SR18679_8f5bd150dcd694471fbb17f9b55b8ff2.jpg saved to cache
2026-04-27 07:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 83a9c299-5f22-570f-bd67-75bf22661eae
2026-04-27 07:56:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438acf510>
2026-04-27 07:56:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d1a0922-da79-5947-a1cf-3ef1420e1b2e/9d1a0922-da79-5947-a1cf-3ef1420e1b2e_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/43/4e43238f55e519095f9519eb6ca0a055/pa/BZ74074_776b509e83bf98fe8fde64044732b70c.jpg saved to cache
2026-04-27 07:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9d1a0922-da79-5947-a1cf-3ef1420e1b2e
2026-04-27 07:56:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/43/4e43238f55e519095f9519eb6ca0a055/pa/BZ74074_8b2b1c2c8254dac44f2b89063bedde4a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c44390af-ce76-5c5b-bbde-2bbae900c214 with identifier: GS97356
2026-04-27 07:56:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c44390af-ce76-5c5b-bbde-2bbae900c214 with identifier: GS97356
2026-04-27 07:56:49 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c44390af-ce76-5c5b-bbde-2bbae900c214 with identifier: GS97356 to the API
2026-04-27 07:56:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:49 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 65,
 'expiration_date': '2026-04-28T15:16:52Z',
 'fuel_type': 'petrol',
 'id': 'c44390af-ce76-5c5b-bbde-2bbae900c214',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GS97356',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 44623,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2015-01-19',
 'seller_name': None,
 'title': 'Opel Corsa 1.0 Graphite',
 'transmission': 'manual',
 'trim': 'Graphite',
 'year': 2015}
2026-04-27 07:56:49 [auto1.fr] INFO: Saving data for GS97356: {'auction_closing_time': 1777389412.0, 'created_time': 1777020712.426754, 'has_photos': True, 'last_price_update_time': 1777276609.455542}
2026-04-27 07:56:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f2dec1af-5137-5b05-9f07-d200cbcdccd0 with identifier: DF10648
2026-04-27 07:56:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f2dec1af-5137-5b05-9f07-d200cbcdccd0 with identifier: DF10648
2026-04-27 07:56:49 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f2dec1af-5137-5b05-9f07-d200cbcdccd0 with identifier: DF10648 to the API
2026-04-27 07:56:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:49 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-04-28T15:12:05Z',
 'fuel_type': 'hybrid',
 'id': 'f2dec1af-5137-5b05-9f07-d200cbcdccd0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF10648',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'BMW',
 'model': '2er',
 'odometer': 119354,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2018-11-06',
 'seller_name': None,
 'title': 'BMW 2er 225xe Active Tourer M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2018}
2026-04-27 07:56:49 [auto1.fr] INFO: Saving data for DF10648: {'auction_closing_time': 1777389125.0, 'created_time': 1777022757.647874, 'has_photos': True, 'last_price_update_time': 1777276609.883159}
2026-04-27 07:56:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438cd7c90>
2026-04-27 07:56:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25983589-8f70-5628-8773-c87541ecdcfc/25983589-8f70-5628-8773-c87541ecdcfc_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/4e/ab4e2a97cadca600a0658a64a72bf36c/pa/YJ22330_d5165b4345d26304d2d7b7b925803185.jpg saved to cache
2026-04-27 07:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 25983589-8f70-5628-8773-c87541ecdcfc
2026-04-27 07:56:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a1a810>
2026-04-27 07:56:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97f77e89-6691-5e3b-a6fa-2af0cb5c989b/97f77e89-6691-5e3b-a6fa-2af0cb5c989b_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/b0/12b06e24b200e0bfaadb3fcf5f847bfb/pa/BV80652_fe4c1ec4a27ebb0fc01a72a3e708f9e1.jpg saved to cache
2026-04-27 07:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 97f77e89-6691-5e3b-a6fa-2af0cb5c989b
2026-04-27 07:56:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 97f77e89-6691-5e3b-a6fa-2af0cb5c989b, skipping ID generation
2026-04-27 07:56:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97f77e89-6691-5e3b-a6fa-2af0cb5c989b with scrape type 1
2026-04-27 07:56:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 97f77e89-6691-5e3b-a6fa-2af0cb5c989b sending to next pipeline
2026-04-27 07:56:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 97f77e89-6691-5e3b-a6fa-2af0cb5c989b, identifier: BV80652
2026-04-27 07:56:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143804f890>
2026-04-27 07:56:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d1a0922-da79-5947-a1cf-3ef1420e1b2e/9d1a0922-da79-5947-a1cf-3ef1420e1b2e_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/43/4e43238f55e519095f9519eb6ca0a055/pa/BZ74074_995bdc3530834408e9abf05f20adff02.jpg saved to cache
2026-04-27 07:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9d1a0922-da79-5947-a1cf-3ef1420e1b2e
2026-04-27 07:56:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/c3/e2c37fe0f35ef80f35b4abeec42e917c/pa/DM72572_e2a7670abee155887455796d7f3acb66.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/80/fe80e7677fbbad7e352e755b990fe68e/pa/SR18679_e15e057ba32eeb0e25573773cb16af9c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/c3/e2c37fe0f35ef80f35b4abeec42e917c/pa/DM72572_af773fc9979c496c845c0c5dafaa7d64.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/4e/ab4e2a97cadca600a0658a64a72bf36c/pa/YJ22330_a90810b5cd4cab7274154bae3cedd925.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:50 [auto1.fr] INFO: Found listing with ID: GH44775
2026-04-27 07:56:50 [auto1.fr] INFO: Scrape type for GH44775: 1
2026-04-27 07:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/29/1f29cb4b74bf86cf5151b56bbb07ea8d/pa/RM20778_57a33a41d1e69165d0fff7a9e22d01be.jpg not downloaded yet
2026-04-27 07:56:50 [auto1.fr] INFO: Found listing with ID: UF43750
2026-04-27 07:56:50 [auto1.fr] INFO: Scrape type for UF43750: 2
2026-04-27 07:56:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 065e1d44-5f52-5074-9885-6889e4ce7bb8 with identifier: UF43750
2026-04-27 07:56:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 065e1d44-5f52-5074-9885-6889e4ce7bb8 with scrape type 2
2026-04-27 07:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 065e1d44-5f52-5074-9885-6889e4ce7bb8 with scrape type 2
2026-04-27 07:56:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 065e1d44-5f52-5074-9885-6889e4ce7bb8, identifier: UF43750
2026-04-27 07:56:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GN48177/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XT28721/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 97f77e89-6691-5e3b-a6fa-2af0cb5c989b with identifier: BV80652
2026-04-27 07:56:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 97f77e89-6691-5e3b-a6fa-2af0cb5c989b with identifier: BV80652
2026-04-27 07:56:50 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 97f77e89-6691-5e3b-a6fa-2af0cb5c989b with identifier: BV80652 to the API
2026-04-27 07:56:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:50 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img12/b0/12b06e24b200e0bfaadb3fcf5f847bfb/pa/BV80652_fe4c1ec4a27ebb0fc01a72a3e708f9e1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 33,
 'category': None,
 'city': 'Ingrandes sur Vienne',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 245,
 'expiration_date': '2026-04-28T15:37:56Z',
 'fuel_type': 'hybrid',
 'id': '97f77e89-6691-5e3b-a6fa-2af0cb5c989b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BV80652',
 'listing': 'auction',
 'location': 'FR, Ingrandes sur Vienne',
 'location_confidence': None,
 'longitude': None,
 'make': 'Cupra',
 'model': 'Formentor',
 'odometer': 41493,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_97f77e89-6691-5e3b-a6fa-2af0cb5c989b/97f77e89-6691-5e3b-a6fa-2af0cb5c989b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74149,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/b0/12b06e24b200e0bfaadb3fcf5f847bfb/pa/BV80652_e907331812e79208b44d8a7db8e7df20.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_97f77e89-6691-5e3b-a6fa-2af0cb5c989b/97f77e89-6691-5e3b-a6fa-2af0cb5c989b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73855,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/b0/12b06e24b200e0bfaadb3fcf5f847bfb/pa/BV80652_822b0ffd9adf20b90af750572836cf6b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_97f77e89-6691-5e3b-a6fa-2af0cb5c989b/97f77e89-6691-5e3b-a6fa-2af0cb5c989b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67142,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/b0/12b06e24b200e0bfaadb3fcf5f847bfb/pa/BV80652_fe4c1ec4a27ebb0fc01a72a3e708f9e1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_97f77e89-6691-5e3b-a6fa-2af0cb5c989b/97f77e89-6691-5e3b-a6fa-2af0cb5c989b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65112,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/b0/12b06e24b200e0bfaadb3fcf5f847bfb/pa/BV80652_49a58bfb7d4acce37e155732f0ca6e94.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_97f77e89-6691-5e3b-a6fa-2af0cb5c989b/97f77e89-6691-5e3b-a6fa-2af0cb5c989b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60412,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/b0/12b06e24b200e0bfaadb3fcf5f847bfb/pa/BV80652_1cde6c629cdfeb1537910c752fcf7427.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_97f77e89-6691-5e3b-a6fa-2af0cb5c989b/97f77e89-6691-5e3b-a6fa-2af0cb5c989b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69694,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/b0/12b06e24b200e0bfaadb3fcf5f847bfb/pa/BV80652_21fb8c57bd5ca58ea130b21f59136ea6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_97f77e89-6691-5e3b-a6fa-2af0cb5c989b/97f77e89-6691-5e3b-a6fa-2af0cb5c989b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66806,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/b0/12b06e24b200e0bfaadb3fcf5f847bfb/pa/BV80652_a3f14e6502023a0d93b799b513741b1e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_97f77e89-6691-5e3b-a6fa-2af0cb5c989b/97f77e89-6691-5e3b-a6fa-2af0cb5c989b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75913,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/b0/12b06e24b200e0bfaadb3fcf5f847bfb/pa/BV80652_57e1c56de324bfde05b6b37d25396339.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_97f77e89-6691-5e3b-a6fa-2af0cb5c989b/97f77e89-6691-5e3b-a6fa-2af0cb5c989b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75682,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/b0/12b06e24b200e0bfaadb3fcf5f847bfb/pa/BV80652_af0ae5d050460ccd22ed002456906492.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_97f77e89-6691-5e3b-a6fa-2af0cb5c989b/97f77e89-6691-5e3b-a6fa-2af0cb5c989b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67819,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/b0/12b06e24b200e0bfaadb3fcf5f847bfb/pa/BV80652_ed4bb03ae162dfabdb8b07bf7e6a7c7f.jpg',
             'Width': 800}],
 'postal_code': None,
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2023-08-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Cupra Formentor 1.4 e-HYBRID VZ',
 'transmission': 'automatic',
 'trim': 'VZ',
 'year': 2023}
2026-04-27 07:56:50 [auto1.fr] INFO: Saving data for BV80652: {'created_time': 1777276610.760489, 'last_price_update_time': 1777276610.760534, 'has_photos': True, 'auction_closing_time': 1777390676.0}
2026-04-27 07:56:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380771d0>
2026-04-27 07:56:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25983589-8f70-5628-8773-c87541ecdcfc/25983589-8f70-5628-8773-c87541ecdcfc_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/4e/ab4e2a97cadca600a0658a64a72bf36c/pa/YJ22330_2bda755d7857622b63f54bf708d6ec2b.jpg saved to cache
2026-04-27 07:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 25983589-8f70-5628-8773-c87541ecdcfc
2026-04-27 07:56:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1f/29/1f29cb4b74bf86cf5151b56bbb07ea8d/pa/RM20778_81e54df8ecc607acdb64fe546d808179.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/43/4e43238f55e519095f9519eb6ca0a055/pa/BZ74074_eab5d97149beab524e0f54df21464750.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1f/29/1f29cb4b74bf86cf5151b56bbb07ea8d/pa/RM20778_62be7efdab54e7dbba79ca84a8dac294.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 065e1d44-5f52-5074-9885-6889e4ce7bb8 with identifier: UF43750
2026-04-27 07:56:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 065e1d44-5f52-5074-9885-6889e4ce7bb8 with identifier: UF43750
2026-04-27 07:56:50 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 065e1d44-5f52-5074-9885-6889e4ce7bb8 with identifier: UF43750 to the API
2026-04-27 07:56:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:51 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-04-28T15:01:56Z',
 'fuel_type': 'hybrid',
 'id': '065e1d44-5f52-5074-9885-6889e4ce7bb8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UF43750',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Citroen',
 'model': 'C5 Aircross',
 'odometer': 59541,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2022-09-28',
 'seller_name': None,
 'title': 'Citroen C5 Aircross 1.6 Plug-in Hybrid ë-EAT8 Shine Pack',
 'transmission': 'automatic',
 'trim': 'Shine Pack',
 'year': 2022}
2026-04-27 07:56:51 [auto1.fr] INFO: Saving data for UF43750: {'auction_closing_time': 1777388516.0, 'created_time': 1777022253.089437, 'has_photos': True, 'last_price_update_time': 1777276611.178128}
2026-04-27 07:56:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a8845ed-5845-5485-a8f8-70d9fdb8d78a with identifier: WE27785
2026-04-27 07:56:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a8845ed-5845-5485-a8f8-70d9fdb8d78a with scrape type 1
2026-04-27 07:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8a8845ed-5845-5485-a8f8-70d9fdb8d78a
2026-04-27 07:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/9e/9c9e83f959949f6fb2d8a4d42b1e0f3f/pa/WE27785_27d9cf0079a7c2bd44021920efef1538.jpg not downloaded yet
2026-04-27 07:56:51 [auto1.fr] INFO: Found listing with ID: XG74646
2026-04-27 07:56:51 [auto1.fr] INFO: Scrape type for XG74646: 1
2026-04-27 07:56:51 [auto1.fr] INFO: Found listing with ID: FG74412
2026-04-27 07:56:51 [auto1.fr] INFO: Scrape type for FG74412: 1
2026-04-27 07:56:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438eec610>
2026-04-27 07:56:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d1a0922-da79-5947-a1cf-3ef1420e1b2e/9d1a0922-da79-5947-a1cf-3ef1420e1b2e_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/43/4e43238f55e519095f9519eb6ca0a055/pa/BZ74074_8b2b1c2c8254dac44f2b89063bedde4a.jpg saved to cache
2026-04-27 07:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9d1a0922-da79-5947-a1cf-3ef1420e1b2e
2026-04-27 07:56:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/4e/ab4e2a97cadca600a0658a64a72bf36c/pa/YJ22330_5853b43911b5f5dd2db152b1986526bf.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/9e/9c9e83f959949f6fb2d8a4d42b1e0f3f/pa/WE27785_3d016aa66cb2d94aa0048676e934a76b.jpg not downloaded yet
2026-04-27 07:56:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14381d4990>
2026-04-27 07:56:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08743775-3902-5767-bb6e-9e5f10ffbe6e/08743775-3902-5767-bb6e-9e5f10ffbe6e_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/c3/e2c37fe0f35ef80f35b4abeec42e917c/pa/DM72572_e2a7670abee155887455796d7f3acb66.jpg saved to cache
2026-04-27 07:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 08743775-3902-5767-bb6e-9e5f10ffbe6e
2026-04-27 07:56:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438183f10>
2026-04-27 07:56:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83a9c299-5f22-570f-bd67-75bf22661eae/83a9c299-5f22-570f-bd67-75bf22661eae_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/80/fe80e7677fbbad7e352e755b990fe68e/pa/SR18679_e15e057ba32eeb0e25573773cb16af9c.jpg saved to cache
2026-04-27 07:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 83a9c299-5f22-570f-bd67-75bf22661eae
2026-04-27 07:56:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438cb4f90>
2026-04-27 07:56:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08743775-3902-5767-bb6e-9e5f10ffbe6e/08743775-3902-5767-bb6e-9e5f10ffbe6e_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/c3/e2c37fe0f35ef80f35b4abeec42e917c/pa/DM72572_af773fc9979c496c845c0c5dafaa7d64.jpg saved to cache
2026-04-27 07:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 08743775-3902-5767-bb6e-9e5f10ffbe6e
2026-04-27 07:56:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f144781e890>
2026-04-27 07:56:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25983589-8f70-5628-8773-c87541ecdcfc/25983589-8f70-5628-8773-c87541ecdcfc_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/4e/ab4e2a97cadca600a0658a64a72bf36c/pa/YJ22330_a90810b5cd4cab7274154bae3cedd925.jpg saved to cache
2026-04-27 07:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 25983589-8f70-5628-8773-c87541ecdcfc
2026-04-27 07:56:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1f/29/1f29cb4b74bf86cf5151b56bbb07ea8d/pa/RM20778_cfbcab752ce1caf45f1583cd118f4e14.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/4e/ab4e2a97cadca600a0658a64a72bf36c/pa/YJ22330_60e64a92f6c8a9549d55cd37a5e6b4e1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:51 [auto1.fr] INFO: Found listing with ID: LA06106
2026-04-27 07:56:51 [auto1.fr] INFO: Scrape type for LA06106: 2
2026-04-27 07:56:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39dec330-bfc9-5d99-adba-e2575e9e63eb with identifier: LA06106
2026-04-27 07:56:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39dec330-bfc9-5d99-adba-e2575e9e63eb with scrape type 2
2026-04-27 07:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 39dec330-bfc9-5d99-adba-e2575e9e63eb with scrape type 2
2026-04-27 07:56:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 39dec330-bfc9-5d99-adba-e2575e9e63eb, identifier: LA06106
2026-04-27 07:56:51 [auto1.fr] INFO: Found listing with ID: DA56679
2026-04-27 07:56:51 [auto1.fr] INFO: Scrape type for DA56679: 1
2026-04-27 07:56:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GR61820> (referer: https://www.auto1.com/v1/car-details-view/GR61820/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ecbf50>
2026-04-27 07:56:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6dd2c18-b668-5728-a326-d20c13c257bc/b6dd2c18-b668-5728-a326-d20c13c257bc_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/29/1f29cb4b74bf86cf5151b56bbb07ea8d/pa/RM20778_81e54df8ecc607acdb64fe546d808179.jpg saved to cache
2026-04-27 07:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b6dd2c18-b668-5728-a326-d20c13c257bc
2026-04-27 07:56:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ca7f50>
2026-04-27 07:56:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d1a0922-da79-5947-a1cf-3ef1420e1b2e/9d1a0922-da79-5947-a1cf-3ef1420e1b2e_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/43/4e43238f55e519095f9519eb6ca0a055/pa/BZ74074_eab5d97149beab524e0f54df21464750.jpg saved to cache
2026-04-27 07:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9d1a0922-da79-5947-a1cf-3ef1420e1b2e
2026-04-27 07:56:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a59cd0>
2026-04-27 07:56:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6dd2c18-b668-5728-a326-d20c13c257bc/b6dd2c18-b668-5728-a326-d20c13c257bc_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/29/1f29cb4b74bf86cf5151b56bbb07ea8d/pa/RM20778_62be7efdab54e7dbba79ca84a8dac294.jpg saved to cache
2026-04-27 07:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b6dd2c18-b668-5728-a326-d20c13c257bc
2026-04-27 07:56:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/c3/e2c37fe0f35ef80f35b4abeec42e917c/pa/DM72572_e34f5672af98e035df4cb5a3a7dab15c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 39dec330-bfc9-5d99-adba-e2575e9e63eb with identifier: LA06106
2026-04-27 07:56:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 39dec330-bfc9-5d99-adba-e2575e9e63eb with identifier: LA06106
2026-04-27 07:56:51 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 39dec330-bfc9-5d99-adba-e2575e9e63eb with identifier: LA06106 to the API
2026-04-27 07:56:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:52 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 163,
 'expiration_date': '2026-04-28T15:39:21Z',
 'fuel_type': 'diesel',
 'id': '39dec330-bfc9-5d99-adba-e2575e9e63eb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LA06106',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Mercedes-Benz',
 'model': 'Vito Tourer',
 'odometer': 104701,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2019-12-17',
 'seller_name': None,
 'title': 'Mercedes-Benz Vito Tourer 116 CDI lang Pro',
 'transmission': 'automatic',
 'trim': 'lang Pro',
 'year': 2019}
2026-04-27 07:56:52 [auto1.fr] INFO: Saving data for LA06106: {'auction_closing_time': 1777390761.0, 'created_time': 1777019814.999772, 'has_photos': True, 'last_price_update_time': 1777276612.21953}
2026-04-27 07:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/9e/9c9e83f959949f6fb2d8a4d42b1e0f3f/pa/WE27785_2e2eceff88bd90e3a1a1221e0ce55421.jpg not downloaded yet
2026-04-27 07:56:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/43/4e43238f55e519095f9519eb6ca0a055/pa/BZ74074_22681a5c3f63410cefb41257a64cd89b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1f/29/1f29cb4b74bf86cf5151b56bbb07ea8d/pa/RM20778_adb5e71f7ab7b45629cea9c15cf09475.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/43/4e43238f55e519095f9519eb6ca0a055/pa/BZ74074_9fd3353e73a35305aa2fe7ff585b36a4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:52 [auto1.fr] INFO: Found listing with ID: RM78834
2026-04-27 07:56:52 [auto1.fr] INFO: Scrape type for RM78834: 2
2026-04-27 07:56:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a30c4def-0816-5bb3-ba23-b74240e7299b with identifier: RM78834
2026-04-27 07:56:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a30c4def-0816-5bb3-ba23-b74240e7299b with scrape type 2
2026-04-27 07:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a30c4def-0816-5bb3-ba23-b74240e7299b with scrape type 2
2026-04-27 07:56:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a30c4def-0816-5bb3-ba23-b74240e7299b, identifier: RM78834
2026-04-27 07:56:52 [auto1.fr] INFO: Found listing with ID: DG39573
2026-04-27 07:56:52 [auto1.fr] INFO: Scrape type for DG39573: 2
2026-04-27 07:56:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf49f486-be8e-581a-b639-c527b4c33f0f with identifier: DG39573
2026-04-27 07:56:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf49f486-be8e-581a-b639-c527b4c33f0f with scrape type 2
2026-04-27 07:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf49f486-be8e-581a-b639-c527b4c33f0f with scrape type 2
2026-04-27 07:56:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: cf49f486-be8e-581a-b639-c527b4c33f0f, identifier: DG39573
2026-04-27 07:56:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438cd57d0>
2026-04-27 07:56:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25983589-8f70-5628-8773-c87541ecdcfc/25983589-8f70-5628-8773-c87541ecdcfc_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/4e/ab4e2a97cadca600a0658a64a72bf36c/pa/YJ22330_5853b43911b5f5dd2db152b1986526bf.jpg saved to cache
2026-04-27 07:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 25983589-8f70-5628-8773-c87541ecdcfc
2026-04-27 07:56:52 [auto1.fr] INFO: Channel: 24h | Page: 8 | totalHits: 4728 | hits on page: 40
2026-04-27 07:56:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1f/29/1f29cb4b74bf86cf5151b56bbb07ea8d/pa/RM20778_b2d5a3a9b25095952f492de240a43e4c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/c3/e2c37fe0f35ef80f35b4abeec42e917c/pa/DM72572_6e8a2fb0a04c0d59eca0589b19c97c3f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a30c4def-0816-5bb3-ba23-b74240e7299b with identifier: RM78834
2026-04-27 07:56:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a30c4def-0816-5bb3-ba23-b74240e7299b with identifier: RM78834
2026-04-27 07:56:52 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a30c4def-0816-5bb3-ba23-b74240e7299b with identifier: RM78834 to the API
2026-04-27 07:56:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:52 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-04-28T15:24:00Z',
 'fuel_type': 'diesel',
 'id': 'a30c4def-0816-5bb3-ba23-b74240e7299b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RM78834',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Renault',
 'model': 'Modus',
 'odometer': 128666,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2008-04-03',
 'seller_name': None,
 'title': 'Renault Modus 1.5 dCi Dynamique',
 'transmission': 'manual',
 'trim': 'Dynamique',
 'year': 2008}
2026-04-27 07:56:52 [auto1.fr] INFO: Saving data for RM78834: {'auction_closing_time': 1777389840.0, 'created_time': 1777020021.935322, 'has_photos': True, 'last_price_update_time': 1777276612.99728}
2026-04-27 07:56:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: cf49f486-be8e-581a-b639-c527b4c33f0f with identifier: DG39573
2026-04-27 07:56:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: cf49f486-be8e-581a-b639-c527b4c33f0f with identifier: DG39573
2026-04-27 07:56:53 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: cf49f486-be8e-581a-b639-c527b4c33f0f with identifier: DG39573 to the API
2026-04-27 07:56:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:53 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-04-28T15:08:36Z',
 'fuel_type': 'petrol',
 'id': 'cf49f486-be8e-581a-b639-c527b4c33f0f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DG39573',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Fiat',
 'model': '500X',
 'odometer': 93829,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2019-01-21',
 'seller_name': None,
 'title': 'Fiat 500X 1.0 Turbo Urban',
 'transmission': 'manual',
 'trim': 'Urban',
 'year': 2019}
2026-04-27 07:56:53 [auto1.fr] INFO: Saving data for DG39573: {'auction_closing_time': 1777388916.0, 'created_time': 1777022806.470853, 'has_photos': True, 'last_price_update_time': 1777276613.356836}
2026-04-27 07:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/9e/9c9e83f959949f6fb2d8a4d42b1e0f3f/pa/WE27785_52a21dec8634ba4e5d26f041d655fd98.jpg not downloaded yet
2026-04-27 07:56:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FK21242/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438124cd0>
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6dd2c18-b668-5728-a326-d20c13c257bc/b6dd2c18-b668-5728-a326-d20c13c257bc_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/29/1f29cb4b74bf86cf5151b56bbb07ea8d/pa/RM20778_cfbcab752ce1caf45f1583cd118f4e14.jpg saved to cache
2026-04-27 07:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b6dd2c18-b668-5728-a326-d20c13c257bc
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b67d10>
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25983589-8f70-5628-8773-c87541ecdcfc/25983589-8f70-5628-8773-c87541ecdcfc_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/4e/ab4e2a97cadca600a0658a64a72bf36c/pa/YJ22330_60e64a92f6c8a9549d55cd37a5e6b4e1.jpg saved to cache
2026-04-27 07:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 25983589-8f70-5628-8773-c87541ecdcfc
2026-04-27 07:56:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 25983589-8f70-5628-8773-c87541ecdcfc, skipping ID generation
2026-04-27 07:56:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25983589-8f70-5628-8773-c87541ecdcfc with scrape type 1
2026-04-27 07:56:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 25983589-8f70-5628-8773-c87541ecdcfc sending to next pipeline
2026-04-27 07:56:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 25983589-8f70-5628-8773-c87541ecdcfc, identifier: YJ22330
2026-04-27 07:56:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3a00016-738e-5ecf-b517-7284a47c7133 with identifier: GR61820
2026-04-27 07:56:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3a00016-738e-5ecf-b517-7284a47c7133 with scrape type 1
2026-04-27 07:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item b3a00016-738e-5ecf-b517-7284a47c7133
2026-04-27 07:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/91/9491a12efd5e242be10507e52500e816/pa/GR61820_b6e42abb5eb292ecdf8c143853e5fb10.jpg not downloaded yet
2026-04-27 07:56:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1f/29/1f29cb4b74bf86cf5151b56bbb07ea8d/pa/RM20778_57a33a41d1e69165d0fff7a9e22d01be.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/9e/9c9e83f959949f6fb2d8a4d42b1e0f3f/pa/WE27785_27d9cf0079a7c2bd44021920efef1538.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:53 [auto1.fr] INFO: Found listing with ID: WF13879
2026-04-27 07:56:53 [auto1.fr] INFO: Scrape type for WF13879: 2
2026-04-27 07:56:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f3d81623-cbd3-5c37-9da4-12560457bee2 with identifier: WF13879
2026-04-27 07:56:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3d81623-cbd3-5c37-9da4-12560457bee2 with scrape type 2
2026-04-27 07:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f3d81623-cbd3-5c37-9da4-12560457bee2 with scrape type 2
2026-04-27 07:56:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f3d81623-cbd3-5c37-9da4-12560457bee2, identifier: WF13879
2026-04-27 07:56:53 [auto1.fr] INFO: Found listing with ID: RF52946
2026-04-27 07:56:53 [auto1.fr] INFO: Scrape type for RF52946: 2
2026-04-27 07:56:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12a0078d-d2bf-590d-b042-14045c819021 with identifier: RF52946
2026-04-27 07:56:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12a0078d-d2bf-590d-b042-14045c819021 with scrape type 2
2026-04-27 07:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 12a0078d-d2bf-590d-b042-14045c819021 with scrape type 2
2026-04-27 07:56:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 12a0078d-d2bf-590d-b042-14045c819021, identifier: RF52946
2026-04-27 07:56:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:53 [auto1.fr] INFO: Found listing with ID: FV06659
2026-04-27 07:56:53 [auto1.fr] INFO: Scrape type for FV06659: 2
2026-04-27 07:56:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c97cbf83-2742-5134-97c5-2091ce66e872 with identifier: FV06659
2026-04-27 07:56:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c97cbf83-2742-5134-97c5-2091ce66e872 with scrape type 2
2026-04-27 07:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c97cbf83-2742-5134-97c5-2091ce66e872 with scrape type 2
2026-04-27 07:56:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c97cbf83-2742-5134-97c5-2091ce66e872, identifier: FV06659
2026-04-27 07:56:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 25983589-8f70-5628-8773-c87541ecdcfc with identifier: YJ22330
2026-04-27 07:56:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 25983589-8f70-5628-8773-c87541ecdcfc with identifier: YJ22330
2026-04-27 07:56:54 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 25983589-8f70-5628-8773-c87541ecdcfc with identifier: YJ22330 to the API
2026-04-27 07:56:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:54 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgab/4e/ab4e2a97cadca600a0658a64a72bf36c/pa/YJ22330_60e64a92f6c8a9549d55cd37a5e6b4e1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'category': None,
 'city': 'Villenoy',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.5L',
 'engine_horse_power': 110,
 'expiration_date': '2026-04-28T15:09:57Z',
 'fuel_type': 'diesel',
 'id': '25983589-8f70-5628-8773-c87541ecdcfc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.9411,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ22330',
 'listing': 'auction',
 'location': 'FR, Villenoy',
 'location_confidence': 'geocoded',
 'longitude': 2.8602,
 'make': 'Renault',
 'model': 'Scenic',
 'odometer': 144353,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_25983589-8f70-5628-8773-c87541ecdcfc/25983589-8f70-5628-8773-c87541ecdcfc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66523,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/4e/ab4e2a97cadca600a0658a64a72bf36c/pa/YJ22330_d80e1c39920073e5deb68b493ab36f00.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_25983589-8f70-5628-8773-c87541ecdcfc/25983589-8f70-5628-8773-c87541ecdcfc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65927,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/4e/ab4e2a97cadca600a0658a64a72bf36c/pa/YJ22330_ee1e6d66a021895bd490bd907df75f44.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_25983589-8f70-5628-8773-c87541ecdcfc/25983589-8f70-5628-8773-c87541ecdcfc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66174,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/4e/ab4e2a97cadca600a0658a64a72bf36c/pa/YJ22330_84b751e1cba29c6ec8e08c3ff7505462.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_25983589-8f70-5628-8773-c87541ecdcfc/25983589-8f70-5628-8773-c87541ecdcfc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62536,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/4e/ab4e2a97cadca600a0658a64a72bf36c/pa/YJ22330_a4dfe70045472de9966bf66e9503a4c4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_25983589-8f70-5628-8773-c87541ecdcfc/25983589-8f70-5628-8773-c87541ecdcfc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61015,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/4e/ab4e2a97cadca600a0658a64a72bf36c/pa/YJ22330_488aa72775012b52db2d0455e96a87b4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_25983589-8f70-5628-8773-c87541ecdcfc/25983589-8f70-5628-8773-c87541ecdcfc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68736,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/4e/ab4e2a97cadca600a0658a64a72bf36c/pa/YJ22330_d5165b4345d26304d2d7b7b925803185.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_25983589-8f70-5628-8773-c87541ecdcfc/25983589-8f70-5628-8773-c87541ecdcfc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62117,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/4e/ab4e2a97cadca600a0658a64a72bf36c/pa/YJ22330_2bda755d7857622b63f54bf708d6ec2b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_25983589-8f70-5628-8773-c87541ecdcfc/25983589-8f70-5628-8773-c87541ecdcfc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71828,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/4e/ab4e2a97cadca600a0658a64a72bf36c/pa/YJ22330_a90810b5cd4cab7274154bae3cedd925.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_25983589-8f70-5628-8773-c87541ecdcfc/25983589-8f70-5628-8773-c87541ecdcfc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68726,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/4e/ab4e2a97cadca600a0658a64a72bf36c/pa/YJ22330_5853b43911b5f5dd2db152b1986526bf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_25983589-8f70-5628-8773-c87541ecdcfc/25983589-8f70-5628-8773-c87541ecdcfc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67222,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/4e/ab4e2a97cadca600a0658a64a72bf36c/pa/YJ22330_60e64a92f6c8a9549d55cd37a5e6b4e1.jpg',
             'Width': 800}],
 'postal_code': '77124',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Seine-et-Marne',
 'province_code': 'FR-77',
 'region': 'Île-de-France',
 'region_code': 'FR-11',
 'registration_date': '2011-05-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Scenic 1.5 dCi Dynamique',
 'transmission': 'manual',
 'trim': 'Dynamique',
 'year': 2011}
2026-04-27 07:56:54 [auto1.fr] INFO: Saving data for YJ22330: {'created_time': 1777276614.398802, 'last_price_update_time': 1777276614.398814, 'has_photos': True, 'auction_closing_time': 1777388997.0}
2026-04-27 07:56:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380e70d0>
2026-04-27 07:56:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08743775-3902-5767-bb6e-9e5f10ffbe6e/08743775-3902-5767-bb6e-9e5f10ffbe6e_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/c3/e2c37fe0f35ef80f35b4abeec42e917c/pa/DM72572_e34f5672af98e035df4cb5a3a7dab15c.jpg saved to cache
2026-04-27 07:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 08743775-3902-5767-bb6e-9e5f10ffbe6e
2026-04-27 07:56:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f3d81623-cbd3-5c37-9da4-12560457bee2 with identifier: WF13879
2026-04-27 07:56:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f3d81623-cbd3-5c37-9da4-12560457bee2 with identifier: WF13879
2026-04-27 07:56:54 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f3d81623-cbd3-5c37-9da4-12560457bee2 with identifier: WF13879 to the API
2026-04-27 07:56:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:54 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-04-28T15:29:01Z',
 'fuel_type': 'diesel',
 'id': 'f3d81623-cbd3-5c37-9da4-12560457bee2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WF13879',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 75277,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2022-01-23',
 'seller_name': None,
 'title': 'Ford Transit 2.0 TDCi 470 L3 Einzelkabine Trend',
 'transmission': 'manual',
 'trim': '470 L3 Einzelkabine Trend',
 'year': 2022}
2026-04-27 07:56:54 [auto1.fr] INFO: Saving data for WF13879: {'auction_closing_time': 1777390141.0, 'created_time': 1777022041.373133, 'has_photos': True, 'last_price_update_time': 1777276614.769431}
2026-04-27 07:56:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 12a0078d-d2bf-590d-b042-14045c819021 with identifier: RF52946
2026-04-27 07:56:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 12a0078d-d2bf-590d-b042-14045c819021 with identifier: RF52946
2026-04-27 07:56:54 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 12a0078d-d2bf-590d-b042-14045c819021 with identifier: RF52946 to the API
2026-04-27 07:56:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:54 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 185,
 'expiration_date': '2026-04-28T15:33:47Z',
 'fuel_type': 'diesel',
 'id': '12a0078d-d2bf-590d-b042-14045c819021',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RF52946',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'BMW',
 'model': '5er',
 'odometer': 241745,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2011-10-30',
 'seller_name': None,
 'title': 'BMW 5er 520d EfficientDynamics Confort',
 'transmission': 'manual',
 'trim': 'EfficientDynamics Confort',
 'year': 2011}
2026-04-27 07:56:55 [auto1.fr] INFO: Saving data for RF52946: {'auction_closing_time': 1777390427.0, 'created_time': 1777022275.216066, 'has_photos': True, 'last_price_update_time': 1777276615.086025}
2026-04-27 07:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/9e/9c9e83f959949f6fb2d8a4d42b1e0f3f/pa/WE27785_8a85b89e7a2483af2100d1b7ad24bf8b.jpg not downloaded yet
2026-04-27 07:56:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c97cbf83-2742-5134-97c5-2091ce66e872 with identifier: FV06659
2026-04-27 07:56:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c97cbf83-2742-5134-97c5-2091ce66e872 with identifier: FV06659
2026-04-27 07:56:55 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c97cbf83-2742-5134-97c5-2091ce66e872 with identifier: FV06659 to the API
2026-04-27 07:56:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:55 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-04-28T15:52:20Z',
 'fuel_type': 'petrol',
 'id': 'c97cbf83-2742-5134-97c5-2091ce66e872',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FV06659',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Renault',
 'model': 'Kadjar',
 'odometer': 132648,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2019-06-27',
 'seller_name': None,
 'title': 'Renault Kadjar 1.3 TCe Black Edition',
 'transmission': 'automatic',
 'trim': 'Black Edition',
 'year': 2019}
2026-04-27 07:56:55 [auto1.fr] INFO: Saving data for FV06659: {'auction_closing_time': 1777391540.0, 'created_time': 1777020366.437604, 'has_photos': True, 'last_price_update_time': 1777276615.479433}
2026-04-27 07:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/91/9491a12efd5e242be10507e52500e816/pa/GR61820_e139215c4506358fd14801d0af8c5f72.jpg not downloaded yet
2026-04-27 07:56:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b28350>
2026-04-27 07:56:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d1a0922-da79-5947-a1cf-3ef1420e1b2e/9d1a0922-da79-5947-a1cf-3ef1420e1b2e_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/43/4e43238f55e519095f9519eb6ca0a055/pa/BZ74074_22681a5c3f63410cefb41257a64cd89b.jpg saved to cache
2026-04-27 07:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9d1a0922-da79-5947-a1cf-3ef1420e1b2e
2026-04-27 07:56:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c35d10>
2026-04-27 07:56:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6dd2c18-b668-5728-a326-d20c13c257bc/b6dd2c18-b668-5728-a326-d20c13c257bc_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/29/1f29cb4b74bf86cf5151b56bbb07ea8d/pa/RM20778_adb5e71f7ab7b45629cea9c15cf09475.jpg saved to cache
2026-04-27 07:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b6dd2c18-b668-5728-a326-d20c13c257bc
2026-04-27 07:56:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d80290>
2026-04-27 07:56:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d1a0922-da79-5947-a1cf-3ef1420e1b2e/9d1a0922-da79-5947-a1cf-3ef1420e1b2e_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/43/4e43238f55e519095f9519eb6ca0a055/pa/BZ74074_9fd3353e73a35305aa2fe7ff585b36a4.jpg saved to cache
2026-04-27 07:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9d1a0922-da79-5947-a1cf-3ef1420e1b2e
2026-04-27 07:56:55 [auto1.fr] INFO: Found listing with ID: UF86890
2026-04-27 07:56:55 [auto1.fr] INFO: Scrape type for UF86890: 1
2026-04-27 07:56:55 [auto1.fr] INFO: Found listing with ID: EL61654
2026-04-27 07:56:55 [auto1.fr] INFO: Scrape type for EL61654: 1
2026-04-27 07:56:55 [auto1.fr] INFO: Found listing with ID: ZW72190
2026-04-27 07:56:55 [auto1.fr] INFO: Scrape type for ZW72190: 2
2026-04-27 07:56:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5127a2f5-28d7-5268-8822-8538ae0a23cc with identifier: ZW72190
2026-04-27 07:56:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5127a2f5-28d7-5268-8822-8538ae0a23cc with scrape type 2
2026-04-27 07:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5127a2f5-28d7-5268-8822-8538ae0a23cc with scrape type 2
2026-04-27 07:56:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5127a2f5-28d7-5268-8822-8538ae0a23cc, identifier: ZW72190
2026-04-27 07:56:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YR21354> (referer: https://www.auto1.com/v1/car-details-view/YR21354/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FR18447> (referer: https://www.auto1.com/v1/car-details-view/FR18447/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b7f790>
2026-04-27 07:56:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6dd2c18-b668-5728-a326-d20c13c257bc/b6dd2c18-b668-5728-a326-d20c13c257bc_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/29/1f29cb4b74bf86cf5151b56bbb07ea8d/pa/RM20778_b2d5a3a9b25095952f492de240a43e4c.jpg saved to cache
2026-04-27 07:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b6dd2c18-b668-5728-a326-d20c13c257bc
2026-04-27 07:56:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438187510>
2026-04-27 07:56:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08743775-3902-5767-bb6e-9e5f10ffbe6e/08743775-3902-5767-bb6e-9e5f10ffbe6e_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/c3/e2c37fe0f35ef80f35b4abeec42e917c/pa/DM72572_6e8a2fb0a04c0d59eca0589b19c97c3f.jpg saved to cache
2026-04-27 07:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 08743775-3902-5767-bb6e-9e5f10ffbe6e
2026-04-27 07:56:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/9e/9c9e83f959949f6fb2d8a4d42b1e0f3f/pa/WE27785_3d016aa66cb2d94aa0048676e934a76b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/9e/9c9e83f959949f6fb2d8a4d42b1e0f3f/pa/WE27785_46065fce464415e32c235212fb544090.jpg not downloaded yet
2026-04-27 07:56:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5127a2f5-28d7-5268-8822-8538ae0a23cc with identifier: ZW72190
2026-04-27 07:56:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5127a2f5-28d7-5268-8822-8538ae0a23cc with identifier: ZW72190
2026-04-27 07:56:56 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 5127a2f5-28d7-5268-8822-8538ae0a23cc with identifier: ZW72190 to the API
2026-04-27 07:56:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:56 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 73,
 'expiration_date': '2026-04-28T15:29:06Z',
 'fuel_type': 'petrol',
 'id': '5127a2f5-28d7-5268-8822-8538ae0a23cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZW72190',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 151790,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2010-02-14',
 'seller_name': None,
 'title': 'Citroen C3 1.4 Ambiance',
 'transmission': 'manual',
 'trim': 'Ambiance',
 'year': 2010}
2026-04-27 07:56:56 [auto1.fr] INFO: Saving data for ZW72190: {'auction_closing_time': 1777390146.0, 'created_time': 1777022970.880311, 'has_photos': True, 'last_price_update_time': 1777276616.552754}
2026-04-27 07:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/91/9491a12efd5e242be10507e52500e816/pa/GR61820_4717344e3466aa783c01dcfbe4736822.jpg not downloaded yet
2026-04-27 07:56:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438e04750>
2026-04-27 07:56:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6dd2c18-b668-5728-a326-d20c13c257bc/b6dd2c18-b668-5728-a326-d20c13c257bc_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/29/1f29cb4b74bf86cf5151b56bbb07ea8d/pa/RM20778_57a33a41d1e69165d0fff7a9e22d01be.jpg saved to cache
2026-04-27 07:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b6dd2c18-b668-5728-a326-d20c13c257bc
2026-04-27 07:56:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b6dd2c18-b668-5728-a326-d20c13c257bc, skipping ID generation
2026-04-27 07:56:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6dd2c18-b668-5728-a326-d20c13c257bc with scrape type 1
2026-04-27 07:56:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b6dd2c18-b668-5728-a326-d20c13c257bc sending to next pipeline
2026-04-27 07:56:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b6dd2c18-b668-5728-a326-d20c13c257bc, identifier: RM20778
2026-04-27 07:56:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143807e350>
2026-04-27 07:56:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a8845ed-5845-5485-a8f8-70d9fdb8d78a/8a8845ed-5845-5485-a8f8-70d9fdb8d78a_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/9e/9c9e83f959949f6fb2d8a4d42b1e0f3f/pa/WE27785_27d9cf0079a7c2bd44021920efef1538.jpg saved to cache
2026-04-27 07:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8a8845ed-5845-5485-a8f8-70d9fdb8d78a
2026-04-27 07:56:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/9e/9c9e83f959949f6fb2d8a4d42b1e0f3f/pa/WE27785_2e2eceff88bd90e3a1a1221e0ce55421.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/80/fe80e7677fbbad7e352e755b990fe68e/pa/SR18679_96391651848855a87dbe69b6e02392c3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:56 [auto1.fr] INFO: Found listing with ID: HD30231
2026-04-27 07:56:56 [auto1.fr] INFO: Scrape type for HD30231: 2
2026-04-27 07:56:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa1f900d-1b91-5184-b7cf-39f82a94a5d9 with identifier: HD30231
2026-04-27 07:56:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa1f900d-1b91-5184-b7cf-39f82a94a5d9 with scrape type 2
2026-04-27 07:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aa1f900d-1b91-5184-b7cf-39f82a94a5d9 with scrape type 2
2026-04-27 07:56:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: aa1f900d-1b91-5184-b7cf-39f82a94a5d9, identifier: HD30231
2026-04-27 07:56:56 [auto1.fr] INFO: Found listing with ID: BA15313
2026-04-27 07:56:56 [auto1.fr] INFO: Scrape type for BA15313: 2
2026-04-27 07:56:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d0f0b4d-3c82-5bc5-a6d3-e138a80c6964 with identifier: BA15313
2026-04-27 07:56:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d0f0b4d-3c82-5bc5-a6d3-e138a80c6964 with scrape type 2
2026-04-27 07:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7d0f0b4d-3c82-5bc5-a6d3-e138a80c6964 with scrape type 2
2026-04-27 07:56:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7d0f0b4d-3c82-5bc5-a6d3-e138a80c6964, identifier: BA15313
2026-04-27 07:56:57 [auto1.fr] INFO: Found listing with ID: FS39649
2026-04-27 07:56:57 [auto1.fr] INFO: Scrape type for FS39649: 2
2026-04-27 07:56:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8cc04cd-3ae6-56db-bc65-b5339e7b6353 with identifier: FS39649
2026-04-27 07:56:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8cc04cd-3ae6-56db-bc65-b5339e7b6353 with scrape type 2
2026-04-27 07:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a8cc04cd-3ae6-56db-bc65-b5339e7b6353 with scrape type 2
2026-04-27 07:56:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a8cc04cd-3ae6-56db-bc65-b5339e7b6353, identifier: FS39649
2026-04-27 07:56:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b6dd2c18-b668-5728-a326-d20c13c257bc with identifier: RM20778
2026-04-27 07:56:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b6dd2c18-b668-5728-a326-d20c13c257bc with identifier: RM20778
2026-04-27 07:56:57 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b6dd2c18-b668-5728-a326-d20c13c257bc with identifier: RM20778 to the API
2026-04-27 07:56:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:57 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1f/29/1f29cb4b74bf86cf5151b56bbb07ea8d/pa/RM20778_57a33a41d1e69165d0fff7a9e22d01be.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'category': None,
 'city': 'Saint Herblain',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.5L',
 'engine_horse_power': 105,
 'expiration_date': '2026-04-28T15:13:52Z',
 'fuel_type': 'diesel',
 'id': 'b6dd2c18-b668-5728-a326-d20c13c257bc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 47.2115,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RM20778',
 'listing': 'auction',
 'location': 'FR, Saint Herblain',
 'location_confidence': 'geocoded',
 'longitude': -1.651,
 'make': 'Renault',
 'model': 'Scenic',
 'odometer': 330817,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b6dd2c18-b668-5728-a326-d20c13c257bc/b6dd2c18-b668-5728-a326-d20c13c257bc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89279,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/29/1f29cb4b74bf86cf5151b56bbb07ea8d/pa/RM20778_b2d5a3a9b25095952f492de240a43e4c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b6dd2c18-b668-5728-a326-d20c13c257bc/b6dd2c18-b668-5728-a326-d20c13c257bc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100036,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/29/1f29cb4b74bf86cf5151b56bbb07ea8d/pa/RM20778_81e54df8ecc607acdb64fe546d808179.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b6dd2c18-b668-5728-a326-d20c13c257bc/b6dd2c18-b668-5728-a326-d20c13c257bc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81328,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/29/1f29cb4b74bf86cf5151b56bbb07ea8d/pa/RM20778_62be7efdab54e7dbba79ca84a8dac294.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b6dd2c18-b668-5728-a326-d20c13c257bc/b6dd2c18-b668-5728-a326-d20c13c257bc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54650,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/29/1f29cb4b74bf86cf5151b56bbb07ea8d/pa/RM20778_cfbcab752ce1caf45f1583cd118f4e14.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b6dd2c18-b668-5728-a326-d20c13c257bc/b6dd2c18-b668-5728-a326-d20c13c257bc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89304,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/29/1f29cb4b74bf86cf5151b56bbb07ea8d/pa/RM20778_adb5e71f7ab7b45629cea9c15cf09475.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b6dd2c18-b668-5728-a326-d20c13c257bc/b6dd2c18-b668-5728-a326-d20c13c257bc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39273,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/29/1f29cb4b74bf86cf5151b56bbb07ea8d/pa/RM20778_57a33a41d1e69165d0fff7a9e22d01be.jpg',
             'Width': 800}],
 'postal_code': '44800',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Loire-Atlantique',
 'province_code': 'FR-44',
 'region': 'Pays de la Loire',
 'region_code': 'FR-52',
 'registration_date': '2007-12-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Scenic 1.5 dCi Latitude',
 'transmission': 'manual',
 'trim': 'Latitude',
 'year': 2007}
2026-04-27 07:56:57 [auto1.fr] INFO: Saving data for RM20778: {'created_time': 1777276617.566597, 'last_price_update_time': 1777276617.56661, 'has_photos': True, 'auction_closing_time': 1777389232.0}
2026-04-27 07:56:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/c3/e2c37fe0f35ef80f35b4abeec42e917c/pa/DM72572_66321652a2b653c80c9ce343e2d2511f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: aa1f900d-1b91-5184-b7cf-39f82a94a5d9 with identifier: HD30231
2026-04-27 07:56:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: aa1f900d-1b91-5184-b7cf-39f82a94a5d9 with identifier: HD30231
2026-04-27 07:56:57 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: aa1f900d-1b91-5184-b7cf-39f82a94a5d9 with identifier: HD30231 to the API
2026-04-27 07:56:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:57 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-04-28T15:17:42Z',
 'fuel_type': 'petrol',
 'id': 'aa1f900d-1b91-5184-b7cf-39f82a94a5d9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HD30231',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 166775,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2014-02-04',
 'seller_name': None,
 'title': 'Seat Leon 1.2 TSI I-Tech',
 'transmission': 'manual',
 'trim': 'I-Tech',
 'year': 2014}
2026-04-27 07:56:58 [auto1.fr] INFO: Saving data for HD30231: {'auction_closing_time': 1777389462.0, 'created_time': 1777019367.039597, 'has_photos': True, 'last_price_update_time': 1777276618.02116}
2026-04-27 07:56:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7d0f0b4d-3c82-5bc5-a6d3-e138a80c6964 with identifier: BA15313
2026-04-27 07:56:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7d0f0b4d-3c82-5bc5-a6d3-e138a80c6964 with identifier: BA15313
2026-04-27 07:56:58 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 7d0f0b4d-3c82-5bc5-a6d3-e138a80c6964 with identifier: BA15313 to the API
2026-04-27 07:56:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:58 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-04-28T15:12:47Z',
 'fuel_type': 'petrol',
 'id': '7d0f0b4d-3c82-5bc5-a6d3-e138a80c6964',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BA15313',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Peugeot',
 'model': '208',
 'odometer': 144061,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2013-10-28',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 VTi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2013}
2026-04-27 07:56:58 [auto1.fr] INFO: Saving data for BA15313: {'auction_closing_time': 1777389167.0, 'created_time': 1777022537.517868, 'has_photos': True, 'last_price_update_time': 1777276618.409703}
2026-04-27 07:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/9e/9c9e83f959949f6fb2d8a4d42b1e0f3f/pa/WE27785_35b6d13f31175381f160a2e8dfe0024b.jpg not downloaded yet
2026-04-27 07:56:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a8cc04cd-3ae6-56db-bc65-b5339e7b6353 with identifier: FS39649
2026-04-27 07:56:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a8cc04cd-3ae6-56db-bc65-b5339e7b6353 with identifier: FS39649
2026-04-27 07:56:58 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a8cc04cd-3ae6-56db-bc65-b5339e7b6353 with identifier: FS39649 to the API
2026-04-27 07:56:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:58 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-04-28T15:18:02Z',
 'fuel_type': 'petrol',
 'id': 'a8cc04cd-3ae6-56db-bc65-b5339e7b6353',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FS39649',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 191458,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2009-11-22',
 'seller_name': None,
 'title': 'Skoda Fabia 1.6 Confort',
 'transmission': 'automatic',
 'trim': 'Confort',
 'year': 2009}
2026-04-27 07:56:58 [auto1.fr] INFO: Saving data for FS39649: {'auction_closing_time': 1777389482.0, 'created_time': 1777020448.351699, 'has_photos': True, 'last_price_update_time': 1777276618.87479}
2026-04-27 07:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/91/9491a12efd5e242be10507e52500e816/pa/GR61820_40ce44dcfa95cbaaf4b0f86877d98c3f.jpg not downloaded yet
2026-04-27 07:56:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99dfed4d-8ddd-55c8-8007-cddacf80f9bc with identifier: YR21354
2026-04-27 07:56:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99dfed4d-8ddd-55c8-8007-cddacf80f9bc with scrape type 1
2026-04-27 07:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 99dfed4d-8ddd-55c8-8007-cddacf80f9bc
2026-04-27 07:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/8a/c88a945034b1acebaca3a20d6f285b1e/pa/YR21354_046fdb1e88714519c86641443e4ac316.jpg not downloaded yet
2026-04-27 07:56:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f28efd8-91df-53c5-840f-8e20efd2f8fc with identifier: FR18447
2026-04-27 07:56:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f28efd8-91df-53c5-840f-8e20efd2f8fc with scrape type 1
2026-04-27 07:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4f28efd8-91df-53c5-840f-8e20efd2f8fc
2026-04-27 07:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/2d/522d57280f332fe6b17e8580bc8b5951/pa/FR18447_c3f529770d88607a2acef47c6748e665.jpg not downloaded yet
2026-04-27 07:56:58 [auto1.fr] INFO: Found listing with ID: YD71367
2026-04-27 07:56:59 [auto1.fr] INFO: Scrape type for YD71367: 2
2026-04-27 07:56:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c006d6d0-4bee-5733-bbde-0b798aea7923 with identifier: YD71367
2026-04-27 07:56:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c006d6d0-4bee-5733-bbde-0b798aea7923 with scrape type 2
2026-04-27 07:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c006d6d0-4bee-5733-bbde-0b798aea7923 with scrape type 2
2026-04-27 07:56:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c006d6d0-4bee-5733-bbde-0b798aea7923, identifier: YD71367
2026-04-27 07:56:59 [auto1.fr] INFO: Found listing with ID: CN89291
2026-04-27 07:56:59 [auto1.fr] INFO: Scrape type for CN89291: 1
2026-04-27 07:56:59 [auto1.fr] INFO: Found listing with ID: YA73463
2026-04-27 07:56:59 [auto1.fr] INFO: Scrape type for YA73463: 2
2026-04-27 07:56:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd5f4477-4b7e-5c60-8c60-2622b26a8213 with identifier: YA73463
2026-04-27 07:56:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd5f4477-4b7e-5c60-8c60-2622b26a8213 with scrape type 2
2026-04-27 07:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd5f4477-4b7e-5c60-8c60-2622b26a8213 with scrape type 2
2026-04-27 07:56:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: fd5f4477-4b7e-5c60-8c60-2622b26a8213, identifier: YA73463
2026-04-27 07:56:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JL00228> (referer: https://www.auto1.com/v1/car-details-view/JL00228/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HN87071> (referer: https://www.auto1.com/v1/car-details-view/HN87071/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438dfb850>
2026-04-27 07:56:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a8845ed-5845-5485-a8f8-70d9fdb8d78a/8a8845ed-5845-5485-a8f8-70d9fdb8d78a_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/9e/9c9e83f959949f6fb2d8a4d42b1e0f3f/pa/WE27785_3d016aa66cb2d94aa0048676e934a76b.jpg saved to cache
2026-04-27 07:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8a8845ed-5845-5485-a8f8-70d9fdb8d78a
2026-04-27 07:56:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/9e/9c9e83f959949f6fb2d8a4d42b1e0f3f/pa/WE27785_8a85b89e7a2483af2100d1b7ad24bf8b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c006d6d0-4bee-5733-bbde-0b798aea7923 with identifier: YD71367
2026-04-27 07:56:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c006d6d0-4bee-5733-bbde-0b798aea7923 with identifier: YD71367
2026-04-27 07:56:59 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c006d6d0-4bee-5733-bbde-0b798aea7923 with identifier: YD71367 to the API
2026-04-27 07:56:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:59 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-04-28T15:04:49Z',
 'fuel_type': 'diesel',
 'id': 'c006d6d0-4bee-5733-bbde-0b798aea7923',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YD71367',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 299202,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2006-08-01',
 'seller_name': None,
 'title': 'Toyota Yaris 1.4 D-4D Luna',
 'transmission': 'manual',
 'trim': 'Luna',
 'year': 2006}
2026-04-27 07:56:59 [auto1.fr] INFO: Saving data for YD71367: {'auction_closing_time': 1777388689.0, 'created_time': 1777021668.025424, 'has_photos': True, 'last_price_update_time': 1777276619.646883}
2026-04-27 07:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/9e/9c9e83f959949f6fb2d8a4d42b1e0f3f/pa/WE27785_21e0ed63b805315077c6a243cf1ba74d.jpg not downloaded yet
2026-04-27 07:56:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: fd5f4477-4b7e-5c60-8c60-2622b26a8213 with identifier: YA73463
2026-04-27 07:56:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: fd5f4477-4b7e-5c60-8c60-2622b26a8213 with identifier: YA73463
2026-04-27 07:56:59 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: fd5f4477-4b7e-5c60-8c60-2622b26a8213 with identifier: YA73463 to the API
2026-04-27 07:56:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:59 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-04-28T15:33:00Z',
 'fuel_type': 'diesel',
 'id': 'fd5f4477-4b7e-5c60-8c60-2622b26a8213',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YA73463',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Peugeot',
 'model': '308',
 'odometer': 208244,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2016-11-29',
 'seller_name': None,
 'title': 'Peugeot 308 2.0 Blue-HDi GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2016}
2026-04-27 07:56:59 [auto1.fr] INFO: Saving data for YA73463: {'auction_closing_time': 1777390380.0, 'created_time': 1777020010.433133, 'has_photos': True, 'last_price_update_time': 1777276619.969775}
2026-04-27 07:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/91/9491a12efd5e242be10507e52500e816/pa/GR61820_6053c191bebd39849249a6e7f35299ec.jpg not downloaded yet
2026-04-27 07:57:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:57:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/8a/c88a945034b1acebaca3a20d6f285b1e/pa/YR21354_6740f27e0644dc5cc34e442ae58f6c35.jpg not downloaded yet
2026-04-27 07:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/2d/522d57280f332fe6b17e8580bc8b5951/pa/FR18447_d43c55e55ce5d0f30476374c4026d185.jpg not downloaded yet
2026-04-27 07:57:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XG74646/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:57:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FG74412/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:57:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438153750>
2026-04-27 07:57:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a8845ed-5845-5485-a8f8-70d9fdb8d78a/8a8845ed-5845-5485-a8f8-70d9fdb8d78a_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/9e/9c9e83f959949f6fb2d8a4d42b1e0f3f/pa/WE27785_2e2eceff88bd90e3a1a1221e0ce55421.jpg saved to cache
2026-04-27 07:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8a8845ed-5845-5485-a8f8-70d9fdb8d78a
2026-04-27 07:57:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438baf090>
2026-04-27 07:57:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83a9c299-5f22-570f-bd67-75bf22661eae/83a9c299-5f22-570f-bd67-75bf22661eae_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/80/fe80e7677fbbad7e352e755b990fe68e/pa/SR18679_96391651848855a87dbe69b6e02392c3.jpg saved to cache
2026-04-27 07:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 83a9c299-5f22-570f-bd67-75bf22661eae
2026-04-27 07:57:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/91/9491a12efd5e242be10507e52500e816/pa/GR61820_b6e42abb5eb292ecdf8c143853e5fb10.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/91/9491a12efd5e242be10507e52500e816/pa/GR61820_e139215c4506358fd14801d0af8c5f72.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:00 [scrapy.extensions.logstats] INFO: Crawled 222 pages (at 63 pages/min), scraped 162 items (at 68 items/min)
2026-04-27 07:57:00 [scrapy.extensions.memusage] INFO: Peak memory usage is 373MiB
2026-04-27 07:57:00 [auto1.fr] INFO: Found listing with ID: HZ41757
2026-04-27 07:57:00 [auto1.fr] INFO: Scrape type for HZ41757: 2
2026-04-27 07:57:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f146cea3-48d9-54c1-b14f-467b7094bd11 with identifier: HZ41757
2026-04-27 07:57:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f146cea3-48d9-54c1-b14f-467b7094bd11 with scrape type 2
2026-04-27 07:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f146cea3-48d9-54c1-b14f-467b7094bd11 with scrape type 2
2026-04-27 07:57:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f146cea3-48d9-54c1-b14f-467b7094bd11, identifier: HZ41757
2026-04-27 07:57:00 [auto1.fr] INFO: Found listing with ID: YV38129
2026-04-27 07:57:00 [auto1.fr] INFO: Scrape type for YV38129: 2
2026-04-27 07:57:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6863f01e-b42e-5687-825f-781537b64432 with identifier: YV38129
2026-04-27 07:57:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6863f01e-b42e-5687-825f-781537b64432 with scrape type 2
2026-04-27 07:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6863f01e-b42e-5687-825f-781537b64432 with scrape type 2
2026-04-27 07:57:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6863f01e-b42e-5687-825f-781537b64432, identifier: YV38129
2026-04-27 07:57:00 [auto1.fr] INFO: Found listing with ID: XV47033
2026-04-27 07:57:00 [auto1.fr] INFO: Scrape type for XV47033: 1
2026-04-27 07:57:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:57:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:57:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XT28721> (referer: https://www.auto1.com/v1/car-details-view/XT28721/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:57:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ed9d10>
2026-04-27 07:57:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08743775-3902-5767-bb6e-9e5f10ffbe6e/08743775-3902-5767-bb6e-9e5f10ffbe6e_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/c3/e2c37fe0f35ef80f35b4abeec42e917c/pa/DM72572_66321652a2b653c80c9ce343e2d2511f.jpg saved to cache
2026-04-27 07:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 08743775-3902-5767-bb6e-9e5f10ffbe6e
2026-04-27 07:57:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f146cea3-48d9-54c1-b14f-467b7094bd11 with identifier: HZ41757
2026-04-27 07:57:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f146cea3-48d9-54c1-b14f-467b7094bd11 with identifier: HZ41757
2026-04-27 07:57:00 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:57:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f146cea3-48d9-54c1-b14f-467b7094bd11 with identifier: HZ41757 to the API
2026-04-27 07:57:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:57:00 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:57:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-04-28T15:45:41Z',
 'fuel_type': 'diesel',
 'id': 'f146cea3-48d9-54c1-b14f-467b7094bd11',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HZ41757',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 110620,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2017-05-25',
 'seller_name': None,
 'title': 'BMW X1 sDrive 18d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2017}
2026-04-27 07:57:00 [auto1.fr] INFO: Saving data for HZ41757: {'auction_closing_time': 1777391141.0, 'created_time': 1777021475.047837, 'has_photos': True, 'last_price_update_time': 1777276620.835854}
2026-04-27 07:57:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6863f01e-b42e-5687-825f-781537b64432 with identifier: YV38129
2026-04-27 07:57:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6863f01e-b42e-5687-825f-781537b64432 with identifier: YV38129
2026-04-27 07:57:00 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:57:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6863f01e-b42e-5687-825f-781537b64432 with identifier: YV38129 to the API
2026-04-27 07:57:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:57:01 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:57:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-04-28T15:52:43Z',
 'fuel_type': 'petrol',
 'id': '6863f01e-b42e-5687-825f-781537b64432',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YV38129',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 100078,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2021-12-12',
 'seller_name': None,
 'title': 'Volvo V60 2.0 B3 Mild-Hybrid R Design',
 'transmission': 'automatic',
 'trim': 'R Design',
 'year': 2021}
2026-04-27 07:57:01 [auto1.fr] INFO: Saving data for YV38129: {'auction_closing_time': 1777391563.0, 'created_time': 1777020395.007304, 'has_photos': True, 'last_price_update_time': 1777276621.166635}
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/9e/9c9e83f959949f6fb2d8a4d42b1e0f3f/pa/WE27785_88069bca9474eaf477e09bfc8485de9f.jpg not downloaded yet
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/91/9491a12efd5e242be10507e52500e816/pa/GR61820_22d4f13445f8cf7eec95944aace1b868.jpg not downloaded yet
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/8a/c88a945034b1acebaca3a20d6f285b1e/pa/YR21354_ffa6aa10bde9ea9cc1107907bf99a84a.jpg not downloaded yet
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/2d/522d57280f332fe6b17e8580bc8b5951/pa/FR18447_74483ca77cce33c6cd403f3cbbc52a2e.jpg not downloaded yet
2026-04-27 07:57:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:57:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/91/9491a12efd5e242be10507e52500e816/pa/GR61820_4717344e3466aa783c01dcfbe4736822.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:01 [auto1.fr] INFO: Found listing with ID: NU45994
2026-04-27 07:57:01 [auto1.fr] INFO: Scrape type for NU45994: 2
2026-04-27 07:57:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ebc7a5b-1b31-5974-a8e8-e8371bf18c9a with identifier: NU45994
2026-04-27 07:57:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ebc7a5b-1b31-5974-a8e8-e8371bf18c9a with scrape type 2
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9ebc7a5b-1b31-5974-a8e8-e8371bf18c9a with scrape type 2
2026-04-27 07:57:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 9ebc7a5b-1b31-5974-a8e8-e8371bf18c9a, identifier: NU45994
2026-04-27 07:57:01 [auto1.fr] INFO: Found listing with ID: WP01544
2026-04-27 07:57:01 [auto1.fr] INFO: Scrape type for WP01544: 1
2026-04-27 07:57:01 [auto1.fr] INFO: Found listing with ID: PY77315
2026-04-27 07:57:01 [auto1.fr] INFO: Scrape type for PY77315: 1
2026-04-27 07:57:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd1991e2-0b47-5bb3-a3cf-6044ca19327f with identifier: JL00228
2026-04-27 07:57:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd1991e2-0b47-5bb3-a3cf-6044ca19327f with scrape type 1
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item fd1991e2-0b47-5bb3-a3cf-6044ca19327f
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/46/87464edc369f5dc875e49df911af3b4d/pa/JL00228_7eaccc5c886a9369b2886fab254fde78.jpg not downloaded yet
2026-04-27 07:57:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a378d879-6aa5-5d15-8f03-39e81aada49a with identifier: HN87071
2026-04-27 07:57:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a378d879-6aa5-5d15-8f03-39e81aada49a with scrape type 1
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item a378d879-6aa5-5d15-8f03-39e81aada49a
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/40/be40c187bb51c8beaf565b0cff7fce5b/pa/HN87071_04c17ada3f4c5b111dbccf1cfe516cfa.jpg not downloaded yet
2026-04-27 07:57:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438e17b50>
2026-04-27 07:57:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a8845ed-5845-5485-a8f8-70d9fdb8d78a/8a8845ed-5845-5485-a8f8-70d9fdb8d78a_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/9e/9c9e83f959949f6fb2d8a4d42b1e0f3f/pa/WE27785_8a85b89e7a2483af2100d1b7ad24bf8b.jpg saved to cache
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8a8845ed-5845-5485-a8f8-70d9fdb8d78a
2026-04-27 07:57:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/91/9491a12efd5e242be10507e52500e816/pa/GR61820_40ce44dcfa95cbaaf4b0f86877d98c3f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 9ebc7a5b-1b31-5974-a8e8-e8371bf18c9a with identifier: NU45994
2026-04-27 07:57:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 9ebc7a5b-1b31-5974-a8e8-e8371bf18c9a with identifier: NU45994
2026-04-27 07:57:01 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:57:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 9ebc7a5b-1b31-5974-a8e8-e8371bf18c9a with identifier: NU45994 to the API
2026-04-27 07:57:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:57:01 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:57:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 230,
 'expiration_date': '2026-04-28T15:40:21Z',
 'fuel_type': 'petrol',
 'id': '9ebc7a5b-1b31-5974-a8e8-e8371bf18c9a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NU45994',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'BMW',
 'model': 'X5',
 'odometer': 999999,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2001-02-11',
 'seller_name': None,
 'title': 'BMW X5 3.0i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2001}
2026-04-27 07:57:01 [auto1.fr] INFO: Saving data for NU45994: {'auction_closing_time': 1777390821.0, 'created_time': 1777022523.777213, 'has_photos': True, 'last_price_update_time': 1777276621.84406}
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/9e/9c9e83f959949f6fb2d8a4d42b1e0f3f/pa/WE27785_c9a07c8ea793019d14ff2f00247311bf.jpg not downloaded yet
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/8a/c88a945034b1acebaca3a20d6f285b1e/pa/YR21354_3ea5a8b6ef7b3846542e0770c012487d.jpg not downloaded yet
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/2d/522d57280f332fe6b17e8580bc8b5951/pa/FR18447_e4dc402931a9ba90138ef3059f9b724a.jpg not downloaded yet
2026-04-27 07:57:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143806d290>
2026-04-27 07:57:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3a00016-738e-5ecf-b517-7284a47c7133/b3a00016-738e-5ecf-b517-7284a47c7133_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/91/9491a12efd5e242be10507e52500e816/pa/GR61820_b6e42abb5eb292ecdf8c143853e5fb10.jpg saved to cache
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b3a00016-738e-5ecf-b517-7284a47c7133
2026-04-27 07:57:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438f09890>
2026-04-27 07:57:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3a00016-738e-5ecf-b517-7284a47c7133/b3a00016-738e-5ecf-b517-7284a47c7133_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/91/9491a12efd5e242be10507e52500e816/pa/GR61820_e139215c4506358fd14801d0af8c5f72.jpg saved to cache
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b3a00016-738e-5ecf-b517-7284a47c7133
2026-04-27 07:57:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/9e/9c9e83f959949f6fb2d8a4d42b1e0f3f/pa/WE27785_35b6d13f31175381f160a2e8dfe0024b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/8a/c88a945034b1acebaca3a20d6f285b1e/pa/YR21354_046fdb1e88714519c86641443e4ac316.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/2d/522d57280f332fe6b17e8580bc8b5951/pa/FR18447_c3f529770d88607a2acef47c6748e665.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:02 [auto1.fr] INFO: Found listing with ID: BS70297
2026-04-27 07:57:02 [auto1.fr] INFO: Scrape type for BS70297: 1
2026-04-27 07:57:02 [auto1.fr] INFO: Found listing with ID: ZY86735
2026-04-27 07:57:02 [auto1.fr] INFO: Scrape type for ZY86735: 1
2026-04-27 07:57:02 [auto1.fr] INFO: Found listing with ID: JC13798
2026-04-27 07:57:02 [auto1.fr] INFO: Scrape type for JC13798: 1
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/46/87464edc369f5dc875e49df911af3b4d/pa/JL00228_0ecba85d7ca2e5187fee0a882ba1ac95.jpg not downloaded yet
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/40/be40c187bb51c8beaf565b0cff7fce5b/pa/HN87071_2f80ce32749d54ec9d766882ac3e1615.jpg not downloaded yet
2026-04-27 07:57:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2995d43e-8fcd-5328-bac5-15fc99b53305 with identifier: XT28721
2026-04-27 07:57:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2995d43e-8fcd-5328-bac5-15fc99b53305 with scrape type 1
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 2995d43e-8fcd-5328-bac5-15fc99b53305
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/0e/840e2ec4e70fbe9017e219f533da41c1/pa/XT28721_6f8bf5e699de4a5daa323c307ec6f016.jpg not downloaded yet
2026-04-27 07:57:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/9e/9c9e83f959949f6fb2d8a4d42b1e0f3f/pa/WE27785_46065fce464415e32c235212fb544090.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/8a/c88a945034b1acebaca3a20d6f285b1e/pa/YR21354_fb064acd5378e5b6752d9b9ff6f8b211.jpg not downloaded yet
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/2d/522d57280f332fe6b17e8580bc8b5951/pa/FR18447_6ed918bb9e15ea71f787aa375de70f97.jpg not downloaded yet
2026-04-27 07:57:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143adc5650>
2026-04-27 07:57:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3a00016-738e-5ecf-b517-7284a47c7133/b3a00016-738e-5ecf-b517-7284a47c7133_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/91/9491a12efd5e242be10507e52500e816/pa/GR61820_4717344e3466aa783c01dcfbe4736822.jpg saved to cache
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b3a00016-738e-5ecf-b517-7284a47c7133
2026-04-27 07:57:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/2d/522d57280f332fe6b17e8580bc8b5951/pa/FR18447_d43c55e55ce5d0f30476374c4026d185.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:02 [auto1.fr] INFO: Found listing with ID: GZ00250
2026-04-27 07:57:02 [auto1.fr] INFO: Scrape type for GZ00250: 2
2026-04-27 07:57:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5eea3fb6-da9f-5c5c-bf09-05d208839add with identifier: GZ00250
2026-04-27 07:57:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5eea3fb6-da9f-5c5c-bf09-05d208839add with scrape type 2
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5eea3fb6-da9f-5c5c-bf09-05d208839add with scrape type 2
2026-04-27 07:57:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5eea3fb6-da9f-5c5c-bf09-05d208839add, identifier: GZ00250
2026-04-27 07:57:02 [auto1.fr] INFO: Found listing with ID: ZN42149
2026-04-27 07:57:02 [auto1.fr] INFO: Scrape type for ZN42149: 2
2026-04-27 07:57:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: affa21c6-44d3-5474-ae51-8ce61ac0c323 with identifier: ZN42149
2026-04-27 07:57:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item affa21c6-44d3-5474-ae51-8ce61ac0c323 with scrape type 2
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item affa21c6-44d3-5474-ae51-8ce61ac0c323 with scrape type 2
2026-04-27 07:57:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: affa21c6-44d3-5474-ae51-8ce61ac0c323, identifier: ZN42149
2026-04-27 07:57:02 [auto1.fr] INFO: Found listing with ID: KB24751
2026-04-27 07:57:02 [auto1.fr] INFO: Scrape type for KB24751: 2
2026-04-27 07:57:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6d20805-5ebe-513a-866e-51251b393d48 with identifier: KB24751
2026-04-27 07:57:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6d20805-5ebe-513a-866e-51251b393d48 with scrape type 2
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b6d20805-5ebe-513a-866e-51251b393d48 with scrape type 2
2026-04-27 07:57:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b6d20805-5ebe-513a-866e-51251b393d48, identifier: KB24751
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/46/87464edc369f5dc875e49df911af3b4d/pa/JL00228_91451640865fdd5555813feba7a10406.jpg not downloaded yet
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/40/be40c187bb51c8beaf565b0cff7fce5b/pa/HN87071_2daec06e0ce3e2951bea27dcdd4f0c9b.jpg not downloaded yet
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/0e/840e2ec4e70fbe9017e219f533da41c1/pa/XT28721_45e52b8c2db71d10016de5318acff712.jpg not downloaded yet
2026-04-27 07:57:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438caad10>
2026-04-27 07:57:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3a00016-738e-5ecf-b517-7284a47c7133/b3a00016-738e-5ecf-b517-7284a47c7133_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/91/9491a12efd5e242be10507e52500e816/pa/GR61820_40ce44dcfa95cbaaf4b0f86877d98c3f.jpg saved to cache
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b3a00016-738e-5ecf-b517-7284a47c7133
2026-04-27 07:57:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5eea3fb6-da9f-5c5c-bf09-05d208839add with identifier: GZ00250
2026-04-27 07:57:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5eea3fb6-da9f-5c5c-bf09-05d208839add with identifier: GZ00250
2026-04-27 07:57:02 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:57:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 5eea3fb6-da9f-5c5c-bf09-05d208839add with identifier: GZ00250 to the API
2026-04-27 07:57:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:57:02 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:57:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-04-28T15:35:43Z',
 'fuel_type': 'petrol',
 'id': '5eea3fb6-da9f-5c5c-bf09-05d208839add',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GZ00250',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 99917,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2020-02-06',
 'seller_name': None,
 'title': 'Peugeot 5008 1.2 PureTech Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2020}
2026-04-27 07:57:03 [auto1.fr] INFO: Saving data for GZ00250: {'auction_closing_time': 1777390543.0, 'created_time': 1777021073.417422, 'has_photos': True, 'last_price_update_time': 1777276623.070114}
2026-04-27 07:57:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: affa21c6-44d3-5474-ae51-8ce61ac0c323 with identifier: ZN42149
2026-04-27 07:57:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: affa21c6-44d3-5474-ae51-8ce61ac0c323 with identifier: ZN42149
2026-04-27 07:57:03 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:57:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: affa21c6-44d3-5474-ae51-8ce61ac0c323 with identifier: ZN42149 to the API
2026-04-27 07:57:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:57:03 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:57:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-04-28T15:12:45Z',
 'fuel_type': 'diesel',
 'id': 'affa21c6-44d3-5474-ae51-8ce61ac0c323',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZN42149',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'BMW',
 'model': 'X5',
 'odometer': 167779,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2010-06-30',
 'seller_name': None,
 'title': 'BMW X5 xDrive 30d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2010}
2026-04-27 07:57:03 [auto1.fr] INFO: Saving data for ZN42149: {'auction_closing_time': 1777389165.0, 'created_time': 1777021080.675507, 'has_photos': True, 'last_price_update_time': 1777276623.489009}
2026-04-27 07:57:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b6d20805-5ebe-513a-866e-51251b393d48 with identifier: KB24751
2026-04-27 07:57:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b6d20805-5ebe-513a-866e-51251b393d48 with identifier: KB24751
2026-04-27 07:57:03 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:57:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b6d20805-5ebe-513a-866e-51251b393d48 with identifier: KB24751 to the API
2026-04-27 07:57:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:57:03 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:57:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-04-28T15:23:25Z',
 'fuel_type': 'hybrid',
 'id': 'b6d20805-5ebe-513a-866e-51251b393d48',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KB24751',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Toyota',
 'model': 'RAV 4',
 'odometer': 138227,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2022-09-27',
 'seller_name': None,
 'title': 'Toyota RAV 4 2.5 Hybrid 4x2 Collection',
 'transmission': 'automatic',
 'trim': '4x2 Collection',
 'year': 2022}
2026-04-27 07:57:03 [auto1.fr] INFO: Saving data for KB24751: {'auction_closing_time': 1777389805.0, 'created_time': 1777019805.276305, 'has_photos': True, 'last_price_update_time': 1777276623.873609}
2026-04-27 07:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/8a/c88a945034b1acebaca3a20d6f285b1e/pa/YR21354_5a06350343a70f98207ad9b4fbd4f99d.jpg not downloaded yet
2026-04-27 07:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/2d/522d57280f332fe6b17e8580bc8b5951/pa/FR18447_f988f11b88cf5291e108ed091b1e24bc.jpg not downloaded yet
2026-04-27 07:57:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d80790>
2026-04-27 07:57:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a8845ed-5845-5485-a8f8-70d9fdb8d78a/8a8845ed-5845-5485-a8f8-70d9fdb8d78a_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/9e/9c9e83f959949f6fb2d8a4d42b1e0f3f/pa/WE27785_35b6d13f31175381f160a2e8dfe0024b.jpg saved to cache
2026-04-27 07:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8a8845ed-5845-5485-a8f8-70d9fdb8d78a
2026-04-27 07:57:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b7c490>
2026-04-27 07:57:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99dfed4d-8ddd-55c8-8007-cddacf80f9bc/99dfed4d-8ddd-55c8-8007-cddacf80f9bc_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/8a/c88a945034b1acebaca3a20d6f285b1e/pa/YR21354_046fdb1e88714519c86641443e4ac316.jpg saved to cache
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 99dfed4d-8ddd-55c8-8007-cddacf80f9bc
2026-04-27 07:57:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a5bd50>
2026-04-27 07:57:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f28efd8-91df-53c5-840f-8e20efd2f8fc/4f28efd8-91df-53c5-840f-8e20efd2f8fc_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/2d/522d57280f332fe6b17e8580bc8b5951/pa/FR18447_c3f529770d88607a2acef47c6748e665.jpg saved to cache
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4f28efd8-91df-53c5-840f-8e20efd2f8fc
2026-04-27 07:57:04 [auto1.fr] INFO: Found listing with ID: VZ69703
2026-04-27 07:57:04 [auto1.fr] INFO: Scrape type for VZ69703: 1
2026-04-27 07:57:04 [auto1.fr] INFO: Found listing with ID: TZ35948
2026-04-27 07:57:04 [auto1.fr] INFO: Scrape type for TZ35948: 2
2026-04-27 07:57:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 152829e4-2bf8-5fc6-9f87-d7a93f12e102 with identifier: TZ35948
2026-04-27 07:57:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 152829e4-2bf8-5fc6-9f87-d7a93f12e102 with scrape type 2
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 152829e4-2bf8-5fc6-9f87-d7a93f12e102 with scrape type 2
2026-04-27 07:57:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 152829e4-2bf8-5fc6-9f87-d7a93f12e102, identifier: TZ35948
2026-04-27 07:57:04 [auto1.fr] INFO: Found listing with ID: KR71053
2026-04-27 07:57:04 [auto1.fr] INFO: Scrape type for KR71053: 1
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/46/87464edc369f5dc875e49df911af3b4d/pa/JL00228_db1a84112e0646edae46377cd1df60ad.jpg not downloaded yet
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/40/be40c187bb51c8beaf565b0cff7fce5b/pa/HN87071_87da6c241a095321137a956fb665ca78.jpg not downloaded yet
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/0e/840e2ec4e70fbe9017e219f533da41c1/pa/XT28721_a180c1716f93ff22b9a786efcf886ade.jpg not downloaded yet
2026-04-27 07:57:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DA56679/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:57:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GH44775/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:57:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b1d450>
2026-04-27 07:57:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a8845ed-5845-5485-a8f8-70d9fdb8d78a/8a8845ed-5845-5485-a8f8-70d9fdb8d78a_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/9e/9c9e83f959949f6fb2d8a4d42b1e0f3f/pa/WE27785_46065fce464415e32c235212fb544090.jpg saved to cache
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8a8845ed-5845-5485-a8f8-70d9fdb8d78a
2026-04-27 07:57:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/40/be40c187bb51c8beaf565b0cff7fce5b/pa/HN87071_04c17ada3f4c5b111dbccf1cfe516cfa.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/2d/522d57280f332fe6b17e8580bc8b5951/pa/FR18447_74483ca77cce33c6cd403f3cbbc52a2e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 152829e4-2bf8-5fc6-9f87-d7a93f12e102 with identifier: TZ35948
2026-04-27 07:57:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 152829e4-2bf8-5fc6-9f87-d7a93f12e102 with identifier: TZ35948
2026-04-27 07:57:04 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:57:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 152829e4-2bf8-5fc6-9f87-d7a93f12e102 with identifier: TZ35948 to the API
2026-04-27 07:57:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:57:04 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:57:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-04-28T15:02:39Z',
 'fuel_type': 'diesel',
 'id': '152829e4-2bf8-5fc6-9f87-d7a93f12e102',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TZ35948',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Chevrolet',
 'model': 'Aveo',
 'odometer': 194354,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2012-10-28',
 'seller_name': None,
 'title': 'Chevrolet Aveo 1.3 Diesel LTZ',
 'transmission': 'manual',
 'trim': 'LTZ',
 'year': 2012}
2026-04-27 07:57:04 [auto1.fr] INFO: Saving data for TZ35948: {'auction_closing_time': 1777388559.0, 'created_time': 1777022606.429726, 'has_photos': True, 'last_price_update_time': 1777276624.704965}
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/2d/522d57280f332fe6b17e8580bc8b5951/pa/FR18447_df60841a38ee5d70928a1eaaae7ccc7f.jpg not downloaded yet
2026-04-27 07:57:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:57:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:57:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d2db50>
2026-04-27 07:57:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f28efd8-91df-53c5-840f-8e20efd2f8fc/4f28efd8-91df-53c5-840f-8e20efd2f8fc_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/2d/522d57280f332fe6b17e8580bc8b5951/pa/FR18447_d43c55e55ce5d0f30476374c4026d185.jpg saved to cache
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4f28efd8-91df-53c5-840f-8e20efd2f8fc
2026-04-27 07:57:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/2d/522d57280f332fe6b17e8580bc8b5951/pa/FR18447_e4dc402931a9ba90138ef3059f9b724a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:04 [auto1.fr] INFO: Found listing with ID: AB89878
2026-04-27 07:57:04 [auto1.fr] INFO: Scrape type for AB89878: 1
2026-04-27 07:57:04 [auto1.fr] INFO: Found listing with ID: XE66943
2026-04-27 07:57:04 [auto1.fr] INFO: Scrape type for XE66943: 2
2026-04-27 07:57:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c329762a-6be5-5b09-b7b7-674fa79a25b0 with identifier: XE66943
2026-04-27 07:57:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c329762a-6be5-5b09-b7b7-674fa79a25b0 with scrape type 2
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c329762a-6be5-5b09-b7b7-674fa79a25b0 with scrape type 2
2026-04-27 07:57:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c329762a-6be5-5b09-b7b7-674fa79a25b0, identifier: XE66943
2026-04-27 07:57:04 [auto1.fr] INFO: Found listing with ID: KU23234
2026-04-27 07:57:04 [auto1.fr] INFO: Scrape type for KU23234: 1
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/46/87464edc369f5dc875e49df911af3b4d/pa/JL00228_747dd82195341da9016f6765cc09111b.jpg not downloaded yet
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/40/be40c187bb51c8beaf565b0cff7fce5b/pa/HN87071_9492444fc8b5f1f89a82d8ac19da4517.jpg not downloaded yet
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/0e/840e2ec4e70fbe9017e219f533da41c1/pa/XT28721_aa8a4a591888941ea247b3408c334436.jpg not downloaded yet
2026-04-27 07:57:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:57:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EF42157/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:57:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/0e/840e2ec4e70fbe9017e219f533da41c1/pa/XT28721_6f8bf5e699de4a5daa323c307ec6f016.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c329762a-6be5-5b09-b7b7-674fa79a25b0 with identifier: XE66943
2026-04-27 07:57:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c329762a-6be5-5b09-b7b7-674fa79a25b0 with identifier: XE66943
2026-04-27 07:57:05 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:57:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c329762a-6be5-5b09-b7b7-674fa79a25b0 with identifier: XE66943 to the API
2026-04-27 07:57:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:57:05 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:57:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-04-28T15:38:09Z',
 'fuel_type': 'hybrid',
 'id': 'c329762a-6be5-5b09-b7b7-674fa79a25b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XE66943',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 101856,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2020-06-07',
 'seller_name': None,
 'title': 'Ford Kuga 2.5 Plug-in Hybrid ST-Line X',
 'transmission': 'automatic',
 'trim': 'ST-Line X',
 'year': 2020}
2026-04-27 07:57:05 [auto1.fr] INFO: Saving data for XE66943: {'auction_closing_time': 1777390689.0, 'created_time': 1777022424.879902, 'has_photos': True, 'last_price_update_time': 1777276625.34784}
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/2d/522d57280f332fe6b17e8580bc8b5951/pa/FR18447_bb843ecd0f3773771d8dcd005d92e93b.jpg not downloaded yet
2026-04-27 07:57:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:57:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:57:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GN48177> (referer: https://www.auto1.com/v1/car-details-view/GN48177/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:57:05 [auto1.fr] INFO: Found listing with ID: EP16771
2026-04-27 07:57:05 [auto1.fr] INFO: Scrape type for EP16771: 1
2026-04-27 07:57:05 [auto1.fr] INFO: Found listing with ID: HG27801
2026-04-27 07:57:05 [auto1.fr] INFO: Scrape type for HG27801: 2
2026-04-27 07:57:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25ca6b11-bddd-556e-a910-8b873d38ee98 with identifier: HG27801
2026-04-27 07:57:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25ca6b11-bddd-556e-a910-8b873d38ee98 with scrape type 2
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 25ca6b11-bddd-556e-a910-8b873d38ee98 with scrape type 2
2026-04-27 07:57:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 25ca6b11-bddd-556e-a910-8b873d38ee98, identifier: HG27801
2026-04-27 07:57:05 [auto1.fr] INFO: Found listing with ID: WN54691
2026-04-27 07:57:05 [auto1.fr] INFO: Scrape type for WN54691: 1
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/46/87464edc369f5dc875e49df911af3b4d/pa/JL00228_71da41ce414633455901536e015daa99.jpg not downloaded yet
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/40/be40c187bb51c8beaf565b0cff7fce5b/pa/HN87071_ee11edece703f791164b0f3d4defa833.jpg not downloaded yet
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/0e/840e2ec4e70fbe9017e219f533da41c1/pa/XT28721_3164bac07e6ea932af99627c3bd0a36f.jpg not downloaded yet
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d7e910>
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a378d879-6aa5-5d15-8f03-39e81aada49a/a378d879-6aa5-5d15-8f03-39e81aada49a_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/40/be40c187bb51c8beaf565b0cff7fce5b/pa/HN87071_04c17ada3f4c5b111dbccf1cfe516cfa.jpg saved to cache
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a378d879-6aa5-5d15-8f03-39e81aada49a
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c3ff90>
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f28efd8-91df-53c5-840f-8e20efd2f8fc/4f28efd8-91df-53c5-840f-8e20efd2f8fc_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/2d/522d57280f332fe6b17e8580bc8b5951/pa/FR18447_74483ca77cce33c6cd403f3cbbc52a2e.jpg saved to cache
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4f28efd8-91df-53c5-840f-8e20efd2f8fc
2026-04-27 07:57:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/8a/c88a945034b1acebaca3a20d6f285b1e/pa/YR21354_5a06350343a70f98207ad9b4fbd4f99d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 25ca6b11-bddd-556e-a910-8b873d38ee98 with identifier: HG27801
2026-04-27 07:57:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 25ca6b11-bddd-556e-a910-8b873d38ee98 with identifier: HG27801
2026-04-27 07:57:05 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:57:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 25ca6b11-bddd-556e-a910-8b873d38ee98 with identifier: HG27801 to the API
2026-04-27 07:57:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:57:05 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:57:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-04-28T15:41:53Z',
 'fuel_type': 'diesel',
 'id': '25ca6b11-bddd-556e-a910-8b873d38ee98',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HG27801',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Audi',
 'model': 'A4',
 'odometer': 168400,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2018-07-08',
 'seller_name': None,
 'title': 'Audi A4 3.0 V6 TDI quattro S line',
 'transmission': 'automatic',
 'trim': 'quattro S line',
 'year': 2018}
2026-04-27 07:57:06 [auto1.fr] INFO: Saving data for HG27801: {'auction_closing_time': 1777390913.0, 'created_time': 1777020769.834742, 'has_photos': True, 'last_price_update_time': 1777276626.037399}
2026-04-27 07:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/2d/522d57280f332fe6b17e8580bc8b5951/pa/FR18447_e38697a470e5a4ec649f6f90998dec20.jpg not downloaded yet
2026-04-27 07:57:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/0e/840e2ec4e70fbe9017e219f533da41c1/pa/XT28721_45e52b8c2db71d10016de5318acff712.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/40/be40c187bb51c8beaf565b0cff7fce5b/pa/HN87071_2daec06e0ce3e2951bea27dcdd4f0c9b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/2d/522d57280f332fe6b17e8580bc8b5951/pa/FR18447_f988f11b88cf5291e108ed091b1e24bc.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:06 [auto1.fr] INFO: Found listing with ID: EE75487
2026-04-27 07:57:06 [auto1.fr] INFO: Scrape type for EE75487: 2
2026-04-27 07:57:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4402d81-ba25-5e09-97ed-2577f6c52ca5 with identifier: EE75487
2026-04-27 07:57:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4402d81-ba25-5e09-97ed-2577f6c52ca5 with scrape type 2
2026-04-27 07:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c4402d81-ba25-5e09-97ed-2577f6c52ca5 with scrape type 2
2026-04-27 07:57:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c4402d81-ba25-5e09-97ed-2577f6c52ca5, identifier: EE75487
2026-04-27 07:57:06 [auto1.fr] INFO: Found listing with ID: AC76322
2026-04-27 07:57:06 [auto1.fr] INFO: Scrape type for AC76322: 1
2026-04-27 07:57:06 [auto1.fr] INFO: Found listing with ID: UV98926
2026-04-27 07:57:06 [auto1.fr] INFO: Scrape type for UV98926: 1
2026-04-27 07:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/0e/840e2ec4e70fbe9017e219f533da41c1/pa/XT28721_0fe954a6e67f40e3ed3971039100ecea.jpg not downloaded yet
2026-04-27 07:57:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EL61654/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:57:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FK21242> (referer: https://www.auto1.com/v1/car-details-view/FK21242/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:57:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:57:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c4fdd0>
2026-04-27 07:57:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f28efd8-91df-53c5-840f-8e20efd2f8fc/4f28efd8-91df-53c5-840f-8e20efd2f8fc_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/2d/522d57280f332fe6b17e8580bc8b5951/pa/FR18447_e4dc402931a9ba90138ef3059f9b724a.jpg saved to cache
2026-04-27 07:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4f28efd8-91df-53c5-840f-8e20efd2f8fc
2026-04-27 07:57:06 [auto1.fr] INFO: Channel: 24h | Page: 9 | totalHits: 4729 | hits on page: 40
2026-04-27 07:57:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143809a190>
2026-04-27 07:57:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2995d43e-8fcd-5328-bac5-15fc99b53305/2995d43e-8fcd-5328-bac5-15fc99b53305_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/0e/840e2ec4e70fbe9017e219f533da41c1/pa/XT28721_6f8bf5e699de4a5daa323c307ec6f016.jpg saved to cache
2026-04-27 07:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2995d43e-8fcd-5328-bac5-15fc99b53305
2026-04-27 07:57:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/40/be40c187bb51c8beaf565b0cff7fce5b/pa/HN87071_87da6c241a095321137a956fb665ca78.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/46/87464edc369f5dc875e49df911af3b4d/pa/JL00228_db1a84112e0646edae46377cd1df60ad.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/0e/840e2ec4e70fbe9017e219f533da41c1/pa/XT28721_a180c1716f93ff22b9a786efcf886ade.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c4402d81-ba25-5e09-97ed-2577f6c52ca5 with identifier: EE75487
2026-04-27 07:57:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c4402d81-ba25-5e09-97ed-2577f6c52ca5 with identifier: EE75487
2026-04-27 07:57:06 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:57:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c4402d81-ba25-5e09-97ed-2577f6c52ca5 with identifier: EE75487 to the API
2026-04-27 07:57:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:57:06 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:57:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-04-28T15:59:08Z',
 'fuel_type': 'petrol',
 'id': 'c4402d81-ba25-5e09-97ed-2577f6c52ca5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EE75487',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 166249,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2010-02-04',
 'seller_name': None,
 'title': 'Renault Clio 1.2 Campus.com',
 'transmission': 'manual',
 'trim': 'Campus.com',
 'year': 2010}
2026-04-27 07:57:06 [auto1.fr] INFO: Saving data for EE75487: {'auction_closing_time': 1777391948.0, 'created_time': 1777022111.027507, 'has_photos': True, 'last_price_update_time': 1777276626.732298}
2026-04-27 07:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/2d/522d57280f332fe6b17e8580bc8b5951/pa/FR18447_8a7c4c283c8f7de4c85cc00ca8184be6.jpg not downloaded yet
2026-04-27 07:57:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:57:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CN89291/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:57:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:57:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/2d/522d57280f332fe6b17e8580bc8b5951/pa/FR18447_df60841a38ee5d70928a1eaaae7ccc7f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:06 [auto1.fr] INFO: Found listing with ID: KV39723
2026-04-27 07:57:06 [auto1.fr] INFO: Scrape type for KV39723: 1
2026-04-27 07:57:06 [auto1.fr] INFO: Found listing with ID: SB35500
2026-04-27 07:57:06 [auto1.fr] INFO: Scrape type for SB35500: 1
2026-04-27 07:57:06 [auto1.fr] INFO: Found listing with ID: RC31349
2026-04-27 07:57:06 [auto1.fr] INFO: Scrape type for RC31349: 2
2026-04-27 07:57:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd3206ac-2351-5cbf-b1ae-e2d465c70a2e with identifier: RC31349
2026-04-27 07:57:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd3206ac-2351-5cbf-b1ae-e2d465c70a2e with scrape type 2
2026-04-27 07:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dd3206ac-2351-5cbf-b1ae-e2d465c70a2e with scrape type 2
2026-04-27 07:57:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: dd3206ac-2351-5cbf-b1ae-e2d465c70a2e, identifier: RC31349
2026-04-27 07:57:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:57:07 [auto1.fr] INFO: Found listing with ID: RK33125
2026-04-27 07:57:07 [auto1.fr] INFO: Scrape type for RK33125: 1
2026-04-27 07:57:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b3da0d2-77e3-5639-b50c-e5651b05b9ac with identifier: GN48177
2026-04-27 07:57:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b3da0d2-77e3-5639-b50c-e5651b05b9ac with scrape type 1
2026-04-27 07:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8b3da0d2-77e3-5639-b50c-e5651b05b9ac
2026-04-27 07:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/5c/f05c4ecbff9b32cedb2bfc7c820b6c6b/pa/GN48177_5b0e5ecf12372f3599aa60990e11353c.jpg not downloaded yet
2026-04-27 07:57:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143809d650>
2026-04-27 07:57:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99dfed4d-8ddd-55c8-8007-cddacf80f9bc/99dfed4d-8ddd-55c8-8007-cddacf80f9bc_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/8a/c88a945034b1acebaca3a20d6f285b1e/pa/YR21354_5a06350343a70f98207ad9b4fbd4f99d.jpg saved to cache
2026-04-27 07:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 99dfed4d-8ddd-55c8-8007-cddacf80f9bc
2026-04-27 07:57:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: dd3206ac-2351-5cbf-b1ae-e2d465c70a2e with identifier: RC31349
2026-04-27 07:57:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: dd3206ac-2351-5cbf-b1ae-e2d465c70a2e with identifier: RC31349
2026-04-27 07:57:07 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:57:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: dd3206ac-2351-5cbf-b1ae-e2d465c70a2e with identifier: RC31349 to the API
2026-04-27 07:57:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:57:07 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:57:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 200,
 'expiration_date': '2026-04-28T15:23:56Z',
 'fuel_type': 'petrol',
 'id': 'dd3206ac-2351-5cbf-b1ae-e2d465c70a2e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC31349',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Honda',
 'model': 'Civic',
 'odometer': 196763,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2009-06-17',
 'seller_name': None,
 'title': 'Honda Civic 2.0 Type R',
 'transmission': 'manual',
 'trim': 'Type R',
 'year': 2009}
2026-04-27 07:57:07 [auto1.fr] INFO: Saving data for RC31349: {'auction_closing_time': 1777389836.0, 'created_time': 1777019178.843769, 'has_photos': True, 'last_price_update_time': 1777276627.524341}
2026-04-27 07:57:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438bfd810>
2026-04-27 07:57:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2995d43e-8fcd-5328-bac5-15fc99b53305/2995d43e-8fcd-5328-bac5-15fc99b53305_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/0e/840e2ec4e70fbe9017e219f533da41c1/pa/XT28721_45e52b8c2db71d10016de5318acff712.jpg saved to cache
2026-04-27 07:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2995d43e-8fcd-5328-bac5-15fc99b53305
2026-04-27 07:57:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142be069d0>
2026-04-27 07:57:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a378d879-6aa5-5d15-8f03-39e81aada49a/a378d879-6aa5-5d15-8f03-39e81aada49a_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/40/be40c187bb51c8beaf565b0cff7fce5b/pa/HN87071_2daec06e0ce3e2951bea27dcdd4f0c9b.jpg saved to cache
2026-04-27 07:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a378d879-6aa5-5d15-8f03-39e81aada49a
2026-04-27 07:57:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142be0cbd0>
2026-04-27 07:57:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f28efd8-91df-53c5-840f-8e20efd2f8fc/4f28efd8-91df-53c5-840f-8e20efd2f8fc_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/2d/522d57280f332fe6b17e8580bc8b5951/pa/FR18447_f988f11b88cf5291e108ed091b1e24bc.jpg saved to cache
2026-04-27 07:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4f28efd8-91df-53c5-840f-8e20efd2f8fc
2026-04-27 07:57:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/40/be40c187bb51c8beaf565b0cff7fce5b/pa/HN87071_ee11edece703f791164b0f3d4defa833.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/0e/840e2ec4e70fbe9017e219f533da41c1/pa/XT28721_aa8a4a591888941ea247b3408c334436.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:07 [auto1.fr] INFO: Found listing with ID: GX21822
2026-04-27 07:57:07 [auto1.fr] INFO: Scrape type for GX21822: 1
2026-04-27 07:57:07 [auto1.fr] INFO: Found listing with ID: WV81568
2026-04-27 07:57:07 [auto1.fr] INFO: Scrape type for WV81568: 1
2026-04-27 07:57:07 [auto1.fr] INFO: Found listing with ID: NJ64865
2026-04-27 07:57:08 [auto1.fr] INFO: Scrape type for NJ64865: 1
2026-04-27 07:57:08 [crawlers.middlewares.monitoring_spider_middleware] ERROR: invalid literal for int() with base 10: 'other'
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/auto1.py", line 231, in parse_api_search
    item = self._listing_from_search_result(car, channel, car_stock_number)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/auto1.py", line 346, in _listing_from_search_result
    item["doors_number"] = int(car.get("doors"))
                           ^^^^^^^^^^^^^^^^^^^^^
ValueError: invalid literal for int() with base 10: 'other'
2026-04-27 07:57:08 [crawlers.middlewares.monitoring_spider_middleware] ERROR: invalid literal for int() with base 10: 'other'
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/auto1.py", line 231, in parse_api_search
    item = self._listing_from_search_result(car, channel, car_stock_number)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/auto1.py", line 346, in _listing_from_search_result
    item["doors_number"] = int(car.get("doors"))
                           ^^^^^^^^^^^^^^^^^^^^^
ValueError: invalid literal for int() with base 10: 'other'
2026-04-27 07:57:08 [crawlers.middlewares.monitoring_spider_middleware] ERROR: invalid literal for int() with base 10: 'other'
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/auto1.py", line 231, in parse_api_search
    item = self._listing_from_search_result(car, channel, car_stock_number)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/auto1.py", line 346, in _listing_from_search_result
    item["doors_number"] = int(car.get("doors"))
                           ^^^^^^^^^^^^^^^^^^^^^
ValueError: invalid literal for int() with base 10: 'other'
2026-04-27 07:57:08 [crawlers.middlewares.monitoring_spider_middleware] ERROR: invalid literal for int() with base 10: 'other'
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/auto1.py", line 231, in parse_api_search
    item = self._listing_from_search_result(car, channel, car_stock_number)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/auto1.py", line 346, in _listing_from_search_result
    item["doors_number"] = int(car.get("doors"))
                           ^^^^^^^^^^^^^^^^^^^^^
ValueError: invalid literal for int() with base 10: 'other'
2026-04-27 07:57:08 [crawlers.middlewares.monitoring_spider_middleware] ERROR: invalid literal for int() with base 10: 'other'
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/auto1.py", line 231, in parse_api_search
    item = self._listing_from_search_result(car, channel, car_stock_number)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/auto1.py", line 346, in _listing_from_search_result
    item["doors_number"] = int(car.get("doors"))
                           ^^^^^^^^^^^^^^^^^^^^^
ValueError: invalid literal for int() with base 10: 'other'
2026-04-27 07:57:08 [crawlers.middlewares.monitoring_spider_middleware] ERROR: invalid literal for int() with base 10: 'other'
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/auto1.py", line 231, in parse_api_search
    item = self._listing_from_search_result(car, channel, car_stock_number)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/auto1.py", line 346, in _listing_from_search_result
    item["doors_number"] = int(car.get("doors"))
                           ^^^^^^^^^^^^^^^^^^^^^
ValueError: invalid literal for int() with base 10: 'other'
2026-04-27 07:57:08 [crawlers.middlewares.monitoring_spider_middleware] ERROR: invalid literal for int() with base 10: 'other'
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/auto1.py", line 231, in parse_api_search
    item = self._listing_from_search_result(car, channel, car_stock_number)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/auto1.py", line 346, in _listing_from_search_result
    item["doors_number"] = int(car.get("doors"))
                           ^^^^^^^^^^^^^^^^^^^^^
ValueError: invalid literal for int() with base 10: 'other'
2026-04-27 07:57:08 [scrapy.core.scraper] ERROR: Spider error processing <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 295, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 374, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 355, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 374, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 355, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy_zyte_api/_middlewares.py", line 206, in process_spider_output_async
    async for item_or_request in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/auto1.py", line 231, in parse_api_search
    item = self._listing_from_search_result(car, channel, car_stock_number)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/auto1.py", line 346, in _listing_from_search_result
    item["doors_number"] = int(car.get("doors"))
                           ^^^^^^^^^^^^^^^^^^^^^
ValueError: invalid literal for int() with base 10: 'other'
2026-04-27 07:57:08 [auto1.fr] INFO: Found listing with ID: NU27668
2026-04-27 07:57:08 [auto1.fr] INFO: Scrape type for NU27668: 2
2026-04-27 07:57:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a01b459a-1b02-508f-8f32-68246894df4a with identifier: NU27668
2026-04-27 07:57:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a01b459a-1b02-508f-8f32-68246894df4a with scrape type 2
2026-04-27 07:57:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a01b459a-1b02-508f-8f32-68246894df4a with scrape type 2
2026-04-27 07:57:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a01b459a-1b02-508f-8f32-68246894df4a, identifier: NU27668
2026-04-27 07:57:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/5c/f05c4ecbff9b32cedb2bfc7c820b6c6b/pa/GN48177_572d36c81fd9985a8b4fce9400e6b62d.jpg not downloaded yet
2026-04-27 07:57:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/46/87464edc369f5dc875e49df911af3b4d/pa/JL00228_71da41ce414633455901536e015daa99.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/2d/522d57280f332fe6b17e8580bc8b5951/pa/FR18447_e38697a470e5a4ec649f6f90998dec20.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/0e/840e2ec4e70fbe9017e219f533da41c1/pa/XT28721_3164bac07e6ea932af99627c3bd0a36f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a01b459a-1b02-508f-8f32-68246894df4a with identifier: NU27668
2026-04-27 07:57:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a01b459a-1b02-508f-8f32-68246894df4a with identifier: NU27668
2026-04-27 07:57:09 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:57:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a01b459a-1b02-508f-8f32-68246894df4a with identifier: NU27668 to the API
2026-04-27 07:57:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:57:09 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:57:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-04-28T15:44:39Z',
 'fuel_type': 'petrol',
 'id': 'a01b459a-1b02-508f-8f32-68246894df4a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NU27668',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Ford',
 'model': 'Ka',
 'odometer': 104637,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2007-02-28',
 'seller_name': None,
 'title': 'Ford Ka 1.3 Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2007}
2026-04-27 07:57:09 [auto1.fr] INFO: Saving data for NU27668: {'auction_closing_time': 1777391079.0, 'created_time': 1777020941.494998, 'has_photos': True, 'last_price_update_time': 1777276629.258879}
2026-04-27 07:57:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c162a9fe-ffbd-51be-a77e-2ca676622047 with identifier: FK21242
2026-04-27 07:57:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c162a9fe-ffbd-51be-a77e-2ca676622047 with scrape type 1
2026-04-27 07:57:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c162a9fe-ffbd-51be-a77e-2ca676622047
2026-04-27 07:57:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/7a/d67a5eaf1b0582aff1abd5e0ef7c8c8f/pa/FK21242_36860fae5a93c265910137ccfee335c0.jpg not downloaded yet
2026-04-27 07:57:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d30650>
2026-04-27 07:57:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a378d879-6aa5-5d15-8f03-39e81aada49a/a378d879-6aa5-5d15-8f03-39e81aada49a_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:57:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/40/be40c187bb51c8beaf565b0cff7fce5b/pa/HN87071_87da6c241a095321137a956fb665ca78.jpg saved to cache
2026-04-27 07:57:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a378d879-6aa5-5d15-8f03-39e81aada49a
2026-04-27 07:57:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ffb9d0>
2026-04-27 07:57:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd1991e2-0b47-5bb3-a3cf-6044ca19327f/fd1991e2-0b47-5bb3-a3cf-6044ca19327f_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:57:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/46/87464edc369f5dc875e49df911af3b4d/pa/JL00228_db1a84112e0646edae46377cd1df60ad.jpg saved to cache
2026-04-27 07:57:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fd1991e2-0b47-5bb3-a3cf-6044ca19327f
2026-04-27 07:57:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438efe750>
2026-04-27 07:57:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2995d43e-8fcd-5328-bac5-15fc99b53305/2995d43e-8fcd-5328-bac5-15fc99b53305_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:57:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/0e/840e2ec4e70fbe9017e219f533da41c1/pa/XT28721_a180c1716f93ff22b9a786efcf886ade.jpg saved to cache
2026-04-27 07:57:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2995d43e-8fcd-5328-bac5-15fc99b53305
2026-04-27 07:57:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bfd0c90>
2026-04-27 07:57:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f28efd8-91df-53c5-840f-8e20efd2f8fc/4f28efd8-91df-53c5-840f-8e20efd2f8fc_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:57:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/2d/522d57280f332fe6b17e8580bc8b5951/pa/FR18447_df60841a38ee5d70928a1eaaae7ccc7f.jpg saved to cache
2026-04-27 07:57:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4f28efd8-91df-53c5-840f-8e20efd2f8fc
2026-04-27 07:57:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/2d/522d57280f332fe6b17e8580bc8b5951/pa/FR18447_bb843ecd0f3773771d8dcd005d92e93b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:09 [auto1.fr] INFO: Found listing with ID: FK21242
2026-04-27 07:57:09 [auto1.fr] INFO: Found listing with ID: EB39116
2026-04-27 07:57:09 [auto1.fr] INFO: Scrape type for EB39116: 1
2026-04-27 07:57:09 [auto1.fr] INFO: Found listing with ID: FA81787
2026-04-27 07:57:09 [auto1.fr] INFO: Scrape type for FA81787: 2
2026-04-27 07:57:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 150660d9-3685-5964-a978-0669909c2570 with identifier: FA81787
2026-04-27 07:57:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 150660d9-3685-5964-a978-0669909c2570 with scrape type 2
2026-04-27 07:57:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 150660d9-3685-5964-a978-0669909c2570 with scrape type 2
2026-04-27 07:57:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 150660d9-3685-5964-a978-0669909c2570, identifier: FA81787
2026-04-27 07:57:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/5c/f05c4ecbff9b32cedb2bfc7c820b6c6b/pa/GN48177_2a088b137723173d389e37ad6aec7db0.jpg not downloaded yet
2026-04-27 07:57:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 150660d9-3685-5964-a978-0669909c2570 with identifier: FA81787
2026-04-27 07:57:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 150660d9-3685-5964-a978-0669909c2570 with identifier: FA81787
2026-04-27 07:57:09 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:57:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 150660d9-3685-5964-a978-0669909c2570 with identifier: FA81787 to the API
2026-04-27 07:57:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:57:09 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:57:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-04-28T15:57:17Z',
 'fuel_type': 'petrol',
 'id': '150660d9-3685-5964-a978-0669909c2570',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FA81787',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Jeep',
 'model': 'Compass',
 'odometer': 115026,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2018-02-07',
 'seller_name': None,
 'title': 'Jeep Compass 1.4 M-Air Limited 4WD',
 'transmission': 'automatic',
 'trim': 'Limited 4WD',
 'year': 2018}
2026-04-27 07:57:10 [auto1.fr] INFO: Saving data for FA81787: {'auction_closing_time': 1777391837.0, 'created_time': 1777019929.493355, 'has_photos': True, 'last_price_update_time': 1777276630.045109}
2026-04-27 07:57:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/7a/d67a5eaf1b0582aff1abd5e0ef7c8c8f/pa/FK21242_c7e4d86bf5bb3c1e87a410f74570ab84.jpg not downloaded yet
2026-04-27 07:57:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UF86890/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:57:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XV47033/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:57:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bf9b450>
2026-04-27 07:57:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a378d879-6aa5-5d15-8f03-39e81aada49a/a378d879-6aa5-5d15-8f03-39e81aada49a_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:57:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/40/be40c187bb51c8beaf565b0cff7fce5b/pa/HN87071_ee11edece703f791164b0f3d4defa833.jpg saved to cache
2026-04-27 07:57:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a378d879-6aa5-5d15-8f03-39e81aada49a
2026-04-27 07:57:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143804cc50>
2026-04-27 07:57:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2995d43e-8fcd-5328-bac5-15fc99b53305/2995d43e-8fcd-5328-bac5-15fc99b53305_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:57:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/0e/840e2ec4e70fbe9017e219f533da41c1/pa/XT28721_aa8a4a591888941ea247b3408c334436.jpg saved to cache
2026-04-27 07:57:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2995d43e-8fcd-5328-bac5-15fc99b53305
2026-04-27 07:57:10 [auto1.fr] INFO: Found listing with ID: WT28512
2026-04-27 07:57:10 [auto1.fr] INFO: Scrape type for WT28512: 2
2026-04-27 07:57:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e57b666e-b4f4-50f0-89d5-f936e9d1e1d6 with identifier: WT28512
2026-04-27 07:57:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e57b666e-b4f4-50f0-89d5-f936e9d1e1d6 with scrape type 2
2026-04-27 07:57:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e57b666e-b4f4-50f0-89d5-f936e9d1e1d6 with scrape type 2
2026-04-27 07:57:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e57b666e-b4f4-50f0-89d5-f936e9d1e1d6, identifier: WT28512
2026-04-27 07:57:10 [auto1.fr] INFO: Found listing with ID: XE44101
2026-04-27 07:57:10 [auto1.fr] INFO: Scrape type for XE44101: 1
2026-04-27 07:57:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/5c/f05c4ecbff9b32cedb2bfc7c820b6c6b/pa/GN48177_45ea7585e310a2e20dd8dd607f4c0200.jpg not downloaded yet
2026-04-27 07:57:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:57:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:57:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143804ad90>
2026-04-27 07:57:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd1991e2-0b47-5bb3-a3cf-6044ca19327f/fd1991e2-0b47-5bb3-a3cf-6044ca19327f_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:57:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/46/87464edc369f5dc875e49df911af3b4d/pa/JL00228_71da41ce414633455901536e015daa99.jpg saved to cache
2026-04-27 07:57:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fd1991e2-0b47-5bb3-a3cf-6044ca19327f
2026-04-27 07:57:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b97bd0>
2026-04-27 07:57:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f28efd8-91df-53c5-840f-8e20efd2f8fc/4f28efd8-91df-53c5-840f-8e20efd2f8fc_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:57:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/2d/522d57280f332fe6b17e8580bc8b5951/pa/FR18447_e38697a470e5a4ec649f6f90998dec20.jpg saved to cache
2026-04-27 07:57:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4f28efd8-91df-53c5-840f-8e20efd2f8fc
2026-04-27 07:57:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d7e750>
2026-04-27 07:57:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2995d43e-8fcd-5328-bac5-15fc99b53305/2995d43e-8fcd-5328-bac5-15fc99b53305_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:57:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/0e/840e2ec4e70fbe9017e219f533da41c1/pa/XT28721_3164bac07e6ea932af99627c3bd0a36f.jpg saved to cache
2026-04-27 07:57:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2995d43e-8fcd-5328-bac5-15fc99b53305
2026-04-27 07:57:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e57b666e-b4f4-50f0-89d5-f936e9d1e1d6 with identifier: WT28512
2026-04-27 07:57:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e57b666e-b4f4-50f0-89d5-f936e9d1e1d6 with identifier: WT28512
2026-04-27 07:57:10 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:57:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e57b666e-b4f4-50f0-89d5-f936e9d1e1d6 with identifier: WT28512 to the API
2026-04-27 07:57:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:57:10 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:57:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-04-28T15:27:28Z',
 'fuel_type': 'diesel',
 'id': 'e57b666e-b4f4-50f0-89d5-f936e9d1e1d6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WT28512',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Opel',
 'model': 'Zafira',
 'odometer': 249146,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2003-10-23',
 'seller_name': None,
 'title': 'Opel Zafira 2.2 DTI Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2003}
2026-04-27 07:57:10 [auto1.fr] INFO: Saving data for WT28512: {'auction_closing_time': 1777390048.0, 'created_time': 1777022946.270894, 'has_photos': True, 'last_price_update_time': 1777276630.846471}
2026-04-27 07:57:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/7a/d67a5eaf1b0582aff1abd5e0ef7c8c8f/pa/FK21242_4c4c4c1e3f3f1c347161e6acaed1f40e.jpg not downloaded yet
2026-04-27 07:57:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d21210>
2026-04-27 07:57:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f28efd8-91df-53c5-840f-8e20efd2f8fc/4f28efd8-91df-53c5-840f-8e20efd2f8fc_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:57:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/2d/522d57280f332fe6b17e8580bc8b5951/pa/FR18447_bb843ecd0f3773771d8dcd005d92e93b.jpg saved to cache
2026-04-27 07:57:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4f28efd8-91df-53c5-840f-8e20efd2f8fc
2026-04-27 07:57:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/5c/f05c4ecbff9b32cedb2bfc7c820b6c6b/pa/GN48177_5b0e5ecf12372f3599aa60990e11353c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/2d/522d57280f332fe6b17e8580bc8b5951/pa/FR18447_8a7c4c283c8f7de4c85cc00ca8184be6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:11 [auto1.fr] INFO: Found listing with ID: MM69519
2026-04-27 07:57:11 [auto1.fr] INFO: Scrape type for MM69519: 2
2026-04-27 07:57:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d9f6eaa-3fb5-5fd6-92cd-46274a868cd9 with identifier: MM69519
2026-04-27 07:57:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d9f6eaa-3fb5-5fd6-92cd-46274a868cd9 with scrape type 2
2026-04-27 07:57:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d9f6eaa-3fb5-5fd6-92cd-46274a868cd9 with scrape type 2
2026-04-27 07:57:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6d9f6eaa-3fb5-5fd6-92cd-46274a868cd9, identifier: MM69519
2026-04-27 07:57:11 [auto1.fr] INFO: Found listing with ID: JA68663
2026-04-27 07:57:11 [auto1.fr] INFO: Scrape type for JA68663: 1
2026-04-27 07:57:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/5c/f05c4ecbff9b32cedb2bfc7c820b6c6b/pa/GN48177_7afb5891c8a95e26d206ddd162099245.jpg not downloaded yet
2026-04-27 07:57:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/5c/f05c4ecbff9b32cedb2bfc7c820b6c6b/pa/GN48177_572d36c81fd9985a8b4fce9400e6b62d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6d9f6eaa-3fb5-5fd6-92cd-46274a868cd9 with identifier: MM69519
2026-04-27 07:57:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6d9f6eaa-3fb5-5fd6-92cd-46274a868cd9 with identifier: MM69519
2026-04-27 07:57:11 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:57:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6d9f6eaa-3fb5-5fd6-92cd-46274a868cd9 with identifier: MM69519 to the API
2026-04-27 07:57:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:57:11 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:57:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-04-28T15:10:50Z',
 'fuel_type': 'diesel',
 'id': '6d9f6eaa-3fb5-5fd6-92cd-46274a868cd9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MM69519',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Peugeot',
 'model': '207',
 'odometer': 206223,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2009-12-17',
 'seller_name': None,
 'title': 'Peugeot 207 1.6 HDi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2009}
2026-04-27 07:57:11 [auto1.fr] INFO: Saving data for MM69519: {'auction_closing_time': 1777389050.0, 'created_time': 1777022610.148055, 'has_photos': True, 'last_price_update_time': 1777276631.48783}
2026-04-27 07:57:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/7a/d67a5eaf1b0582aff1abd5e0ef7c8c8f/pa/FK21242_7fed943c21f1094c787abc2bbc0ba255.jpg not downloaded yet
2026-04-27 07:57:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FG74412> (referer: https://www.auto1.com/v1/car-details-view/FG74412/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:57:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XG74646> (referer: https://www.auto1.com/v1/car-details-view/XG74646/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:57:11 [auto1.fr] INFO: Found listing with ID: PZ67230
2026-04-27 07:57:11 [auto1.fr] INFO: Scrape type for PZ67230: 2
2026-04-27 07:57:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87dacb5e-9a55-597f-9c05-d22d25f73675 with identifier: PZ67230
2026-04-27 07:57:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87dacb5e-9a55-597f-9c05-d22d25f73675 with scrape type 2
2026-04-27 07:57:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 87dacb5e-9a55-597f-9c05-d22d25f73675 with scrape type 2
2026-04-27 07:57:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 87dacb5e-9a55-597f-9c05-d22d25f73675, identifier: PZ67230
2026-04-27 07:57:11 [auto1.fr] INFO: Found listing with ID: BW78861
2026-04-27 07:57:11 [auto1.fr] INFO: Scrape type for BW78861: 1
2026-04-27 07:57:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/5c/f05c4ecbff9b32cedb2bfc7c820b6c6b/pa/GN48177_8ccfe815d226d2d69e369b87c036963d.jpg not downloaded yet
2026-04-27 07:57:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:57:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:57:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 87dacb5e-9a55-597f-9c05-d22d25f73675 with identifier: PZ67230
2026-04-27 07:57:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 87dacb5e-9a55-597f-9c05-d22d25f73675 with identifier: PZ67230
2026-04-27 07:57:11 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:57:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 87dacb5e-9a55-597f-9c05-d22d25f73675 with identifier: PZ67230 to the API
2026-04-27 07:57:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:57:11 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:57:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-04-28T15:37:39Z',
 'fuel_type': 'diesel',
 'id': '87dacb5e-9a55-597f-9c05-d22d25f73675',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PZ67230',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Volkswagen',
 'model': 'T5 Multivan',
 'odometer': 161411,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2015-12-22',
 'seller_name': None,
 'title': 'Volkswagen T5 Multivan 2.0 TDI Highline',
 'transmission': 'automatic',
 'trim': 'Highline',
 'year': 2015}
2026-04-27 07:57:11 [auto1.fr] INFO: Saving data for PZ67230: {'auction_closing_time': 1777390659.0, 'created_time': 1777021343.01185, 'has_photos': True, 'last_price_update_time': 1777276631.963148}
2026-04-27 07:57:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/7a/d67a5eaf1b0582aff1abd5e0ef7c8c8f/pa/FK21242_37eceb7825c529ebe9788dd4f978f80a.jpg not downloaded yet
2026-04-27 07:57:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438cc7790>
2026-04-27 07:57:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b3da0d2-77e3-5639-b50c-e5651b05b9ac/8b3da0d2-77e3-5639-b50c-e5651b05b9ac_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:57:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/5c/f05c4ecbff9b32cedb2bfc7c820b6c6b/pa/GN48177_5b0e5ecf12372f3599aa60990e11353c.jpg saved to cache
2026-04-27 07:57:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8b3da0d2-77e3-5639-b50c-e5651b05b9ac
2026-04-27 07:57:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14381cf650>
2026-04-27 07:57:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f28efd8-91df-53c5-840f-8e20efd2f8fc/4f28efd8-91df-53c5-840f-8e20efd2f8fc_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:57:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/2d/522d57280f332fe6b17e8580bc8b5951/pa/FR18447_8a7c4c283c8f7de4c85cc00ca8184be6.jpg saved to cache
2026-04-27 07:57:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4f28efd8-91df-53c5-840f-8e20efd2f8fc
2026-04-27 07:57:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/5c/f05c4ecbff9b32cedb2bfc7c820b6c6b/pa/GN48177_2a088b137723173d389e37ad6aec7db0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:12 [auto1.fr] INFO: Found listing with ID: WN94836
2026-04-27 07:57:12 [auto1.fr] INFO: Scrape type for WN94836: 2
2026-04-27 07:57:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b000831e-ca4c-53f3-b756-1ad4093ca5e5 with identifier: WN94836
2026-04-27 07:57:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b000831e-ca4c-53f3-b756-1ad4093ca5e5 with scrape type 2
2026-04-27 07:57:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b000831e-ca4c-53f3-b756-1ad4093ca5e5 with scrape type 2
2026-04-27 07:57:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b000831e-ca4c-53f3-b756-1ad4093ca5e5, identifier: WN94836
2026-04-27 07:57:12 [auto1.fr] INFO: Found listing with ID: MN17403
2026-04-27 07:57:12 [auto1.fr] INFO: Scrape type for MN17403: 1
2026-04-27 07:57:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/5c/f05c4ecbff9b32cedb2bfc7c820b6c6b/pa/GN48177_226bb3d0990e7c726616c93ca6ce5ccc.jpg not downloaded yet
2026-04-27 07:57:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b000831e-ca4c-53f3-b756-1ad4093ca5e5 with identifier: WN94836
2026-04-27 07:57:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b000831e-ca4c-53f3-b756-1ad4093ca5e5 with identifier: WN94836
2026-04-27 07:57:12 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:57:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b000831e-ca4c-53f3-b756-1ad4093ca5e5 with identifier: WN94836 to the API
2026-04-27 07:57:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:57:12 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:57:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-04-28T15:38:30Z',
 'fuel_type': 'diesel',
 'id': 'b000831e-ca4c-53f3-b756-1ad4093ca5e5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WN94836',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Renault',
 'model': 'Talisman',
 'odometer': 228111,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2019-11-19',
 'seller_name': None,
 'title': 'Renault Talisman 2.0 BLUE dCi Initiale Paris',
 'transmission': 'automatic',
 'trim': 'Initiale Paris',
 'year': 2019}
2026-04-27 07:57:12 [auto1.fr] INFO: Saving data for WN94836: {'auction_closing_time': 1777390710.0, 'created_time': 1777020358.647116, 'has_photos': True, 'last_price_update_time': 1777276632.554246}
2026-04-27 07:57:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/7a/d67a5eaf1b0582aff1abd5e0ef7c8c8f/pa/FK21242_9d56136810d7448b7674af82b22f7f16.jpg not downloaded yet
2026-04-27 07:57:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438cb7e10>
2026-04-27 07:57:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b3da0d2-77e3-5639-b50c-e5651b05b9ac/8b3da0d2-77e3-5639-b50c-e5651b05b9ac_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:57:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/5c/f05c4ecbff9b32cedb2bfc7c820b6c6b/pa/GN48177_572d36c81fd9985a8b4fce9400e6b62d.jpg saved to cache
2026-04-27 07:57:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8b3da0d2-77e3-5639-b50c-e5651b05b9ac
2026-04-27 07:57:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32a10a69-6d3d-53e2-acca-ed359ef2b418 with identifier: FG74412
2026-04-27 07:57:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32a10a69-6d3d-53e2-acca-ed359ef2b418 with scrape type 1
2026-04-27 07:57:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 32a10a69-6d3d-53e2-acca-ed359ef2b418
2026-04-27 07:57:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/c7/53c7850e98ebf83fa98f09bfc65e95c9/pa/FG74412_7742e9d09ed9307e92070f60da097c65.jpg not downloaded yet
2026-04-27 07:57:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09b54c5f-3e76-57a6-b73f-1614347216ec with identifier: XG74646
2026-04-27 07:57:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09b54c5f-3e76-57a6-b73f-1614347216ec with scrape type 1
2026-04-27 07:57:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 09b54c5f-3e76-57a6-b73f-1614347216ec
2026-04-27 07:57:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/5c/fa5c14669f55b0380cb99369778f61d0/pa/XG74646_97b11e0a652c2bdb52da90348005cc38.jpg not downloaded yet
2026-04-27 07:57:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/5c/f05c4ecbff9b32cedb2bfc7c820b6c6b/pa/GN48177_45ea7585e310a2e20dd8dd607f4c0200.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/7a/d67a5eaf1b0582aff1abd5e0ef7c8c8f/pa/FK21242_4c4c4c1e3f3f1c347161e6acaed1f40e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:12 [auto1.fr] INFO: Found listing with ID: GY43936
2026-04-27 07:57:12 [auto1.fr] INFO: Scrape type for GY43936: 2
2026-04-27 07:57:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa16b0e6-16d6-55a9-806c-5cea0841187e with identifier: GY43936
2026-04-27 07:57:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa16b0e6-16d6-55a9-806c-5cea0841187e with scrape type 2
2026-04-27 07:57:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa16b0e6-16d6-55a9-806c-5cea0841187e with scrape type 2
2026-04-27 07:57:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: fa16b0e6-16d6-55a9-806c-5cea0841187e, identifier: GY43936
2026-04-27 07:57:12 [auto1.fr] INFO: Found listing with ID: DK96004
2026-04-27 07:57:12 [auto1.fr] INFO: Scrape type for DK96004: 2
2026-04-27 07:57:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 176d1604-1724-5864-98fd-a6807692e0f6 with identifier: DK96004
2026-04-27 07:57:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 176d1604-1724-5864-98fd-a6807692e0f6 with scrape type 2
2026-04-27 07:57:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 176d1604-1724-5864-98fd-a6807692e0f6 with scrape type 2
2026-04-27 07:57:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 176d1604-1724-5864-98fd-a6807692e0f6, identifier: DK96004
2026-04-27 07:57:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/5c/f05c4ecbff9b32cedb2bfc7c820b6c6b/pa/GN48177_bb9b40297c5349832c287e3b5bf5ea43.jpg not downloaded yet
2026-04-27 07:57:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: fa16b0e6-16d6-55a9-806c-5cea0841187e with identifier: GY43936
2026-04-27 07:57:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: fa16b0e6-16d6-55a9-806c-5cea0841187e with identifier: GY43936
2026-04-27 07:57:13 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:57:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: fa16b0e6-16d6-55a9-806c-5cea0841187e with identifier: GY43936 to the API
2026-04-27 07:57:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:57:13 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:57:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-04-28T15:00:02Z',
 'fuel_type': 'diesel',
 'id': 'fa16b0e6-16d6-55a9-806c-5cea0841187e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GY43936',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'BMW',
 'model': 'X2',
 'odometer': 81083,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2020-11-01',
 'seller_name': None,
 'title': 'BMW X2 xDrive 20d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2020}
2026-04-27 07:57:13 [auto1.fr] INFO: Saving data for GY43936: {'auction_closing_time': 1777388402.0, 'created_time': 1777022700.606919, 'has_photos': True, 'last_price_update_time': 1777276633.292298}
2026-04-27 07:57:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 176d1604-1724-5864-98fd-a6807692e0f6 with identifier: DK96004
2026-04-27 07:57:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 176d1604-1724-5864-98fd-a6807692e0f6 with identifier: DK96004
2026-04-27 07:57:13 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:57:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 176d1604-1724-5864-98fd-a6807692e0f6 with identifier: DK96004 to the API
2026-04-27 07:57:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:57:13 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:57:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-04-28T15:23:48Z',
 'fuel_type': 'diesel',
 'id': '176d1604-1724-5864-98fd-a6807692e0f6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DK96004',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Seat',
 'model': 'Altea',
 'odometer': 183869,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2009-09-28',
 'seller_name': None,
 'title': 'Seat Altea 1.9 TDI Stylance Style',
 'transmission': 'manual',
 'trim': 'Stylance Style',
 'year': 2009}
2026-04-27 07:57:13 [auto1.fr] INFO: Saving data for DK96004: {'auction_closing_time': 1777389828.0, 'created_time': 1777021682.434001, 'has_photos': True, 'last_price_update_time': 1777276633.60315}
2026-04-27 07:57:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/7a/d67a5eaf1b0582aff1abd5e0ef7c8c8f/pa/FK21242_4841d07aad93431d3f5acc42118e7762.jpg not downloaded yet
2026-04-27 07:57:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/c7/53c7850e98ebf83fa98f09bfc65e95c9/pa/FG74412_c66572e04d2184c434f721954e923321.jpg not downloaded yet
2026-04-27 07:57:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/5c/fa5c14669f55b0380cb99369778f61d0/pa/XG74646_7f7d83309ae8bcb6b11fdebd214bd263.jpg not downloaded yet
2026-04-27 07:57:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143804a6d0>
2026-04-27 07:57:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b3da0d2-77e3-5639-b50c-e5651b05b9ac/8b3da0d2-77e3-5639-b50c-e5651b05b9ac_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:57:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/5c/f05c4ecbff9b32cedb2bfc7c820b6c6b/pa/GN48177_2a088b137723173d389e37ad6aec7db0.jpg saved to cache
2026-04-27 07:57:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8b3da0d2-77e3-5639-b50c-e5651b05b9ac
2026-04-27 07:57:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/5c/f05c4ecbff9b32cedb2bfc7c820b6c6b/pa/GN48177_7afb5891c8a95e26d206ddd162099245.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:13 [auto1.fr] INFO: Found listing with ID: EF05565
2026-04-27 07:57:13 [auto1.fr] INFO: Scrape type for EF05565: 1
2026-04-27 07:57:13 [auto1.fr] INFO: Found listing with ID: XB97503
2026-04-27 07:57:13 [auto1.fr] INFO: Scrape type for XB97503: 1
2026-04-27 07:57:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/5c/f05c4ecbff9b32cedb2bfc7c820b6c6b/pa/GN48177_4c2fe0a1149a754bfd65e4f1d44d586f.jpg not downloaded yet
2026-04-27 07:57:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/7a/d67a5eaf1b0582aff1abd5e0ef7c8c8f/pa/FK21242_d918308f82226ec5ba235d4f6050b4dc.jpg not downloaded yet
2026-04-27 07:57:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/c7/53c7850e98ebf83fa98f09bfc65e95c9/pa/FG74412_489caf9fc1e340adc3991869e2eaa0c5.jpg not downloaded yet
2026-04-27 07:57:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/5c/fa5c14669f55b0380cb99369778f61d0/pa/XG74646_6b3b852c82422881909e922ae9307031.jpg not downloaded yet
2026-04-27 07:57:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142be1bf10>
2026-04-27 07:57:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b3da0d2-77e3-5639-b50c-e5651b05b9ac/8b3da0d2-77e3-5639-b50c-e5651b05b9ac_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:57:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/5c/f05c4ecbff9b32cedb2bfc7c820b6c6b/pa/GN48177_45ea7585e310a2e20dd8dd607f4c0200.jpg saved to cache
2026-04-27 07:57:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8b3da0d2-77e3-5639-b50c-e5651b05b9ac
2026-04-27 07:57:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d34c50>
2026-04-27 07:57:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c162a9fe-ffbd-51be-a77e-2ca676622047/c162a9fe-ffbd-51be-a77e-2ca676622047_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:57:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/7a/d67a5eaf1b0582aff1abd5e0ef7c8c8f/pa/FK21242_4c4c4c1e3f3f1c347161e6acaed1f40e.jpg saved to cache
2026-04-27 07:57:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c162a9fe-ffbd-51be-a77e-2ca676622047
2026-04-27 07:57:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/7a/d67a5eaf1b0582aff1abd5e0ef7c8c8f/pa/FK21242_37eceb7825c529ebe9788dd4f978f80a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:13 [auto1.fr] INFO: Found listing with ID: YW93136
2026-04-27 07:57:13 [auto1.fr] INFO: Scrape type for YW93136: 2
2026-04-27 07:57:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 790308d9-2567-5c2e-9ea7-1abd4f4d775a with identifier: YW93136
2026-04-27 07:57:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 790308d9-2567-5c2e-9ea7-1abd4f4d775a with scrape type 2
2026-04-27 07:57:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 790308d9-2567-5c2e-9ea7-1abd4f4d775a with scrape type 2
2026-04-27 07:57:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 790308d9-2567-5c2e-9ea7-1abd4f4d775a, identifier: YW93136
2026-04-27 07:57:14 [auto1.fr] INFO: Found listing with ID: VU62913
2026-04-27 07:57:14 [auto1.fr] INFO: Scrape type for VU62913: 2
2026-04-27 07:57:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c80d4ccf-8729-5e65-8cb5-c57c3f9cef69 with identifier: VU62913
2026-04-27 07:57:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c80d4ccf-8729-5e65-8cb5-c57c3f9cef69 with scrape type 2
2026-04-27 07:57:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c80d4ccf-8729-5e65-8cb5-c57c3f9cef69 with scrape type 2
2026-04-27 07:57:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c80d4ccf-8729-5e65-8cb5-c57c3f9cef69, identifier: VU62913
2026-04-27 07:57:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/5c/f05c4ecbff9b32cedb2bfc7c820b6c6b/pa/GN48177_6b3ac45090ce37affb0f541c64adecef.jpg not downloaded yet
2026-04-27 07:57:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 790308d9-2567-5c2e-9ea7-1abd4f4d775a with identifier: YW93136
2026-04-27 07:57:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 790308d9-2567-5c2e-9ea7-1abd4f4d775a with identifier: YW93136
2026-04-27 07:57:14 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:57:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 790308d9-2567-5c2e-9ea7-1abd4f4d775a with identifier: YW93136 to the API
2026-04-27 07:57:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:57:14 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:57:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-04-28T15:32:26Z',
 'fuel_type': 'diesel',
 'id': '790308d9-2567-5c2e-9ea7-1abd4f4d775a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YW93136',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 113916,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2018-06-25',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 180 d Shooting Brake Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2018}
2026-04-27 07:57:14 [auto1.fr] INFO: Saving data for YW93136: {'auction_closing_time': 1777390346.0, 'created_time': 1777022240.800237, 'has_photos': True, 'last_price_update_time': 1777276634.454462}
2026-04-27 07:57:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c80d4ccf-8729-5e65-8cb5-c57c3f9cef69 with identifier: VU62913
2026-04-27 07:57:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c80d4ccf-8729-5e65-8cb5-c57c3f9cef69 with identifier: VU62913
2026-04-27 07:57:14 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:57:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c80d4ccf-8729-5e65-8cb5-c57c3f9cef69 with identifier: VU62913 to the API
2026-04-27 07:57:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:57:14 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:57:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-04-28T15:59:42Z',
 'fuel_type': 'diesel',
 'id': 'c80d4ccf-8729-5e65-8cb5-c57c3f9cef69',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VU62913',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 158232,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2015-12-20',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Lounge BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Lounge BlueMotion Tech',
 'year': 2015}
2026-04-27 07:57:14 [auto1.fr] INFO: Saving data for VU62913: {'auction_closing_time': 1777391982.0, 'created_time': 1777021819.056294, 'has_photos': True, 'last_price_update_time': 1777276634.857537}
2026-04-27 07:57:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/7a/d67a5eaf1b0582aff1abd5e0ef7c8c8f/pa/FK21242_1010749743a75267181a5360277e3b9f.jpg not downloaded yet
2026-04-27 07:57:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/c7/53c7850e98ebf83fa98f09bfc65e95c9/pa/FG74412_66094e8b0df18c27927a18bdc2d8f957.jpg not downloaded yet
2026-04-27 07:57:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/5c/fa5c14669f55b0380cb99369778f61d0/pa/XG74646_c40853c0f92d6b3929266c4d011a9fb7.jpg not downloaded yet
2026-04-27 07:57:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/5c/f05c4ecbff9b32cedb2bfc7c820b6c6b/pa/GN48177_226bb3d0990e7c726616c93ca6ce5ccc.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:14 [auto1.fr] INFO: Found listing with ID: TS10931
2026-04-27 07:57:14 [auto1.fr] INFO: Scrape type for TS10931: 1
2026-04-27 07:57:14 [auto1.fr] INFO: Found listing with ID: JJ66524
2026-04-27 07:57:14 [auto1.fr] INFO: Scrape type for JJ66524: 2
2026-04-27 07:57:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 400e3e69-d593-5bae-a976-72c4b97f7a7c with identifier: JJ66524
2026-04-27 07:57:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 400e3e69-d593-5bae-a976-72c4b97f7a7c with scrape type 2
2026-04-27 07:57:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 400e3e69-d593-5bae-a976-72c4b97f7a7c with scrape type 2
2026-04-27 07:57:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 400e3e69-d593-5bae-a976-72c4b97f7a7c, identifier: JJ66524
2026-04-27 07:57:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142be15cd0>
2026-04-27 07:57:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b3da0d2-77e3-5639-b50c-e5651b05b9ac/8b3da0d2-77e3-5639-b50c-e5651b05b9ac_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:57:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/5c/f05c4ecbff9b32cedb2bfc7c820b6c6b/pa/GN48177_7afb5891c8a95e26d206ddd162099245.jpg saved to cache
2026-04-27 07:57:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8b3da0d2-77e3-5639-b50c-e5651b05b9ac
2026-04-27 07:57:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/5c/f05c4ecbff9b32cedb2bfc7c820b6c6b/pa/GN48177_bb9b40297c5349832c287e3b5bf5ea43.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 400e3e69-d593-5bae-a976-72c4b97f7a7c with identifier: JJ66524
2026-04-27 07:57:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 400e3e69-d593-5bae-a976-72c4b97f7a7c with identifier: JJ66524
2026-04-27 07:57:15 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:57:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 400e3e69-d593-5bae-a976-72c4b97f7a7c with identifier: JJ66524 to the API
2026-04-27 07:57:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:57:15 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:57:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-04-28T15:36:04Z',
 'fuel_type': 'hybrid',
 'id': '400e3e69-d593-5bae-a976-72c4b97f7a7c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JJ66524',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Cupra',
 'model': 'Leon',
 'odometer': 34685,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2020-12-09',
 'seller_name': None,
 'title': 'Cupra Leon 1.4 e-HYBRID',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-04-27 07:57:15 [auto1.fr] INFO: Saving data for JJ66524: {'auction_closing_time': 1777390564.0, 'created_time': 1777022881.810866, 'has_photos': True, 'last_price_update_time': 1777276635.469408}
2026-04-27 07:57:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/7a/d67a5eaf1b0582aff1abd5e0ef7c8c8f/pa/FK21242_947023434f7ab9022d0ac0485bd6d46d.jpg not downloaded yet
2026-04-27 07:57:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/c7/53c7850e98ebf83fa98f09bfc65e95c9/pa/FG74412_d98f322d043c5f158feeeafa5d9c4d36.jpg not downloaded yet
2026-04-27 07:57:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/5c/fa5c14669f55b0380cb99369778f61d0/pa/XG74646_3d00c37c0f3cb6c84f8e2a05baeb5804.jpg not downloaded yet
2026-04-27 07:57:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438085e10>
2026-04-27 07:57:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c162a9fe-ffbd-51be-a77e-2ca676622047/c162a9fe-ffbd-51be-a77e-2ca676622047_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:57:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/7a/d67a5eaf1b0582aff1abd5e0ef7c8c8f/pa/FK21242_37eceb7825c529ebe9788dd4f978f80a.jpg saved to cache
2026-04-27 07:57:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c162a9fe-ffbd-51be-a77e-2ca676622047
2026-04-27 07:57:15 [auto1.fr] INFO: Found listing with ID: ME18719
2026-04-27 07:57:15 [auto1.fr] INFO: Scrape type for ME18719: 1
2026-04-27 07:57:15 [auto1.fr] INFO: Found listing with ID: FH45650
2026-04-27 07:57:15 [auto1.fr] INFO: Scrape type for FH45650: 1
2026-04-27 07:57:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/5c/f05c4ecbff9b32cedb2bfc7c820b6c6b/pa/GN48177_4c2fe0a1149a754bfd65e4f1d44d586f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/c7/53c7850e98ebf83fa98f09bfc65e95c9/pa/FG74412_985acde5c30021d410166d9e125e7319.jpg not downloaded yet
2026-04-27 07:57:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/5c/fa5c14669f55b0380cb99369778f61d0/pa/XG74646_3f34a8b5eb171a68b03dda1bba048ad1.jpg not downloaded yet
2026-04-27 07:57:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142be0e090>
2026-04-27 07:57:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b3da0d2-77e3-5639-b50c-e5651b05b9ac/8b3da0d2-77e3-5639-b50c-e5651b05b9ac_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:57:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/5c/f05c4ecbff9b32cedb2bfc7c820b6c6b/pa/GN48177_226bb3d0990e7c726616c93ca6ce5ccc.jpg saved to cache
2026-04-27 07:57:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8b3da0d2-77e3-5639-b50c-e5651b05b9ac
2026-04-27 07:57:15 [auto1.fr] INFO: Found listing with ID: WB21909
2026-04-27 07:57:15 [auto1.fr] INFO: Scrape type for WB21909: 2
2026-04-27 07:57:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f719afa5-11ca-5af9-93b9-537c5bc6fd55 with identifier: WB21909
2026-04-27 07:57:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f719afa5-11ca-5af9-93b9-537c5bc6fd55 with scrape type 2
2026-04-27 07:57:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f719afa5-11ca-5af9-93b9-537c5bc6fd55 with scrape type 2
2026-04-27 07:57:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f719afa5-11ca-5af9-93b9-537c5bc6fd55, identifier: WB21909
2026-04-27 07:57:15 [auto1.fr] INFO: Found listing with ID: WB82666
2026-04-27 07:57:15 [auto1.fr] INFO: Scrape type for WB82666: 2
2026-04-27 07:57:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f4a4d7f-9b18-53e1-970a-705ca2e187c1 with identifier: WB82666
2026-04-27 07:57:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f4a4d7f-9b18-53e1-970a-705ca2e187c1 with scrape type 2
2026-04-27 07:57:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1f4a4d7f-9b18-53e1-970a-705ca2e187c1 with scrape type 2
2026-04-27 07:57:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 1f4a4d7f-9b18-53e1-970a-705ca2e187c1, identifier: WB82666
2026-04-27 07:57:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ac5950>
2026-04-27 07:57:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b3da0d2-77e3-5639-b50c-e5651b05b9ac/8b3da0d2-77e3-5639-b50c-e5651b05b9ac_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:57:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/5c/f05c4ecbff9b32cedb2bfc7c820b6c6b/pa/GN48177_bb9b40297c5349832c287e3b5bf5ea43.jpg saved to cache
2026-04-27 07:57:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8b3da0d2-77e3-5639-b50c-e5651b05b9ac
2026-04-27 07:57:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f719afa5-11ca-5af9-93b9-537c5bc6fd55 with identifier: WB21909
2026-04-27 07:57:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f719afa5-11ca-5af9-93b9-537c5bc6fd55 with identifier: WB21909
2026-04-27 07:57:16 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:57:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f719afa5-11ca-5af9-93b9-537c5bc6fd55 with identifier: WB21909 to the API
2026-04-27 07:57:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:57:16 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:57:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-04-28T15:59:46Z',
 'fuel_type': 'petrol',
 'id': 'f719afa5-11ca-5af9-93b9-537c5bc6fd55',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WB21909',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Fiat',
 'model': '500X',
 'odometer': 104381,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2016-04-27',
 'seller_name': None,
 'title': 'Fiat 500X 1.4 Turbo Pop Star',
 'transmission': 'manual',
 'trim': 'Pop Star',
 'year': 2016}
2026-04-27 07:57:16 [auto1.fr] INFO: Saving data for WB21909: {'auction_closing_time': 1777391986.0, 'created_time': 1777022681.049553, 'has_photos': True, 'last_price_update_time': 1777276636.314027}
2026-04-27 07:57:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 1f4a4d7f-9b18-53e1-970a-705ca2e187c1 with identifier: WB82666
2026-04-27 07:57:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 1f4a4d7f-9b18-53e1-970a-705ca2e187c1 with identifier: WB82666
2026-04-27 07:57:16 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:57:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 1f4a4d7f-9b18-53e1-970a-705ca2e187c1 with identifier: WB82666 to the API
2026-04-27 07:57:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:57:16 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:57:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-04-28T15:09:01Z',
 'fuel_type': 'petrol',
 'id': '1f4a4d7f-9b18-53e1-970a-705ca2e187c1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WB82666',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Peugeot',
 'model': '208',
 'odometer': 66038,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2019-11-27',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2019}
2026-04-27 07:57:16 [auto1.fr] INFO: Saving data for WB82666: {'auction_closing_time': 1777388941.0, 'created_time': 1777020828.459806, 'has_photos': True, 'last_price_update_time': 1777276636.664975}
2026-04-27 07:57:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/c7/53c7850e98ebf83fa98f09bfc65e95c9/pa/FG74412_8396aea4ccc255082a3ec69260ebd266.jpg not downloaded yet
2026-04-27 07:57:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/5c/fa5c14669f55b0380cb99369778f61d0/pa/XG74646_c40853c0f92d6b3929266c4d011a9fb7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:16 [auto1.fr] INFO: Found listing with ID: PD22801
2026-04-27 07:57:16 [auto1.fr] INFO: Scrape type for PD22801: 2
2026-04-27 07:57:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52985053-fa9a-5f81-a129-75693753d021 with identifier: PD22801
2026-04-27 07:57:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52985053-fa9a-5f81-a129-75693753d021 with scrape type 2
2026-04-27 07:57:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 52985053-fa9a-5f81-a129-75693753d021 with scrape type 2
2026-04-27 07:57:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 52985053-fa9a-5f81-a129-75693753d021, identifier: PD22801
2026-04-27 07:57:16 [auto1.fr] INFO: Found listing with ID: ZL15775
2026-04-27 07:57:16 [auto1.fr] INFO: Scrape type for ZL15775: 2
2026-04-27 07:57:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 581af0e1-825b-531b-9738-b6aeefc7513a with identifier: ZL15775
2026-04-27 07:57:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 581af0e1-825b-531b-9738-b6aeefc7513a with scrape type 2
2026-04-27 07:57:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 581af0e1-825b-531b-9738-b6aeefc7513a with scrape type 2
2026-04-27 07:57:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 581af0e1-825b-531b-9738-b6aeefc7513a, identifier: ZL15775
2026-04-27 07:57:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/5c/f05c4ecbff9b32cedb2bfc7c820b6c6b/pa/GN48177_6b3ac45090ce37affb0f541c64adecef.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 52985053-fa9a-5f81-a129-75693753d021 with identifier: PD22801
2026-04-27 07:57:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 52985053-fa9a-5f81-a129-75693753d021 with identifier: PD22801
2026-04-27 07:57:17 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:57:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 52985053-fa9a-5f81-a129-75693753d021 with identifier: PD22801 to the API
2026-04-27 07:57:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:57:17 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:57:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-04-28T15:38:28Z',
 'fuel_type': 'hybrid',
 'id': '52985053-fa9a-5f81-a129-75693753d021',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PD22801',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Renault',
 'model': 'Arkana',
 'odometer': 185323,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2021-09-12',
 'seller_name': None,
 'title': 'Renault Arkana 1.6 Hybrid E-Tech Business',
 'transmission': 'automatic',
 'trim': 'Business',
 'year': 2021}
2026-04-27 07:57:17 [auto1.fr] INFO: Saving data for PD22801: {'auction_closing_time': 1777390708.0, 'created_time': 1777021829.6216, 'has_photos': True, 'last_price_update_time': 1777276637.296704}
2026-04-27 07:57:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 581af0e1-825b-531b-9738-b6aeefc7513a with identifier: ZL15775
2026-04-27 07:57:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 581af0e1-825b-531b-9738-b6aeefc7513a with identifier: ZL15775
2026-04-27 07:57:17 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:57:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 581af0e1-825b-531b-9738-b6aeefc7513a with identifier: ZL15775 to the API
2026-04-27 07:57:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:57:17 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:57:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-04-28T15:51:24Z',
 'fuel_type': 'diesel',
 'id': '581af0e1-825b-531b-9738-b6aeefc7513a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZL15775',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 311593,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2014-01-23',
 'seller_name': None,
 'title': 'Seat Leon 2.0 TDI FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2014}
2026-04-27 07:57:17 [auto1.fr] INFO: Saving data for ZL15775: {'auction_closing_time': 1777391484.0, 'created_time': 1777022488.947979, 'has_photos': True, 'last_price_update_time': 1777276637.642395}
2026-04-27 07:57:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/c7/53c7850e98ebf83fa98f09bfc65e95c9/pa/FG74412_aa68b6c2fdc499d46288faf937e7a06f.jpg not downloaded yet
2026-04-27 07:57:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/5c/fa5c14669f55b0380cb99369778f61d0/pa/XG74646_3d00c37c0f3cb6c84f8e2a05baeb5804.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:17 [auto1.fr] INFO: Found listing with ID: TJ83398
2026-04-27 07:57:17 [auto1.fr] INFO: Scrape type for TJ83398: 2
2026-04-27 07:57:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2700ab97-075d-5620-b2fa-b5ec2dda823e with identifier: TJ83398
2026-04-27 07:57:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2700ab97-075d-5620-b2fa-b5ec2dda823e with scrape type 2
2026-04-27 07:57:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2700ab97-075d-5620-b2fa-b5ec2dda823e with scrape type 2
2026-04-27 07:57:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2700ab97-075d-5620-b2fa-b5ec2dda823e, identifier: TJ83398
2026-04-27 07:57:17 [auto1.fr] INFO: Found listing with ID: VP03638
2026-04-27 07:57:17 [auto1.fr] INFO: Scrape type for VP03638: 2
2026-04-27 07:57:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f396f232-1761-507f-aad5-44254dd4205c with identifier: VP03638
2026-04-27 07:57:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f396f232-1761-507f-aad5-44254dd4205c with scrape type 2
2026-04-27 07:57:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f396f232-1761-507f-aad5-44254dd4205c with scrape type 2
2026-04-27 07:57:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f396f232-1761-507f-aad5-44254dd4205c, identifier: VP03638
2026-04-27 07:57:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c3b210>
2026-04-27 07:57:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b3da0d2-77e3-5639-b50c-e5651b05b9ac/8b3da0d2-77e3-5639-b50c-e5651b05b9ac_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:57:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/5c/f05c4ecbff9b32cedb2bfc7c820b6c6b/pa/GN48177_4c2fe0a1149a754bfd65e4f1d44d586f.jpg saved to cache
2026-04-27 07:57:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8b3da0d2-77e3-5639-b50c-e5651b05b9ac
2026-04-27 07:57:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2700ab97-075d-5620-b2fa-b5ec2dda823e with identifier: TJ83398
2026-04-27 07:57:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2700ab97-075d-5620-b2fa-b5ec2dda823e with identifier: TJ83398
2026-04-27 07:57:18 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:57:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2700ab97-075d-5620-b2fa-b5ec2dda823e with identifier: TJ83398 to the API
2026-04-27 07:57:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:57:18 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:57:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 110,
 'expiration_date': '2026-04-28T15:39:08Z',
 'fuel_type': 'diesel',
 'id': '2700ab97-075d-5620-b2fa-b5ec2dda823e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TJ83398',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Peugeot',
 'model': '207',
 'odometer': 267728,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2011-03-24',
 'seller_name': None,
 'title': 'Peugeot 207 1.6 HDi Sport Pack',
 'transmission': 'manual',
 'trim': 'Sport Pack',
 'year': 2011}
2026-04-27 07:57:18 [auto1.fr] INFO: Saving data for TJ83398: {'auction_closing_time': 1777390748.0, 'created_time': 1777020598.326174, 'has_photos': True, 'last_price_update_time': 1777276638.273528}
2026-04-27 07:57:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f396f232-1761-507f-aad5-44254dd4205c with identifier: VP03638
2026-04-27 07:57:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f396f232-1761-507f-aad5-44254dd4205c with identifier: VP03638
2026-04-27 07:57:18 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:57:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f396f232-1761-507f-aad5-44254dd4205c with identifier: VP03638 to the API
2026-04-27 07:57:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:57:18 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:57:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-04-28T15:37:59Z',
 'fuel_type': 'hybrid',
 'id': 'f396f232-1761-507f-aad5-44254dd4205c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VP03638',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 128247,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2023-02-06',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.5 VC-T e-POWER Tekna',
 'transmission': 'automatic',
 'trim': 'Tekna',
 'year': 2023}
2026-04-27 07:57:18 [auto1.fr] INFO: Saving data for VP03638: {'auction_closing_time': 1777390679.0, 'created_time': 1777021540.009115, 'has_photos': True, 'last_price_update_time': 1777276638.616155}
2026-04-27 07:57:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/c7/53c7850e98ebf83fa98f09bfc65e95c9/pa/FG74412_609bd4fc2add0f355fc4c5d53f42bed2.jpg not downloaded yet
2026-04-27 07:57:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380846d0>
2026-04-27 07:57:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09b54c5f-3e76-57a6-b73f-1614347216ec/09b54c5f-3e76-57a6-b73f-1614347216ec_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:57:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/5c/fa5c14669f55b0380cb99369778f61d0/pa/XG74646_c40853c0f92d6b3929266c4d011a9fb7.jpg saved to cache
2026-04-27 07:57:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 09b54c5f-3e76-57a6-b73f-1614347216ec
2026-04-27 07:57:18 [auto1.fr] INFO: Found listing with ID: FP34263
2026-04-27 07:57:18 [auto1.fr] INFO: Scrape type for FP34263: 2
2026-04-27 07:57:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: beeee632-fd87-5794-966f-548cb3b38dd2 with identifier: FP34263
2026-04-27 07:57:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item beeee632-fd87-5794-966f-548cb3b38dd2 with scrape type 2
2026-04-27 07:57:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item beeee632-fd87-5794-966f-548cb3b38dd2 with scrape type 2
2026-04-27 07:57:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: beeee632-fd87-5794-966f-548cb3b38dd2, identifier: FP34263
2026-04-27 07:57:18 [auto1.fr] INFO: Found listing with ID: NE15384
2026-04-27 07:57:18 [auto1.fr] INFO: Scrape type for NE15384: 2
2026-04-27 07:57:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd3ff358-a2ab-5aa4-9ab8-ca296c33a15a with identifier: NE15384
2026-04-27 07:57:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd3ff358-a2ab-5aa4-9ab8-ca296c33a15a with scrape type 2
2026-04-27 07:57:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd3ff358-a2ab-5aa4-9ab8-ca296c33a15a with scrape type 2
2026-04-27 07:57:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: cd3ff358-a2ab-5aa4-9ab8-ca296c33a15a, identifier: NE15384
2026-04-27 07:57:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/c7/53c7850e98ebf83fa98f09bfc65e95c9/pa/FG74412_8396aea4ccc255082a3ec69260ebd266.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/5c/fa5c14669f55b0380cb99369778f61d0/pa/XG74646_3f34a8b5eb171a68b03dda1bba048ad1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: beeee632-fd87-5794-966f-548cb3b38dd2 with identifier: FP34263
2026-04-27 07:57:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: beeee632-fd87-5794-966f-548cb3b38dd2 with identifier: FP34263
2026-04-27 07:57:19 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:57:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: beeee632-fd87-5794-966f-548cb3b38dd2 with identifier: FP34263 to the API
2026-04-27 07:57:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:57:19 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:57:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-04-28T15:54:04Z',
 'fuel_type': 'diesel',
 'id': 'beeee632-fd87-5794-966f-548cb3b38dd2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FP34263',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 143680,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2007-10-21',
 'seller_name': None,
 'title': 'Volkswagen Golf V 1.9 TDI Tour',
 'transmission': 'manual',
 'trim': 'Tour',
 'year': 2007}
2026-04-27 07:57:19 [auto1.fr] INFO: Saving data for FP34263: {'auction_closing_time': 1777391644.0, 'created_time': 1777022572.784689, 'has_photos': True, 'last_price_update_time': 1777276639.268616}
2026-04-27 07:57:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: cd3ff358-a2ab-5aa4-9ab8-ca296c33a15a with identifier: NE15384
2026-04-27 07:57:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: cd3ff358-a2ab-5aa4-9ab8-ca296c33a15a with identifier: NE15384
2026-04-27 07:57:19 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:57:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: cd3ff358-a2ab-5aa4-9ab8-ca296c33a15a with identifier: NE15384 to the API
2026-04-27 07:57:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:57:19 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:57:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-04-28T15:24:21Z',
 'fuel_type': 'petrol',
 'id': 'cd3ff358-a2ab-5aa4-9ab8-ca296c33a15a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NE15384',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 199295,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2015-04-10',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 TSI Cup BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Cup BlueMotion Tech',
 'year': 2015}
2026-04-27 07:57:19 [auto1.fr] INFO: Saving data for NE15384: {'auction_closing_time': 1777389861.0, 'created_time': 1777019936.728975, 'has_photos': True, 'last_price_update_time': 1777276639.741344}
2026-04-27 07:57:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/c7/53c7850e98ebf83fa98f09bfc65e95c9/pa/FG74412_28fbfdea3f68e7d8ff0acbd1d1b153b6.jpg not downloaded yet
2026-04-27 07:57:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ec1990>
2026-04-27 07:57:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b3da0d2-77e3-5639-b50c-e5651b05b9ac/8b3da0d2-77e3-5639-b50c-e5651b05b9ac_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:57:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/5c/f05c4ecbff9b32cedb2bfc7c820b6c6b/pa/GN48177_6b3ac45090ce37affb0f541c64adecef.jpg saved to cache
2026-04-27 07:57:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8b3da0d2-77e3-5639-b50c-e5651b05b9ac
2026-04-27 07:57:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438eaa6d0>
2026-04-27 07:57:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09b54c5f-3e76-57a6-b73f-1614347216ec/09b54c5f-3e76-57a6-b73f-1614347216ec_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:57:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/5c/fa5c14669f55b0380cb99369778f61d0/pa/XG74646_3d00c37c0f3cb6c84f8e2a05baeb5804.jpg saved to cache
2026-04-27 07:57:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 09b54c5f-3e76-57a6-b73f-1614347216ec
2026-04-27 07:57:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/c7/53c7850e98ebf83fa98f09bfc65e95c9/pa/FG74412_985acde5c30021d410166d9e125e7319.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:19 [auto1.fr] INFO: Found listing with ID: BB34695
2026-04-27 07:57:19 [auto1.fr] INFO: Scrape type for BB34695: 1
2026-04-27 07:57:19 [auto1.fr] INFO: Found listing with ID: ZE79634
2026-04-27 07:57:19 [auto1.fr] INFO: Scrape type for ZE79634: 1
2026-04-27 07:57:19 [auto1.fr] INFO: Found listing with ID: DU50792
2026-04-27 07:57:19 [auto1.fr] INFO: Scrape type for DU50792: 2
2026-04-27 07:57:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc3078a5-0aa8-5ad3-b1cc-21b96027f50b with identifier: DU50792
2026-04-27 07:57:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc3078a5-0aa8-5ad3-b1cc-21b96027f50b with scrape type 2
2026-04-27 07:57:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc3078a5-0aa8-5ad3-b1cc-21b96027f50b with scrape type 2
2026-04-27 07:57:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: fc3078a5-0aa8-5ad3-b1cc-21b96027f50b, identifier: DU50792
2026-04-27 07:57:20 [auto1.fr] INFO: Found listing with ID: SE73326
2026-04-27 07:57:20 [auto1.fr] INFO: Scrape type for SE73326: 2
2026-04-27 07:57:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a363bb9-de20-5d1b-84d3-eaa69274564d with identifier: SE73326
2026-04-27 07:57:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a363bb9-de20-5d1b-84d3-eaa69274564d with scrape type 2
2026-04-27 07:57:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6a363bb9-de20-5d1b-84d3-eaa69274564d with scrape type 2
2026-04-27 07:57:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6a363bb9-de20-5d1b-84d3-eaa69274564d, identifier: SE73326
2026-04-27 07:57:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d34210>
2026-04-27 07:57:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32a10a69-6d3d-53e2-acca-ed359ef2b418/32a10a69-6d3d-53e2-acca-ed359ef2b418_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:57:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/c7/53c7850e98ebf83fa98f09bfc65e95c9/pa/FG74412_8396aea4ccc255082a3ec69260ebd266.jpg saved to cache
2026-04-27 07:57:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 32a10a69-6d3d-53e2-acca-ed359ef2b418
2026-04-27 07:57:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438eff010>
2026-04-27 07:57:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09b54c5f-3e76-57a6-b73f-1614347216ec/09b54c5f-3e76-57a6-b73f-1614347216ec_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:57:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/5c/fa5c14669f55b0380cb99369778f61d0/pa/XG74646_3f34a8b5eb171a68b03dda1bba048ad1.jpg saved to cache
2026-04-27 07:57:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 09b54c5f-3e76-57a6-b73f-1614347216ec
2026-04-27 07:57:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: fc3078a5-0aa8-5ad3-b1cc-21b96027f50b with identifier: DU50792
2026-04-27 07:57:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: fc3078a5-0aa8-5ad3-b1cc-21b96027f50b with identifier: DU50792
2026-04-27 07:57:20 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:57:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: fc3078a5-0aa8-5ad3-b1cc-21b96027f50b with identifier: DU50792 to the API
2026-04-27 07:57:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:57:20 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:57:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-04-28T15:26:42Z',
 'fuel_type': 'diesel',
 'id': 'fc3078a5-0aa8-5ad3-b1cc-21b96027f50b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DU50792',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 150260,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2017-10-17',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Highline 4Motion BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion BlueMotion Tech',
 'year': 2017}
2026-04-27 07:57:20 [auto1.fr] INFO: Saving data for DU50792: {'auction_closing_time': 1777390002.0, 'created_time': 1777021435.409006, 'has_photos': True, 'last_price_update_time': 1777276640.544213}
2026-04-27 07:57:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6a363bb9-de20-5d1b-84d3-eaa69274564d with identifier: SE73326
2026-04-27 07:57:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6a363bb9-de20-5d1b-84d3-eaa69274564d with identifier: SE73326
2026-04-27 07:57:20 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:57:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6a363bb9-de20-5d1b-84d3-eaa69274564d with identifier: SE73326 to the API
2026-04-27 07:57:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:57:20 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:57:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-04-28T15:21:12Z',
 'fuel_type': 'petrol',
 'id': '6a363bb9-de20-5d1b-84d3-eaa69274564d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SE73326',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 63708,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2021-05-20',
 'seller_name': None,
 'title': 'Opel Astra 1.2 Turbo Edition Start/Stop',
 'transmission': 'manual',
 'trim': 'Edition Start/Stop',
 'year': 2021}
2026-04-27 07:57:20 [auto1.fr] INFO: Saving data for SE73326: {'auction_closing_time': 1777389672.0, 'created_time': 1777022239.395698, 'has_photos': True, 'last_price_update_time': 1777276640.839179}
2026-04-27 07:57:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/c7/53c7850e98ebf83fa98f09bfc65e95c9/pa/FG74412_609bd4fc2add0f355fc4c5d53f42bed2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/c7/53c7850e98ebf83fa98f09bfc65e95c9/pa/FG74412_aa68b6c2fdc499d46288faf937e7a06f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:20 [auto1.fr] INFO: Found listing with ID: SM61335
2026-04-27 07:57:20 [auto1.fr] INFO: Scrape type for SM61335: 1
2026-04-27 07:57:20 [auto1.fr] INFO: Found listing with ID: BL04872
2026-04-27 07:57:20 [auto1.fr] INFO: Scrape type for BL04872: 2
2026-04-27 07:57:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8dd17d71-27f4-5e52-ab48-c5d384512354 with identifier: BL04872
2026-04-27 07:57:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8dd17d71-27f4-5e52-ab48-c5d384512354 with scrape type 2
2026-04-27 07:57:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8dd17d71-27f4-5e52-ab48-c5d384512354 with scrape type 2
2026-04-27 07:57:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8dd17d71-27f4-5e52-ab48-c5d384512354, identifier: BL04872
2026-04-27 07:57:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8dd17d71-27f4-5e52-ab48-c5d384512354 with identifier: BL04872
2026-04-27 07:57:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8dd17d71-27f4-5e52-ab48-c5d384512354 with identifier: BL04872
2026-04-27 07:57:21 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:57:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 8dd17d71-27f4-5e52-ab48-c5d384512354 with identifier: BL04872 to the API
2026-04-27 07:57:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:57:21 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:57:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-04-28T15:57:00Z',
 'fuel_type': 'diesel',
 'id': '8dd17d71-27f4-5e52-ab48-c5d384512354',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BL04872',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Citroen',
 'model': 'C4 Aircross',
 'odometer': 227240,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2013-03-26',
 'seller_name': None,
 'title': 'Citroen C4 Aircross 1.6 HDi Confort 4x4',
 'transmission': 'manual',
 'trim': 'Confort 4x4',
 'year': 2013}
2026-04-27 07:57:21 [auto1.fr] INFO: Saving data for BL04872: {'auction_closing_time': 1777391820.0, 'created_time': 1777022411.551592, 'has_photos': True, 'last_price_update_time': 1777276641.280966}
2026-04-27 07:57:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f144750c950>
2026-04-27 07:57:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32a10a69-6d3d-53e2-acca-ed359ef2b418/32a10a69-6d3d-53e2-acca-ed359ef2b418_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:57:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/c7/53c7850e98ebf83fa98f09bfc65e95c9/pa/FG74412_985acde5c30021d410166d9e125e7319.jpg saved to cache
2026-04-27 07:57:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 32a10a69-6d3d-53e2-acca-ed359ef2b418
2026-04-27 07:57:21 [auto1.fr] INFO: Found listing with ID: TX67186
2026-04-27 07:57:21 [auto1.fr] INFO: Scrape type for TX67186: 1
2026-04-27 07:57:21 [auto1.fr] INFO: Found listing with ID: XW75844
2026-04-27 07:57:21 [auto1.fr] INFO: Scrape type for XW75844: 1
2026-04-27 07:57:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ac5c90>
2026-04-27 07:57:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32a10a69-6d3d-53e2-acca-ed359ef2b418/32a10a69-6d3d-53e2-acca-ed359ef2b418_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:57:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/c7/53c7850e98ebf83fa98f09bfc65e95c9/pa/FG74412_609bd4fc2add0f355fc4c5d53f42bed2.jpg saved to cache
2026-04-27 07:57:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 32a10a69-6d3d-53e2-acca-ed359ef2b418
2026-04-27 07:57:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d2fb90>
2026-04-27 07:57:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32a10a69-6d3d-53e2-acca-ed359ef2b418/32a10a69-6d3d-53e2-acca-ed359ef2b418_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:57:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/c7/53c7850e98ebf83fa98f09bfc65e95c9/pa/FG74412_aa68b6c2fdc499d46288faf937e7a06f.jpg saved to cache
2026-04-27 07:57:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 32a10a69-6d3d-53e2-acca-ed359ef2b418
2026-04-27 07:57:21 [auto1.fr] INFO: Found listing with ID: BC53965
2026-04-27 07:57:21 [auto1.fr] INFO: Scrape type for BC53965: 2
2026-04-27 07:57:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40df4bd9-a2ca-5151-b01e-5c3d44cbcb8b with identifier: BC53965
2026-04-27 07:57:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40df4bd9-a2ca-5151-b01e-5c3d44cbcb8b with scrape type 2
2026-04-27 07:57:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40df4bd9-a2ca-5151-b01e-5c3d44cbcb8b with scrape type 2
2026-04-27 07:57:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 40df4bd9-a2ca-5151-b01e-5c3d44cbcb8b, identifier: BC53965
2026-04-27 07:57:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 40df4bd9-a2ca-5151-b01e-5c3d44cbcb8b with identifier: BC53965
2026-04-27 07:57:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 40df4bd9-a2ca-5151-b01e-5c3d44cbcb8b with identifier: BC53965
2026-04-27 07:57:21 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:57:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 40df4bd9-a2ca-5151-b01e-5c3d44cbcb8b with identifier: BC53965 to the API
2026-04-27 07:57:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:57:21 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:57:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-04-28T15:07:11Z',
 'fuel_type': 'diesel',
 'id': '40df4bd9-a2ca-5151-b01e-5c3d44cbcb8b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BC53965',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 61613,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2011-02-27',
 'seller_name': None,
 'title': 'Renault Twingo 1.5 dCi Authentique',
 'transmission': 'manual',
 'trim': 'Authentique',
 'year': 2011}
2026-04-27 07:57:21 [auto1.fr] INFO: Saving data for BC53965: {'auction_closing_time': 1777388831.0, 'created_time': 1777020990.322631, 'has_photos': True, 'last_price_update_time': 1777276641.821443}
2026-04-27 07:57:21 [auto1.fr] INFO: Found listing with ID: US13669
2026-04-27 07:57:21 [auto1.fr] INFO: Scrape type for US13669: 1
2026-04-27 07:57:21 [auto1.fr] INFO: Found listing with ID: FG18910
2026-04-27 07:57:21 [auto1.fr] INFO: Scrape type for FG18910: 2
2026-04-27 07:57:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1a61706-0203-5bc0-8720-6bdbb92c82f0 with identifier: FG18910
2026-04-27 07:57:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1a61706-0203-5bc0-8720-6bdbb92c82f0 with scrape type 2
2026-04-27 07:57:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b1a61706-0203-5bc0-8720-6bdbb92c82f0 with scrape type 2
2026-04-27 07:57:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b1a61706-0203-5bc0-8720-6bdbb92c82f0, identifier: FG18910
2026-04-27 07:57:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b1a61706-0203-5bc0-8720-6bdbb92c82f0 with identifier: FG18910
2026-04-27 07:57:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b1a61706-0203-5bc0-8720-6bdbb92c82f0 with identifier: FG18910
2026-04-27 07:57:22 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:57:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b1a61706-0203-5bc0-8720-6bdbb92c82f0 with identifier: FG18910 to the API
2026-04-27 07:57:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:57:22 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:57:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-04-28T15:31:48Z',
 'fuel_type': 'petrol',
 'id': 'b1a61706-0203-5bc0-8720-6bdbb92c82f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FG18910',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Ford',
 'model': 'C-Max',
 'odometer': 141806,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2013-09-25',
 'seller_name': None,
 'title': 'Ford C-Max 1.0 EcoBoost Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2013}
2026-04-27 07:57:22 [auto1.fr] INFO: Saving data for FG18910: {'auction_closing_time': 1777390308.0, 'created_time': 1777023085.036155, 'has_photos': True, 'last_price_update_time': 1777276642.242544}
2026-04-27 07:57:22 [auto1.fr] INFO: Found listing with ID: KK28971
2026-04-27 07:57:22 [auto1.fr] INFO: Scrape type for KK28971: 1
2026-04-27 07:57:22 [auto1.fr] INFO: Found listing with ID: YT25917
2026-04-27 07:57:22 [auto1.fr] INFO: Scrape type for YT25917: 2
2026-04-27 07:57:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd70afca-425e-51d9-a413-98a46b76568d with identifier: YT25917
2026-04-27 07:57:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd70afca-425e-51d9-a413-98a46b76568d with scrape type 2
2026-04-27 07:57:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bd70afca-425e-51d9-a413-98a46b76568d with scrape type 2
2026-04-27 07:57:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: bd70afca-425e-51d9-a413-98a46b76568d, identifier: YT25917
2026-04-27 07:57:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: bd70afca-425e-51d9-a413-98a46b76568d with identifier: YT25917
2026-04-27 07:57:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: bd70afca-425e-51d9-a413-98a46b76568d with identifier: YT25917
2026-04-27 07:57:22 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:57:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: bd70afca-425e-51d9-a413-98a46b76568d with identifier: YT25917 to the API
2026-04-27 07:57:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:57:22 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:57:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 95,
 'expiration_date': '2026-04-28T15:42:01Z',
 'fuel_type': 'diesel',
 'id': 'bd70afca-425e-51d9-a413-98a46b76568d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YT25917',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Fiat',
 'model': '500',
 'odometer': 121088,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2017-05-30',
 'seller_name': None,
 'title': 'Fiat 500 1.3 M-Jet Club',
 'transmission': 'manual',
 'trim': 'Club',
 'year': 2017}
2026-04-27 07:57:22 [auto1.fr] INFO: Saving data for YT25917: {'auction_closing_time': 1777390921.0, 'created_time': 1777019176.876581, 'has_photos': True, 'last_price_update_time': 1777276642.726105}
2026-04-27 07:57:22 [auto1.fr] INFO: Found listing with ID: NS26210
2026-04-27 07:57:22 [auto1.fr] INFO: Scrape type for NS26210: 2
2026-04-27 07:57:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00502b49-f0a0-521a-a99e-20935f7fc2c9 with identifier: NS26210
2026-04-27 07:57:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00502b49-f0a0-521a-a99e-20935f7fc2c9 with scrape type 2
2026-04-27 07:57:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 00502b49-f0a0-521a-a99e-20935f7fc2c9 with scrape type 2
2026-04-27 07:57:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 00502b49-f0a0-521a-a99e-20935f7fc2c9, identifier: NS26210
2026-04-27 07:57:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 00502b49-f0a0-521a-a99e-20935f7fc2c9 with identifier: NS26210
2026-04-27 07:57:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 00502b49-f0a0-521a-a99e-20935f7fc2c9 with identifier: NS26210
2026-04-27 07:57:22 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:57:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 00502b49-f0a0-521a-a99e-20935f7fc2c9 with identifier: NS26210 to the API
2026-04-27 07:57:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:57:22 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:57:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-04-28T15:57:31Z',
 'fuel_type': 'petrol',
 'id': '00502b49-f0a0-521a-a99e-20935f7fc2c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NS26210',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 68723,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2018-08-06',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.2 Tekna +',
 'transmission': 'automatic',
 'trim': 'Tekna +',
 'year': 2018}
2026-04-27 07:57:23 [auto1.fr] INFO: Saving data for NS26210: {'auction_closing_time': 1777391851.0, 'created_time': 1777022493.345948, 'has_photos': True, 'last_price_update_time': 1777276643.109468}
2026-04-27 07:57:23 [auto1.fr] INFO: Found listing with ID: FW66356
2026-04-27 07:57:23 [auto1.fr] INFO: Scrape type for FW66356: 1
2026-04-27 07:57:23 [auto1.fr] INFO: Found listing with ID: VS85106
2026-04-27 07:57:23 [auto1.fr] INFO: Scrape type for VS85106: 1
2026-04-27 07:57:23 [auto1.fr] INFO: Found listing with ID: XE23390
2026-04-27 07:57:23 [auto1.fr] INFO: Scrape type for XE23390: 1
2026-04-27 07:57:23 [auto1.fr] INFO: Found listing with ID: AA48290
2026-04-27 07:57:23 [auto1.fr] INFO: Scrape type for AA48290: 1
2026-04-27 07:57:23 [auto1.fr] INFO: Found listing with ID: MB92679
2026-04-27 07:57:23 [auto1.fr] INFO: Scrape type for MB92679: 1
2026-04-27 07:57:23 [auto1.fr] INFO: Found listing with ID: AD72789
2026-04-27 07:57:23 [auto1.fr] INFO: Scrape type for AD72789: 2
2026-04-27 07:57:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a901e17-783a-53ff-9397-4e9965f7b8b4 with identifier: AD72789
2026-04-27 07:57:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a901e17-783a-53ff-9397-4e9965f7b8b4 with scrape type 2
2026-04-27 07:57:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a901e17-783a-53ff-9397-4e9965f7b8b4 with scrape type 2
2026-04-27 07:57:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5a901e17-783a-53ff-9397-4e9965f7b8b4, identifier: AD72789
2026-04-27 07:57:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5a901e17-783a-53ff-9397-4e9965f7b8b4 with identifier: AD72789
2026-04-27 07:57:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5a901e17-783a-53ff-9397-4e9965f7b8b4 with identifier: AD72789
2026-04-27 07:57:23 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:57:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 5a901e17-783a-53ff-9397-4e9965f7b8b4 with identifier: AD72789 to the API
2026-04-27 07:57:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:57:23 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:57:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 145,
 'expiration_date': '2026-04-28T15:36:05Z',
 'fuel_type': 'petrol',
 'id': '5a901e17-783a-53ff-9397-4e9965f7b8b4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AD72789',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Abarth',
 'model': '595',
 'odometer': 62078,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2016-12-20',
 'seller_name': None,
 'title': 'Abarth 595 1.4 Turbo',
 'transmission': 'manual',
 'trim': '',
 'year': 2016}
2026-04-27 07:57:23 [auto1.fr] INFO: Saving data for AD72789: {'auction_closing_time': 1777390565.0, 'created_time': 1777020430.041099, 'has_photos': True, 'last_price_update_time': 1777276643.599113}
2026-04-27 07:57:23 [auto1.fr] INFO: Found listing with ID: RL62627
2026-04-27 07:57:23 [auto1.fr] INFO: Scrape type for RL62627: 1
2026-04-27 07:57:23 [auto1.fr] INFO: Found listing with ID: WB55099
2026-04-27 07:57:23 [auto1.fr] INFO: Scrape type for WB55099: 1
2026-04-27 07:57:23 [auto1.fr] INFO: Found listing with ID: LW97078
2026-04-27 07:57:23 [auto1.fr] INFO: Scrape type for LW97078: 1
2026-04-27 07:57:23 [auto1.fr] INFO: Found listing with ID: ZT15844
2026-04-27 07:57:23 [auto1.fr] INFO: Scrape type for ZT15844: 2
2026-04-27 07:57:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd0ca302-d8a8-5a56-a13f-723d6bde85f0 with identifier: ZT15844
2026-04-27 07:57:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd0ca302-d8a8-5a56-a13f-723d6bde85f0 with scrape type 2
2026-04-27 07:57:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd0ca302-d8a8-5a56-a13f-723d6bde85f0 with scrape type 2
2026-04-27 07:57:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: cd0ca302-d8a8-5a56-a13f-723d6bde85f0, identifier: ZT15844
2026-04-27 07:57:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: cd0ca302-d8a8-5a56-a13f-723d6bde85f0 with identifier: ZT15844
2026-04-27 07:57:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: cd0ca302-d8a8-5a56-a13f-723d6bde85f0 with identifier: ZT15844
2026-04-27 07:57:23 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:57:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: cd0ca302-d8a8-5a56-a13f-723d6bde85f0 with identifier: ZT15844 to the API
2026-04-27 07:57:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:57:23 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:57:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-04-28T15:50:52Z',
 'fuel_type': 'diesel',
 'id': 'cd0ca302-d8a8-5a56-a13f-723d6bde85f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZT15844',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 150239,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2015-05-19',
 'seller_name': None,
 'title': 'Peugeot 2008 1.6 Blue-HDi Crossway',
 'transmission': 'manual',
 'trim': 'Crossway',
 'year': 2015}
2026-04-27 07:57:24 [auto1.fr] INFO: Saving data for ZT15844: {'auction_closing_time': 1777391452.0, 'created_time': 1770811069.441273, 'has_photos': False, 'last_price_update_time': 1777276644.036777}
2026-04-27 07:57:24 [auto1.fr] INFO: Found listing with ID: LS92623
2026-04-27 07:57:24 [auto1.fr] INFO: Scrape type for LS92623: 1
2026-04-27 07:57:24 [auto1.fr] INFO: Found listing with ID: PL62225
2026-04-27 07:57:24 [auto1.fr] INFO: Scrape type for PL62225: 2
2026-04-27 07:57:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0fc86e6-69a0-58fe-8487-63a43161896f with identifier: PL62225
2026-04-27 07:57:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0fc86e6-69a0-58fe-8487-63a43161896f with scrape type 2
2026-04-27 07:57:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d0fc86e6-69a0-58fe-8487-63a43161896f with scrape type 2
2026-04-27 07:57:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d0fc86e6-69a0-58fe-8487-63a43161896f, identifier: PL62225
2026-04-27 07:57:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d0fc86e6-69a0-58fe-8487-63a43161896f with identifier: PL62225
2026-04-27 07:57:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d0fc86e6-69a0-58fe-8487-63a43161896f with identifier: PL62225
2026-04-27 07:57:24 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:57:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: d0fc86e6-69a0-58fe-8487-63a43161896f with identifier: PL62225 to the API
2026-04-27 07:57:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:57:24 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:57:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 240,
 'expiration_date': '2026-04-28T15:28:00Z',
 'fuel_type': 'diesel',
 'id': 'd0fc86e6-69a0-58fe-8487-63a43161896f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PL62225',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Jaguar',
 'model': 'XF',
 'odometer': 141210,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2015-01-14',
 'seller_name': None,
 'title': 'Jaguar XF 3.0 D V6',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-04-27 07:57:24 [auto1.fr] INFO: Saving data for PL62225: {'auction_closing_time': 1777390080.0, 'created_time': 1777020157.217438, 'has_photos': True, 'last_price_update_time': 1777276644.518458}
2026-04-27 07:57:24 [auto1.fr] INFO: Found listing with ID: SY30151
2026-04-27 07:57:24 [auto1.fr] INFO: Scrape type for SY30151: 1
2026-04-27 07:57:24 [auto1.fr] INFO: Found listing with ID: AF40134
2026-04-27 07:57:24 [auto1.fr] INFO: Scrape type for AF40134: 1
2026-04-27 07:57:59 [scrapy.extensions.logstats] INFO: Crawled 231 pages (at 9 pages/min), scraped 202 items (at 40 items/min)
2026-04-27 07:57:59 [scrapy.extensions.memusage] INFO: Peak memory usage is 373MiB
2026-04-27 07:58:59 [scrapy.extensions.logstats] INFO: Crawled 231 pages (at 0 pages/min), scraped 202 items (at 0 items/min)
2026-04-27 07:58:59 [scrapy.extensions.memusage] INFO: Peak memory usage is 373MiB
2026-04-27 07:59:20 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 133.977(s), this was the 1st time calling it.
2026-04-27 07:59:20 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.855527911786206 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 07:59:20 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 133.385(s), this was the 1st time calling it.
2026-04-27 07:59:20 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.60104892371772 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 07:59:20 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 133.389(s), this was the 1st time calling it.
2026-04-27 07:59:20 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.092421942435793 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 07:59:20 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 133.187(s), this was the 1st time calling it.
2026-04-27 07:59:20 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 3.7044992838053497 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 07:59:20 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.934(s), this was the 1st time calling it.
2026-04-27 07:59:20 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.873911946838869 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 07:59:20 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.935(s), this was the 1st time calling it.
2026-04-27 07:59:20 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.302663064701708 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 07:59:22 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.640(s), this was the 1st time calling it.
2026-04-27 07:59:22 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.383012009759129 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 07:59:22 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.641(s), this was the 1st time calling it.
2026-04-27 07:59:22 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.618735032153173 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 07:59:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 07:59:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 07:59:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EP16771/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 07:59:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 07:59:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 07:59:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KV39723/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:27 [auto1.fr] INFO: Channel: 24h | Page: 10 | totalHits: 4739 | hits on page: 40
2026-04-27 07:59:27 [auto1.fr] INFO: Found listing with ID: AA48290
2026-04-27 07:59:27 [auto1.fr] INFO: Found listing with ID: MB92679
2026-04-27 07:59:27 [auto1.fr] INFO: Found listing with ID: AD72789
2026-04-27 07:59:27 [auto1.fr] INFO: Scrape type for AD72789: 0
2026-04-27 07:59:27 [auto1.fr] INFO: Found listing with ID: RL62627
2026-04-27 07:59:27 [auto1.fr] INFO: Found listing with ID: WB55099
2026-04-27 07:59:27 [auto1.fr] INFO: Found listing with ID: LW97078
2026-04-27 07:59:27 [auto1.fr] INFO: Found listing with ID: ZT15844
2026-04-27 07:59:27 [auto1.fr] INFO: Scrape type for ZT15844: 0
2026-04-27 07:59:27 [auto1.fr] INFO: Found listing with ID: LS92623
2026-04-27 07:59:27 [auto1.fr] INFO: Found listing with ID: PL62225
2026-04-27 07:59:27 [auto1.fr] INFO: Scrape type for PL62225: 0
2026-04-27 07:59:27 [auto1.fr] INFO: Found listing with ID: SY30151
2026-04-27 07:59:27 [auto1.fr] INFO: Found listing with ID: AF40134
2026-04-27 07:59:27 [auto1.fr] INFO: Found listing with ID: VR99778
2026-04-27 07:59:27 [auto1.fr] INFO: Scrape type for VR99778: 1
2026-04-27 07:59:27 [auto1.fr] INFO: Found listing with ID: ES75996
2026-04-27 07:59:27 [auto1.fr] INFO: Scrape type for ES75996: 1
2026-04-27 07:59:27 [auto1.fr] INFO: Found listing with ID: YR94758
2026-04-27 07:59:27 [auto1.fr] INFO: Scrape type for YR94758: 1
2026-04-27 07:59:27 [auto1.fr] INFO: Found listing with ID: ME56071
2026-04-27 07:59:27 [auto1.fr] INFO: Scrape type for ME56071: 1
2026-04-27 07:59:27 [auto1.fr] INFO: Found listing with ID: JJ39391
2026-04-27 07:59:27 [auto1.fr] INFO: Scrape type for JJ39391: 1
2026-04-27 07:59:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 07:59:27 [auto1.fr] INFO: Found listing with ID: PT52640
2026-04-27 07:59:27 [auto1.fr] INFO: Scrape type for PT52640: 2
2026-04-27 07:59:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a16ef163-8d5c-5467-bd3f-98b41d97de0f with identifier: PT52640
2026-04-27 07:59:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a16ef163-8d5c-5467-bd3f-98b41d97de0f with scrape type 2
2026-04-27 07:59:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a16ef163-8d5c-5467-bd3f-98b41d97de0f with scrape type 2
2026-04-27 07:59:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a16ef163-8d5c-5467-bd3f-98b41d97de0f, identifier: PT52640
2026-04-27 07:59:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a16ef163-8d5c-5467-bd3f-98b41d97de0f with identifier: PT52640
2026-04-27 07:59:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a16ef163-8d5c-5467-bd3f-98b41d97de0f with identifier: PT52640
2026-04-27 07:59:28 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a16ef163-8d5c-5467-bd3f-98b41d97de0f with identifier: PT52640 to the API
2026-04-27 07:59:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:28 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-04-28T15:17:32Z',
 'fuel_type': 'petrol',
 'id': 'a16ef163-8d5c-5467-bd3f-98b41d97de0f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PT52640',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Peugeot',
 'model': '308',
 'odometer': 128805,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2013-08-25',
 'seller_name': None,
 'title': 'Peugeot 308 1.6 THP Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2013}
2026-04-27 07:59:28 [auto1.fr] INFO: Saving data for PT52640: {'auction_closing_time': 1777389452.0, 'created_time': 1777021791.731692, 'has_photos': True, 'last_price_update_time': 1777276768.392373}
2026-04-27 07:59:28 [auto1.fr] INFO: Found listing with ID: UW89865
2026-04-27 07:59:28 [auto1.fr] INFO: Scrape type for UW89865: 2
2026-04-27 07:59:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ae311b4-ebd4-5c13-a36a-31e34cd7ad87 with identifier: UW89865
2026-04-27 07:59:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ae311b4-ebd4-5c13-a36a-31e34cd7ad87 with scrape type 2
2026-04-27 07:59:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6ae311b4-ebd4-5c13-a36a-31e34cd7ad87 with scrape type 2
2026-04-27 07:59:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6ae311b4-ebd4-5c13-a36a-31e34cd7ad87, identifier: UW89865
2026-04-27 07:59:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6ae311b4-ebd4-5c13-a36a-31e34cd7ad87 with identifier: UW89865
2026-04-27 07:59:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6ae311b4-ebd4-5c13-a36a-31e34cd7ad87 with identifier: UW89865
2026-04-27 07:59:28 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6ae311b4-ebd4-5c13-a36a-31e34cd7ad87 with identifier: UW89865 to the API
2026-04-27 07:59:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:28 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 68,
 'expiration_date': '2026-04-28T15:53:15Z',
 'fuel_type': 'petrol',
 'id': '6ae311b4-ebd4-5c13-a36a-31e34cd7ad87',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UW89865',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Citroen',
 'model': 'C1',
 'odometer': 140793,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2006-12-20',
 'seller_name': None,
 'title': 'Citroen C1 1.0',
 'transmission': 'manual',
 'trim': '',
 'year': 2006}
2026-04-27 07:59:28 [auto1.fr] INFO: Saving data for UW89865: {'auction_closing_time': 1777391595.0, 'created_time': 1777020277.766979, 'has_photos': True, 'last_price_update_time': 1777276768.994485}
2026-04-27 07:59:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 07:59:29 [auto1.fr] INFO: Found listing with ID: AX33817
2026-04-27 07:59:29 [auto1.fr] INFO: Scrape type for AX33817: 1
2026-04-27 07:59:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 07:59:29 [auto1.fr] INFO: Found listing with ID: UJ10852
2026-04-27 07:59:29 [auto1.fr] INFO: Scrape type for UJ10852: 2
2026-04-27 07:59:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f31b1fbd-cc04-55a7-8761-bf9e4bf791a9 with identifier: UJ10852
2026-04-27 07:59:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f31b1fbd-cc04-55a7-8761-bf9e4bf791a9 with scrape type 2
2026-04-27 07:59:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f31b1fbd-cc04-55a7-8761-bf9e4bf791a9 with scrape type 2
2026-04-27 07:59:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f31b1fbd-cc04-55a7-8761-bf9e4bf791a9, identifier: UJ10852
2026-04-27 07:59:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f31b1fbd-cc04-55a7-8761-bf9e4bf791a9 with identifier: UJ10852
2026-04-27 07:59:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f31b1fbd-cc04-55a7-8761-bf9e4bf791a9 with identifier: UJ10852
2026-04-27 07:59:29 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f31b1fbd-cc04-55a7-8761-bf9e4bf791a9 with identifier: UJ10852 to the API
2026-04-27 07:59:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:29 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-04-28T15:59:03Z',
 'fuel_type': 'diesel',
 'id': 'f31b1fbd-cc04-55a7-8761-bf9e4bf791a9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UJ10852',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 94412,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2023-02-01',
 'seller_name': None,
 'title': 'Renault Clio 1.5 BLUE dCi Evolution Réversible',
 'transmission': 'manual',
 'trim': 'Evolution Réversible',
 'year': 2023}
2026-04-27 07:59:29 [auto1.fr] INFO: Saving data for UJ10852: {'auction_closing_time': 1777391943.0, 'created_time': 1777021374.031366, 'has_photos': True, 'last_price_update_time': 1777276769.54592}
2026-04-27 07:59:29 [auto1.fr] INFO: Found listing with ID: MW07169
2026-04-27 07:59:29 [auto1.fr] INFO: Scrape type for MW07169: 1
2026-04-27 07:59:29 [auto1.fr] INFO: Found listing with ID: HS41672
2026-04-27 07:59:29 [auto1.fr] INFO: Scrape type for HS41672: 2
2026-04-27 07:59:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e50e7d35-d32a-5040-8650-9603bb8808c5 with identifier: HS41672
2026-04-27 07:59:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e50e7d35-d32a-5040-8650-9603bb8808c5 with scrape type 2
2026-04-27 07:59:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e50e7d35-d32a-5040-8650-9603bb8808c5 with scrape type 2
2026-04-27 07:59:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e50e7d35-d32a-5040-8650-9603bb8808c5, identifier: HS41672
2026-04-27 07:59:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e50e7d35-d32a-5040-8650-9603bb8808c5 with identifier: HS41672
2026-04-27 07:59:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e50e7d35-d32a-5040-8650-9603bb8808c5 with identifier: HS41672
2026-04-27 07:59:29 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e50e7d35-d32a-5040-8650-9603bb8808c5 with identifier: HS41672 to the API
2026-04-27 07:59:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:30 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-04-28T15:33:10Z',
 'fuel_type': 'diesel',
 'id': 'e50e7d35-d32a-5040-8650-9603bb8808c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HS41672',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 261481,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2009-11-08',
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2009}
2026-04-27 07:59:30 [auto1.fr] INFO: Saving data for HS41672: {'auction_closing_time': 1777390390.0, 'created_time': 1777020328.05489, 'has_photos': True, 'last_price_update_time': 1777276770.371189}
2026-04-27 07:59:30 [auto1.fr] INFO: Found listing with ID: ZU85882
2026-04-27 07:59:30 [auto1.fr] INFO: Scrape type for ZU85882: 2
2026-04-27 07:59:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b77cd24-a7b5-5ba4-a424-27a0d7332b74 with identifier: ZU85882
2026-04-27 07:59:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b77cd24-a7b5-5ba4-a424-27a0d7332b74 with scrape type 2
2026-04-27 07:59:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b77cd24-a7b5-5ba4-a424-27a0d7332b74 with scrape type 2
2026-04-27 07:59:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2b77cd24-a7b5-5ba4-a424-27a0d7332b74, identifier: ZU85882
2026-04-27 07:59:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2b77cd24-a7b5-5ba4-a424-27a0d7332b74 with identifier: ZU85882
2026-04-27 07:59:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2b77cd24-a7b5-5ba4-a424-27a0d7332b74 with identifier: ZU85882
2026-04-27 07:59:30 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2b77cd24-a7b5-5ba4-a424-27a0d7332b74 with identifier: ZU85882 to the API
2026-04-27 07:59:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:30 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 190,
 'expiration_date': '2026-04-28T15:41:22Z',
 'fuel_type': 'diesel',
 'id': '2b77cd24-a7b5-5ba4-a424-27a0d7332b74',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU85882',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 121045,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2014-12-22',
 'seller_name': None,
 'title': 'Land Rover Evoque 2.2 Sd4 Pure',
 'transmission': 'automatic',
 'trim': 'Pure',
 'year': 2014}
2026-04-27 07:59:30 [auto1.fr] INFO: Saving data for ZU85882: {'auction_closing_time': 1777390882.0, 'created_time': 1777022348.476347, 'has_photos': True, 'last_price_update_time': 1777276770.860898}
2026-04-27 07:59:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XE44101/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:30 [auto1.fr] INFO: Found listing with ID: UW84259
2026-04-27 07:59:30 [auto1.fr] INFO: Scrape type for UW84259: 2
2026-04-27 07:59:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62ecb165-23bb-56b9-afe4-c5360bbf1173 with identifier: UW84259
2026-04-27 07:59:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62ecb165-23bb-56b9-afe4-c5360bbf1173 with scrape type 2
2026-04-27 07:59:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 62ecb165-23bb-56b9-afe4-c5360bbf1173 with scrape type 2
2026-04-27 07:59:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 62ecb165-23bb-56b9-afe4-c5360bbf1173, identifier: UW84259
2026-04-27 07:59:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 62ecb165-23bb-56b9-afe4-c5360bbf1173 with identifier: UW84259
2026-04-27 07:59:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 62ecb165-23bb-56b9-afe4-c5360bbf1173 with identifier: UW84259
2026-04-27 07:59:31 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 62ecb165-23bb-56b9-afe4-c5360bbf1173 with identifier: UW84259 to the API
2026-04-27 07:59:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:31 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-04-28T15:02:05Z',
 'fuel_type': 'diesel',
 'id': '62ecb165-23bb-56b9-afe4-c5360bbf1173',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UW84259',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Mercedes-Benz',
 'model': 'M-Klasse',
 'odometer': 372423,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2011-11-17',
 'seller_name': None,
 'title': 'Mercedes-Benz M-Klasse ML 350 CDI BlueTEC',
 'transmission': 'automatic',
 'trim': 'BlueTEC',
 'year': 2011}
2026-04-27 07:59:31 [auto1.fr] INFO: Saving data for UW84259: {'auction_closing_time': 1777388525.0, 'created_time': 1777021147.240812, 'has_photos': True, 'last_price_update_time': 1777276771.870441}
2026-04-27 07:59:31 [auto1.fr] INFO: Found listing with ID: CN39539
2026-04-27 07:59:31 [auto1.fr] INFO: Scrape type for CN39539: 2
2026-04-27 07:59:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 981b29c1-bcdc-5809-93f1-e0e16fb18931 with identifier: CN39539
2026-04-27 07:59:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 981b29c1-bcdc-5809-93f1-e0e16fb18931 with scrape type 2
2026-04-27 07:59:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 981b29c1-bcdc-5809-93f1-e0e16fb18931 with scrape type 2
2026-04-27 07:59:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 981b29c1-bcdc-5809-93f1-e0e16fb18931, identifier: CN39539
2026-04-27 07:59:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 981b29c1-bcdc-5809-93f1-e0e16fb18931 with identifier: CN39539
2026-04-27 07:59:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 981b29c1-bcdc-5809-93f1-e0e16fb18931 with identifier: CN39539
2026-04-27 07:59:32 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 981b29c1-bcdc-5809-93f1-e0e16fb18931 with identifier: CN39539 to the API
2026-04-27 07:59:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:32 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 72,
 'expiration_date': '2026-04-28T15:55:48Z',
 'fuel_type': 'petrol',
 'id': '981b29c1-bcdc-5809-93f1-e0e16fb18931',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CN39539',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Toyota',
 'model': 'Aygo',
 'odometer': 56700,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2020-12-07',
 'seller_name': None,
 'title': 'Toyota Aygo 1.0 VVT-i X',
 'transmission': 'manual',
 'trim': 'X',
 'year': 2020}
2026-04-27 07:59:32 [auto1.fr] INFO: Saving data for CN39539: {'auction_closing_time': 1777391748.0, 'created_time': 1777021463.922704, 'has_photos': True, 'last_price_update_time': 1777276772.408938}
2026-04-27 07:59:32 [auto1.fr] INFO: Found listing with ID: NN12776
2026-04-27 07:59:32 [auto1.fr] INFO: Scrape type for NN12776: 1
2026-04-27 07:59:32 [auto1.fr] INFO: Found listing with ID: AT92425
2026-04-27 07:59:32 [auto1.fr] INFO: Scrape type for AT92425: 2
2026-04-27 07:59:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 033862a7-3ba1-5a52-943a-d1d62936387e with identifier: AT92425
2026-04-27 07:59:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 033862a7-3ba1-5a52-943a-d1d62936387e with scrape type 2
2026-04-27 07:59:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 033862a7-3ba1-5a52-943a-d1d62936387e with scrape type 2
2026-04-27 07:59:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 033862a7-3ba1-5a52-943a-d1d62936387e, identifier: AT92425
2026-04-27 07:59:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 033862a7-3ba1-5a52-943a-d1d62936387e with identifier: AT92425
2026-04-27 07:59:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 033862a7-3ba1-5a52-943a-d1d62936387e with identifier: AT92425
2026-04-27 07:59:32 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 033862a7-3ba1-5a52-943a-d1d62936387e with identifier: AT92425 to the API
2026-04-27 07:59:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:32 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-04-28T15:42:41Z',
 'fuel_type': 'diesel',
 'id': '033862a7-3ba1-5a52-943a-d1d62936387e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AT92425',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 203709,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2016-05-05',
 'seller_name': None,
 'title': 'BMW X1 sDrive 18d xLine',
 'transmission': 'automatic',
 'trim': 'xLine',
 'year': 2016}
2026-04-27 07:59:32 [auto1.fr] INFO: Saving data for AT92425: {'auction_closing_time': 1777390961.0, 'created_time': 1777019735.732003, 'has_photos': True, 'last_price_update_time': 1777276772.906626}
2026-04-27 07:59:32 [auto1.fr] INFO: Found listing with ID: KZ84979
2026-04-27 07:59:32 [auto1.fr] INFO: Scrape type for KZ84979: 1
2026-04-27 07:59:32 [auto1.fr] INFO: Found listing with ID: VL77818
2026-04-27 07:59:32 [auto1.fr] INFO: Scrape type for VL77818: 1
2026-04-27 07:59:32 [auto1.fr] INFO: Found listing with ID: HW58466
2026-04-27 07:59:32 [auto1.fr] INFO: Scrape type for HW58466: 1
2026-04-27 07:59:32 [auto1.fr] INFO: Found listing with ID: NY85596
2026-04-27 07:59:32 [auto1.fr] INFO: Scrape type for NY85596: 2
2026-04-27 07:59:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b02373d1-d9ac-596a-abf6-25a3566eff25 with identifier: NY85596
2026-04-27 07:59:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b02373d1-d9ac-596a-abf6-25a3566eff25 with scrape type 2
2026-04-27 07:59:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b02373d1-d9ac-596a-abf6-25a3566eff25 with scrape type 2
2026-04-27 07:59:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b02373d1-d9ac-596a-abf6-25a3566eff25, identifier: NY85596
2026-04-27 07:59:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b02373d1-d9ac-596a-abf6-25a3566eff25 with identifier: NY85596
2026-04-27 07:59:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b02373d1-d9ac-596a-abf6-25a3566eff25 with identifier: NY85596
2026-04-27 07:59:33 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b02373d1-d9ac-596a-abf6-25a3566eff25 with identifier: NY85596 to the API
2026-04-27 07:59:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:33 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-04-28T15:00:51Z',
 'fuel_type': 'petrol',
 'id': 'b02373d1-d9ac-596a-abf6-25a3566eff25',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NY85596',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Renault',
 'model': 'Kadjar',
 'odometer': 138377,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2016-12-29',
 'seller_name': None,
 'title': 'Renault Kadjar 1.2 TCe Energy Intens',
 'transmission': 'manual',
 'trim': 'Intens',
 'year': 2016}
2026-04-27 07:59:33 [auto1.fr] INFO: Saving data for NY85596: {'auction_closing_time': 1777388451.0, 'created_time': 1777019969.027968, 'has_photos': True, 'last_price_update_time': 1777276773.444352}
2026-04-27 07:59:33 [auto1.fr] INFO: Found listing with ID: FM17724
2026-04-27 07:59:33 [auto1.fr] INFO: Scrape type for FM17724: 2
2026-04-27 07:59:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7510e5b2-f932-5166-af21-2f6a50929234 with identifier: FM17724
2026-04-27 07:59:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7510e5b2-f932-5166-af21-2f6a50929234 with scrape type 2
2026-04-27 07:59:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7510e5b2-f932-5166-af21-2f6a50929234 with scrape type 2
2026-04-27 07:59:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7510e5b2-f932-5166-af21-2f6a50929234, identifier: FM17724
2026-04-27 07:59:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7510e5b2-f932-5166-af21-2f6a50929234 with identifier: FM17724
2026-04-27 07:59:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7510e5b2-f932-5166-af21-2f6a50929234 with identifier: FM17724
2026-04-27 07:59:33 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 7510e5b2-f932-5166-af21-2f6a50929234 with identifier: FM17724 to the API
2026-04-27 07:59:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:33 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-04-28T15:23:13Z',
 'fuel_type': 'diesel',
 'id': '7510e5b2-f932-5166-af21-2f6a50929234',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FM17724',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 185121,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2018-03-31',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 CDI BlueEfficiency Fascination',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Fascination',
 'year': 2018}
2026-04-27 07:59:33 [auto1.fr] INFO: Saving data for FM17724: {'auction_closing_time': 1777389793.0, 'created_time': 1777022585.577814, 'has_photos': True, 'last_price_update_time': 1777276773.977918}
2026-04-27 07:59:33 [auto1.fr] INFO: Found listing with ID: XE09151
2026-04-27 07:59:34 [auto1.fr] INFO: Scrape type for XE09151: 2
2026-04-27 07:59:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d98d487-86d0-5ab4-bd25-f98fb505019b with identifier: XE09151
2026-04-27 07:59:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d98d487-86d0-5ab4-bd25-f98fb505019b with scrape type 2
2026-04-27 07:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4d98d487-86d0-5ab4-bd25-f98fb505019b with scrape type 2
2026-04-27 07:59:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4d98d487-86d0-5ab4-bd25-f98fb505019b, identifier: XE09151
2026-04-27 07:59:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4d98d487-86d0-5ab4-bd25-f98fb505019b with identifier: XE09151
2026-04-27 07:59:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4d98d487-86d0-5ab4-bd25-f98fb505019b with identifier: XE09151
2026-04-27 07:59:34 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 4d98d487-86d0-5ab4-bd25-f98fb505019b with identifier: XE09151 to the API
2026-04-27 07:59:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:34 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 58,
 'expiration_date': '2026-04-28T15:38:24Z',
 'fuel_type': 'petrol',
 'id': '4d98d487-86d0-5ab4-bd25-f98fb505019b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XE09151',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 171775,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2001-04-23',
 'seller_name': None,
 'title': 'Opel Corsa 1.0 Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2001}
2026-04-27 07:59:34 [auto1.fr] INFO: Saving data for XE09151: {'auction_closing_time': 1777390704.0, 'created_time': 1777023377.280625, 'has_photos': True, 'last_price_update_time': 1777276774.459164}
2026-04-27 07:59:34 [auto1.fr] INFO: Found listing with ID: TK04922
2026-04-27 07:59:34 [auto1.fr] INFO: Scrape type for TK04922: 2
2026-04-27 07:59:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd5fc86b-b560-59e9-8f47-71749b513f96 with identifier: TK04922
2026-04-27 07:59:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd5fc86b-b560-59e9-8f47-71749b513f96 with scrape type 2
2026-04-27 07:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dd5fc86b-b560-59e9-8f47-71749b513f96 with scrape type 2
2026-04-27 07:59:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: dd5fc86b-b560-59e9-8f47-71749b513f96, identifier: TK04922
2026-04-27 07:59:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: dd5fc86b-b560-59e9-8f47-71749b513f96 with identifier: TK04922
2026-04-27 07:59:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: dd5fc86b-b560-59e9-8f47-71749b513f96 with identifier: TK04922
2026-04-27 07:59:34 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: dd5fc86b-b560-59e9-8f47-71749b513f96 with identifier: TK04922 to the API
2026-04-27 07:59:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:34 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 92,
 'expiration_date': '2026-04-28T15:32:43Z',
 'fuel_type': 'diesel',
 'id': 'dd5fc86b-b560-59e9-8f47-71749b513f96',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TK04922',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Citroen',
 'model': 'C3 Picasso',
 'odometer': 275803,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2014-07-10',
 'seller_name': None,
 'title': 'Citroen C3 Picasso 1.6 HDi Confort',
 'transmission': 'manual',
 'trim': 'Confort',
 'year': 2014}
2026-04-27 07:59:34 [auto1.fr] INFO: Saving data for TK04922: {'auction_closing_time': 1777390363.0, 'created_time': 1777021085.540237, 'has_photos': True, 'last_price_update_time': 1777276774.893185}
2026-04-27 07:59:34 [auto1.fr] INFO: Found listing with ID: KZ52464
2026-04-27 07:59:34 [auto1.fr] INFO: Scrape type for KZ52464: 1
2026-04-27 07:59:34 [auto1.fr] INFO: Found listing with ID: ZB78862
2026-04-27 07:59:34 [auto1.fr] INFO: Scrape type for ZB78862: 1
2026-04-27 07:59:34 [auto1.fr] INFO: Found listing with ID: KL75694
2026-04-27 07:59:34 [auto1.fr] INFO: Scrape type for KL75694: 1
2026-04-27 07:59:34 [auto1.fr] INFO: Found listing with ID: ZS24433
2026-04-27 07:59:34 [auto1.fr] INFO: Scrape type for ZS24433: 2
2026-04-27 07:59:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae6bbb17-7b8f-504b-865d-8148bf4adf7b with identifier: ZS24433
2026-04-27 07:59:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae6bbb17-7b8f-504b-865d-8148bf4adf7b with scrape type 2
2026-04-27 07:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ae6bbb17-7b8f-504b-865d-8148bf4adf7b with scrape type 2
2026-04-27 07:59:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ae6bbb17-7b8f-504b-865d-8148bf4adf7b, identifier: ZS24433
2026-04-27 07:59:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ae6bbb17-7b8f-504b-865d-8148bf4adf7b with identifier: ZS24433
2026-04-27 07:59:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ae6bbb17-7b8f-504b-865d-8148bf4adf7b with identifier: ZS24433
2026-04-27 07:59:35 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ae6bbb17-7b8f-504b-865d-8148bf4adf7b with identifier: ZS24433 to the API
2026-04-27 07:59:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:35 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-04-28T15:09:21Z',
 'fuel_type': 'diesel',
 'id': 'ae6bbb17-7b8f-504b-865d-8148bf4adf7b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZS24433',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Peugeot',
 'model': '508',
 'odometer': 71805,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2019-06-06',
 'seller_name': None,
 'title': 'Peugeot 508 1.5 Blue-HDi Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2019}
2026-04-27 07:59:35 [auto1.fr] INFO: Saving data for ZS24433: {'auction_closing_time': 1777388961.0, 'created_time': 1777022545.954053, 'has_photos': True, 'last_price_update_time': 1777276775.366901}
2026-04-27 07:59:35 [auto1.fr] INFO: Found listing with ID: DP12800
2026-04-27 07:59:35 [auto1.fr] INFO: Scrape type for DP12800: 1
2026-04-27 07:59:35 [auto1.fr] INFO: Found listing with ID: KF38228
2026-04-27 07:59:35 [auto1.fr] INFO: Scrape type for KF38228: 1
2026-04-27 07:59:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WN54691/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SB35500/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MN17403/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EB39116/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RK33125/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JA68663/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FH45650/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GH44775> (referer: https://www.auto1.com/v1/car-details-view/GH44775/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9c8b082-2b19-5a80-85f2-48c10a27d489 with identifier: GH44775
2026-04-27 07:59:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9c8b082-2b19-5a80-85f2-48c10a27d489 with scrape type 1
2026-04-27 07:59:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e9c8b082-2b19-5a80-85f2-48c10a27d489
2026-04-27 07:59:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/52/cf5274c82509b8423d7fff0a3500f139/pa/GH44775_fb5ff4661032b7d16582328d5e36d71c.jpg not downloaded yet
2026-04-27 07:59:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/52/cf5274c82509b8423d7fff0a3500f139/pa/GH44775_c9504359fc8f28601ac9f6454ad974ec.jpg already downloaded
2026-04-27 07:59:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/52/cf5274c82509b8423d7fff0a3500f139/pa/GH44775_e974edd9f68346c3b0312e8f39102e48.jpg already downloaded
2026-04-27 07:59:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/52/cf5274c82509b8423d7fff0a3500f139/pa/GH44775_fe29298799b508ab2163e30c07b83f92.jpg already downloaded
2026-04-27 07:59:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/52/cf5274c82509b8423d7fff0a3500f139/pa/GH44775_a01c088a042ab843ff04eb9281be6fae.jpg already downloaded
2026-04-27 07:59:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/52/cf5274c82509b8423d7fff0a3500f139/pa/GH44775_84b3ad92b1d3b0de4c9dac6dc9606a3c.jpg already downloaded
2026-04-27 07:59:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/52/cf5274c82509b8423d7fff0a3500f139/pa/GH44775_23a5cdb2d2d2fb7b413119ab2f41ac9a.jpg already downloaded
2026-04-27 07:59:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/52/cf5274c82509b8423d7fff0a3500f139/pa/GH44775_d1da84a4e15baf0ae66ea25dd09607bb.jpg already downloaded
2026-04-27 07:59:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/52/cf5274c82509b8423d7fff0a3500f139/pa/GH44775_de47b3d0c49abf6bca7d79a641befb3a.jpg already downloaded
2026-04-27 07:59:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/52/cf5274c82509b8423d7fff0a3500f139/pa/GH44775_42ac403bdd471f846d4560da36591d98.jpg already downloaded
2026-04-27 07:59:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EP16771> (referer: https://www.auto1.com/v1/car-details-view/EP16771/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZE79634/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AF40134/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b389423-2149-52d0-a830-b4f42220ce97 with identifier: EP16771
2026-04-27 07:59:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b389423-2149-52d0-a830-b4f42220ce97 with scrape type 1
2026-04-27 07:59:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 5b389423-2149-52d0-a830-b4f42220ce97
2026-04-27 07:59:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/c7/c3c78eec1d9c34c9b334f3dd108f8e60/pa/EP16771_08afe81ed66e64cc19b8fc2dfae3e963.jpg not downloaded yet
2026-04-27 07:59:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/c7/c3c78eec1d9c34c9b334f3dd108f8e60/pa/EP16771_ab1748c7f7b6f7bc7b81cfa01cb7f3f9.jpg not downloaded yet
2026-04-27 07:59:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/c7/c3c78eec1d9c34c9b334f3dd108f8e60/pa/EP16771_e4cd0b75e6c50b7f85f995f40f245589.jpg not downloaded yet
2026-04-27 07:59:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/c7/c3c78eec1d9c34c9b334f3dd108f8e60/pa/EP16771_7a52baa3b512920b86716fccbd5526a4.jpg not downloaded yet
2026-04-27 07:59:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/c7/c3c78eec1d9c34c9b334f3dd108f8e60/pa/EP16771_d6c0446133bbdddd7da651b5c2b63f95.jpg not downloaded yet
2026-04-27 07:59:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/52/cf5274c82509b8423d7fff0a3500f139/pa/GH44775_fb5ff4661032b7d16582328d5e36d71c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/c7/c3c78eec1d9c34c9b334f3dd108f8e60/pa/EP16771_b4a733a2efc1c8604e69f4e6f3ee54fc.jpg not downloaded yet
2026-04-27 07:59:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MW07169/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1448354750>
2026-04-27 07:59:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9c8b082-2b19-5a80-85f2-48c10a27d489/e9c8b082-2b19-5a80-85f2-48c10a27d489_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:59:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/52/cf5274c82509b8423d7fff0a3500f139/pa/GH44775_fb5ff4661032b7d16582328d5e36d71c.jpg saved to cache
2026-04-27 07:59:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e9c8b082-2b19-5a80-85f2-48c10a27d489
2026-04-27 07:59:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e9c8b082-2b19-5a80-85f2-48c10a27d489, skipping ID generation
2026-04-27 07:59:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9c8b082-2b19-5a80-85f2-48c10a27d489 with scrape type 1
2026-04-27 07:59:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e9c8b082-2b19-5a80-85f2-48c10a27d489 sending to next pipeline
2026-04-27 07:59:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e9c8b082-2b19-5a80-85f2-48c10a27d489, identifier: GH44775
2026-04-27 07:59:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e9c8b082-2b19-5a80-85f2-48c10a27d489 with identifier: GH44775
2026-04-27 07:59:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e9c8b082-2b19-5a80-85f2-48c10a27d489 with identifier: GH44775
2026-04-27 07:59:49 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e9c8b082-2b19-5a80-85f2-48c10a27d489 with identifier: GH44775 to the API
2026-04-27 07:59:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:50 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgcf/52/cf5274c82509b8423d7fff0a3500f139/pa/GH44775_fb5ff4661032b7d16582328d5e36d71c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 95,
 'category': None,
 'city': 'Houécourt',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 90,
 'expiration_date': '2026-04-28T15:30:23Z',
 'fuel_type': 'diesel',
 'id': 'e9c8b082-2b19-5a80-85f2-48c10a27d489',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.2985,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GH44775',
 'listing': 'auction',
 'location': 'FR, Houecourt',
 'location_confidence': 'geocoded',
 'longitude': 5.8931,
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 209548,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e9c8b082-2b19-5a80-85f2-48c10a27d489/e9c8b082-2b19-5a80-85f2-48c10a27d489_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62534,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/52/cf5274c82509b8423d7fff0a3500f139/pa/GH44775_fb5ff4661032b7d16582328d5e36d71c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e9c8b082-2b19-5a80-85f2-48c10a27d489/e9c8b082-2b19-5a80-85f2-48c10a27d489_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59593,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/52/cf5274c82509b8423d7fff0a3500f139/pa/GH44775_c9504359fc8f28601ac9f6454ad974ec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e9c8b082-2b19-5a80-85f2-48c10a27d489/e9c8b082-2b19-5a80-85f2-48c10a27d489_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82520,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/52/cf5274c82509b8423d7fff0a3500f139/pa/GH44775_e974edd9f68346c3b0312e8f39102e48.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e9c8b082-2b19-5a80-85f2-48c10a27d489/e9c8b082-2b19-5a80-85f2-48c10a27d489_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54478,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/52/cf5274c82509b8423d7fff0a3500f139/pa/GH44775_fe29298799b508ab2163e30c07b83f92.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e9c8b082-2b19-5a80-85f2-48c10a27d489/e9c8b082-2b19-5a80-85f2-48c10a27d489_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70639,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/52/cf5274c82509b8423d7fff0a3500f139/pa/GH44775_a01c088a042ab843ff04eb9281be6fae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e9c8b082-2b19-5a80-85f2-48c10a27d489/e9c8b082-2b19-5a80-85f2-48c10a27d489_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73726,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/52/cf5274c82509b8423d7fff0a3500f139/pa/GH44775_84b3ad92b1d3b0de4c9dac6dc9606a3c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e9c8b082-2b19-5a80-85f2-48c10a27d489/e9c8b082-2b19-5a80-85f2-48c10a27d489_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59075,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/52/cf5274c82509b8423d7fff0a3500f139/pa/GH44775_23a5cdb2d2d2fb7b413119ab2f41ac9a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e9c8b082-2b19-5a80-85f2-48c10a27d489/e9c8b082-2b19-5a80-85f2-48c10a27d489_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55378,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/52/cf5274c82509b8423d7fff0a3500f139/pa/GH44775_d1da84a4e15baf0ae66ea25dd09607bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e9c8b082-2b19-5a80-85f2-48c10a27d489/e9c8b082-2b19-5a80-85f2-48c10a27d489_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60107,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/52/cf5274c82509b8423d7fff0a3500f139/pa/GH44775_de47b3d0c49abf6bca7d79a641befb3a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e9c8b082-2b19-5a80-85f2-48c10a27d489/e9c8b082-2b19-5a80-85f2-48c10a27d489_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79055,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/52/cf5274c82509b8423d7fff0a3500f139/pa/GH44775_42ac403bdd471f846d4560da36591d98.jpg',
             'Width': 800}],
 'postal_code': '88170',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Vosges',
 'province_code': 'FR-88',
 'region': 'Grand Est',
 'region_code': 'FR-44',
 'registration_date': '2016-07-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Megane 1.5 dCi Energy Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2016}
2026-04-27 07:59:50 [auto1.fr] INFO: Saving data for GH44775: {'created_time': 1777276790.708345, 'last_price_update_time': 1777276790.708358, 'has_photos': True, 'auction_closing_time': 1777390223.0}
2026-04-27 07:59:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/c7/c3c78eec1d9c34c9b334f3dd108f8e60/pa/EP16771_d6c0446133bbdddd7da651b5c2b63f95.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KV39723> (referer: https://www.auto1.com/v1/car-details-view/KV39723/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SB35500> (referer: https://www.auto1.com/v1/car-details-view/SB35500/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BB34695/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a83510>
2026-04-27 07:59:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b389423-2149-52d0-a830-b4f42220ce97/5b389423-2149-52d0-a830-b4f42220ce97_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:59:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/c7/c3c78eec1d9c34c9b334f3dd108f8e60/pa/EP16771_d6c0446133bbdddd7da651b5c2b63f95.jpg saved to cache
2026-04-27 07:59:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5b389423-2149-52d0-a830-b4f42220ce97
2026-04-27 07:59:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c49e49e1-4dfb-52ca-94ca-5b85c40003e0 with identifier: KV39723
2026-04-27 07:59:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c49e49e1-4dfb-52ca-94ca-5b85c40003e0 with scrape type 1
2026-04-27 07:59:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item c49e49e1-4dfb-52ca-94ca-5b85c40003e0
2026-04-27 07:59:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/a2/6ea23628a61b06421af0ee58f60c5e6d/pa/KV39723_bc169f09a888d879b2504ca5d168e956.jpg not downloaded yet
2026-04-27 07:59:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21a220f7-e414-54bc-a7c1-307ad431a547 with identifier: SB35500
2026-04-27 07:59:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21a220f7-e414-54bc-a7c1-307ad431a547 with scrape type 1
2026-04-27 07:59:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 21a220f7-e414-54bc-a7c1-307ad431a547
2026-04-27 07:59:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/39/5b39350ee939e86001d92073bef74f29/pa/SB35500_fc326c3919bfc72ef3e60ccde56a9a8f.jpg not downloaded yet
2026-04-27 07:59:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/c7/c3c78eec1d9c34c9b334f3dd108f8e60/pa/EP16771_b4a733a2efc1c8604e69f4e6f3ee54fc.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/a2/6ea23628a61b06421af0ee58f60c5e6d/pa/KV39723_d0a14097a836ab6343f30799979a60e2.jpg not downloaded yet
2026-04-27 07:59:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/39/5b39350ee939e86001d92073bef74f29/pa/SB35500_bdcf5d68b3c1d0a0363e112ffdc5bf00.jpg not downloaded yet
2026-04-27 07:59:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/c7/c3c78eec1d9c34c9b334f3dd108f8e60/pa/EP16771_7a52baa3b512920b86716fccbd5526a4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/a2/6ea23628a61b06421af0ee58f60c5e6d/pa/KV39723_5a6c3f72e0392ea7a0c2f148a3af0827.jpg not downloaded yet
2026-04-27 07:59:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/39/5b39350ee939e86001d92073bef74f29/pa/SB35500_ed5a83610b22c2936f010b52bf9895ba.jpg not downloaded yet
2026-04-27 07:59:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/a2/6ea23628a61b06421af0ee58f60c5e6d/pa/KV39723_78b095751845a59ce507b3afbdd5d58c.jpg not downloaded yet
2026-04-27 07:59:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/39/5b39350ee939e86001d92073bef74f29/pa/SB35500_129ed2299ea5c7ff3f06af007cd77e08.jpg not downloaded yet
2026-04-27 07:59:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/a2/6ea23628a61b06421af0ee58f60c5e6d/pa/KV39723_eb33cec6a99d9719abc58d7f584e5e89.jpg not downloaded yet
2026-04-27 07:59:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/39/5b39350ee939e86001d92073bef74f29/pa/SB35500_231bf95ef6209885a063580a12b42b83.jpg not downloaded yet
2026-04-27 07:59:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/a2/6ea23628a61b06421af0ee58f60c5e6d/pa/KV39723_4c1a35c2d185e57e2c49cb3365fe6fc5.jpg not downloaded yet
2026-04-27 07:59:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/39/5b39350ee939e86001d92073bef74f29/pa/SB35500_36f48e4510d417061018a1263bfe12f9.png not downloaded yet
2026-04-27 07:59:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/39/5b39350ee939e86001d92073bef74f29/pa/SB35500_fc326c3919bfc72ef3e60ccde56a9a8f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438131610>
2026-04-27 07:59:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b389423-2149-52d0-a830-b4f42220ce97/5b389423-2149-52d0-a830-b4f42220ce97_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:59:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/c7/c3c78eec1d9c34c9b334f3dd108f8e60/pa/EP16771_b4a733a2efc1c8604e69f4e6f3ee54fc.jpg saved to cache
2026-04-27 07:59:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5b389423-2149-52d0-a830-b4f42220ce97
2026-04-27 07:59:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f144750c990>
2026-04-27 07:59:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b389423-2149-52d0-a830-b4f42220ce97/5b389423-2149-52d0-a830-b4f42220ce97_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:59:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/c7/c3c78eec1d9c34c9b334f3dd108f8e60/pa/EP16771_7a52baa3b512920b86716fccbd5526a4.jpg saved to cache
2026-04-27 07:59:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5b389423-2149-52d0-a830-b4f42220ce97
2026-04-27 07:59:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143adb1650>
2026-04-27 07:59:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21a220f7-e414-54bc-a7c1-307ad431a547/21a220f7-e414-54bc-a7c1-307ad431a547_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:59:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/39/5b39350ee939e86001d92073bef74f29/pa/SB35500_fc326c3919bfc72ef3e60ccde56a9a8f.jpg saved to cache
2026-04-27 07:59:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 21a220f7-e414-54bc-a7c1-307ad431a547
2026-04-27 07:59:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/39/5b39350ee939e86001d92073bef74f29/pa/SB35500_231bf95ef6209885a063580a12b42b83.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DP12800/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143820d610>
2026-04-27 07:59:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21a220f7-e414-54bc-a7c1-307ad431a547/21a220f7-e414-54bc-a7c1-307ad431a547_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:59:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/39/5b39350ee939e86001d92073bef74f29/pa/SB35500_231bf95ef6209885a063580a12b42b83.jpg saved to cache
2026-04-27 07:59:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 21a220f7-e414-54bc-a7c1-307ad431a547
2026-04-27 07:59:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/a2/6ea23628a61b06421af0ee58f60c5e6d/pa/KV39723_4c1a35c2d185e57e2c49cb3365fe6fc5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14381ac210>
2026-04-27 07:59:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c49e49e1-4dfb-52ca-94ca-5b85c40003e0/c49e49e1-4dfb-52ca-94ca-5b85c40003e0_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:59:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/a2/6ea23628a61b06421af0ee58f60c5e6d/pa/KV39723_4c1a35c2d185e57e2c49cb3365fe6fc5.jpg saved to cache
2026-04-27 07:59:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c49e49e1-4dfb-52ca-94ca-5b85c40003e0
2026-04-27 07:59:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/39/5b39350ee939e86001d92073bef74f29/pa/SB35500_36f48e4510d417061018a1263bfe12f9.png> (referer: https://www.auto1.com/)
2026-04-27 07:59:51 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-04-27 07:59:51 [PIL.PngImagePlugin] DEBUG: STREAM b'eXIf' 41 68
2026-04-27 07:59:51 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 121 9
2026-04-27 07:59:51 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 142 8192
2026-04-27 07:59:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ae44d0>
2026-04-27 07:59:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21a220f7-e414-54bc-a7c1-307ad431a547/21a220f7-e414-54bc-a7c1-307ad431a547_image_5.png HTTP/1.1" 201 0
2026-04-27 07:59:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/39/5b39350ee939e86001d92073bef74f29/pa/SB35500_36f48e4510d417061018a1263bfe12f9.png saved to cache
2026-04-27 07:59:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 21a220f7-e414-54bc-a7c1-307ad431a547
2026-04-27 07:59:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WN54691> (referer: https://www.auto1.com/v1/car-details-view/WN54691/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/a2/6ea23628a61b06421af0ee58f60c5e6d/pa/KV39723_eb33cec6a99d9719abc58d7f584e5e89.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32d9dff2-124f-5d8c-87ed-ca0f660580a3 with identifier: WN54691
2026-04-27 07:59:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32d9dff2-124f-5d8c-87ed-ca0f660580a3 with scrape type 1
2026-04-27 07:59:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 32d9dff2-124f-5d8c-87ed-ca0f660580a3
2026-04-27 07:59:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/f1/7af1ee0683ac750f2cf5b828140e6e4d/pa/WN54691_2e1febc23fb5a51c7df061172735021c.jpg not downloaded yet
2026-04-27 07:59:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/f1/7af1ee0683ac750f2cf5b828140e6e4d/pa/WN54691_8f4f83dc934fe2848b2a3c2a2a2117a5.jpg not downloaded yet
2026-04-27 07:59:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/f1/7af1ee0683ac750f2cf5b828140e6e4d/pa/WN54691_a979e2b7ad2d14e410cfe2000e163189.jpg not downloaded yet
2026-04-27 07:59:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438cb8090>
2026-04-27 07:59:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c49e49e1-4dfb-52ca-94ca-5b85c40003e0/c49e49e1-4dfb-52ca-94ca-5b85c40003e0_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:59:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/a2/6ea23628a61b06421af0ee58f60c5e6d/pa/KV39723_eb33cec6a99d9719abc58d7f584e5e89.jpg saved to cache
2026-04-27 07:59:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c49e49e1-4dfb-52ca-94ca-5b85c40003e0
2026-04-27 07:59:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/39/5b39350ee939e86001d92073bef74f29/pa/SB35500_129ed2299ea5c7ff3f06af007cd77e08.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/f1/7af1ee0683ac750f2cf5b828140e6e4d/pa/WN54691_ec3fd9b1d33635d44238e4947f89b7b0.jpg not downloaded yet
2026-04-27 07:59:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/a2/6ea23628a61b06421af0ee58f60c5e6d/pa/KV39723_78b095751845a59ce507b3afbdd5d58c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/f1/7af1ee0683ac750f2cf5b828140e6e4d/pa/WN54691_3fa09984ef8d2f11aaea226bf307c168.jpg not downloaded yet
2026-04-27 07:59:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/f1/7af1ee0683ac750f2cf5b828140e6e4d/pa/WN54691_031b5ff6c627c1727fc80ae3f3371dce.jpg not downloaded yet
2026-04-27 07:59:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/f1/7af1ee0683ac750f2cf5b828140e6e4d/pa/WN54691_b7a90814b3aff18f233e5469461c2d4f.jpg not downloaded yet
2026-04-27 07:59:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/f1/7af1ee0683ac750f2cf5b828140e6e4d/pa/WN54691_e7d9c93d788d24bda52efd7c7f731f75.jpg not downloaded yet
2026-04-27 07:59:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/f1/7af1ee0683ac750f2cf5b828140e6e4d/pa/WN54691_9804d9485702bf208e4e6c01ef842f43.jpg not downloaded yet
2026-04-27 07:59:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/f1/7af1ee0683ac750f2cf5b828140e6e4d/pa/WN54691_b922eddd47c68d6e21828d5e4e3140ee.jpg not downloaded yet
2026-04-27 07:59:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142be0ead0>
2026-04-27 07:59:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21a220f7-e414-54bc-a7c1-307ad431a547/21a220f7-e414-54bc-a7c1-307ad431a547_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:59:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/39/5b39350ee939e86001d92073bef74f29/pa/SB35500_129ed2299ea5c7ff3f06af007cd77e08.jpg saved to cache
2026-04-27 07:59:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 21a220f7-e414-54bc-a7c1-307ad431a547
2026-04-27 07:59:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/f1/7af1ee0683ac750f2cf5b828140e6e4d/pa/WN54691_a979e2b7ad2d14e410cfe2000e163189.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c87e50>
2026-04-27 07:59:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c49e49e1-4dfb-52ca-94ca-5b85c40003e0/c49e49e1-4dfb-52ca-94ca-5b85c40003e0_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:59:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/a2/6ea23628a61b06421af0ee58f60c5e6d/pa/KV39723_78b095751845a59ce507b3afbdd5d58c.jpg saved to cache
2026-04-27 07:59:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c49e49e1-4dfb-52ca-94ca-5b85c40003e0
2026-04-27 07:59:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/f1/7af1ee0683ac750f2cf5b828140e6e4d/pa/WN54691_8f4f83dc934fe2848b2a3c2a2a2117a5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/f1/7af1ee0683ac750f2cf5b828140e6e4d/pa/WN54691_9804d9485702bf208e4e6c01ef842f43.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a56d50>
2026-04-27 07:59:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32d9dff2-124f-5d8c-87ed-ca0f660580a3/32d9dff2-124f-5d8c-87ed-ca0f660580a3_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:59:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/f1/7af1ee0683ac750f2cf5b828140e6e4d/pa/WN54691_a979e2b7ad2d14e410cfe2000e163189.jpg saved to cache
2026-04-27 07:59:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 32d9dff2-124f-5d8c-87ed-ca0f660580a3
2026-04-27 07:59:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/f1/7af1ee0683ac750f2cf5b828140e6e4d/pa/WN54691_b922eddd47c68d6e21828d5e4e3140ee.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a563d0>
2026-04-27 07:59:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32d9dff2-124f-5d8c-87ed-ca0f660580a3/32d9dff2-124f-5d8c-87ed-ca0f660580a3_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:59:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/f1/7af1ee0683ac750f2cf5b828140e6e4d/pa/WN54691_8f4f83dc934fe2848b2a3c2a2a2117a5.jpg saved to cache
2026-04-27 07:59:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 32d9dff2-124f-5d8c-87ed-ca0f660580a3
2026-04-27 07:59:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438dc8f50>
2026-04-27 07:59:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32d9dff2-124f-5d8c-87ed-ca0f660580a3/32d9dff2-124f-5d8c-87ed-ca0f660580a3_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:59:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/f1/7af1ee0683ac750f2cf5b828140e6e4d/pa/WN54691_9804d9485702bf208e4e6c01ef842f43.jpg saved to cache
2026-04-27 07:59:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 32d9dff2-124f-5d8c-87ed-ca0f660580a3
2026-04-27 07:59:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438dc9d10>
2026-04-27 07:59:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32d9dff2-124f-5d8c-87ed-ca0f660580a3/32d9dff2-124f-5d8c-87ed-ca0f660580a3_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:59:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/f1/7af1ee0683ac750f2cf5b828140e6e4d/pa/WN54691_b922eddd47c68d6e21828d5e4e3140ee.jpg saved to cache
2026-04-27 07:59:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 32d9dff2-124f-5d8c-87ed-ca0f660580a3
2026-04-27 07:59:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/f1/7af1ee0683ac750f2cf5b828140e6e4d/pa/WN54691_b7a90814b3aff18f233e5469461c2d4f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/f1/7af1ee0683ac750f2cf5b828140e6e4d/pa/WN54691_e7d9c93d788d24bda52efd7c7f731f75.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/f1/7af1ee0683ac750f2cf5b828140e6e4d/pa/WN54691_031b5ff6c627c1727fc80ae3f3371dce.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/f1/7af1ee0683ac750f2cf5b828140e6e4d/pa/WN54691_ec3fd9b1d33635d44238e4947f89b7b0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/f1/7af1ee0683ac750f2cf5b828140e6e4d/pa/WN54691_3fa09984ef8d2f11aaea226bf307c168.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438dc9650>
2026-04-27 07:59:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32d9dff2-124f-5d8c-87ed-ca0f660580a3/32d9dff2-124f-5d8c-87ed-ca0f660580a3_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:59:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/f1/7af1ee0683ac750f2cf5b828140e6e4d/pa/WN54691_b7a90814b3aff18f233e5469461c2d4f.jpg saved to cache
2026-04-27 07:59:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 32d9dff2-124f-5d8c-87ed-ca0f660580a3
2026-04-27 07:59:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ec1710>
2026-04-27 07:59:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32d9dff2-124f-5d8c-87ed-ca0f660580a3/32d9dff2-124f-5d8c-87ed-ca0f660580a3_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:59:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/f1/7af1ee0683ac750f2cf5b828140e6e4d/pa/WN54691_e7d9c93d788d24bda52efd7c7f731f75.jpg saved to cache
2026-04-27 07:59:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 32d9dff2-124f-5d8c-87ed-ca0f660580a3
2026-04-27 07:59:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143adb29d0>
2026-04-27 07:59:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32d9dff2-124f-5d8c-87ed-ca0f660580a3/32d9dff2-124f-5d8c-87ed-ca0f660580a3_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:59:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/f1/7af1ee0683ac750f2cf5b828140e6e4d/pa/WN54691_031b5ff6c627c1727fc80ae3f3371dce.jpg saved to cache
2026-04-27 07:59:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 32d9dff2-124f-5d8c-87ed-ca0f660580a3
2026-04-27 07:59:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/f1/7af1ee0683ac750f2cf5b828140e6e4d/pa/WN54691_2e1febc23fb5a51c7df061172735021c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438130110>
2026-04-27 07:59:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32d9dff2-124f-5d8c-87ed-ca0f660580a3/32d9dff2-124f-5d8c-87ed-ca0f660580a3_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:59:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/f1/7af1ee0683ac750f2cf5b828140e6e4d/pa/WN54691_ec3fd9b1d33635d44238e4947f89b7b0.jpg saved to cache
2026-04-27 07:59:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 32d9dff2-124f-5d8c-87ed-ca0f660580a3
2026-04-27 07:59:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14381ed650>
2026-04-27 07:59:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32d9dff2-124f-5d8c-87ed-ca0f660580a3/32d9dff2-124f-5d8c-87ed-ca0f660580a3_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:59:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/f1/7af1ee0683ac750f2cf5b828140e6e4d/pa/WN54691_3fa09984ef8d2f11aaea226bf307c168.jpg saved to cache
2026-04-27 07:59:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 32d9dff2-124f-5d8c-87ed-ca0f660580a3
2026-04-27 07:59:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/39/5b39350ee939e86001d92073bef74f29/pa/SB35500_ed5a83610b22c2936f010b52bf9895ba.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c87490>
2026-04-27 07:59:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32d9dff2-124f-5d8c-87ed-ca0f660580a3/32d9dff2-124f-5d8c-87ed-ca0f660580a3_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:59:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/f1/7af1ee0683ac750f2cf5b828140e6e4d/pa/WN54691_2e1febc23fb5a51c7df061172735021c.jpg saved to cache
2026-04-27 07:59:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 32d9dff2-124f-5d8c-87ed-ca0f660580a3
2026-04-27 07:59:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 32d9dff2-124f-5d8c-87ed-ca0f660580a3, skipping ID generation
2026-04-27 07:59:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32d9dff2-124f-5d8c-87ed-ca0f660580a3 with scrape type 1
2026-04-27 07:59:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 32d9dff2-124f-5d8c-87ed-ca0f660580a3 sending to next pipeline
2026-04-27 07:59:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 32d9dff2-124f-5d8c-87ed-ca0f660580a3, identifier: WN54691
2026-04-27 07:59:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 32d9dff2-124f-5d8c-87ed-ca0f660580a3 with identifier: WN54691
2026-04-27 07:59:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 32d9dff2-124f-5d8c-87ed-ca0f660580a3 with identifier: WN54691
2026-04-27 07:59:53 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 32d9dff2-124f-5d8c-87ed-ca0f660580a3 with identifier: WN54691 to the API
2026-04-27 07:59:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:54 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img7a/f1/7af1ee0683ac750f2cf5b828140e6e4d/pa/WN54691_2e1febc23fb5a51c7df061172735021c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'category': None,
 'city': 'Beaucaire',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 130,
 'expiration_date': '2026-04-28T15:56:24Z',
 'fuel_type': 'diesel',
 'id': '32d9dff2-124f-5d8c-87ed-ca0f660580a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 43.8081,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WN54691',
 'listing': 'auction',
 'location': 'FR, Beaucaire',
 'location_confidence': 'geocoded',
 'longitude': 4.6442,
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 176767,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_32d9dff2-124f-5d8c-87ed-ca0f660580a3/32d9dff2-124f-5d8c-87ed-ca0f660580a3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71764,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/f1/7af1ee0683ac750f2cf5b828140e6e4d/pa/WN54691_2e1febc23fb5a51c7df061172735021c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_32d9dff2-124f-5d8c-87ed-ca0f660580a3/32d9dff2-124f-5d8c-87ed-ca0f660580a3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68381,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/f1/7af1ee0683ac750f2cf5b828140e6e4d/pa/WN54691_8f4f83dc934fe2848b2a3c2a2a2117a5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_32d9dff2-124f-5d8c-87ed-ca0f660580a3/32d9dff2-124f-5d8c-87ed-ca0f660580a3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76585,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/f1/7af1ee0683ac750f2cf5b828140e6e4d/pa/WN54691_a979e2b7ad2d14e410cfe2000e163189.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_32d9dff2-124f-5d8c-87ed-ca0f660580a3/32d9dff2-124f-5d8c-87ed-ca0f660580a3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57915,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/f1/7af1ee0683ac750f2cf5b828140e6e4d/pa/WN54691_ec3fd9b1d33635d44238e4947f89b7b0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_32d9dff2-124f-5d8c-87ed-ca0f660580a3/32d9dff2-124f-5d8c-87ed-ca0f660580a3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64070,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/f1/7af1ee0683ac750f2cf5b828140e6e4d/pa/WN54691_3fa09984ef8d2f11aaea226bf307c168.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_32d9dff2-124f-5d8c-87ed-ca0f660580a3/32d9dff2-124f-5d8c-87ed-ca0f660580a3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74087,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/f1/7af1ee0683ac750f2cf5b828140e6e4d/pa/WN54691_031b5ff6c627c1727fc80ae3f3371dce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_32d9dff2-124f-5d8c-87ed-ca0f660580a3/32d9dff2-124f-5d8c-87ed-ca0f660580a3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56438,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/f1/7af1ee0683ac750f2cf5b828140e6e4d/pa/WN54691_b7a90814b3aff18f233e5469461c2d4f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_32d9dff2-124f-5d8c-87ed-ca0f660580a3/32d9dff2-124f-5d8c-87ed-ca0f660580a3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79358,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/f1/7af1ee0683ac750f2cf5b828140e6e4d/pa/WN54691_e7d9c93d788d24bda52efd7c7f731f75.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_32d9dff2-124f-5d8c-87ed-ca0f660580a3/32d9dff2-124f-5d8c-87ed-ca0f660580a3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68426,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/f1/7af1ee0683ac750f2cf5b828140e6e4d/pa/WN54691_9804d9485702bf208e4e6c01ef842f43.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_32d9dff2-124f-5d8c-87ed-ca0f660580a3/32d9dff2-124f-5d8c-87ed-ca0f660580a3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58729,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/f1/7af1ee0683ac750f2cf5b828140e6e4d/pa/WN54691_b922eddd47c68d6e21828d5e4e3140ee.jpg',
             'Width': 800}],
 'postal_code': '30300',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Gard',
 'province_code': 'FR-30',
 'region': 'Occitanie',
 'region_code': 'FR-76',
 'registration_date': '2017-04-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Megane 1.6 dCi Energy Zen',
 'transmission': 'manual',
 'trim': 'Zen',
 'year': 2017}
2026-04-27 07:59:54 [auto1.fr] INFO: Saving data for WN54691: {'created_time': 1777276794.696636, 'last_price_update_time': 1777276794.696651, 'has_photos': True, 'auction_closing_time': 1777391784.0}
2026-04-27 07:59:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/39/5b39350ee939e86001d92073bef74f29/pa/SB35500_bdcf5d68b3c1d0a0363e112ffdc5bf00.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/a2/6ea23628a61b06421af0ee58f60c5e6d/pa/KV39723_5a6c3f72e0392ea7a0c2f148a3af0827.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bfd50d0>
2026-04-27 07:59:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21a220f7-e414-54bc-a7c1-307ad431a547/21a220f7-e414-54bc-a7c1-307ad431a547_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:59:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/39/5b39350ee939e86001d92073bef74f29/pa/SB35500_ed5a83610b22c2936f010b52bf9895ba.jpg saved to cache
2026-04-27 07:59:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 21a220f7-e414-54bc-a7c1-307ad431a547
2026-04-27 07:59:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143812e750>
2026-04-27 07:59:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21a220f7-e414-54bc-a7c1-307ad431a547/21a220f7-e414-54bc-a7c1-307ad431a547_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:59:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/39/5b39350ee939e86001d92073bef74f29/pa/SB35500_bdcf5d68b3c1d0a0363e112ffdc5bf00.jpg saved to cache
2026-04-27 07:59:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 21a220f7-e414-54bc-a7c1-307ad431a547
2026-04-27 07:59:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 21a220f7-e414-54bc-a7c1-307ad431a547, skipping ID generation
2026-04-27 07:59:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21a220f7-e414-54bc-a7c1-307ad431a547 with scrape type 1
2026-04-27 07:59:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 21a220f7-e414-54bc-a7c1-307ad431a547 sending to next pipeline
2026-04-27 07:59:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 21a220f7-e414-54bc-a7c1-307ad431a547, identifier: SB35500
2026-04-27 07:59:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 21a220f7-e414-54bc-a7c1-307ad431a547 with identifier: SB35500
2026-04-27 07:59:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 21a220f7-e414-54bc-a7c1-307ad431a547 with identifier: SB35500
2026-04-27 07:59:55 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 21a220f7-e414-54bc-a7c1-307ad431a547 with identifier: SB35500 to the API
2026-04-27 07:59:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:55 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5b/39/5b39350ee939e86001d92073bef74f29/pa/SB35500_bdcf5d68b3c1d0a0363e112ffdc5bf00.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 208,
 'category': None,
 'city': 'La Ravoire',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 2',
 'engine': '2.0L',
 'engine_horse_power': 98,
 'expiration_date': '2026-04-28T15:07:46Z',
 'fuel_type': 'diesel',
 'id': '21a220f7-e414-54bc-a7c1-307ad431a547',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 45.5627,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SB35500',
 'listing': 'auction',
 'location': 'FR, La Ravoire',
 'location_confidence': 'geocoded',
 'longitude': 5.9583,
 'make': 'Land Rover',
 'model': 'Freelander',
 'odometer': 214553,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_21a220f7-e414-54bc-a7c1-307ad431a547/21a220f7-e414-54bc-a7c1-307ad431a547_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110519,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/39/5b39350ee939e86001d92073bef74f29/pa/SB35500_fc326c3919bfc72ef3e60ccde56a9a8f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_21a220f7-e414-54bc-a7c1-307ad431a547/21a220f7-e414-54bc-a7c1-307ad431a547_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112419,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/39/5b39350ee939e86001d92073bef74f29/pa/SB35500_bdcf5d68b3c1d0a0363e112ffdc5bf00.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_21a220f7-e414-54bc-a7c1-307ad431a547/21a220f7-e414-54bc-a7c1-307ad431a547_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95156,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/39/5b39350ee939e86001d92073bef74f29/pa/SB35500_ed5a83610b22c2936f010b52bf9895ba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_21a220f7-e414-54bc-a7c1-307ad431a547/21a220f7-e414-54bc-a7c1-307ad431a547_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60480,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/39/5b39350ee939e86001d92073bef74f29/pa/SB35500_129ed2299ea5c7ff3f06af007cd77e08.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_21a220f7-e414-54bc-a7c1-307ad431a547/21a220f7-e414-54bc-a7c1-307ad431a547_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88533,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/39/5b39350ee939e86001d92073bef74f29/pa/SB35500_231bf95ef6209885a063580a12b42b83.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_21a220f7-e414-54bc-a7c1-307ad431a547/21a220f7-e414-54bc-a7c1-307ad431a547_image_5.png',
             'Extension': 'png',
             'FileSizeInBytes': 87062,
             'Height': 525,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/39/5b39350ee939e86001d92073bef74f29/pa/SB35500_36f48e4510d417061018a1263bfe12f9.png',
             'Width': 800}],
 'postal_code': '73490',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Savoie',
 'province_code': 'FR-73',
 'region': 'Auvergne-Rhône-Alpes',
 'region_code': 'FR-84',
 'registration_date': '1999-05-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Freelander 2.0 Turbodiesel Di Familiar',
 'transmission': 'manual',
 'trim': 'Di Familiar',
 'year': 1999}
2026-04-27 07:59:55 [auto1.fr] INFO: Saving data for SB35500: {'created_time': 1777276795.2775, 'last_price_update_time': 1777276795.277512, 'has_photos': True, 'auction_closing_time': 1777388866.0}
2026-04-27 07:59:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/a2/6ea23628a61b06421af0ee58f60c5e6d/pa/KV39723_bc169f09a888d879b2504ca5d168e956.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143817d010>
2026-04-27 07:59:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c49e49e1-4dfb-52ca-94ca-5b85c40003e0/c49e49e1-4dfb-52ca-94ca-5b85c40003e0_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:59:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/a2/6ea23628a61b06421af0ee58f60c5e6d/pa/KV39723_5a6c3f72e0392ea7a0c2f148a3af0827.jpg saved to cache
2026-04-27 07:59:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c49e49e1-4dfb-52ca-94ca-5b85c40003e0
2026-04-27 07:59:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/a2/6ea23628a61b06421af0ee58f60c5e6d/pa/KV39723_d0a14097a836ab6343f30799979a60e2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438131e10>
2026-04-27 07:59:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c49e49e1-4dfb-52ca-94ca-5b85c40003e0/c49e49e1-4dfb-52ca-94ca-5b85c40003e0_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:59:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/a2/6ea23628a61b06421af0ee58f60c5e6d/pa/KV39723_bc169f09a888d879b2504ca5d168e956.jpg saved to cache
2026-04-27 07:59:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c49e49e1-4dfb-52ca-94ca-5b85c40003e0
2026-04-27 07:59:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f144750d650>
2026-04-27 07:59:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c49e49e1-4dfb-52ca-94ca-5b85c40003e0/c49e49e1-4dfb-52ca-94ca-5b85c40003e0_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:59:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/a2/6ea23628a61b06421af0ee58f60c5e6d/pa/KV39723_d0a14097a836ab6343f30799979a60e2.jpg saved to cache
2026-04-27 07:59:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c49e49e1-4dfb-52ca-94ca-5b85c40003e0
2026-04-27 07:59:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c49e49e1-4dfb-52ca-94ca-5b85c40003e0, skipping ID generation
2026-04-27 07:59:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c49e49e1-4dfb-52ca-94ca-5b85c40003e0 with scrape type 1
2026-04-27 07:59:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c49e49e1-4dfb-52ca-94ca-5b85c40003e0 sending to next pipeline
2026-04-27 07:59:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c49e49e1-4dfb-52ca-94ca-5b85c40003e0, identifier: KV39723
2026-04-27 07:59:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c49e49e1-4dfb-52ca-94ca-5b85c40003e0 with identifier: KV39723
2026-04-27 07:59:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c49e49e1-4dfb-52ca-94ca-5b85c40003e0 with identifier: KV39723
2026-04-27 07:59:55 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c49e49e1-4dfb-52ca-94ca-5b85c40003e0 with identifier: KV39723 to the API
2026-04-27 07:59:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:55 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6e/a2/6ea23628a61b06421af0ee58f60c5e6d/pa/KV39723_d0a14097a836ab6343f30799979a60e2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'category': None,
 'city': 'Le Havre',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 110,
 'expiration_date': '2026-04-28T15:04:55Z',
 'fuel_type': 'diesel',
 'id': 'c49e49e1-4dfb-52ca-94ca-5b85c40003e0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 49.4935,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV39723',
 'listing': 'auction',
 'location': 'FR, LE HAVRE',
 'location_confidence': 'geocoded',
 'longitude': 0.1079,
 'make': 'Mazda',
 'model': '3',
 'odometer': 211735,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c49e49e1-4dfb-52ca-94ca-5b85c40003e0/c49e49e1-4dfb-52ca-94ca-5b85c40003e0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98598,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/a2/6ea23628a61b06421af0ee58f60c5e6d/pa/KV39723_bc169f09a888d879b2504ca5d168e956.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c49e49e1-4dfb-52ca-94ca-5b85c40003e0/c49e49e1-4dfb-52ca-94ca-5b85c40003e0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105931,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/a2/6ea23628a61b06421af0ee58f60c5e6d/pa/KV39723_d0a14097a836ab6343f30799979a60e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c49e49e1-4dfb-52ca-94ca-5b85c40003e0/c49e49e1-4dfb-52ca-94ca-5b85c40003e0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98753,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/a2/6ea23628a61b06421af0ee58f60c5e6d/pa/KV39723_5a6c3f72e0392ea7a0c2f148a3af0827.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c49e49e1-4dfb-52ca-94ca-5b85c40003e0/c49e49e1-4dfb-52ca-94ca-5b85c40003e0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72421,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/a2/6ea23628a61b06421af0ee58f60c5e6d/pa/KV39723_78b095751845a59ce507b3afbdd5d58c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c49e49e1-4dfb-52ca-94ca-5b85c40003e0/c49e49e1-4dfb-52ca-94ca-5b85c40003e0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115923,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/a2/6ea23628a61b06421af0ee58f60c5e6d/pa/KV39723_eb33cec6a99d9719abc58d7f584e5e89.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c49e49e1-4dfb-52ca-94ca-5b85c40003e0/c49e49e1-4dfb-52ca-94ca-5b85c40003e0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42269,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/a2/6ea23628a61b06421af0ee58f60c5e6d/pa/KV39723_4c1a35c2d185e57e2c49cb3365fe6fc5.jpg',
             'Width': 800}],
 'postal_code': '76050 CEDEX',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Seine-Maritime',
 'province_code': 'FR-76',
 'region': 'Normandie',
 'region_code': 'FR-28',
 'registration_date': '2007-11-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mazda 3 1.6 CD Diesel Elégance',
 'transmission': 'manual',
 'trim': 'Elégance',
 'year': 2007}
2026-04-27 07:59:55 [auto1.fr] INFO: Saving data for KV39723: {'created_time': 1777276795.879001, 'last_price_update_time': 1777276795.879012, 'has_photos': True, 'auction_closing_time': 1777388695.0}
2026-04-27 07:59:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/c7/c3c78eec1d9c34c9b334f3dd108f8e60/pa/EP16771_e4cd0b75e6c50b7f85f995f40f245589.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/c7/c3c78eec1d9c34c9b334f3dd108f8e60/pa/EP16771_ab1748c7f7b6f7bc7b81cfa01cb7f3f9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/c7/c3c78eec1d9c34c9b334f3dd108f8e60/pa/EP16771_08afe81ed66e64cc19b8fc2dfae3e963.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ae7150>
2026-04-27 07:59:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b389423-2149-52d0-a830-b4f42220ce97/5b389423-2149-52d0-a830-b4f42220ce97_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:59:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/c7/c3c78eec1d9c34c9b334f3dd108f8e60/pa/EP16771_e4cd0b75e6c50b7f85f995f40f245589.jpg saved to cache
2026-04-27 07:59:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5b389423-2149-52d0-a830-b4f42220ce97
2026-04-27 07:59:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d2f910>
2026-04-27 07:59:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b389423-2149-52d0-a830-b4f42220ce97/5b389423-2149-52d0-a830-b4f42220ce97_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:59:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/c7/c3c78eec1d9c34c9b334f3dd108f8e60/pa/EP16771_ab1748c7f7b6f7bc7b81cfa01cb7f3f9.jpg saved to cache
2026-04-27 07:59:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5b389423-2149-52d0-a830-b4f42220ce97
2026-04-27 07:59:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143809b590>
2026-04-27 07:59:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b389423-2149-52d0-a830-b4f42220ce97/5b389423-2149-52d0-a830-b4f42220ce97_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:59:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/c7/c3c78eec1d9c34c9b334f3dd108f8e60/pa/EP16771_08afe81ed66e64cc19b8fc2dfae3e963.jpg saved to cache
2026-04-27 07:59:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5b389423-2149-52d0-a830-b4f42220ce97
2026-04-27 07:59:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5b389423-2149-52d0-a830-b4f42220ce97, skipping ID generation
2026-04-27 07:59:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b389423-2149-52d0-a830-b4f42220ce97 with scrape type 1
2026-04-27 07:59:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5b389423-2149-52d0-a830-b4f42220ce97 sending to next pipeline
2026-04-27 07:59:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5b389423-2149-52d0-a830-b4f42220ce97, identifier: EP16771
2026-04-27 07:59:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5b389423-2149-52d0-a830-b4f42220ce97 with identifier: EP16771
2026-04-27 07:59:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5b389423-2149-52d0-a830-b4f42220ce97 with identifier: EP16771
2026-04-27 07:59:56 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 5b389423-2149-52d0-a830-b4f42220ce97 with identifier: EP16771 to the API
2026-04-27 07:59:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:56 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc3/c7/c3c78eec1d9c34c9b334f3dd108f8e60/pa/EP16771_08afe81ed66e64cc19b8fc2dfae3e963.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'category': None,
 'city': 'Bussy-Lettrée',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.0L',
 'engine_horse_power': 68,
 'expiration_date': '2026-04-28T15:04:58Z',
 'fuel_type': 'petrol',
 'id': '5b389423-2149-52d0-a830-b4f42220ce97',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.8052,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EP16771',
 'listing': 'auction',
 'location': 'FR, Bussy-Lettrée',
 'location_confidence': 'geocoded',
 'longitude': 4.2592,
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 81995,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5b389423-2149-52d0-a830-b4f42220ce97/5b389423-2149-52d0-a830-b4f42220ce97_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83779,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/c7/c3c78eec1d9c34c9b334f3dd108f8e60/pa/EP16771_08afe81ed66e64cc19b8fc2dfae3e963.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5b389423-2149-52d0-a830-b4f42220ce97/5b389423-2149-52d0-a830-b4f42220ce97_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82427,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/c7/c3c78eec1d9c34c9b334f3dd108f8e60/pa/EP16771_ab1748c7f7b6f7bc7b81cfa01cb7f3f9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5b389423-2149-52d0-a830-b4f42220ce97/5b389423-2149-52d0-a830-b4f42220ce97_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77628,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/c7/c3c78eec1d9c34c9b334f3dd108f8e60/pa/EP16771_e4cd0b75e6c50b7f85f995f40f245589.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5b389423-2149-52d0-a830-b4f42220ce97/5b389423-2149-52d0-a830-b4f42220ce97_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68952,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/c7/c3c78eec1d9c34c9b334f3dd108f8e60/pa/EP16771_7a52baa3b512920b86716fccbd5526a4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5b389423-2149-52d0-a830-b4f42220ce97/5b389423-2149-52d0-a830-b4f42220ce97_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78112,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/c7/c3c78eec1d9c34c9b334f3dd108f8e60/pa/EP16771_d6c0446133bbdddd7da651b5c2b63f95.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5b389423-2149-52d0-a830-b4f42220ce97/5b389423-2149-52d0-a830-b4f42220ce97_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38304,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/c7/c3c78eec1d9c34c9b334f3dd108f8e60/pa/EP16771_b4a733a2efc1c8604e69f4e6f3ee54fc.jpg',
             'Width': 800}],
 'postal_code': '51320',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Marne',
 'province_code': 'FR-51',
 'region': 'Grand Est',
 'region_code': 'FR-44',
 'registration_date': '2014-05-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 1.0 VTi Confort',
 'transmission': 'manual',
 'trim': 'Confort',
 'year': 2014}
2026-04-27 07:59:56 [auto1.fr] INFO: Saving data for EP16771: {'created_time': 1777276796.553193, 'last_price_update_time': 1777276796.553202, 'has_photos': True, 'auction_closing_time': 1777388698.0}
2026-04-27 07:59:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EB39116> (referer: https://www.auto1.com/v1/car-details-view/EB39116/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e25ae8db-cee0-5a11-9310-ea68b473436e with identifier: EB39116
2026-04-27 07:59:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e25ae8db-cee0-5a11-9310-ea68b473436e with scrape type 1
2026-04-27 07:59:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e25ae8db-cee0-5a11-9310-ea68b473436e
2026-04-27 07:59:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/cc/22cccefa44c3c5688c690292bbe32078/pa/EB39116_2db45b5927b6e3e6de05a9fb29397a8b.jpg not downloaded yet
2026-04-27 07:59:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/cc/22cccefa44c3c5688c690292bbe32078/pa/EB39116_f0e20fe931f6407a43756953f457994d.jpg not downloaded yet
2026-04-27 07:59:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/cc/22cccefa44c3c5688c690292bbe32078/pa/EB39116_7babaf26a8aff9690bddee9b88b617c6.jpg not downloaded yet
2026-04-27 07:59:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/cc/22cccefa44c3c5688c690292bbe32078/pa/EB39116_b0e7dee7753c9acd9a7c2befa4e8a69b.jpg not downloaded yet
2026-04-27 07:59:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/cc/22cccefa44c3c5688c690292bbe32078/pa/EB39116_45064099d73420ca18f2558393881679.jpg not downloaded yet
2026-04-27 07:59:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/cc/22cccefa44c3c5688c690292bbe32078/pa/EB39116_54af6e8eef416725e21c51d45fabfd4d.jpg not downloaded yet
2026-04-27 07:59:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/cc/22cccefa44c3c5688c690292bbe32078/pa/EB39116_1a45f33f9460b672d614f194f387e6ce.jpg not downloaded yet
2026-04-27 07:59:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/cc/22cccefa44c3c5688c690292bbe32078/pa/EB39116_b68980fa439eeff9d9c27314653f9947.jpg not downloaded yet
2026-04-27 07:59:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/cc/22cccefa44c3c5688c690292bbe32078/pa/EB39116_9c0393b6a0e2db8fd4c972874219d261.jpg not downloaded yet
2026-04-27 07:59:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/cc/22cccefa44c3c5688c690292bbe32078/pa/EB39116_5a7259f8124626465ebb8a15524ffa6b.jpg not downloaded yet
2026-04-27 07:59:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JA68663> (referer: https://www.auto1.com/v1/car-details-view/JA68663/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf532ab9-fe27-51a7-b449-add0ecb7edf2 with identifier: JA68663
2026-04-27 07:59:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf532ab9-fe27-51a7-b449-add0ecb7edf2 with scrape type 1
2026-04-27 07:59:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cf532ab9-fe27-51a7-b449-add0ecb7edf2
2026-04-27 07:59:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/a7/61a73f43f8639b0290725005642a625f/pa/JA68663_91ca3ab1d540721f23902fcf8763ce67.jpg not downloaded yet
2026-04-27 07:59:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/a7/61a73f43f8639b0290725005642a625f/pa/JA68663_e31033988ca87c7b1b98e4673d9d0e9e.jpg not downloaded yet
2026-04-27 07:59:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/cc/22cccefa44c3c5688c690292bbe32078/pa/EB39116_5a7259f8124626465ebb8a15524ffa6b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/a7/61a73f43f8639b0290725005642a625f/pa/JA68663_6f329a0cd23e223f6ca105c37f796ff3.jpg not downloaded yet
2026-04-27 07:59:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/a7/61a73f43f8639b0290725005642a625f/pa/JA68663_b618f1343ba90db9345d6a3741e74a96.jpg not downloaded yet
2026-04-27 07:59:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/a7/61a73f43f8639b0290725005642a625f/pa/JA68663_f5a6da844acdd574e78336635ef49c6e.jpg not downloaded yet
2026-04-27 07:59:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/a7/61a73f43f8639b0290725005642a625f/pa/JA68663_a5781be7c386eca79e299793239b281a.jpg not downloaded yet
2026-04-27 07:59:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/a7/61a73f43f8639b0290725005642a625f/pa/JA68663_08849d62c73b8fb926074d37e6e0cf0e.jpg not downloaded yet
2026-04-27 07:59:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/a7/61a73f43f8639b0290725005642a625f/pa/JA68663_07613941b3a1d1ceda681ea651740974.jpg not downloaded yet
2026-04-27 07:59:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/a7/61a73f43f8639b0290725005642a625f/pa/JA68663_e391ad7ecafb201d4f2b16ba48f2fc5b.jpg not downloaded yet
2026-04-27 07:59:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/a7/61a73f43f8639b0290725005642a625f/pa/JA68663_5c2f248be381e6caa5ee7d443d767adc.jpg not downloaded yet
2026-04-27 07:59:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438df9550>
2026-04-27 07:59:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e25ae8db-cee0-5a11-9310-ea68b473436e/e25ae8db-cee0-5a11-9310-ea68b473436e_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:59:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/cc/22cccefa44c3c5688c690292bbe32078/pa/EB39116_5a7259f8124626465ebb8a15524ffa6b.jpg saved to cache
2026-04-27 07:59:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e25ae8db-cee0-5a11-9310-ea68b473436e
2026-04-27 07:59:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/a7/61a73f43f8639b0290725005642a625f/pa/JA68663_e31033988ca87c7b1b98e4673d9d0e9e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438cb9050>
2026-04-27 07:59:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf532ab9-fe27-51a7-b449-add0ecb7edf2/cf532ab9-fe27-51a7-b449-add0ecb7edf2_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:59:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/a7/61a73f43f8639b0290725005642a625f/pa/JA68663_e31033988ca87c7b1b98e4673d9d0e9e.jpg saved to cache
2026-04-27 07:59:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cf532ab9-fe27-51a7-b449-add0ecb7edf2
2026-04-27 07:59:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/a7/61a73f43f8639b0290725005642a625f/pa/JA68663_5c2f248be381e6caa5ee7d443d767adc.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438f90450>
2026-04-27 07:59:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf532ab9-fe27-51a7-b449-add0ecb7edf2/cf532ab9-fe27-51a7-b449-add0ecb7edf2_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:59:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/a7/61a73f43f8639b0290725005642a625f/pa/JA68663_5c2f248be381e6caa5ee7d443d767adc.jpg saved to cache
2026-04-27 07:59:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cf532ab9-fe27-51a7-b449-add0ecb7edf2
2026-04-27 07:59:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/a7/61a73f43f8639b0290725005642a625f/pa/JA68663_e391ad7ecafb201d4f2b16ba48f2fc5b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:59 [scrapy.extensions.logstats] INFO: Crawled 255 pages (at 24 pages/min), scraped 220 items (at 18 items/min)
2026-04-27 07:59:59 [scrapy.extensions.memusage] INFO: Peak memory usage is 373MiB
2026-04-27 08:00:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142be17c10>
2026-04-27 08:00:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf532ab9-fe27-51a7-b449-add0ecb7edf2/cf532ab9-fe27-51a7-b449-add0ecb7edf2_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:00:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/a7/61a73f43f8639b0290725005642a625f/pa/JA68663_e391ad7ecafb201d4f2b16ba48f2fc5b.jpg saved to cache
2026-04-27 08:00:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cf532ab9-fe27-51a7-b449-add0ecb7edf2
2026-04-27 08:00:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/a7/61a73f43f8639b0290725005642a625f/pa/JA68663_07613941b3a1d1ceda681ea651740974.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d7d610>
2026-04-27 08:00:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf532ab9-fe27-51a7-b449-add0ecb7edf2/cf532ab9-fe27-51a7-b449-add0ecb7edf2_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:00:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/a7/61a73f43f8639b0290725005642a625f/pa/JA68663_07613941b3a1d1ceda681ea651740974.jpg saved to cache
2026-04-27 08:00:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cf532ab9-fe27-51a7-b449-add0ecb7edf2
2026-04-27 08:00:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/a7/61a73f43f8639b0290725005642a625f/pa/JA68663_08849d62c73b8fb926074d37e6e0cf0e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14381301d0>
2026-04-27 08:00:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf532ab9-fe27-51a7-b449-add0ecb7edf2/cf532ab9-fe27-51a7-b449-add0ecb7edf2_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:00:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/a7/61a73f43f8639b0290725005642a625f/pa/JA68663_08849d62c73b8fb926074d37e6e0cf0e.jpg saved to cache
2026-04-27 08:00:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cf532ab9-fe27-51a7-b449-add0ecb7edf2
2026-04-27 08:00:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/a7/61a73f43f8639b0290725005642a625f/pa/JA68663_a5781be7c386eca79e299793239b281a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a54050>
2026-04-27 08:00:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf532ab9-fe27-51a7-b449-add0ecb7edf2/cf532ab9-fe27-51a7-b449-add0ecb7edf2_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:00:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/a7/61a73f43f8639b0290725005642a625f/pa/JA68663_a5781be7c386eca79e299793239b281a.jpg saved to cache
2026-04-27 08:00:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cf532ab9-fe27-51a7-b449-add0ecb7edf2
2026-04-27 08:00:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AF40134> (referer: https://www.auto1.com/v1/car-details-view/AF40134/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/a7/61a73f43f8639b0290725005642a625f/pa/JA68663_f5a6da844acdd574e78336635ef49c6e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17e8dbbc-c625-5cfc-b834-a1829e3e897e with identifier: AF40134
2026-04-27 08:00:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17e8dbbc-c625-5cfc-b834-a1829e3e897e with scrape type 1
2026-04-27 08:00:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 17e8dbbc-c625-5cfc-b834-a1829e3e897e
2026-04-27 08:00:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/7f/a37f8bc58c1dafd6a5bdb51913f2d11e/pa/AF40134_c4d1c880c57b947b63732e7a22085f63.jpg not downloaded yet
2026-04-27 08:00:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/7f/a37f8bc58c1dafd6a5bdb51913f2d11e/pa/AF40134_e83db889dcbb821dc48350c3318c7cd4.jpg not downloaded yet
2026-04-27 08:00:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/7f/a37f8bc58c1dafd6a5bdb51913f2d11e/pa/AF40134_994f01268f5cad2108db5e81d5284fec.jpg not downloaded yet
2026-04-27 08:00:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c37990>
2026-04-27 08:00:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf532ab9-fe27-51a7-b449-add0ecb7edf2/cf532ab9-fe27-51a7-b449-add0ecb7edf2_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:00:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/a7/61a73f43f8639b0290725005642a625f/pa/JA68663_f5a6da844acdd574e78336635ef49c6e.jpg saved to cache
2026-04-27 08:00:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cf532ab9-fe27-51a7-b449-add0ecb7edf2
2026-04-27 08:00:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/7f/a37f8bc58c1dafd6a5bdb51913f2d11e/pa/AF40134_119acb83eb7346de85adaa23843ed72e.jpg not downloaded yet
2026-04-27 08:00:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/a7/61a73f43f8639b0290725005642a625f/pa/JA68663_6f329a0cd23e223f6ca105c37f796ff3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/7f/a37f8bc58c1dafd6a5bdb51913f2d11e/pa/AF40134_c18686c228b5b83219441bd92f379ff4.jpg not downloaded yet
2026-04-27 08:00:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/a7/61a73f43f8639b0290725005642a625f/pa/JA68663_b618f1343ba90db9345d6a3741e74a96.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/7f/a37f8bc58c1dafd6a5bdb51913f2d11e/pa/AF40134_d687265d98f7425645a8030374541cdf.jpg not downloaded yet
2026-04-27 08:00:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/7f/a37f8bc58c1dafd6a5bdb51913f2d11e/pa/AF40134_119acb83eb7346de85adaa23843ed72e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/7f/a37f8bc58c1dafd6a5bdb51913f2d11e/pa/AF40134_c18686c228b5b83219441bd92f379ff4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143817d410>
2026-04-27 08:00:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf532ab9-fe27-51a7-b449-add0ecb7edf2/cf532ab9-fe27-51a7-b449-add0ecb7edf2_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:00:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/a7/61a73f43f8639b0290725005642a625f/pa/JA68663_6f329a0cd23e223f6ca105c37f796ff3.jpg saved to cache
2026-04-27 08:00:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cf532ab9-fe27-51a7-b449-add0ecb7edf2
2026-04-27 08:00:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/7f/a37f8bc58c1dafd6a5bdb51913f2d11e/pa/AF40134_d687265d98f7425645a8030374541cdf.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143812d250>
2026-04-27 08:00:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf532ab9-fe27-51a7-b449-add0ecb7edf2/cf532ab9-fe27-51a7-b449-add0ecb7edf2_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:00:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/a7/61a73f43f8639b0290725005642a625f/pa/JA68663_b618f1343ba90db9345d6a3741e74a96.jpg saved to cache
2026-04-27 08:00:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cf532ab9-fe27-51a7-b449-add0ecb7edf2
2026-04-27 08:00:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438130510>
2026-04-27 08:00:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17e8dbbc-c625-5cfc-b834-a1829e3e897e/17e8dbbc-c625-5cfc-b834-a1829e3e897e_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:00:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/7f/a37f8bc58c1dafd6a5bdb51913f2d11e/pa/AF40134_119acb83eb7346de85adaa23843ed72e.jpg saved to cache
2026-04-27 08:00:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 17e8dbbc-c625-5cfc-b834-a1829e3e897e
2026-04-27 08:00:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ffb0d0>
2026-04-27 08:00:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17e8dbbc-c625-5cfc-b834-a1829e3e897e/17e8dbbc-c625-5cfc-b834-a1829e3e897e_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:00:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/7f/a37f8bc58c1dafd6a5bdb51913f2d11e/pa/AF40134_c18686c228b5b83219441bd92f379ff4.jpg saved to cache
2026-04-27 08:00:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 17e8dbbc-c625-5cfc-b834-a1829e3e897e
2026-04-27 08:00:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143817d890>
2026-04-27 08:00:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17e8dbbc-c625-5cfc-b834-a1829e3e897e/17e8dbbc-c625-5cfc-b834-a1829e3e897e_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:00:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/7f/a37f8bc58c1dafd6a5bdb51913f2d11e/pa/AF40134_d687265d98f7425645a8030374541cdf.jpg saved to cache
2026-04-27 08:00:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 17e8dbbc-c625-5cfc-b834-a1829e3e897e
2026-04-27 08:00:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/7f/a37f8bc58c1dafd6a5bdb51913f2d11e/pa/AF40134_994f01268f5cad2108db5e81d5284fec.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/7f/a37f8bc58c1dafd6a5bdb51913f2d11e/pa/AF40134_c4d1c880c57b947b63732e7a22085f63.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/a7/61a73f43f8639b0290725005642a625f/pa/JA68663_91ca3ab1d540721f23902fcf8763ce67.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ae4b10>
2026-04-27 08:00:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17e8dbbc-c625-5cfc-b834-a1829e3e897e/17e8dbbc-c625-5cfc-b834-a1829e3e897e_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:00:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/7f/a37f8bc58c1dafd6a5bdb51913f2d11e/pa/AF40134_994f01268f5cad2108db5e81d5284fec.jpg saved to cache
2026-04-27 08:00:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 17e8dbbc-c625-5cfc-b834-a1829e3e897e
2026-04-27 08:00:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/7f/a37f8bc58c1dafd6a5bdb51913f2d11e/pa/AF40134_e83db889dcbb821dc48350c3318c7cd4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438f825d0>
2026-04-27 08:00:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17e8dbbc-c625-5cfc-b834-a1829e3e897e/17e8dbbc-c625-5cfc-b834-a1829e3e897e_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:00:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/7f/a37f8bc58c1dafd6a5bdb51913f2d11e/pa/AF40134_c4d1c880c57b947b63732e7a22085f63.jpg saved to cache
2026-04-27 08:00:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 17e8dbbc-c625-5cfc-b834-a1829e3e897e
2026-04-27 08:00:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b94f10>
2026-04-27 08:00:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf532ab9-fe27-51a7-b449-add0ecb7edf2/cf532ab9-fe27-51a7-b449-add0ecb7edf2_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:00:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/a7/61a73f43f8639b0290725005642a625f/pa/JA68663_91ca3ab1d540721f23902fcf8763ce67.jpg saved to cache
2026-04-27 08:00:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cf532ab9-fe27-51a7-b449-add0ecb7edf2
2026-04-27 08:00:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cf532ab9-fe27-51a7-b449-add0ecb7edf2, skipping ID generation
2026-04-27 08:00:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf532ab9-fe27-51a7-b449-add0ecb7edf2 with scrape type 1
2026-04-27 08:00:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cf532ab9-fe27-51a7-b449-add0ecb7edf2 sending to next pipeline
2026-04-27 08:00:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: cf532ab9-fe27-51a7-b449-add0ecb7edf2, identifier: JA68663
2026-04-27 08:00:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: cf532ab9-fe27-51a7-b449-add0ecb7edf2 with identifier: JA68663
2026-04-27 08:00:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: cf532ab9-fe27-51a7-b449-add0ecb7edf2 with identifier: JA68663
2026-04-27 08:00:01 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: cf532ab9-fe27-51a7-b449-add0ecb7edf2 with identifier: JA68663 to the API
2026-04-27 08:00:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:02 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img61/a7/61a73f43f8639b0290725005642a625f/pa/JA68663_91ca3ab1d540721f23902fcf8763ce67.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'category': None,
 'city': 'Loyettes',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.1L',
 'engine_horse_power': 136,
 'expiration_date': '2026-04-28T15:03:23Z',
 'fuel_type': 'diesel',
 'id': 'cf532ab9-fe27-51a7-b449-add0ecb7edf2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 45.7766,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JA68663',
 'listing': 'auction',
 'location': 'FR, Loyettes',
 'location_confidence': 'geocoded',
 'longitude': 5.2069,
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 147010,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cf532ab9-fe27-51a7-b449-add0ecb7edf2/cf532ab9-fe27-51a7-b449-add0ecb7edf2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68269,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/a7/61a73f43f8639b0290725005642a625f/pa/JA68663_91ca3ab1d540721f23902fcf8763ce67.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cf532ab9-fe27-51a7-b449-add0ecb7edf2/cf532ab9-fe27-51a7-b449-add0ecb7edf2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64704,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/a7/61a73f43f8639b0290725005642a625f/pa/JA68663_e31033988ca87c7b1b98e4673d9d0e9e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cf532ab9-fe27-51a7-b449-add0ecb7edf2/cf532ab9-fe27-51a7-b449-add0ecb7edf2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65949,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/a7/61a73f43f8639b0290725005642a625f/pa/JA68663_6f329a0cd23e223f6ca105c37f796ff3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cf532ab9-fe27-51a7-b449-add0ecb7edf2/cf532ab9-fe27-51a7-b449-add0ecb7edf2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53376,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/a7/61a73f43f8639b0290725005642a625f/pa/JA68663_b618f1343ba90db9345d6a3741e74a96.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cf532ab9-fe27-51a7-b449-add0ecb7edf2/cf532ab9-fe27-51a7-b449-add0ecb7edf2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60877,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/a7/61a73f43f8639b0290725005642a625f/pa/JA68663_f5a6da844acdd574e78336635ef49c6e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cf532ab9-fe27-51a7-b449-add0ecb7edf2/cf532ab9-fe27-51a7-b449-add0ecb7edf2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66887,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/a7/61a73f43f8639b0290725005642a625f/pa/JA68663_a5781be7c386eca79e299793239b281a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cf532ab9-fe27-51a7-b449-add0ecb7edf2/cf532ab9-fe27-51a7-b449-add0ecb7edf2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53477,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/a7/61a73f43f8639b0290725005642a625f/pa/JA68663_08849d62c73b8fb926074d37e6e0cf0e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cf532ab9-fe27-51a7-b449-add0ecb7edf2/cf532ab9-fe27-51a7-b449-add0ecb7edf2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59883,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/a7/61a73f43f8639b0290725005642a625f/pa/JA68663_07613941b3a1d1ceda681ea651740974.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cf532ab9-fe27-51a7-b449-add0ecb7edf2/cf532ab9-fe27-51a7-b449-add0ecb7edf2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65910,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/a7/61a73f43f8639b0290725005642a625f/pa/JA68663_e391ad7ecafb201d4f2b16ba48f2fc5b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cf532ab9-fe27-51a7-b449-add0ecb7edf2/cf532ab9-fe27-51a7-b449-add0ecb7edf2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51990,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/a7/61a73f43f8639b0290725005642a625f/pa/JA68663_5c2f248be381e6caa5ee7d443d767adc.jpg',
             'Width': 800}],
 'postal_code': '01360',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Ain',
 'province_code': 'FR-01',
 'region': 'Auvergne-Rhône-Alpes',
 'region_code': 'FR-84',
 'registration_date': '2016-06-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 200 d Inspiration',
 'transmission': 'automatic',
 'trim': 'Inspiration',
 'year': 2016}
2026-04-27 08:00:02 [auto1.fr] INFO: Saving data for JA68663: {'created_time': 1777276802.368371, 'last_price_update_time': 1777276802.368383, 'has_photos': True, 'auction_closing_time': 1777388603.0}
2026-04-27 08:00:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/cc/22cccefa44c3c5688c690292bbe32078/pa/EB39116_9c0393b6a0e2db8fd4c972874219d261.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/cc/22cccefa44c3c5688c690292bbe32078/pa/EB39116_b68980fa439eeff9d9c27314653f9947.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KF38228/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bfd4510>
2026-04-27 08:00:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17e8dbbc-c625-5cfc-b834-a1829e3e897e/17e8dbbc-c625-5cfc-b834-a1829e3e897e_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:00:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/7f/a37f8bc58c1dafd6a5bdb51913f2d11e/pa/AF40134_e83db889dcbb821dc48350c3318c7cd4.jpg saved to cache
2026-04-27 08:00:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 17e8dbbc-c625-5cfc-b834-a1829e3e897e
2026-04-27 08:00:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 17e8dbbc-c625-5cfc-b834-a1829e3e897e, skipping ID generation
2026-04-27 08:00:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17e8dbbc-c625-5cfc-b834-a1829e3e897e with scrape type 1
2026-04-27 08:00:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 17e8dbbc-c625-5cfc-b834-a1829e3e897e sending to next pipeline
2026-04-27 08:00:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 17e8dbbc-c625-5cfc-b834-a1829e3e897e, identifier: AF40134
2026-04-27 08:00:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 17e8dbbc-c625-5cfc-b834-a1829e3e897e with identifier: AF40134
2026-04-27 08:00:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 17e8dbbc-c625-5cfc-b834-a1829e3e897e with identifier: AF40134
2026-04-27 08:00:02 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 17e8dbbc-c625-5cfc-b834-a1829e3e897e with identifier: AF40134 to the API
2026-04-27 08:00:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:03 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga3/7f/a37f8bc58c1dafd6a5bdb51913f2d11e/pa/AF40134_e83db889dcbb821dc48350c3318c7cd4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'category': None,
 'city': 'Allennes-les-Marais',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 75,
 'expiration_date': '2026-04-28T15:41:42Z',
 'fuel_type': 'diesel',
 'id': '17e8dbbc-c625-5cfc-b834-a1829e3e897e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 50.5375,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AF40134',
 'listing': 'auction',
 'location': 'FR, Allennes-les-Marais',
 'location_confidence': 'geocoded',
 'longitude': 2.9536,
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 275506,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_17e8dbbc-c625-5cfc-b834-a1829e3e897e/17e8dbbc-c625-5cfc-b834-a1829e3e897e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82054,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/7f/a37f8bc58c1dafd6a5bdb51913f2d11e/pa/AF40134_c4d1c880c57b947b63732e7a22085f63.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_17e8dbbc-c625-5cfc-b834-a1829e3e897e/17e8dbbc-c625-5cfc-b834-a1829e3e897e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77756,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/7f/a37f8bc58c1dafd6a5bdb51913f2d11e/pa/AF40134_e83db889dcbb821dc48350c3318c7cd4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_17e8dbbc-c625-5cfc-b834-a1829e3e897e/17e8dbbc-c625-5cfc-b834-a1829e3e897e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70188,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/7f/a37f8bc58c1dafd6a5bdb51913f2d11e/pa/AF40134_994f01268f5cad2108db5e81d5284fec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_17e8dbbc-c625-5cfc-b834-a1829e3e897e/17e8dbbc-c625-5cfc-b834-a1829e3e897e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63405,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/7f/a37f8bc58c1dafd6a5bdb51913f2d11e/pa/AF40134_119acb83eb7346de85adaa23843ed72e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_17e8dbbc-c625-5cfc-b834-a1829e3e897e/17e8dbbc-c625-5cfc-b834-a1829e3e897e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77833,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/7f/a37f8bc58c1dafd6a5bdb51913f2d11e/pa/AF40134_c18686c228b5b83219441bd92f379ff4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_17e8dbbc-c625-5cfc-b834-a1829e3e897e/17e8dbbc-c625-5cfc-b834-a1829e3e897e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37187,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/7f/a37f8bc58c1dafd6a5bdb51913f2d11e/pa/AF40134_d687265d98f7425645a8030374541cdf.jpg',
             'Width': 800}],
 'postal_code': '59251',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Nord',
 'province_code': 'FR-59',
 'region': 'Hauts-de-France',
 'region_code': 'FR-32',
 'registration_date': '2014-12-17',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Peugeot Partner 1.6 HDi L1 Pack CD Clim',
 'transmission': 'manual',
 'trim': 'L1 Pack CD Clim',
 'year': 2014}
2026-04-27 08:00:03 [auto1.fr] INFO: Saving data for AF40134: {'created_time': 1777276803.172548, 'last_price_update_time': 1777276803.172561, 'has_photos': True, 'auction_closing_time': 1777390902.0}
2026-04-27 08:00:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/cc/22cccefa44c3c5688c690292bbe32078/pa/EB39116_1a45f33f9460b672d614f194f387e6ce.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/cc/22cccefa44c3c5688c690292bbe32078/pa/EB39116_54af6e8eef416725e21c51d45fabfd4d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ea9010>
2026-04-27 08:00:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e25ae8db-cee0-5a11-9310-ea68b473436e/e25ae8db-cee0-5a11-9310-ea68b473436e_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:00:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/cc/22cccefa44c3c5688c690292bbe32078/pa/EB39116_9c0393b6a0e2db8fd4c972874219d261.jpg saved to cache
2026-04-27 08:00:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e25ae8db-cee0-5a11-9310-ea68b473436e
2026-04-27 08:00:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a56210>
2026-04-27 08:00:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e25ae8db-cee0-5a11-9310-ea68b473436e/e25ae8db-cee0-5a11-9310-ea68b473436e_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:00:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/cc/22cccefa44c3c5688c690292bbe32078/pa/EB39116_b68980fa439eeff9d9c27314653f9947.jpg saved to cache
2026-04-27 08:00:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e25ae8db-cee0-5a11-9310-ea68b473436e
2026-04-27 08:00:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14381ffa90>
2026-04-27 08:00:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e25ae8db-cee0-5a11-9310-ea68b473436e/e25ae8db-cee0-5a11-9310-ea68b473436e_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:00:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/cc/22cccefa44c3c5688c690292bbe32078/pa/EB39116_1a45f33f9460b672d614f194f387e6ce.jpg saved to cache
2026-04-27 08:00:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e25ae8db-cee0-5a11-9310-ea68b473436e
2026-04-27 08:00:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c34bd0>
2026-04-27 08:00:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e25ae8db-cee0-5a11-9310-ea68b473436e/e25ae8db-cee0-5a11-9310-ea68b473436e_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:00:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/cc/22cccefa44c3c5688c690292bbe32078/pa/EB39116_54af6e8eef416725e21c51d45fabfd4d.jpg saved to cache
2026-04-27 08:00:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e25ae8db-cee0-5a11-9310-ea68b473436e
2026-04-27 08:00:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/cc/22cccefa44c3c5688c690292bbe32078/pa/EB39116_b0e7dee7753c9acd9a7c2befa4e8a69b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/cc/22cccefa44c3c5688c690292bbe32078/pa/EB39116_7babaf26a8aff9690bddee9b88b617c6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/cc/22cccefa44c3c5688c690292bbe32078/pa/EB39116_45064099d73420ca18f2558393881679.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/cc/22cccefa44c3c5688c690292bbe32078/pa/EB39116_2db45b5927b6e3e6de05a9fb29397a8b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438170a10>
2026-04-27 08:00:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e25ae8db-cee0-5a11-9310-ea68b473436e/e25ae8db-cee0-5a11-9310-ea68b473436e_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:00:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/cc/22cccefa44c3c5688c690292bbe32078/pa/EB39116_b0e7dee7753c9acd9a7c2befa4e8a69b.jpg saved to cache
2026-04-27 08:00:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e25ae8db-cee0-5a11-9310-ea68b473436e
2026-04-27 08:00:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142be1abd0>
2026-04-27 08:00:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e25ae8db-cee0-5a11-9310-ea68b473436e/e25ae8db-cee0-5a11-9310-ea68b473436e_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:00:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/cc/22cccefa44c3c5688c690292bbe32078/pa/EB39116_7babaf26a8aff9690bddee9b88b617c6.jpg saved to cache
2026-04-27 08:00:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e25ae8db-cee0-5a11-9310-ea68b473436e
2026-04-27 08:00:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c6f050>
2026-04-27 08:00:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e25ae8db-cee0-5a11-9310-ea68b473436e/e25ae8db-cee0-5a11-9310-ea68b473436e_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:00:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/cc/22cccefa44c3c5688c690292bbe32078/pa/EB39116_45064099d73420ca18f2558393881679.jpg saved to cache
2026-04-27 08:00:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e25ae8db-cee0-5a11-9310-ea68b473436e
2026-04-27 08:00:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c36310>
2026-04-27 08:00:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e25ae8db-cee0-5a11-9310-ea68b473436e/e25ae8db-cee0-5a11-9310-ea68b473436e_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:00:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/cc/22cccefa44c3c5688c690292bbe32078/pa/EB39116_2db45b5927b6e3e6de05a9fb29397a8b.jpg saved to cache
2026-04-27 08:00:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e25ae8db-cee0-5a11-9310-ea68b473436e
2026-04-27 08:00:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/cc/22cccefa44c3c5688c690292bbe32078/pa/EB39116_f0e20fe931f6407a43756953f457994d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14381fca90>
2026-04-27 08:00:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e25ae8db-cee0-5a11-9310-ea68b473436e/e25ae8db-cee0-5a11-9310-ea68b473436e_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:00:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/cc/22cccefa44c3c5688c690292bbe32078/pa/EB39116_f0e20fe931f6407a43756953f457994d.jpg saved to cache
2026-04-27 08:00:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e25ae8db-cee0-5a11-9310-ea68b473436e
2026-04-27 08:00:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e25ae8db-cee0-5a11-9310-ea68b473436e, skipping ID generation
2026-04-27 08:00:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e25ae8db-cee0-5a11-9310-ea68b473436e with scrape type 1
2026-04-27 08:00:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e25ae8db-cee0-5a11-9310-ea68b473436e sending to next pipeline
2026-04-27 08:00:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e25ae8db-cee0-5a11-9310-ea68b473436e, identifier: EB39116
2026-04-27 08:00:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e25ae8db-cee0-5a11-9310-ea68b473436e with identifier: EB39116
2026-04-27 08:00:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e25ae8db-cee0-5a11-9310-ea68b473436e with identifier: EB39116
2026-04-27 08:00:04 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e25ae8db-cee0-5a11-9310-ea68b473436e with identifier: EB39116 to the API
2026-04-27 08:00:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:04 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img22/cc/22cccefa44c3c5688c690292bbe32078/pa/EB39116_f0e20fe931f6407a43756953f457994d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'category': None,
 'city': 'Beaucaire',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-04-28T15:22:33Z',
 'fuel_type': 'diesel',
 'id': 'e25ae8db-cee0-5a11-9310-ea68b473436e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 43.8081,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EB39116',
 'listing': 'auction',
 'location': 'FR, Beaucaire',
 'location_confidence': 'geocoded',
 'longitude': 4.6442,
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 130768,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e25ae8db-cee0-5a11-9310-ea68b473436e/e25ae8db-cee0-5a11-9310-ea68b473436e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59756,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/cc/22cccefa44c3c5688c690292bbe32078/pa/EB39116_2db45b5927b6e3e6de05a9fb29397a8b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e25ae8db-cee0-5a11-9310-ea68b473436e/e25ae8db-cee0-5a11-9310-ea68b473436e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61087,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/cc/22cccefa44c3c5688c690292bbe32078/pa/EB39116_f0e20fe931f6407a43756953f457994d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e25ae8db-cee0-5a11-9310-ea68b473436e/e25ae8db-cee0-5a11-9310-ea68b473436e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55706,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/cc/22cccefa44c3c5688c690292bbe32078/pa/EB39116_7babaf26a8aff9690bddee9b88b617c6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e25ae8db-cee0-5a11-9310-ea68b473436e/e25ae8db-cee0-5a11-9310-ea68b473436e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52329,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/cc/22cccefa44c3c5688c690292bbe32078/pa/EB39116_b0e7dee7753c9acd9a7c2befa4e8a69b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e25ae8db-cee0-5a11-9310-ea68b473436e/e25ae8db-cee0-5a11-9310-ea68b473436e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51686,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/cc/22cccefa44c3c5688c690292bbe32078/pa/EB39116_45064099d73420ca18f2558393881679.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e25ae8db-cee0-5a11-9310-ea68b473436e/e25ae8db-cee0-5a11-9310-ea68b473436e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58742,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/cc/22cccefa44c3c5688c690292bbe32078/pa/EB39116_54af6e8eef416725e21c51d45fabfd4d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e25ae8db-cee0-5a11-9310-ea68b473436e/e25ae8db-cee0-5a11-9310-ea68b473436e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46419,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/cc/22cccefa44c3c5688c690292bbe32078/pa/EB39116_1a45f33f9460b672d614f194f387e6ce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e25ae8db-cee0-5a11-9310-ea68b473436e/e25ae8db-cee0-5a11-9310-ea68b473436e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54780,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/cc/22cccefa44c3c5688c690292bbe32078/pa/EB39116_b68980fa439eeff9d9c27314653f9947.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e25ae8db-cee0-5a11-9310-ea68b473436e/e25ae8db-cee0-5a11-9310-ea68b473436e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63128,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/cc/22cccefa44c3c5688c690292bbe32078/pa/EB39116_9c0393b6a0e2db8fd4c972874219d261.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e25ae8db-cee0-5a11-9310-ea68b473436e/e25ae8db-cee0-5a11-9310-ea68b473436e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62860,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/cc/22cccefa44c3c5688c690292bbe32078/pa/EB39116_5a7259f8124626465ebb8a15524ffa6b.jpg',
             'Width': 800}],
 'postal_code': '30300',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Gard',
 'province_code': 'FR-30',
 'region': 'Occitanie',
 'region_code': 'FR-76',
 'registration_date': '2018-02-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 2.0 Blue-HDi Allure Business',
 'transmission': 'manual',
 'trim': 'Allure Business',
 'year': 2018}
2026-04-27 08:00:04 [auto1.fr] INFO: Saving data for EB39116: {'created_time': 1777276804.423416, 'last_price_update_time': 1777276804.42344, 'has_photos': True, 'auction_closing_time': 1777389753.0}
2026-04-27 08:00:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MN17403> (referer: https://www.auto1.com/v1/car-details-view/MN17403/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MW07169> (referer: https://www.auto1.com/v1/car-details-view/MW07169/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 528d0219-fadc-5901-bd15-08adfe25412c with identifier: MN17403
2026-04-27 08:00:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 528d0219-fadc-5901-bd15-08adfe25412c with scrape type 1
2026-04-27 08:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 528d0219-fadc-5901-bd15-08adfe25412c
2026-04-27 08:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/48/4448a915253d716d1add89a7b8f2943b/pa/MN17403_13d3271f44e78f07c592645321d1a28e.jpg not downloaded yet
2026-04-27 08:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/48/4448a915253d716d1add89a7b8f2943b/pa/MN17403_f93fbe4b048acea28a83e18cc4304451.jpg not downloaded yet
2026-04-27 08:00:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fdc1ab87-8d2c-5907-9e01-a39e8b073c5f with identifier: MW07169
2026-04-27 08:00:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fdc1ab87-8d2c-5907-9e01-a39e8b073c5f with scrape type 1
2026-04-27 08:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fdc1ab87-8d2c-5907-9e01-a39e8b073c5f
2026-04-27 08:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/2a/4f2aace06a9fd6449489ccb24b1ab776/pa/MW07169_e07602e0276090027031d92fe00139a4.jpg not downloaded yet
2026-04-27 08:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/48/4448a915253d716d1add89a7b8f2943b/pa/MN17403_ad92dab1c93e7e86353d808d7f49121c.jpg not downloaded yet
2026-04-27 08:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/2a/4f2aace06a9fd6449489ccb24b1ab776/pa/MW07169_6bacb19f8e3e93e2313fd50b87df4287.jpg not downloaded yet
2026-04-27 08:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/48/4448a915253d716d1add89a7b8f2943b/pa/MN17403_15b79d5c29f1e6ea8c4c5914a45ebad2.jpg not downloaded yet
2026-04-27 08:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/2a/4f2aace06a9fd6449489ccb24b1ab776/pa/MW07169_e3363137e0924d8be8da25f587937b0e.jpg not downloaded yet
2026-04-27 08:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/48/4448a915253d716d1add89a7b8f2943b/pa/MN17403_b9a3153a539966de49163d56632b2158.jpg not downloaded yet
2026-04-27 08:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/2a/4f2aace06a9fd6449489ccb24b1ab776/pa/MW07169_ef378f573f0102f3fccd8a0f66d18703.jpg not downloaded yet
2026-04-27 08:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/48/4448a915253d716d1add89a7b8f2943b/pa/MN17403_c3f133079b3d19cbdd336cb3a14512d5.jpg not downloaded yet
2026-04-27 08:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/2a/4f2aace06a9fd6449489ccb24b1ab776/pa/MW07169_4bbfa4175084cc6f8116a4535e439b8b.jpg not downloaded yet
2026-04-27 08:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/48/4448a915253d716d1add89a7b8f2943b/pa/MN17403_714fee08602328ce97425d3030280508.jpg not downloaded yet
2026-04-27 08:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/2a/4f2aace06a9fd6449489ccb24b1ab776/pa/MW07169_b01a80cbf08d564e18ca007043cb5703.jpg not downloaded yet
2026-04-27 08:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/48/4448a915253d716d1add89a7b8f2943b/pa/MN17403_861225f8b9a0f3f3a9f7099fa24e217d.jpg not downloaded yet
2026-04-27 08:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/2a/4f2aace06a9fd6449489ccb24b1ab776/pa/MW07169_d47b7139d660d343f5e51dab9ec5b2c9.jpg not downloaded yet
2026-04-27 08:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/48/4448a915253d716d1add89a7b8f2943b/pa/MN17403_8371812cc0b96be63341513657f435aa.jpg not downloaded yet
2026-04-27 08:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/2a/4f2aace06a9fd6449489ccb24b1ab776/pa/MW07169_d5ef04d407f48d864ee039965d1e67fd.jpg not downloaded yet
2026-04-27 08:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/48/4448a915253d716d1add89a7b8f2943b/pa/MN17403_48f6cfe3a45ca83da94becca05bcf93e.jpg not downloaded yet
2026-04-27 08:00:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/2a/4f2aace06a9fd6449489ccb24b1ab776/pa/MW07169_1a21e414025970b90f2fec8d12cd4b41.jpg not downloaded yet
2026-04-27 08:00:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/2a/4f2aace06a9fd6449489ccb24b1ab776/pa/MW07169_580a70f1c04ae86caa40c12c443456aa.jpg not downloaded yet
2026-04-27 08:00:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZE79634> (referer: https://www.auto1.com/v1/car-details-view/ZE79634/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b603026a-340d-5bdf-b3d8-ce353df55608 with identifier: ZE79634
2026-04-27 08:00:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b603026a-340d-5bdf-b3d8-ce353df55608 with scrape type 1
2026-04-27 08:00:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b603026a-340d-5bdf-b3d8-ce353df55608
2026-04-27 08:00:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/e4/c6e4e30078866cfe0d4489eec90d5dbe/pa/ZE79634_3ead16c7053276863006dcadaaf5bd9d.jpg not downloaded yet
2026-04-27 08:00:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/e4/c6e4e30078866cfe0d4489eec90d5dbe/pa/ZE79634_b66ddd94c86d7cffb29f3b84c50856aa.jpg not downloaded yet
2026-04-27 08:00:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/e4/c6e4e30078866cfe0d4489eec90d5dbe/pa/ZE79634_f07c880a8e7fe774c0294e580e4a3232.jpg not downloaded yet
2026-04-27 08:00:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/e4/c6e4e30078866cfe0d4489eec90d5dbe/pa/ZE79634_38bf37622084ff310533416d39d314c3.jpg not downloaded yet
2026-04-27 08:00:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/e4/c6e4e30078866cfe0d4489eec90d5dbe/pa/ZE79634_473b1c8432295a2404da3a6d744192d6.jpg not downloaded yet
2026-04-27 08:00:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/e4/c6e4e30078866cfe0d4489eec90d5dbe/pa/ZE79634_56e347adac9d0c17643ebcace2949c40.jpg not downloaded yet
2026-04-27 08:00:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/e4/c6e4e30078866cfe0d4489eec90d5dbe/pa/ZE79634_1432e1200b45225dc1a71395cd5acacc.jpg not downloaded yet
2026-04-27 08:00:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/e4/c6e4e30078866cfe0d4489eec90d5dbe/pa/ZE79634_02fc35123c9917fe366f7c59e37c76e6.jpg not downloaded yet
2026-04-27 08:00:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/e4/c6e4e30078866cfe0d4489eec90d5dbe/pa/ZE79634_951e0a5f5c4fd09ed3aa9ac7cad44610.jpg not downloaded yet
2026-04-27 08:00:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/2a/4f2aace06a9fd6449489ccb24b1ab776/pa/MW07169_580a70f1c04ae86caa40c12c443456aa.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/e4/c6e4e30078866cfe0d4489eec90d5dbe/pa/ZE79634_932d98486f725ad33b341d5e4bdbf4d7.jpg not downloaded yet
2026-04-27 08:00:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BB34695> (referer: https://www.auto1.com/v1/car-details-view/BB34695/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bf68850>
2026-04-27 08:00:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdc1ab87-8d2c-5907-9e01-a39e8b073c5f/fdc1ab87-8d2c-5907-9e01-a39e8b073c5f_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:00:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/2a/4f2aace06a9fd6449489ccb24b1ab776/pa/MW07169_580a70f1c04ae86caa40c12c443456aa.jpg saved to cache
2026-04-27 08:00:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fdc1ab87-8d2c-5907-9e01-a39e8b073c5f
2026-04-27 08:00:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76de5699-493f-57cc-a70e-287438bd25c6 with identifier: BB34695
2026-04-27 08:00:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76de5699-493f-57cc-a70e-287438bd25c6 with scrape type 1
2026-04-27 08:00:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 76de5699-493f-57cc-a70e-287438bd25c6
2026-04-27 08:00:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/f3/b8f33925049e927a68a79a80a62921b9/pa/BB34695_71b568dbd193e8f05c344dfb9b515102.jpg not downloaded yet
2026-04-27 08:00:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/f3/b8f33925049e927a68a79a80a62921b9/pa/BB34695_ee8003d60895d239cb5214fdd343de2a.jpg not downloaded yet
2026-04-27 08:00:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/e4/c6e4e30078866cfe0d4489eec90d5dbe/pa/ZE79634_951e0a5f5c4fd09ed3aa9ac7cad44610.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/f3/b8f33925049e927a68a79a80a62921b9/pa/BB34695_e9ae66aefb44f1ccccc61656ec87539a.jpg not downloaded yet
2026-04-27 08:00:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/f3/b8f33925049e927a68a79a80a62921b9/pa/BB34695_5e89f8c42e8f671c5ad0d7bbf1f5c773.jpg not downloaded yet
2026-04-27 08:00:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/f3/b8f33925049e927a68a79a80a62921b9/pa/BB34695_36492682fbc8233e7460287600050380.jpg not downloaded yet
2026-04-27 08:00:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/f3/b8f33925049e927a68a79a80a62921b9/pa/BB34695_f2f90d10fd46d8712eb13eed9c624a72.jpg not downloaded yet
2026-04-27 08:00:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/e4/c6e4e30078866cfe0d4489eec90d5dbe/pa/ZE79634_932d98486f725ad33b341d5e4bdbf4d7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/f3/b8f33925049e927a68a79a80a62921b9/pa/BB34695_f88768ae464e393889cf313ba53a1cbb.jpg not downloaded yet
2026-04-27 08:00:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/f3/b8f33925049e927a68a79a80a62921b9/pa/BB34695_ee8003d60895d239cb5214fdd343de2a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/f3/b8f33925049e927a68a79a80a62921b9/pa/BB34695_496e1d332cc42a805f8f3aa2437b3d19.jpg not downloaded yet
2026-04-27 08:00:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/f3/b8f33925049e927a68a79a80a62921b9/pa/BB34695_ee78e106a354e16a5cf7d48e3f9c2876.jpg not downloaded yet
2026-04-27 08:00:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438e04890>
2026-04-27 08:00:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b603026a-340d-5bdf-b3d8-ce353df55608/b603026a-340d-5bdf-b3d8-ce353df55608_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/e4/c6e4e30078866cfe0d4489eec90d5dbe/pa/ZE79634_951e0a5f5c4fd09ed3aa9ac7cad44610.jpg saved to cache
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b603026a-340d-5bdf-b3d8-ce353df55608
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/f3/b8f33925049e927a68a79a80a62921b9/pa/BB34695_64303940a6a7d10599d95e19949afac4.jpg not downloaded yet
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438e7f490>
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b603026a-340d-5bdf-b3d8-ce353df55608/b603026a-340d-5bdf-b3d8-ce353df55608_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/e4/c6e4e30078866cfe0d4489eec90d5dbe/pa/ZE79634_932d98486f725ad33b341d5e4bdbf4d7.jpg saved to cache
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b603026a-340d-5bdf-b3d8-ce353df55608
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438130190>
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76de5699-493f-57cc-a70e-287438bd25c6/76de5699-493f-57cc-a70e-287438bd25c6_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/f3/b8f33925049e927a68a79a80a62921b9/pa/BB34695_ee8003d60895d239cb5214fdd343de2a.jpg saved to cache
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 76de5699-493f-57cc-a70e-287438bd25c6
2026-04-27 08:00:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/f3/b8f33925049e927a68a79a80a62921b9/pa/BB34695_f2f90d10fd46d8712eb13eed9c624a72.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/f3/b8f33925049e927a68a79a80a62921b9/pa/BB34695_f88768ae464e393889cf313ba53a1cbb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DP12800> (referer: https://www.auto1.com/v1/car-details-view/DP12800/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14381ff390>
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76de5699-493f-57cc-a70e-287438bd25c6/76de5699-493f-57cc-a70e-287438bd25c6_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/f3/b8f33925049e927a68a79a80a62921b9/pa/BB34695_f2f90d10fd46d8712eb13eed9c624a72.jpg saved to cache
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 76de5699-493f-57cc-a70e-287438bd25c6
2026-04-27 08:00:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/f3/b8f33925049e927a68a79a80a62921b9/pa/BB34695_496e1d332cc42a805f8f3aa2437b3d19.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/f3/b8f33925049e927a68a79a80a62921b9/pa/BB34695_ee78e106a354e16a5cf7d48e3f9c2876.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142be0f5d0>
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76de5699-493f-57cc-a70e-287438bd25c6/76de5699-493f-57cc-a70e-287438bd25c6_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/f3/b8f33925049e927a68a79a80a62921b9/pa/BB34695_f88768ae464e393889cf313ba53a1cbb.jpg saved to cache
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 76de5699-493f-57cc-a70e-287438bd25c6
2026-04-27 08:00:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/f3/b8f33925049e927a68a79a80a62921b9/pa/BB34695_64303940a6a7d10599d95e19949afac4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a5070862-05e4-54f3-a1b7-16b2cad0ba0d with identifier: DP12800
2026-04-27 08:00:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5070862-05e4-54f3-a1b7-16b2cad0ba0d with scrape type 1
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a5070862-05e4-54f3-a1b7-16b2cad0ba0d
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/eb/9aeb4dad59632da496ae8dec7ad5ef8b/pa/DP12800_5f374ba4913632f3234379f6a30a4b84.jpg not downloaded yet
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/eb/9aeb4dad59632da496ae8dec7ad5ef8b/pa/DP12800_98dc1fb1cdad2c82ba1bb6b324003b56.jpg not downloaded yet
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/eb/9aeb4dad59632da496ae8dec7ad5ef8b/pa/DP12800_6027367610ce0352210b6bf3d89e67da.jpg not downloaded yet
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/eb/9aeb4dad59632da496ae8dec7ad5ef8b/pa/DP12800_bf74dbba7777d510e47e4feca1e1266c.jpg not downloaded yet
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438208c90>
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76de5699-493f-57cc-a70e-287438bd25c6/76de5699-493f-57cc-a70e-287438bd25c6_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/f3/b8f33925049e927a68a79a80a62921b9/pa/BB34695_496e1d332cc42a805f8f3aa2437b3d19.jpg saved to cache
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 76de5699-493f-57cc-a70e-287438bd25c6
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143812c4d0>
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76de5699-493f-57cc-a70e-287438bd25c6/76de5699-493f-57cc-a70e-287438bd25c6_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/f3/b8f33925049e927a68a79a80a62921b9/pa/BB34695_ee78e106a354e16a5cf7d48e3f9c2876.jpg saved to cache
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 76de5699-493f-57cc-a70e-287438bd25c6
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/eb/9aeb4dad59632da496ae8dec7ad5ef8b/pa/DP12800_f7f0157cd6bb02f6f9841779be91f169.jpg not downloaded yet
2026-04-27 08:00:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/f3/b8f33925049e927a68a79a80a62921b9/pa/BB34695_36492682fbc8233e7460287600050380.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/f3/b8f33925049e927a68a79a80a62921b9/pa/BB34695_e9ae66aefb44f1ccccc61656ec87539a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/eb/9aeb4dad59632da496ae8dec7ad5ef8b/pa/DP12800_2b2c8ea7e433ffd0c5a88fc260b04c1b.jpg not downloaded yet
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c2dd10>
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76de5699-493f-57cc-a70e-287438bd25c6/76de5699-493f-57cc-a70e-287438bd25c6_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/f3/b8f33925049e927a68a79a80a62921b9/pa/BB34695_64303940a6a7d10599d95e19949afac4.jpg saved to cache
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 76de5699-493f-57cc-a70e-287438bd25c6
2026-04-27 08:00:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/f3/b8f33925049e927a68a79a80a62921b9/pa/BB34695_5e89f8c42e8f671c5ad0d7bbf1f5c773.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/eb/9aeb4dad59632da496ae8dec7ad5ef8b/pa/DP12800_f8253f15117b6f91d158fb21c297f346.jpg not downloaded yet
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/eb/9aeb4dad59632da496ae8dec7ad5ef8b/pa/DP12800_e7e3e30f4fcb010a94e3acdc647f5d20.jpg not downloaded yet
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/eb/9aeb4dad59632da496ae8dec7ad5ef8b/pa/DP12800_a86bee593c3a66bf534567d2a1ca9d3c.jpg not downloaded yet
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/eb/9aeb4dad59632da496ae8dec7ad5ef8b/pa/DP12800_5e33c576663fc05ba72261d99fbd6506.jpg not downloaded yet
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143817d7d0>
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76de5699-493f-57cc-a70e-287438bd25c6/76de5699-493f-57cc-a70e-287438bd25c6_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/f3/b8f33925049e927a68a79a80a62921b9/pa/BB34695_36492682fbc8233e7460287600050380.jpg saved to cache
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 76de5699-493f-57cc-a70e-287438bd25c6
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438bc44d0>
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76de5699-493f-57cc-a70e-287438bd25c6/76de5699-493f-57cc-a70e-287438bd25c6_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/f3/b8f33925049e927a68a79a80a62921b9/pa/BB34695_e9ae66aefb44f1ccccc61656ec87539a.jpg saved to cache
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 76de5699-493f-57cc-a70e-287438bd25c6
2026-04-27 08:00:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/eb/9aeb4dad59632da496ae8dec7ad5ef8b/pa/DP12800_bf74dbba7777d510e47e4feca1e1266c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d231d0>
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76de5699-493f-57cc-a70e-287438bd25c6/76de5699-493f-57cc-a70e-287438bd25c6_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/f3/b8f33925049e927a68a79a80a62921b9/pa/BB34695_5e89f8c42e8f671c5ad0d7bbf1f5c773.jpg saved to cache
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 76de5699-493f-57cc-a70e-287438bd25c6
2026-04-27 08:00:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/eb/9aeb4dad59632da496ae8dec7ad5ef8b/pa/DP12800_f7f0157cd6bb02f6f9841779be91f169.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/eb/9aeb4dad59632da496ae8dec7ad5ef8b/pa/DP12800_2b2c8ea7e433ffd0c5a88fc260b04c1b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142be15610>
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5070862-05e4-54f3-a1b7-16b2cad0ba0d/a5070862-05e4-54f3-a1b7-16b2cad0ba0d_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/eb/9aeb4dad59632da496ae8dec7ad5ef8b/pa/DP12800_bf74dbba7777d510e47e4feca1e1266c.jpg saved to cache
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a5070862-05e4-54f3-a1b7-16b2cad0ba0d
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142be15b50>
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5070862-05e4-54f3-a1b7-16b2cad0ba0d/a5070862-05e4-54f3-a1b7-16b2cad0ba0d_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/eb/9aeb4dad59632da496ae8dec7ad5ef8b/pa/DP12800_f7f0157cd6bb02f6f9841779be91f169.jpg saved to cache
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a5070862-05e4-54f3-a1b7-16b2cad0ba0d
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c2ef50>
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5070862-05e4-54f3-a1b7-16b2cad0ba0d/a5070862-05e4-54f3-a1b7-16b2cad0ba0d_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/eb/9aeb4dad59632da496ae8dec7ad5ef8b/pa/DP12800_2b2c8ea7e433ffd0c5a88fc260b04c1b.jpg saved to cache
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a5070862-05e4-54f3-a1b7-16b2cad0ba0d
2026-04-27 08:00:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/eb/9aeb4dad59632da496ae8dec7ad5ef8b/pa/DP12800_5e33c576663fc05ba72261d99fbd6506.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/eb/9aeb4dad59632da496ae8dec7ad5ef8b/pa/DP12800_f8253f15117b6f91d158fb21c297f346.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/eb/9aeb4dad59632da496ae8dec7ad5ef8b/pa/DP12800_a86bee593c3a66bf534567d2a1ca9d3c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/eb/9aeb4dad59632da496ae8dec7ad5ef8b/pa/DP12800_e7e3e30f4fcb010a94e3acdc647f5d20.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380392d0>
2026-04-27 08:00:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5070862-05e4-54f3-a1b7-16b2cad0ba0d/a5070862-05e4-54f3-a1b7-16b2cad0ba0d_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:00:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/eb/9aeb4dad59632da496ae8dec7ad5ef8b/pa/DP12800_5e33c576663fc05ba72261d99fbd6506.jpg saved to cache
2026-04-27 08:00:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a5070862-05e4-54f3-a1b7-16b2cad0ba0d
2026-04-27 08:00:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/eb/9aeb4dad59632da496ae8dec7ad5ef8b/pa/DP12800_5f374ba4913632f3234379f6a30a4b84.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438bff990>
2026-04-27 08:00:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5070862-05e4-54f3-a1b7-16b2cad0ba0d/a5070862-05e4-54f3-a1b7-16b2cad0ba0d_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:00:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/eb/9aeb4dad59632da496ae8dec7ad5ef8b/pa/DP12800_f8253f15117b6f91d158fb21c297f346.jpg saved to cache
2026-04-27 08:00:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a5070862-05e4-54f3-a1b7-16b2cad0ba0d
2026-04-27 08:00:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/f3/b8f33925049e927a68a79a80a62921b9/pa/BB34695_71b568dbd193e8f05c344dfb9b515102.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bfd2150>
2026-04-27 08:00:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5070862-05e4-54f3-a1b7-16b2cad0ba0d/a5070862-05e4-54f3-a1b7-16b2cad0ba0d_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:00:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/eb/9aeb4dad59632da496ae8dec7ad5ef8b/pa/DP12800_a86bee593c3a66bf534567d2a1ca9d3c.jpg saved to cache
2026-04-27 08:00:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a5070862-05e4-54f3-a1b7-16b2cad0ba0d
2026-04-27 08:00:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ae7bd0>
2026-04-27 08:00:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5070862-05e4-54f3-a1b7-16b2cad0ba0d/a5070862-05e4-54f3-a1b7-16b2cad0ba0d_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:00:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/eb/9aeb4dad59632da496ae8dec7ad5ef8b/pa/DP12800_e7e3e30f4fcb010a94e3acdc647f5d20.jpg saved to cache
2026-04-27 08:00:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a5070862-05e4-54f3-a1b7-16b2cad0ba0d
2026-04-27 08:00:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/eb/9aeb4dad59632da496ae8dec7ad5ef8b/pa/DP12800_6027367610ce0352210b6bf3d89e67da.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/eb/9aeb4dad59632da496ae8dec7ad5ef8b/pa/DP12800_98dc1fb1cdad2c82ba1bb6b324003b56.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bf8de50>
2026-04-27 08:00:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5070862-05e4-54f3-a1b7-16b2cad0ba0d/a5070862-05e4-54f3-a1b7-16b2cad0ba0d_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:00:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/eb/9aeb4dad59632da496ae8dec7ad5ef8b/pa/DP12800_5f374ba4913632f3234379f6a30a4b84.jpg saved to cache
2026-04-27 08:00:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a5070862-05e4-54f3-a1b7-16b2cad0ba0d
2026-04-27 08:00:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bf8d710>
2026-04-27 08:00:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76de5699-493f-57cc-a70e-287438bd25c6/76de5699-493f-57cc-a70e-287438bd25c6_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:00:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/f3/b8f33925049e927a68a79a80a62921b9/pa/BB34695_71b568dbd193e8f05c344dfb9b515102.jpg saved to cache
2026-04-27 08:00:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 76de5699-493f-57cc-a70e-287438bd25c6
2026-04-27 08:00:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 76de5699-493f-57cc-a70e-287438bd25c6, skipping ID generation
2026-04-27 08:00:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76de5699-493f-57cc-a70e-287438bd25c6 with scrape type 1
2026-04-27 08:00:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 76de5699-493f-57cc-a70e-287438bd25c6 sending to next pipeline
2026-04-27 08:00:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 76de5699-493f-57cc-a70e-287438bd25c6, identifier: BB34695
2026-04-27 08:00:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 76de5699-493f-57cc-a70e-287438bd25c6 with identifier: BB34695
2026-04-27 08:00:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 76de5699-493f-57cc-a70e-287438bd25c6 with identifier: BB34695
2026-04-27 08:00:07 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 76de5699-493f-57cc-a70e-287438bd25c6 with identifier: BB34695 to the API
2026-04-27 08:00:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:08 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb8/f3/b8f33925049e927a68a79a80a62921b9/pa/BB34695_71b568dbd193e8f05c344dfb9b515102.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'city': 'CASTELNAU D’ESTRETEFONDS',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 90,
 'expiration_date': '2026-04-28T15:46:27Z',
 'fuel_type': 'diesel',
 'id': '76de5699-493f-57cc-a70e-287438bd25c6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 43.7837,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BB34695',
 'listing': 'auction',
 'location': 'FR, CASTELNAU D’ESTRETEFONDS',
 'location_confidence': 'geocoded',
 'longitude': 1.359,
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 171509,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_76de5699-493f-57cc-a70e-287438bd25c6/76de5699-493f-57cc-a70e-287438bd25c6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74648,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/f3/b8f33925049e927a68a79a80a62921b9/pa/BB34695_71b568dbd193e8f05c344dfb9b515102.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_76de5699-493f-57cc-a70e-287438bd25c6/76de5699-493f-57cc-a70e-287438bd25c6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64274,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/f3/b8f33925049e927a68a79a80a62921b9/pa/BB34695_ee8003d60895d239cb5214fdd343de2a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_76de5699-493f-57cc-a70e-287438bd25c6/76de5699-493f-57cc-a70e-287438bd25c6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67978,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/f3/b8f33925049e927a68a79a80a62921b9/pa/BB34695_e9ae66aefb44f1ccccc61656ec87539a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_76de5699-493f-57cc-a70e-287438bd25c6/76de5699-493f-57cc-a70e-287438bd25c6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59438,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/f3/b8f33925049e927a68a79a80a62921b9/pa/BB34695_5e89f8c42e8f671c5ad0d7bbf1f5c773.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_76de5699-493f-57cc-a70e-287438bd25c6/76de5699-493f-57cc-a70e-287438bd25c6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70167,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/f3/b8f33925049e927a68a79a80a62921b9/pa/BB34695_36492682fbc8233e7460287600050380.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_76de5699-493f-57cc-a70e-287438bd25c6/76de5699-493f-57cc-a70e-287438bd25c6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69934,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/f3/b8f33925049e927a68a79a80a62921b9/pa/BB34695_f2f90d10fd46d8712eb13eed9c624a72.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_76de5699-493f-57cc-a70e-287438bd25c6/76de5699-493f-57cc-a70e-287438bd25c6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57961,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/f3/b8f33925049e927a68a79a80a62921b9/pa/BB34695_f88768ae464e393889cf313ba53a1cbb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_76de5699-493f-57cc-a70e-287438bd25c6/76de5699-493f-57cc-a70e-287438bd25c6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63331,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/f3/b8f33925049e927a68a79a80a62921b9/pa/BB34695_496e1d332cc42a805f8f3aa2437b3d19.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_76de5699-493f-57cc-a70e-287438bd25c6/76de5699-493f-57cc-a70e-287438bd25c6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67403,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/f3/b8f33925049e927a68a79a80a62921b9/pa/BB34695_ee78e106a354e16a5cf7d48e3f9c2876.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_76de5699-493f-57cc-a70e-287438bd25c6/76de5699-493f-57cc-a70e-287438bd25c6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67237,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/f3/b8f33925049e927a68a79a80a62921b9/pa/BB34695_64303940a6a7d10599d95e19949afac4.jpg',
             'Width': 800}],
 'postal_code': '31620',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Haute-Garonne',
 'province_code': 'FR-31',
 'region': 'Occitanie',
 'region_code': 'FR-76',
 'registration_date': '2011-10-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.6 TDI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2011}
2026-04-27 08:00:08 [auto1.fr] INFO: Saving data for BB34695: {'created_time': 1777276808.18282, 'last_price_update_time': 1777276808.182828, 'has_photos': True, 'auction_closing_time': 1777391187.0}
2026-04-27 08:00:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/e4/c6e4e30078866cfe0d4489eec90d5dbe/pa/ZE79634_56e347adac9d0c17643ebcace2949c40.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/e4/c6e4e30078866cfe0d4489eec90d5dbe/pa/ZE79634_1432e1200b45225dc1a71395cd5acacc.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/e4/c6e4e30078866cfe0d4489eec90d5dbe/pa/ZE79634_02fc35123c9917fe366f7c59e37c76e6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438dc8c90>
2026-04-27 08:00:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5070862-05e4-54f3-a1b7-16b2cad0ba0d/a5070862-05e4-54f3-a1b7-16b2cad0ba0d_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:00:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/eb/9aeb4dad59632da496ae8dec7ad5ef8b/pa/DP12800_6027367610ce0352210b6bf3d89e67da.jpg saved to cache
2026-04-27 08:00:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a5070862-05e4-54f3-a1b7-16b2cad0ba0d
2026-04-27 08:00:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a82c50>
2026-04-27 08:00:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5070862-05e4-54f3-a1b7-16b2cad0ba0d/a5070862-05e4-54f3-a1b7-16b2cad0ba0d_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:00:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/eb/9aeb4dad59632da496ae8dec7ad5ef8b/pa/DP12800_98dc1fb1cdad2c82ba1bb6b324003b56.jpg saved to cache
2026-04-27 08:00:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a5070862-05e4-54f3-a1b7-16b2cad0ba0d
2026-04-27 08:00:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a5070862-05e4-54f3-a1b7-16b2cad0ba0d, skipping ID generation
2026-04-27 08:00:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5070862-05e4-54f3-a1b7-16b2cad0ba0d with scrape type 1
2026-04-27 08:00:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a5070862-05e4-54f3-a1b7-16b2cad0ba0d sending to next pipeline
2026-04-27 08:00:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a5070862-05e4-54f3-a1b7-16b2cad0ba0d, identifier: DP12800
2026-04-27 08:00:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a5070862-05e4-54f3-a1b7-16b2cad0ba0d with identifier: DP12800
2026-04-27 08:00:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a5070862-05e4-54f3-a1b7-16b2cad0ba0d with identifier: DP12800
2026-04-27 08:00:08 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a5070862-05e4-54f3-a1b7-16b2cad0ba0d with identifier: DP12800 to the API
2026-04-27 08:00:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:08 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img9a/eb/9aeb4dad59632da496ae8dec7ad5ef8b/pa/DP12800_98dc1fb1cdad2c82ba1bb6b324003b56.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'category': None,
 'city': 'Loyettes',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 200,
 'expiration_date': '2026-04-28T15:32:54Z',
 'fuel_type': 'petrol',
 'id': 'a5070862-05e4-54f3-a1b7-16b2cad0ba0d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 45.7766,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DP12800',
 'listing': 'auction',
 'location': 'FR, Loyettes',
 'location_confidence': 'geocoded',
 'longitude': 5.2069,
 'make': 'Renault',
 'model': 'Talisman',
 'odometer': 75850,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a5070862-05e4-54f3-a1b7-16b2cad0ba0d/a5070862-05e4-54f3-a1b7-16b2cad0ba0d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50411,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/eb/9aeb4dad59632da496ae8dec7ad5ef8b/pa/DP12800_5f374ba4913632f3234379f6a30a4b84.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a5070862-05e4-54f3-a1b7-16b2cad0ba0d/a5070862-05e4-54f3-a1b7-16b2cad0ba0d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47791,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/eb/9aeb4dad59632da496ae8dec7ad5ef8b/pa/DP12800_98dc1fb1cdad2c82ba1bb6b324003b56.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a5070862-05e4-54f3-a1b7-16b2cad0ba0d/a5070862-05e4-54f3-a1b7-16b2cad0ba0d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51298,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/eb/9aeb4dad59632da496ae8dec7ad5ef8b/pa/DP12800_6027367610ce0352210b6bf3d89e67da.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a5070862-05e4-54f3-a1b7-16b2cad0ba0d/a5070862-05e4-54f3-a1b7-16b2cad0ba0d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46029,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/eb/9aeb4dad59632da496ae8dec7ad5ef8b/pa/DP12800_bf74dbba7777d510e47e4feca1e1266c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a5070862-05e4-54f3-a1b7-16b2cad0ba0d/a5070862-05e4-54f3-a1b7-16b2cad0ba0d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50670,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/eb/9aeb4dad59632da496ae8dec7ad5ef8b/pa/DP12800_f7f0157cd6bb02f6f9841779be91f169.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a5070862-05e4-54f3-a1b7-16b2cad0ba0d/a5070862-05e4-54f3-a1b7-16b2cad0ba0d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52369,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/eb/9aeb4dad59632da496ae8dec7ad5ef8b/pa/DP12800_2b2c8ea7e433ffd0c5a88fc260b04c1b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a5070862-05e4-54f3-a1b7-16b2cad0ba0d/a5070862-05e4-54f3-a1b7-16b2cad0ba0d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48951,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/eb/9aeb4dad59632da496ae8dec7ad5ef8b/pa/DP12800_f8253f15117b6f91d158fb21c297f346.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a5070862-05e4-54f3-a1b7-16b2cad0ba0d/a5070862-05e4-54f3-a1b7-16b2cad0ba0d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108275,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/eb/9aeb4dad59632da496ae8dec7ad5ef8b/pa/DP12800_e7e3e30f4fcb010a94e3acdc647f5d20.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a5070862-05e4-54f3-a1b7-16b2cad0ba0d/a5070862-05e4-54f3-a1b7-16b2cad0ba0d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66252,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/eb/9aeb4dad59632da496ae8dec7ad5ef8b/pa/DP12800_a86bee593c3a66bf534567d2a1ca9d3c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a5070862-05e4-54f3-a1b7-16b2cad0ba0d/a5070862-05e4-54f3-a1b7-16b2cad0ba0d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70870,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/eb/9aeb4dad59632da496ae8dec7ad5ef8b/pa/DP12800_5e33c576663fc05ba72261d99fbd6506.jpg',
             'Width': 800}],
 'postal_code': '01360',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Ain',
 'province_code': 'FR-01',
 'region': 'Auvergne-Rhône-Alpes',
 'region_code': 'FR-84',
 'registration_date': '2016-09-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Talisman 1.6 TCe Energy Intens',
 'transmission': 'automatic',
 'trim': 'Intens',
 'year': 2016}
2026-04-27 08:00:08 [auto1.fr] INFO: Saving data for DP12800: {'created_time': 1777276808.857739, 'last_price_update_time': 1777276808.85775, 'has_photos': True, 'auction_closing_time': 1777390374.0}
2026-04-27 08:00:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/e4/c6e4e30078866cfe0d4489eec90d5dbe/pa/ZE79634_473b1c8432295a2404da3a6d744192d6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/e4/c6e4e30078866cfe0d4489eec90d5dbe/pa/ZE79634_f07c880a8e7fe774c0294e580e4a3232.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bffde10>
2026-04-27 08:00:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b603026a-340d-5bdf-b3d8-ce353df55608/b603026a-340d-5bdf-b3d8-ce353df55608_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:00:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/e4/c6e4e30078866cfe0d4489eec90d5dbe/pa/ZE79634_56e347adac9d0c17643ebcace2949c40.jpg saved to cache
2026-04-27 08:00:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b603026a-340d-5bdf-b3d8-ce353df55608
2026-04-27 08:00:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d2c990>
2026-04-27 08:00:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b603026a-340d-5bdf-b3d8-ce353df55608/b603026a-340d-5bdf-b3d8-ce353df55608_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:00:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/e4/c6e4e30078866cfe0d4489eec90d5dbe/pa/ZE79634_1432e1200b45225dc1a71395cd5acacc.jpg saved to cache
2026-04-27 08:00:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b603026a-340d-5bdf-b3d8-ce353df55608
2026-04-27 08:00:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438172090>
2026-04-27 08:00:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b603026a-340d-5bdf-b3d8-ce353df55608/b603026a-340d-5bdf-b3d8-ce353df55608_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:00:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/e4/c6e4e30078866cfe0d4489eec90d5dbe/pa/ZE79634_02fc35123c9917fe366f7c59e37c76e6.jpg saved to cache
2026-04-27 08:00:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b603026a-340d-5bdf-b3d8-ce353df55608
2026-04-27 08:00:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a60950>
2026-04-27 08:00:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b603026a-340d-5bdf-b3d8-ce353df55608/b603026a-340d-5bdf-b3d8-ce353df55608_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:00:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/e4/c6e4e30078866cfe0d4489eec90d5dbe/pa/ZE79634_473b1c8432295a2404da3a6d744192d6.jpg saved to cache
2026-04-27 08:00:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b603026a-340d-5bdf-b3d8-ce353df55608
2026-04-27 08:00:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438130b50>
2026-04-27 08:00:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b603026a-340d-5bdf-b3d8-ce353df55608/b603026a-340d-5bdf-b3d8-ce353df55608_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:00:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/e4/c6e4e30078866cfe0d4489eec90d5dbe/pa/ZE79634_f07c880a8e7fe774c0294e580e4a3232.jpg saved to cache
2026-04-27 08:00:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b603026a-340d-5bdf-b3d8-ce353df55608
2026-04-27 08:00:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/e4/c6e4e30078866cfe0d4489eec90d5dbe/pa/ZE79634_38bf37622084ff310533416d39d314c3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/e4/c6e4e30078866cfe0d4489eec90d5dbe/pa/ZE79634_3ead16c7053276863006dcadaaf5bd9d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b95e10>
2026-04-27 08:00:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b603026a-340d-5bdf-b3d8-ce353df55608/b603026a-340d-5bdf-b3d8-ce353df55608_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:00:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/e4/c6e4e30078866cfe0d4489eec90d5dbe/pa/ZE79634_38bf37622084ff310533416d39d314c3.jpg saved to cache
2026-04-27 08:00:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b603026a-340d-5bdf-b3d8-ce353df55608
2026-04-27 08:00:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/e4/c6e4e30078866cfe0d4489eec90d5dbe/pa/ZE79634_b66ddd94c86d7cffb29f3b84c50856aa.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ff1a90>
2026-04-27 08:00:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b603026a-340d-5bdf-b3d8-ce353df55608/b603026a-340d-5bdf-b3d8-ce353df55608_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:00:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/e4/c6e4e30078866cfe0d4489eec90d5dbe/pa/ZE79634_3ead16c7053276863006dcadaaf5bd9d.jpg saved to cache
2026-04-27 08:00:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b603026a-340d-5bdf-b3d8-ce353df55608
2026-04-27 08:00:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/48/4448a915253d716d1add89a7b8f2943b/pa/MN17403_48f6cfe3a45ca83da94becca05bcf93e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/2a/4f2aace06a9fd6449489ccb24b1ab776/pa/MW07169_1a21e414025970b90f2fec8d12cd4b41.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/48/4448a915253d716d1add89a7b8f2943b/pa/MN17403_8371812cc0b96be63341513657f435aa.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143812f110>
2026-04-27 08:00:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b603026a-340d-5bdf-b3d8-ce353df55608/b603026a-340d-5bdf-b3d8-ce353df55608_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:00:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/e4/c6e4e30078866cfe0d4489eec90d5dbe/pa/ZE79634_b66ddd94c86d7cffb29f3b84c50856aa.jpg saved to cache
2026-04-27 08:00:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b603026a-340d-5bdf-b3d8-ce353df55608
2026-04-27 08:00:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b603026a-340d-5bdf-b3d8-ce353df55608, skipping ID generation
2026-04-27 08:00:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b603026a-340d-5bdf-b3d8-ce353df55608 with scrape type 1
2026-04-27 08:00:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b603026a-340d-5bdf-b3d8-ce353df55608 sending to next pipeline
2026-04-27 08:00:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b603026a-340d-5bdf-b3d8-ce353df55608, identifier: ZE79634
2026-04-27 08:00:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b603026a-340d-5bdf-b3d8-ce353df55608 with identifier: ZE79634
2026-04-27 08:00:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b603026a-340d-5bdf-b3d8-ce353df55608 with identifier: ZE79634
2026-04-27 08:00:09 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b603026a-340d-5bdf-b3d8-ce353df55608 with identifier: ZE79634 to the API
2026-04-27 08:00:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:09 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc6/e4/c6e4e30078866cfe0d4489eec90d5dbe/pa/ZE79634_b66ddd94c86d7cffb29f3b84c50856aa.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'category': None,
 'city': 'Creutzwald',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2026-04-28T15:09:21Z',
 'fuel_type': 'diesel',
 'id': 'b603026a-340d-5bdf-b3d8-ce353df55608',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 49.2053,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZE79634',
 'listing': 'auction',
 'location': 'FR, Creutzwald',
 'location_confidence': 'geocoded',
 'longitude': 6.6967,
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 203318,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b603026a-340d-5bdf-b3d8-ce353df55608/b603026a-340d-5bdf-b3d8-ce353df55608_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64393,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/e4/c6e4e30078866cfe0d4489eec90d5dbe/pa/ZE79634_3ead16c7053276863006dcadaaf5bd9d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b603026a-340d-5bdf-b3d8-ce353df55608/b603026a-340d-5bdf-b3d8-ce353df55608_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64758,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/e4/c6e4e30078866cfe0d4489eec90d5dbe/pa/ZE79634_b66ddd94c86d7cffb29f3b84c50856aa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b603026a-340d-5bdf-b3d8-ce353df55608/b603026a-340d-5bdf-b3d8-ce353df55608_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58988,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/e4/c6e4e30078866cfe0d4489eec90d5dbe/pa/ZE79634_f07c880a8e7fe774c0294e580e4a3232.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b603026a-340d-5bdf-b3d8-ce353df55608/b603026a-340d-5bdf-b3d8-ce353df55608_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58207,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/e4/c6e4e30078866cfe0d4489eec90d5dbe/pa/ZE79634_38bf37622084ff310533416d39d314c3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b603026a-340d-5bdf-b3d8-ce353df55608/b603026a-340d-5bdf-b3d8-ce353df55608_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43208,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/e4/c6e4e30078866cfe0d4489eec90d5dbe/pa/ZE79634_473b1c8432295a2404da3a6d744192d6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b603026a-340d-5bdf-b3d8-ce353df55608/b603026a-340d-5bdf-b3d8-ce353df55608_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53363,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/e4/c6e4e30078866cfe0d4489eec90d5dbe/pa/ZE79634_56e347adac9d0c17643ebcace2949c40.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b603026a-340d-5bdf-b3d8-ce353df55608/b603026a-340d-5bdf-b3d8-ce353df55608_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57059,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/e4/c6e4e30078866cfe0d4489eec90d5dbe/pa/ZE79634_1432e1200b45225dc1a71395cd5acacc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b603026a-340d-5bdf-b3d8-ce353df55608/b603026a-340d-5bdf-b3d8-ce353df55608_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70154,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/e4/c6e4e30078866cfe0d4489eec90d5dbe/pa/ZE79634_02fc35123c9917fe366f7c59e37c76e6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b603026a-340d-5bdf-b3d8-ce353df55608/b603026a-340d-5bdf-b3d8-ce353df55608_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59017,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/e4/c6e4e30078866cfe0d4489eec90d5dbe/pa/ZE79634_951e0a5f5c4fd09ed3aa9ac7cad44610.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b603026a-340d-5bdf-b3d8-ce353df55608/b603026a-340d-5bdf-b3d8-ce353df55608_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53577,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/e4/c6e4e30078866cfe0d4489eec90d5dbe/pa/ZE79634_932d98486f725ad33b341d5e4bdbf4d7.jpg',
             'Width': 800}],
 'postal_code': '57150',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Moselle',
 'province_code': 'FR-57',
 'region': 'Grand Est',
 'region_code': 'FR-44',
 'registration_date': '2014-03-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.6 e-HDi Feline Cuivre',
 'transmission': 'manual',
 'trim': 'Feline Cuivre',
 'year': 2014}
2026-04-27 08:00:09 [auto1.fr] INFO: Saving data for ZE79634: {'created_time': 1777276809.813081, 'last_price_update_time': 1777276809.813092, 'has_photos': True, 'auction_closing_time': 1777388961.0}
2026-04-27 08:00:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/2a/4f2aace06a9fd6449489ccb24b1ab776/pa/MW07169_d47b7139d660d343f5e51dab9ec5b2c9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/48/4448a915253d716d1add89a7b8f2943b/pa/MN17403_861225f8b9a0f3f3a9f7099fa24e217d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/2a/4f2aace06a9fd6449489ccb24b1ab776/pa/MW07169_d5ef04d407f48d864ee039965d1e67fd.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HW58466/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142be0da90>
2026-04-27 08:00:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_528d0219-fadc-5901-bd15-08adfe25412c/528d0219-fadc-5901-bd15-08adfe25412c_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:00:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/48/4448a915253d716d1add89a7b8f2943b/pa/MN17403_48f6cfe3a45ca83da94becca05bcf93e.jpg saved to cache
2026-04-27 08:00:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 528d0219-fadc-5901-bd15-08adfe25412c
2026-04-27 08:00:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ea92d0>
2026-04-27 08:00:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdc1ab87-8d2c-5907-9e01-a39e8b073c5f/fdc1ab87-8d2c-5907-9e01-a39e8b073c5f_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:00:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/2a/4f2aace06a9fd6449489ccb24b1ab776/pa/MW07169_1a21e414025970b90f2fec8d12cd4b41.jpg saved to cache
2026-04-27 08:00:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fdc1ab87-8d2c-5907-9e01-a39e8b073c5f
2026-04-27 08:00:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143809cb90>
2026-04-27 08:00:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_528d0219-fadc-5901-bd15-08adfe25412c/528d0219-fadc-5901-bd15-08adfe25412c_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:00:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/48/4448a915253d716d1add89a7b8f2943b/pa/MN17403_8371812cc0b96be63341513657f435aa.jpg saved to cache
2026-04-27 08:00:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 528d0219-fadc-5901-bd15-08adfe25412c
2026-04-27 08:00:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZB78862/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142be16d90>
2026-04-27 08:00:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdc1ab87-8d2c-5907-9e01-a39e8b073c5f/fdc1ab87-8d2c-5907-9e01-a39e8b073c5f_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/2a/4f2aace06a9fd6449489ccb24b1ab776/pa/MW07169_d47b7139d660d343f5e51dab9ec5b2c9.jpg saved to cache
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fdc1ab87-8d2c-5907-9e01-a39e8b073c5f
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bf02090>
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_528d0219-fadc-5901-bd15-08adfe25412c/528d0219-fadc-5901-bd15-08adfe25412c_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/48/4448a915253d716d1add89a7b8f2943b/pa/MN17403_861225f8b9a0f3f3a9f7099fa24e217d.jpg saved to cache
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 528d0219-fadc-5901-bd15-08adfe25412c
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14381717d0>
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdc1ab87-8d2c-5907-9e01-a39e8b073c5f/fdc1ab87-8d2c-5907-9e01-a39e8b073c5f_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/2a/4f2aace06a9fd6449489ccb24b1ab776/pa/MW07169_d5ef04d407f48d864ee039965d1e67fd.jpg saved to cache
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fdc1ab87-8d2c-5907-9e01-a39e8b073c5f
2026-04-27 08:00:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/48/4448a915253d716d1add89a7b8f2943b/pa/MN17403_714fee08602328ce97425d3030280508.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/2a/4f2aace06a9fd6449489ccb24b1ab776/pa/MW07169_b01a80cbf08d564e18ca007043cb5703.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/2a/4f2aace06a9fd6449489ccb24b1ab776/pa/MW07169_4bbfa4175084cc6f8116a4535e439b8b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c36ed0>
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_528d0219-fadc-5901-bd15-08adfe25412c/528d0219-fadc-5901-bd15-08adfe25412c_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/48/4448a915253d716d1add89a7b8f2943b/pa/MN17403_714fee08602328ce97425d3030280508.jpg saved to cache
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 528d0219-fadc-5901-bd15-08adfe25412c
2026-04-27 08:00:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/48/4448a915253d716d1add89a7b8f2943b/pa/MN17403_b9a3153a539966de49163d56632b2158.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438fa5d90>
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdc1ab87-8d2c-5907-9e01-a39e8b073c5f/fdc1ab87-8d2c-5907-9e01-a39e8b073c5f_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/2a/4f2aace06a9fd6449489ccb24b1ab776/pa/MW07169_b01a80cbf08d564e18ca007043cb5703.jpg saved to cache
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fdc1ab87-8d2c-5907-9e01-a39e8b073c5f
2026-04-27 08:00:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/2a/4f2aace06a9fd6449489ccb24b1ab776/pa/MW07169_ef378f573f0102f3fccd8a0f66d18703.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438e7ee10>
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdc1ab87-8d2c-5907-9e01-a39e8b073c5f/fdc1ab87-8d2c-5907-9e01-a39e8b073c5f_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/2a/4f2aace06a9fd6449489ccb24b1ab776/pa/MW07169_4bbfa4175084cc6f8116a4535e439b8b.jpg saved to cache
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fdc1ab87-8d2c-5907-9e01-a39e8b073c5f
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d84950>
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_528d0219-fadc-5901-bd15-08adfe25412c/528d0219-fadc-5901-bd15-08adfe25412c_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/48/4448a915253d716d1add89a7b8f2943b/pa/MN17403_b9a3153a539966de49163d56632b2158.jpg saved to cache
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 528d0219-fadc-5901-bd15-08adfe25412c
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438074210>
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdc1ab87-8d2c-5907-9e01-a39e8b073c5f/fdc1ab87-8d2c-5907-9e01-a39e8b073c5f_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/2a/4f2aace06a9fd6449489ccb24b1ab776/pa/MW07169_ef378f573f0102f3fccd8a0f66d18703.jpg saved to cache
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fdc1ab87-8d2c-5907-9e01-a39e8b073c5f
2026-04-27 08:00:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/2a/4f2aace06a9fd6449489ccb24b1ab776/pa/MW07169_e3363137e0924d8be8da25f587937b0e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/48/4448a915253d716d1add89a7b8f2943b/pa/MN17403_c3f133079b3d19cbdd336cb3a14512d5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/48/4448a915253d716d1add89a7b8f2943b/pa/MN17403_15b79d5c29f1e6ea8c4c5914a45ebad2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438f93210>
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdc1ab87-8d2c-5907-9e01-a39e8b073c5f/fdc1ab87-8d2c-5907-9e01-a39e8b073c5f_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/2a/4f2aace06a9fd6449489ccb24b1ab776/pa/MW07169_e3363137e0924d8be8da25f587937b0e.jpg saved to cache
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fdc1ab87-8d2c-5907-9e01-a39e8b073c5f
2026-04-27 08:00:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/2a/4f2aace06a9fd6449489ccb24b1ab776/pa/MW07169_e07602e0276090027031d92fe00139a4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/48/4448a915253d716d1add89a7b8f2943b/pa/MN17403_ad92dab1c93e7e86353d808d7f49121c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bf8f7d0>
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_528d0219-fadc-5901-bd15-08adfe25412c/528d0219-fadc-5901-bd15-08adfe25412c_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/48/4448a915253d716d1add89a7b8f2943b/pa/MN17403_c3f133079b3d19cbdd336cb3a14512d5.jpg saved to cache
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 528d0219-fadc-5901-bd15-08adfe25412c
2026-04-27 08:00:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/48/4448a915253d716d1add89a7b8f2943b/pa/MN17403_f93fbe4b048acea28a83e18cc4304451.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143817ea90>
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_528d0219-fadc-5901-bd15-08adfe25412c/528d0219-fadc-5901-bd15-08adfe25412c_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/48/4448a915253d716d1add89a7b8f2943b/pa/MN17403_15b79d5c29f1e6ea8c4c5914a45ebad2.jpg saved to cache
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 528d0219-fadc-5901-bd15-08adfe25412c
2026-04-27 08:00:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/48/4448a915253d716d1add89a7b8f2943b/pa/MN17403_13d3271f44e78f07c592645321d1a28e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/2a/4f2aace06a9fd6449489ccb24b1ab776/pa/MW07169_6bacb19f8e3e93e2313fd50b87df4287.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438130790>
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdc1ab87-8d2c-5907-9e01-a39e8b073c5f/fdc1ab87-8d2c-5907-9e01-a39e8b073c5f_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/2a/4f2aace06a9fd6449489ccb24b1ab776/pa/MW07169_e07602e0276090027031d92fe00139a4.jpg saved to cache
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fdc1ab87-8d2c-5907-9e01-a39e8b073c5f
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bf8fcd0>
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_528d0219-fadc-5901-bd15-08adfe25412c/528d0219-fadc-5901-bd15-08adfe25412c_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/48/4448a915253d716d1add89a7b8f2943b/pa/MN17403_ad92dab1c93e7e86353d808d7f49121c.jpg saved to cache
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 528d0219-fadc-5901-bd15-08adfe25412c
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143817fb50>
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_528d0219-fadc-5901-bd15-08adfe25412c/528d0219-fadc-5901-bd15-08adfe25412c_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/48/4448a915253d716d1add89a7b8f2943b/pa/MN17403_f93fbe4b048acea28a83e18cc4304451.jpg saved to cache
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 528d0219-fadc-5901-bd15-08adfe25412c
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143812c9d0>
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_528d0219-fadc-5901-bd15-08adfe25412c/528d0219-fadc-5901-bd15-08adfe25412c_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/48/4448a915253d716d1add89a7b8f2943b/pa/MN17403_13d3271f44e78f07c592645321d1a28e.jpg saved to cache
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 528d0219-fadc-5901-bd15-08adfe25412c
2026-04-27 08:00:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 528d0219-fadc-5901-bd15-08adfe25412c, skipping ID generation
2026-04-27 08:00:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 528d0219-fadc-5901-bd15-08adfe25412c with scrape type 1
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 528d0219-fadc-5901-bd15-08adfe25412c sending to next pipeline
2026-04-27 08:00:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 528d0219-fadc-5901-bd15-08adfe25412c, identifier: MN17403
2026-04-27 08:00:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b95e50>
2026-04-27 08:00:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdc1ab87-8d2c-5907-9e01-a39e8b073c5f/fdc1ab87-8d2c-5907-9e01-a39e8b073c5f_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:00:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/2a/4f2aace06a9fd6449489ccb24b1ab776/pa/MW07169_6bacb19f8e3e93e2313fd50b87df4287.jpg saved to cache
2026-04-27 08:00:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fdc1ab87-8d2c-5907-9e01-a39e8b073c5f
2026-04-27 08:00:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fdc1ab87-8d2c-5907-9e01-a39e8b073c5f, skipping ID generation
2026-04-27 08:00:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fdc1ab87-8d2c-5907-9e01-a39e8b073c5f with scrape type 1
2026-04-27 08:00:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fdc1ab87-8d2c-5907-9e01-a39e8b073c5f sending to next pipeline
2026-04-27 08:00:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: fdc1ab87-8d2c-5907-9e01-a39e8b073c5f, identifier: MW07169
2026-04-27 08:00:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 528d0219-fadc-5901-bd15-08adfe25412c with identifier: MN17403
2026-04-27 08:00:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 528d0219-fadc-5901-bd15-08adfe25412c with identifier: MN17403
2026-04-27 08:00:11 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 528d0219-fadc-5901-bd15-08adfe25412c with identifier: MN17403 to the API
2026-04-27 08:00:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:11 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img44/48/4448a915253d716d1add89a7b8f2943b/pa/MN17403_13d3271f44e78f07c592645321d1a28e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'category': None,
 'city': 'Montataire',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 181,
 'expiration_date': '2026-04-28T15:23:21Z',
 'fuel_type': 'petrol',
 'id': '528d0219-fadc-5901-bd15-08adfe25412c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 49.259,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MN17403',
 'listing': 'auction',
 'location': 'FR, Montataire',
 'location_confidence': 'geocoded',
 'longitude': 2.4378,
 'make': 'Citroen',
 'model': 'C5 Aircross',
 'odometer': 70761,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_528d0219-fadc-5901-bd15-08adfe25412c/528d0219-fadc-5901-bd15-08adfe25412c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57506,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/48/4448a915253d716d1add89a7b8f2943b/pa/MN17403_13d3271f44e78f07c592645321d1a28e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_528d0219-fadc-5901-bd15-08adfe25412c/528d0219-fadc-5901-bd15-08adfe25412c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79330,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/48/4448a915253d716d1add89a7b8f2943b/pa/MN17403_f93fbe4b048acea28a83e18cc4304451.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_528d0219-fadc-5901-bd15-08adfe25412c/528d0219-fadc-5901-bd15-08adfe25412c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64450,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/48/4448a915253d716d1add89a7b8f2943b/pa/MN17403_ad92dab1c93e7e86353d808d7f49121c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_528d0219-fadc-5901-bd15-08adfe25412c/528d0219-fadc-5901-bd15-08adfe25412c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72257,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/48/4448a915253d716d1add89a7b8f2943b/pa/MN17403_15b79d5c29f1e6ea8c4c5914a45ebad2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_528d0219-fadc-5901-bd15-08adfe25412c/528d0219-fadc-5901-bd15-08adfe25412c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61954,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/48/4448a915253d716d1add89a7b8f2943b/pa/MN17403_b9a3153a539966de49163d56632b2158.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_528d0219-fadc-5901-bd15-08adfe25412c/528d0219-fadc-5901-bd15-08adfe25412c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76294,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/48/4448a915253d716d1add89a7b8f2943b/pa/MN17403_c3f133079b3d19cbdd336cb3a14512d5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_528d0219-fadc-5901-bd15-08adfe25412c/528d0219-fadc-5901-bd15-08adfe25412c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64140,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/48/4448a915253d716d1add89a7b8f2943b/pa/MN17403_714fee08602328ce97425d3030280508.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_528d0219-fadc-5901-bd15-08adfe25412c/528d0219-fadc-5901-bd15-08adfe25412c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62584,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/48/4448a915253d716d1add89a7b8f2943b/pa/MN17403_861225f8b9a0f3f3a9f7099fa24e217d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_528d0219-fadc-5901-bd15-08adfe25412c/528d0219-fadc-5901-bd15-08adfe25412c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52944,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/48/4448a915253d716d1add89a7b8f2943b/pa/MN17403_8371812cc0b96be63341513657f435aa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_528d0219-fadc-5901-bd15-08adfe25412c/528d0219-fadc-5901-bd15-08adfe25412c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57824,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/48/4448a915253d716d1add89a7b8f2943b/pa/MN17403_48f6cfe3a45ca83da94becca05bcf93e.jpg',
             'Width': 800}],
 'postal_code': '60160',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Oise',
 'province_code': 'FR-60',
 'region': 'Hauts-de-France',
 'region_code': 'FR-32',
 'registration_date': '2019-04-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C5 Aircross 1.6 PureTech Shine',
 'transmission': 'automatic',
 'trim': 'Shine',
 'year': 2019}
2026-04-27 08:00:11 [auto1.fr] INFO: Saving data for MN17403: {'created_time': 1777276811.662666, 'last_price_update_time': 1777276811.662677, 'has_photos': True, 'auction_closing_time': 1777389801.0}
2026-04-27 08:00:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: fdc1ab87-8d2c-5907-9e01-a39e8b073c5f with identifier: MW07169
2026-04-27 08:00:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: fdc1ab87-8d2c-5907-9e01-a39e8b073c5f with identifier: MW07169
2026-04-27 08:00:11 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: fdc1ab87-8d2c-5907-9e01-a39e8b073c5f with identifier: MW07169 to the API
2026-04-27 08:00:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:11 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4f/2a/4f2aace06a9fd6449489ccb24b1ab776/pa/MW07169_6bacb19f8e3e93e2313fd50b87df4287.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 95,
 'category': None,
 'city': 'Marseille',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '0.9L',
 'engine_horse_power': 85,
 'expiration_date': '2026-04-28T15:47:25Z',
 'fuel_type': 'petrol',
 'id': 'fdc1ab87-8d2c-5907-9e01-a39e8b073c5f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 43.2969,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MW07169',
 'listing': 'auction',
 'location': 'FR, Marseille',
 'location_confidence': 'geocoded',
 'longitude': 5.3811,
 'make': 'Fiat',
 'model': '500',
 'odometer': 243016,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fdc1ab87-8d2c-5907-9e01-a39e8b073c5f/fdc1ab87-8d2c-5907-9e01-a39e8b073c5f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63833,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/2a/4f2aace06a9fd6449489ccb24b1ab776/pa/MW07169_e07602e0276090027031d92fe00139a4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fdc1ab87-8d2c-5907-9e01-a39e8b073c5f/fdc1ab87-8d2c-5907-9e01-a39e8b073c5f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58704,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/2a/4f2aace06a9fd6449489ccb24b1ab776/pa/MW07169_6bacb19f8e3e93e2313fd50b87df4287.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fdc1ab87-8d2c-5907-9e01-a39e8b073c5f/fdc1ab87-8d2c-5907-9e01-a39e8b073c5f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60287,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/2a/4f2aace06a9fd6449489ccb24b1ab776/pa/MW07169_e3363137e0924d8be8da25f587937b0e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fdc1ab87-8d2c-5907-9e01-a39e8b073c5f/fdc1ab87-8d2c-5907-9e01-a39e8b073c5f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48677,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/2a/4f2aace06a9fd6449489ccb24b1ab776/pa/MW07169_ef378f573f0102f3fccd8a0f66d18703.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fdc1ab87-8d2c-5907-9e01-a39e8b073c5f/fdc1ab87-8d2c-5907-9e01-a39e8b073c5f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58330,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/2a/4f2aace06a9fd6449489ccb24b1ab776/pa/MW07169_4bbfa4175084cc6f8116a4535e439b8b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fdc1ab87-8d2c-5907-9e01-a39e8b073c5f/fdc1ab87-8d2c-5907-9e01-a39e8b073c5f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61194,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/2a/4f2aace06a9fd6449489ccb24b1ab776/pa/MW07169_b01a80cbf08d564e18ca007043cb5703.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fdc1ab87-8d2c-5907-9e01-a39e8b073c5f/fdc1ab87-8d2c-5907-9e01-a39e8b073c5f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55978,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/2a/4f2aace06a9fd6449489ccb24b1ab776/pa/MW07169_d47b7139d660d343f5e51dab9ec5b2c9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fdc1ab87-8d2c-5907-9e01-a39e8b073c5f/fdc1ab87-8d2c-5907-9e01-a39e8b073c5f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104311,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/2a/4f2aace06a9fd6449489ccb24b1ab776/pa/MW07169_d5ef04d407f48d864ee039965d1e67fd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fdc1ab87-8d2c-5907-9e01-a39e8b073c5f/fdc1ab87-8d2c-5907-9e01-a39e8b073c5f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85653,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/2a/4f2aace06a9fd6449489ccb24b1ab776/pa/MW07169_1a21e414025970b90f2fec8d12cd4b41.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fdc1ab87-8d2c-5907-9e01-a39e8b073c5f/fdc1ab87-8d2c-5907-9e01-a39e8b073c5f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90338,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/2a/4f2aace06a9fd6449489ccb24b1ab776/pa/MW07169_580a70f1c04ae86caa40c12c443456aa.jpg',
             'Width': 800}],
 'postal_code': '13000',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Bouches-du-Rhône',
 'province_code': 'FR-13',
 'region': "Provence-Alpes-Côte d'Azur",
 'region_code': 'FR-93',
 'registration_date': '2011-02-08',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat 500 0.9 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2011}
2026-04-27 08:00:12 [auto1.fr] INFO: Saving data for MW07169: {'created_time': 1777276812.02062, 'last_price_update_time': 1777276812.020634, 'has_photos': True, 'auction_closing_time': 1777391245.0}
2026-04-27 08:00:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VL77818/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KF38228> (referer: https://www.auto1.com/v1/car-details-view/KF38228/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b6b8c0f-288d-53fb-a29b-c70195c0264b with identifier: KF38228
2026-04-27 08:00:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b6b8c0f-288d-53fb-a29b-c70195c0264b with scrape type 1
2026-04-27 08:00:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 8b6b8c0f-288d-53fb-a29b-c70195c0264b
2026-04-27 08:00:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/b8/dbb8ef6848b3a713c790882f6e3677a4/pa/KF38228_52637a58881908161c55ed1fb3d6faf1.jpg not downloaded yet
2026-04-27 08:00:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/b8/dbb8ef6848b3a713c790882f6e3677a4/pa/KF38228_ed3195f69b60240ead10ed831fd9312c.jpg not downloaded yet
2026-04-27 08:00:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/b8/dbb8ef6848b3a713c790882f6e3677a4/pa/KF38228_bb8ff27a585e2b0b622fb642e3269989.jpg not downloaded yet
2026-04-27 08:00:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/b8/dbb8ef6848b3a713c790882f6e3677a4/pa/KF38228_0a9b72f492d59cb05ccfb488a6571064.jpg not downloaded yet
2026-04-27 08:00:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/b8/dbb8ef6848b3a713c790882f6e3677a4/pa/KF38228_bc0fbf91b0bb7918d4b10f15b9bc937f.jpg not downloaded yet
2026-04-27 08:00:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/b8/dbb8ef6848b3a713c790882f6e3677a4/pa/KF38228_a73d26d86092039df70da6a967f990fa.jpg not downloaded yet
2026-04-27 08:00:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KZ84979/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/b8/dbb8ef6848b3a713c790882f6e3677a4/pa/KF38228_a73d26d86092039df70da6a967f990fa.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f144751f2d0>
2026-04-27 08:00:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b6b8c0f-288d-53fb-a29b-c70195c0264b/8b6b8c0f-288d-53fb-a29b-c70195c0264b_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:00:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/b8/dbb8ef6848b3a713c790882f6e3677a4/pa/KF38228_a73d26d86092039df70da6a967f990fa.jpg saved to cache
2026-04-27 08:00:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8b6b8c0f-288d-53fb-a29b-c70195c0264b
2026-04-27 08:00:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/b8/dbb8ef6848b3a713c790882f6e3677a4/pa/KF38228_bc0fbf91b0bb7918d4b10f15b9bc937f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142be1a010>
2026-04-27 08:00:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b6b8c0f-288d-53fb-a29b-c70195c0264b/8b6b8c0f-288d-53fb-a29b-c70195c0264b_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:00:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/b8/dbb8ef6848b3a713c790882f6e3677a4/pa/KF38228_bc0fbf91b0bb7918d4b10f15b9bc937f.jpg saved to cache
2026-04-27 08:00:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8b6b8c0f-288d-53fb-a29b-c70195c0264b
2026-04-27 08:00:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NN12776/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/b8/dbb8ef6848b3a713c790882f6e3677a4/pa/KF38228_0a9b72f492d59cb05ccfb488a6571064.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/b8/dbb8ef6848b3a713c790882f6e3677a4/pa/KF38228_bb8ff27a585e2b0b622fb642e3269989.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bf8f150>
2026-04-27 08:00:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b6b8c0f-288d-53fb-a29b-c70195c0264b/8b6b8c0f-288d-53fb-a29b-c70195c0264b_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:00:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/b8/dbb8ef6848b3a713c790882f6e3677a4/pa/KF38228_0a9b72f492d59cb05ccfb488a6571064.jpg saved to cache
2026-04-27 08:00:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8b6b8c0f-288d-53fb-a29b-c70195c0264b
2026-04-27 08:00:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a61090>
2026-04-27 08:00:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b6b8c0f-288d-53fb-a29b-c70195c0264b/8b6b8c0f-288d-53fb-a29b-c70195c0264b_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:00:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/b8/dbb8ef6848b3a713c790882f6e3677a4/pa/KF38228_bb8ff27a585e2b0b622fb642e3269989.jpg saved to cache
2026-04-27 08:00:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8b6b8c0f-288d-53fb-a29b-c70195c0264b
2026-04-27 08:00:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HW58466> (referer: https://www.auto1.com/v1/car-details-view/HW58466/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/b8/dbb8ef6848b3a713c790882f6e3677a4/pa/KF38228_ed3195f69b60240ead10ed831fd9312c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e214c93-379a-532c-a820-0b2c03ca46b0 with identifier: HW58466
2026-04-27 08:00:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e214c93-379a-532c-a820-0b2c03ca46b0 with scrape type 1
2026-04-27 08:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 4e214c93-379a-532c-a820-0b2c03ca46b0
2026-04-27 08:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/07/830762d90e8044f9b5ea410472ef52fd/pa/HW58466_24bf6827745df31d2a96c6a66c1c848e.jpg not downloaded yet
2026-04-27 08:00:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/b8/dbb8ef6848b3a713c790882f6e3677a4/pa/KF38228_52637a58881908161c55ed1fb3d6faf1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/07/830762d90e8044f9b5ea410472ef52fd/pa/HW58466_8982ad8e1729bc339e162a364bc8c145.jpg not downloaded yet
2026-04-27 08:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/07/830762d90e8044f9b5ea410472ef52fd/pa/HW58466_836d4f6a8a601a5a4d3dbe4908454e73.jpg not downloaded yet
2026-04-27 08:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/07/830762d90e8044f9b5ea410472ef52fd/pa/HW58466_1022e716a7e40b37f7e897d37777f42d.jpg not downloaded yet
2026-04-27 08:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/07/830762d90e8044f9b5ea410472ef52fd/pa/HW58466_511718f607e675b046dae68112808f62.jpg not downloaded yet
2026-04-27 08:00:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a55490>
2026-04-27 08:00:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b6b8c0f-288d-53fb-a29b-c70195c0264b/8b6b8c0f-288d-53fb-a29b-c70195c0264b_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/b8/dbb8ef6848b3a713c790882f6e3677a4/pa/KF38228_ed3195f69b60240ead10ed831fd9312c.jpg saved to cache
2026-04-27 08:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8b6b8c0f-288d-53fb-a29b-c70195c0264b
2026-04-27 08:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/07/830762d90e8044f9b5ea410472ef52fd/pa/HW58466_70691db6ecad087326ef38bc902ebd8d.jpg not downloaded yet
2026-04-27 08:00:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/07/830762d90e8044f9b5ea410472ef52fd/pa/HW58466_24bf6827745df31d2a96c6a66c1c848e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14478e0450>
2026-04-27 08:00:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b6b8c0f-288d-53fb-a29b-c70195c0264b/8b6b8c0f-288d-53fb-a29b-c70195c0264b_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/b8/dbb8ef6848b3a713c790882f6e3677a4/pa/KF38228_52637a58881908161c55ed1fb3d6faf1.jpg saved to cache
2026-04-27 08:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8b6b8c0f-288d-53fb-a29b-c70195c0264b
2026-04-27 08:00:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8b6b8c0f-288d-53fb-a29b-c70195c0264b, skipping ID generation
2026-04-27 08:00:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b6b8c0f-288d-53fb-a29b-c70195c0264b with scrape type 1
2026-04-27 08:00:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8b6b8c0f-288d-53fb-a29b-c70195c0264b sending to next pipeline
2026-04-27 08:00:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8b6b8c0f-288d-53fb-a29b-c70195c0264b, identifier: KF38228
2026-04-27 08:00:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8b6b8c0f-288d-53fb-a29b-c70195c0264b with identifier: KF38228
2026-04-27 08:00:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8b6b8c0f-288d-53fb-a29b-c70195c0264b with identifier: KF38228
2026-04-27 08:00:24 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 8b6b8c0f-288d-53fb-a29b-c70195c0264b with identifier: KF38228 to the API
2026-04-27 08:00:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:24 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgdb/b8/dbb8ef6848b3a713c790882f6e3677a4/pa/KF38228_52637a58881908161c55ed1fb3d6faf1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'city': 'Creutzwald',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2026-04-28T15:30:25Z',
 'fuel_type': 'diesel',
 'id': '8b6b8c0f-288d-53fb-a29b-c70195c0264b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 49.2053,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KF38228',
 'listing': 'auction',
 'location': 'FR, Creutzwald',
 'location_confidence': 'geocoded',
 'longitude': 6.6967,
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 276488,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8b6b8c0f-288d-53fb-a29b-c70195c0264b/8b6b8c0f-288d-53fb-a29b-c70195c0264b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92199,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/b8/dbb8ef6848b3a713c790882f6e3677a4/pa/KF38228_52637a58881908161c55ed1fb3d6faf1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8b6b8c0f-288d-53fb-a29b-c70195c0264b/8b6b8c0f-288d-53fb-a29b-c70195c0264b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91449,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/b8/dbb8ef6848b3a713c790882f6e3677a4/pa/KF38228_ed3195f69b60240ead10ed831fd9312c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8b6b8c0f-288d-53fb-a29b-c70195c0264b/8b6b8c0f-288d-53fb-a29b-c70195c0264b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70125,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/b8/dbb8ef6848b3a713c790882f6e3677a4/pa/KF38228_bb8ff27a585e2b0b622fb642e3269989.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8b6b8c0f-288d-53fb-a29b-c70195c0264b/8b6b8c0f-288d-53fb-a29b-c70195c0264b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70259,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/b8/dbb8ef6848b3a713c790882f6e3677a4/pa/KF38228_0a9b72f492d59cb05ccfb488a6571064.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8b6b8c0f-288d-53fb-a29b-c70195c0264b/8b6b8c0f-288d-53fb-a29b-c70195c0264b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87579,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/b8/dbb8ef6848b3a713c790882f6e3677a4/pa/KF38228_bc0fbf91b0bb7918d4b10f15b9bc937f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8b6b8c0f-288d-53fb-a29b-c70195c0264b/8b6b8c0f-288d-53fb-a29b-c70195c0264b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39474,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/b8/dbb8ef6848b3a713c790882f6e3677a4/pa/KF38228_a73d26d86092039df70da6a967f990fa.jpg',
             'Width': 800}],
 'postal_code': '57150',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Moselle',
 'province_code': 'FR-57',
 'region': 'Grand Est',
 'region_code': 'FR-44',
 'registration_date': '2011-06-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 1.6 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2011}
2026-04-27 08:00:24 [auto1.fr] INFO: Saving data for KF38228: {'created_time': 1777276824.59474, 'last_price_update_time': 1777276824.59475, 'has_photos': True, 'auction_closing_time': 1777390225.0}
2026-04-27 08:00:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14381cd150>
2026-04-27 08:00:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e214c93-379a-532c-a820-0b2c03ca46b0/4e214c93-379a-532c-a820-0b2c03ca46b0_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/07/830762d90e8044f9b5ea410472ef52fd/pa/HW58466_24bf6827745df31d2a96c6a66c1c848e.jpg saved to cache
2026-04-27 08:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4e214c93-379a-532c-a820-0b2c03ca46b0
2026-04-27 08:00:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/07/830762d90e8044f9b5ea410472ef52fd/pa/HW58466_70691db6ecad087326ef38bc902ebd8d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/07/830762d90e8044f9b5ea410472ef52fd/pa/HW58466_511718f607e675b046dae68112808f62.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143809b890>
2026-04-27 08:00:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e214c93-379a-532c-a820-0b2c03ca46b0/4e214c93-379a-532c-a820-0b2c03ca46b0_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/07/830762d90e8044f9b5ea410472ef52fd/pa/HW58466_70691db6ecad087326ef38bc902ebd8d.jpg saved to cache
2026-04-27 08:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4e214c93-379a-532c-a820-0b2c03ca46b0
2026-04-27 08:00:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/07/830762d90e8044f9b5ea410472ef52fd/pa/HW58466_1022e716a7e40b37f7e897d37777f42d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a56ad0>
2026-04-27 08:00:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e214c93-379a-532c-a820-0b2c03ca46b0/4e214c93-379a-532c-a820-0b2c03ca46b0_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/07/830762d90e8044f9b5ea410472ef52fd/pa/HW58466_511718f607e675b046dae68112808f62.jpg saved to cache
2026-04-27 08:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4e214c93-379a-532c-a820-0b2c03ca46b0
2026-04-27 08:00:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/07/830762d90e8044f9b5ea410472ef52fd/pa/HW58466_836d4f6a8a601a5a4d3dbe4908454e73.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438130f50>
2026-04-27 08:00:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e214c93-379a-532c-a820-0b2c03ca46b0/4e214c93-379a-532c-a820-0b2c03ca46b0_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/07/830762d90e8044f9b5ea410472ef52fd/pa/HW58466_1022e716a7e40b37f7e897d37777f42d.jpg saved to cache
2026-04-27 08:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4e214c93-379a-532c-a820-0b2c03ca46b0
2026-04-27 08:00:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/07/830762d90e8044f9b5ea410472ef52fd/pa/HW58466_8982ad8e1729bc339e162a364bc8c145.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438039f90>
2026-04-27 08:00:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e214c93-379a-532c-a820-0b2c03ca46b0/4e214c93-379a-532c-a820-0b2c03ca46b0_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/07/830762d90e8044f9b5ea410472ef52fd/pa/HW58466_836d4f6a8a601a5a4d3dbe4908454e73.jpg saved to cache
2026-04-27 08:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4e214c93-379a-532c-a820-0b2c03ca46b0
2026-04-27 08:00:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b5bd10>
2026-04-27 08:00:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e214c93-379a-532c-a820-0b2c03ca46b0/4e214c93-379a-532c-a820-0b2c03ca46b0_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/07/830762d90e8044f9b5ea410472ef52fd/pa/HW58466_8982ad8e1729bc339e162a364bc8c145.jpg saved to cache
2026-04-27 08:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4e214c93-379a-532c-a820-0b2c03ca46b0
2026-04-27 08:00:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4e214c93-379a-532c-a820-0b2c03ca46b0, skipping ID generation
2026-04-27 08:00:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e214c93-379a-532c-a820-0b2c03ca46b0 with scrape type 1
2026-04-27 08:00:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4e214c93-379a-532c-a820-0b2c03ca46b0 sending to next pipeline
2026-04-27 08:00:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4e214c93-379a-532c-a820-0b2c03ca46b0, identifier: HW58466
2026-04-27 08:00:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4e214c93-379a-532c-a820-0b2c03ca46b0 with identifier: HW58466
2026-04-27 08:00:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4e214c93-379a-532c-a820-0b2c03ca46b0 with identifier: HW58466
2026-04-27 08:00:25 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 4e214c93-379a-532c-a820-0b2c03ca46b0 with identifier: HW58466 to the API
2026-04-27 08:00:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:25 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img83/07/830762d90e8044f9b5ea410472ef52fd/pa/HW58466_8982ad8e1729bc339e162a364bc8c145.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'city': 'Beaucaire',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-04-28T15:14:00Z',
 'fuel_type': 'diesel',
 'id': '4e214c93-379a-532c-a820-0b2c03ca46b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 43.8081,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HW58466',
 'listing': 'auction',
 'location': 'FR, Beaucaire',
 'location_confidence': 'geocoded',
 'longitude': 4.6442,
 'make': 'Fiat',
 'model': 'Punto',
 'odometer': 195415,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4e214c93-379a-532c-a820-0b2c03ca46b0/4e214c93-379a-532c-a820-0b2c03ca46b0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 142561,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/07/830762d90e8044f9b5ea410472ef52fd/pa/HW58466_24bf6827745df31d2a96c6a66c1c848e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4e214c93-379a-532c-a820-0b2c03ca46b0/4e214c93-379a-532c-a820-0b2c03ca46b0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 125890,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/07/830762d90e8044f9b5ea410472ef52fd/pa/HW58466_8982ad8e1729bc339e162a364bc8c145.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4e214c93-379a-532c-a820-0b2c03ca46b0/4e214c93-379a-532c-a820-0b2c03ca46b0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65114,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/07/830762d90e8044f9b5ea410472ef52fd/pa/HW58466_836d4f6a8a601a5a4d3dbe4908454e73.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4e214c93-379a-532c-a820-0b2c03ca46b0/4e214c93-379a-532c-a820-0b2c03ca46b0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64963,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/07/830762d90e8044f9b5ea410472ef52fd/pa/HW58466_1022e716a7e40b37f7e897d37777f42d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4e214c93-379a-532c-a820-0b2c03ca46b0/4e214c93-379a-532c-a820-0b2c03ca46b0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91996,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/07/830762d90e8044f9b5ea410472ef52fd/pa/HW58466_511718f607e675b046dae68112808f62.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4e214c93-379a-532c-a820-0b2c03ca46b0/4e214c93-379a-532c-a820-0b2c03ca46b0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38544,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/07/830762d90e8044f9b5ea410472ef52fd/pa/HW58466_70691db6ecad087326ef38bc902ebd8d.jpg',
             'Width': 800}],
 'postal_code': '30300',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Gard',
 'province_code': 'FR-30',
 'region': 'Occitanie',
 'region_code': 'FR-76',
 'registration_date': '2011-02-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat Punto 1.3 JTD Classic Active',
 'transmission': 'manual',
 'trim': 'Classic Active',
 'year': 2011}
2026-04-27 08:00:25 [auto1.fr] INFO: Saving data for HW58466: {'created_time': 1777276825.550326, 'last_price_update_time': 1777276825.550336, 'has_photos': True, 'auction_closing_time': 1777389240.0}
2026-04-27 08:00:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FH45650> (referer: https://www.auto1.com/v1/car-details-view/FH45650/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8a0bab2-01aa-584f-a420-446ad3f2993b with identifier: FH45650
2026-04-27 08:00:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8a0bab2-01aa-584f-a420-446ad3f2993b with scrape type 1
2026-04-27 08:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e8a0bab2-01aa-584f-a420-446ad3f2993b
2026-04-27 08:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/e1/f8e15fd3c39ba65b017666803826b193/pa/FH45650_beaf3aa38fdaafd234b0a2931c25da6c.jpg not downloaded yet
2026-04-27 08:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/e1/f8e15fd3c39ba65b017666803826b193/pa/FH45650_5b8dcf7d11ea8428375145e2f20803ce.jpg not downloaded yet
2026-04-27 08:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/e1/f8e15fd3c39ba65b017666803826b193/pa/FH45650_c91b2b7aa126e7f9ab1405c4ddb8aabc.jpg not downloaded yet
2026-04-27 08:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/e1/f8e15fd3c39ba65b017666803826b193/pa/FH45650_1dc12d4d7945a717b5d551177a5c0084.jpg not downloaded yet
2026-04-27 08:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/e1/f8e15fd3c39ba65b017666803826b193/pa/FH45650_af4fcd77075823ece0fda529c05cec99.jpg not downloaded yet
2026-04-27 08:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/e1/f8e15fd3c39ba65b017666803826b193/pa/FH45650_1e54eb06abf66b90f19ec2d4f2d9e2ec.jpg not downloaded yet
2026-04-27 08:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/e1/f8e15fd3c39ba65b017666803826b193/pa/FH45650_6436f704f2bb697f127f7d8baa462556.jpg not downloaded yet
2026-04-27 08:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/e1/f8e15fd3c39ba65b017666803826b193/pa/FH45650_c6d0beb69d8c728dacf02647295102ed.jpg not downloaded yet
2026-04-27 08:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/e1/f8e15fd3c39ba65b017666803826b193/pa/FH45650_a594a736e45664c0ea01a9de09b486ae.jpg not downloaded yet
2026-04-27 08:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/e1/f8e15fd3c39ba65b017666803826b193/pa/FH45650_676e0751066172a6ea2074a744debed8.jpg not downloaded yet
2026-04-27 08:00:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZB78862> (referer: https://www.auto1.com/v1/car-details-view/ZB78862/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e74beda-350e-5279-8acd-028068f13ac4 with identifier: ZB78862
2026-04-27 08:00:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e74beda-350e-5279-8acd-028068f13ac4 with scrape type 1
2026-04-27 08:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 2e74beda-350e-5279-8acd-028068f13ac4
2026-04-27 08:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/d0/1dd07450837b1aba8a3294335710d503/pa/ZB78862_058de5830c2e148f67dc24748d99ff0d.jpg not downloaded yet
2026-04-27 08:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/d0/1dd07450837b1aba8a3294335710d503/pa/ZB78862_c445b0dea579176b54964551a188ab6b.jpg not downloaded yet
2026-04-27 08:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/d0/1dd07450837b1aba8a3294335710d503/pa/ZB78862_80a00c34a4ce1ba5ebdfd12304d462eb.jpg not downloaded yet
2026-04-27 08:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/d0/1dd07450837b1aba8a3294335710d503/pa/ZB78862_59512cb6a5a9c12490ced9fa3a48eb30.jpg not downloaded yet
2026-04-27 08:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/d0/1dd07450837b1aba8a3294335710d503/pa/ZB78862_42f3f9f8191bda0f69abed93e2b298fa.jpg not downloaded yet
2026-04-27 08:00:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/e1/f8e15fd3c39ba65b017666803826b193/pa/FH45650_676e0751066172a6ea2074a744debed8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/d0/1dd07450837b1aba8a3294335710d503/pa/ZB78862_b50386ddaf6d83f2f9f45fca77f8d7c7.jpg not downloaded yet
2026-04-27 08:00:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d6f7d0>
2026-04-27 08:00:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8a0bab2-01aa-584f-a420-446ad3f2993b/e8a0bab2-01aa-584f-a420-446ad3f2993b_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/e1/f8e15fd3c39ba65b017666803826b193/pa/FH45650_676e0751066172a6ea2074a744debed8.jpg saved to cache
2026-04-27 08:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e8a0bab2-01aa-584f-a420-446ad3f2993b
2026-04-27 08:00:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/d0/1dd07450837b1aba8a3294335710d503/pa/ZB78862_42f3f9f8191bda0f69abed93e2b298fa.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438076e90>
2026-04-27 08:00:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e74beda-350e-5279-8acd-028068f13ac4/2e74beda-350e-5279-8acd-028068f13ac4_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/d0/1dd07450837b1aba8a3294335710d503/pa/ZB78862_42f3f9f8191bda0f69abed93e2b298fa.jpg saved to cache
2026-04-27 08:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2e74beda-350e-5279-8acd-028068f13ac4
2026-04-27 08:00:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/d0/1dd07450837b1aba8a3294335710d503/pa/ZB78862_b50386ddaf6d83f2f9f45fca77f8d7c7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438df8c50>
2026-04-27 08:00:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e74beda-350e-5279-8acd-028068f13ac4/2e74beda-350e-5279-8acd-028068f13ac4_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/d0/1dd07450837b1aba8a3294335710d503/pa/ZB78862_b50386ddaf6d83f2f9f45fca77f8d7c7.jpg saved to cache
2026-04-27 08:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2e74beda-350e-5279-8acd-028068f13ac4
2026-04-27 08:00:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AX33817/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/d0/1dd07450837b1aba8a3294335710d503/pa/ZB78862_59512cb6a5a9c12490ced9fa3a48eb30.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438dfb850>
2026-04-27 08:00:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e74beda-350e-5279-8acd-028068f13ac4/2e74beda-350e-5279-8acd-028068f13ac4_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/d0/1dd07450837b1aba8a3294335710d503/pa/ZB78862_59512cb6a5a9c12490ced9fa3a48eb30.jpg saved to cache
2026-04-27 08:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2e74beda-350e-5279-8acd-028068f13ac4
2026-04-27 08:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/d0/1dd07450837b1aba8a3294335710d503/pa/ZB78862_c445b0dea579176b54964551a188ab6b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/d0/1dd07450837b1aba8a3294335710d503/pa/ZB78862_80a00c34a4ce1ba5ebdfd12304d462eb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143812ded0>
2026-04-27 08:00:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e74beda-350e-5279-8acd-028068f13ac4/2e74beda-350e-5279-8acd-028068f13ac4_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/d0/1dd07450837b1aba8a3294335710d503/pa/ZB78862_c445b0dea579176b54964551a188ab6b.jpg saved to cache
2026-04-27 08:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2e74beda-350e-5279-8acd-028068f13ac4
2026-04-27 08:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/d0/1dd07450837b1aba8a3294335710d503/pa/ZB78862_058de5830c2e148f67dc24748d99ff0d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c36ed0>
2026-04-27 08:00:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e74beda-350e-5279-8acd-028068f13ac4/2e74beda-350e-5279-8acd-028068f13ac4_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/d0/1dd07450837b1aba8a3294335710d503/pa/ZB78862_80a00c34a4ce1ba5ebdfd12304d462eb.jpg saved to cache
2026-04-27 08:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2e74beda-350e-5279-8acd-028068f13ac4
2026-04-27 08:00:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142be17e50>
2026-04-27 08:00:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e74beda-350e-5279-8acd-028068f13ac4/2e74beda-350e-5279-8acd-028068f13ac4_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/d0/1dd07450837b1aba8a3294335710d503/pa/ZB78862_058de5830c2e148f67dc24748d99ff0d.jpg saved to cache
2026-04-27 08:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2e74beda-350e-5279-8acd-028068f13ac4
2026-04-27 08:00:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2e74beda-350e-5279-8acd-028068f13ac4, skipping ID generation
2026-04-27 08:00:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e74beda-350e-5279-8acd-028068f13ac4 with scrape type 1
2026-04-27 08:00:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2e74beda-350e-5279-8acd-028068f13ac4 sending to next pipeline
2026-04-27 08:00:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2e74beda-350e-5279-8acd-028068f13ac4, identifier: ZB78862
2026-04-27 08:00:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2e74beda-350e-5279-8acd-028068f13ac4 with identifier: ZB78862
2026-04-27 08:00:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2e74beda-350e-5279-8acd-028068f13ac4 with identifier: ZB78862
2026-04-27 08:00:29 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2e74beda-350e-5279-8acd-028068f13ac4 with identifier: ZB78862 to the API
2026-04-27 08:00:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:29 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1d/d0/1dd07450837b1aba8a3294335710d503/pa/ZB78862_058de5830c2e148f67dc24748d99ff0d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 170,
 'category': None,
 'city': 'Vezin-le-Coquet',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 130,
 'expiration_date': '2026-04-28T15:55:58Z',
 'fuel_type': 'petrol',
 'id': '2e74beda-350e-5279-8acd-028068f13ac4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.119,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZB78862',
 'listing': 'auction',
 'location': 'FR, Vezin-le-Coquet',
 'location_confidence': 'geocoded',
 'longitude': -1.7563,
 'make': 'Renault',
 'model': 'Grand Scenic',
 'odometer': 186465,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2e74beda-350e-5279-8acd-028068f13ac4/2e74beda-350e-5279-8acd-028068f13ac4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91090,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/d0/1dd07450837b1aba8a3294335710d503/pa/ZB78862_058de5830c2e148f67dc24748d99ff0d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2e74beda-350e-5279-8acd-028068f13ac4/2e74beda-350e-5279-8acd-028068f13ac4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78953,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/d0/1dd07450837b1aba8a3294335710d503/pa/ZB78862_c445b0dea579176b54964551a188ab6b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2e74beda-350e-5279-8acd-028068f13ac4/2e74beda-350e-5279-8acd-028068f13ac4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89395,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/d0/1dd07450837b1aba8a3294335710d503/pa/ZB78862_80a00c34a4ce1ba5ebdfd12304d462eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2e74beda-350e-5279-8acd-028068f13ac4/2e74beda-350e-5279-8acd-028068f13ac4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80018,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/d0/1dd07450837b1aba8a3294335710d503/pa/ZB78862_59512cb6a5a9c12490ced9fa3a48eb30.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2e74beda-350e-5279-8acd-028068f13ac4/2e74beda-350e-5279-8acd-028068f13ac4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84825,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/d0/1dd07450837b1aba8a3294335710d503/pa/ZB78862_42f3f9f8191bda0f69abed93e2b298fa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2e74beda-350e-5279-8acd-028068f13ac4/2e74beda-350e-5279-8acd-028068f13ac4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36951,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/d0/1dd07450837b1aba8a3294335710d503/pa/ZB78862_b50386ddaf6d83f2f9f45fca77f8d7c7.jpg',
             'Width': 800}],
 'postal_code': '35132',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Ille-et-Vilaine',
 'province_code': 'FR-35',
 'region': 'Bretagne',
 'region_code': 'FR-53',
 'registration_date': '2011-10-23',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Renault Grand Scenic 1.4 TCe Dynamique',
 'transmission': 'manual',
 'trim': 'Dynamique',
 'year': 2011}
2026-04-27 08:00:29 [auto1.fr] INFO: Saving data for ZB78862: {'created_time': 1777276829.687063, 'last_price_update_time': 1777276829.687073, 'has_photos': True, 'auction_closing_time': 1777391758.0}
2026-04-27 08:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/e1/f8e15fd3c39ba65b017666803826b193/pa/FH45650_a594a736e45664c0ea01a9de09b486ae.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438df85d0>
2026-04-27 08:00:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8a0bab2-01aa-584f-a420-446ad3f2993b/e8a0bab2-01aa-584f-a420-446ad3f2993b_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/e1/f8e15fd3c39ba65b017666803826b193/pa/FH45650_a594a736e45664c0ea01a9de09b486ae.jpg saved to cache
2026-04-27 08:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e8a0bab2-01aa-584f-a420-446ad3f2993b
2026-04-27 08:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/e1/f8e15fd3c39ba65b017666803826b193/pa/FH45650_c6d0beb69d8c728dacf02647295102ed.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bfffe10>
2026-04-27 08:00:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8a0bab2-01aa-584f-a420-446ad3f2993b/e8a0bab2-01aa-584f-a420-446ad3f2993b_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/e1/f8e15fd3c39ba65b017666803826b193/pa/FH45650_c6d0beb69d8c728dacf02647295102ed.jpg saved to cache
2026-04-27 08:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e8a0bab2-01aa-584f-a420-446ad3f2993b
2026-04-27 08:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/e1/f8e15fd3c39ba65b017666803826b193/pa/FH45650_6436f704f2bb697f127f7d8baa462556.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c848d0>
2026-04-27 08:00:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8a0bab2-01aa-584f-a420-446ad3f2993b/e8a0bab2-01aa-584f-a420-446ad3f2993b_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/e1/f8e15fd3c39ba65b017666803826b193/pa/FH45650_6436f704f2bb697f127f7d8baa462556.jpg saved to cache
2026-04-27 08:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e8a0bab2-01aa-584f-a420-446ad3f2993b
2026-04-27 08:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/e1/f8e15fd3c39ba65b017666803826b193/pa/FH45650_1e54eb06abf66b90f19ec2d4f2d9e2ec.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438df9f10>
2026-04-27 08:00:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8a0bab2-01aa-584f-a420-446ad3f2993b/e8a0bab2-01aa-584f-a420-446ad3f2993b_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/e1/f8e15fd3c39ba65b017666803826b193/pa/FH45650_1e54eb06abf66b90f19ec2d4f2d9e2ec.jpg saved to cache
2026-04-27 08:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e8a0bab2-01aa-584f-a420-446ad3f2993b
2026-04-27 08:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/e1/f8e15fd3c39ba65b017666803826b193/pa/FH45650_af4fcd77075823ece0fda529c05cec99.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142be18b50>
2026-04-27 08:00:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8a0bab2-01aa-584f-a420-446ad3f2993b/e8a0bab2-01aa-584f-a420-446ad3f2993b_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/e1/f8e15fd3c39ba65b017666803826b193/pa/FH45650_af4fcd77075823ece0fda529c05cec99.jpg saved to cache
2026-04-27 08:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e8a0bab2-01aa-584f-a420-446ad3f2993b
2026-04-27 08:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/e1/f8e15fd3c39ba65b017666803826b193/pa/FH45650_1dc12d4d7945a717b5d551177a5c0084.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bf7a250>
2026-04-27 08:00:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8a0bab2-01aa-584f-a420-446ad3f2993b/e8a0bab2-01aa-584f-a420-446ad3f2993b_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/e1/f8e15fd3c39ba65b017666803826b193/pa/FH45650_1dc12d4d7945a717b5d551177a5c0084.jpg saved to cache
2026-04-27 08:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e8a0bab2-01aa-584f-a420-446ad3f2993b
2026-04-27 08:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/e1/f8e15fd3c39ba65b017666803826b193/pa/FH45650_c91b2b7aa126e7f9ab1405c4ddb8aabc.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c87f90>
2026-04-27 08:00:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8a0bab2-01aa-584f-a420-446ad3f2993b/e8a0bab2-01aa-584f-a420-446ad3f2993b_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/e1/f8e15fd3c39ba65b017666803826b193/pa/FH45650_c91b2b7aa126e7f9ab1405c4ddb8aabc.jpg saved to cache
2026-04-27 08:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e8a0bab2-01aa-584f-a420-446ad3f2993b
2026-04-27 08:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/e1/f8e15fd3c39ba65b017666803826b193/pa/FH45650_5b8dcf7d11ea8428375145e2f20803ce.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/e1/f8e15fd3c39ba65b017666803826b193/pa/FH45650_beaf3aa38fdaafd234b0a2931c25da6c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438f829d0>
2026-04-27 08:00:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8a0bab2-01aa-584f-a420-446ad3f2993b/e8a0bab2-01aa-584f-a420-446ad3f2993b_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/e1/f8e15fd3c39ba65b017666803826b193/pa/FH45650_5b8dcf7d11ea8428375145e2f20803ce.jpg saved to cache
2026-04-27 08:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e8a0bab2-01aa-584f-a420-446ad3f2993b
2026-04-27 08:00:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d86810>
2026-04-27 08:00:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8a0bab2-01aa-584f-a420-446ad3f2993b/e8a0bab2-01aa-584f-a420-446ad3f2993b_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/e1/f8e15fd3c39ba65b017666803826b193/pa/FH45650_beaf3aa38fdaafd234b0a2931c25da6c.jpg saved to cache
2026-04-27 08:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e8a0bab2-01aa-584f-a420-446ad3f2993b
2026-04-27 08:00:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e8a0bab2-01aa-584f-a420-446ad3f2993b, skipping ID generation
2026-04-27 08:00:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8a0bab2-01aa-584f-a420-446ad3f2993b with scrape type 1
2026-04-27 08:00:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e8a0bab2-01aa-584f-a420-446ad3f2993b sending to next pipeline
2026-04-27 08:00:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e8a0bab2-01aa-584f-a420-446ad3f2993b, identifier: FH45650
2026-04-27 08:00:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e8a0bab2-01aa-584f-a420-446ad3f2993b with identifier: FH45650
2026-04-27 08:00:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e8a0bab2-01aa-584f-a420-446ad3f2993b with identifier: FH45650
2026-04-27 08:00:31 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e8a0bab2-01aa-584f-a420-446ad3f2993b with identifier: FH45650 to the API
2026-04-27 08:00:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:31 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf8/e1/f8e15fd3c39ba65b017666803826b193/pa/FH45650_beaf3aa38fdaafd234b0a2931c25da6c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'city': 'Quincieux',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 130,
 'expiration_date': '2026-04-28T15:01:01Z',
 'fuel_type': 'petrol',
 'id': 'e8a0bab2-01aa-584f-a420-446ad3f2993b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 45.9137,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FH45650',
 'listing': 'auction',
 'location': 'FR, Quincieux',
 'location_confidence': 'geocoded',
 'longitude': 4.777,
 'make': 'Peugeot',
 'model': '308',
 'odometer': 169826,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e8a0bab2-01aa-584f-a420-446ad3f2993b/e8a0bab2-01aa-584f-a420-446ad3f2993b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76427,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/e1/f8e15fd3c39ba65b017666803826b193/pa/FH45650_beaf3aa38fdaafd234b0a2931c25da6c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e8a0bab2-01aa-584f-a420-446ad3f2993b/e8a0bab2-01aa-584f-a420-446ad3f2993b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75533,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/e1/f8e15fd3c39ba65b017666803826b193/pa/FH45650_5b8dcf7d11ea8428375145e2f20803ce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e8a0bab2-01aa-584f-a420-446ad3f2993b/e8a0bab2-01aa-584f-a420-446ad3f2993b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77014,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/e1/f8e15fd3c39ba65b017666803826b193/pa/FH45650_c91b2b7aa126e7f9ab1405c4ddb8aabc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e8a0bab2-01aa-584f-a420-446ad3f2993b/e8a0bab2-01aa-584f-a420-446ad3f2993b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68247,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/e1/f8e15fd3c39ba65b017666803826b193/pa/FH45650_1dc12d4d7945a717b5d551177a5c0084.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e8a0bab2-01aa-584f-a420-446ad3f2993b/e8a0bab2-01aa-584f-a420-446ad3f2993b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59486,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/e1/f8e15fd3c39ba65b017666803826b193/pa/FH45650_af4fcd77075823ece0fda529c05cec99.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e8a0bab2-01aa-584f-a420-446ad3f2993b/e8a0bab2-01aa-584f-a420-446ad3f2993b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81208,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/e1/f8e15fd3c39ba65b017666803826b193/pa/FH45650_1e54eb06abf66b90f19ec2d4f2d9e2ec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e8a0bab2-01aa-584f-a420-446ad3f2993b/e8a0bab2-01aa-584f-a420-446ad3f2993b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71202,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/e1/f8e15fd3c39ba65b017666803826b193/pa/FH45650_6436f704f2bb697f127f7d8baa462556.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e8a0bab2-01aa-584f-a420-446ad3f2993b/e8a0bab2-01aa-584f-a420-446ad3f2993b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90483,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/e1/f8e15fd3c39ba65b017666803826b193/pa/FH45650_c6d0beb69d8c728dacf02647295102ed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e8a0bab2-01aa-584f-a420-446ad3f2993b/e8a0bab2-01aa-584f-a420-446ad3f2993b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76177,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/e1/f8e15fd3c39ba65b017666803826b193/pa/FH45650_a594a736e45664c0ea01a9de09b486ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e8a0bab2-01aa-584f-a420-446ad3f2993b/e8a0bab2-01aa-584f-a420-446ad3f2993b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47784,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/e1/f8e15fd3c39ba65b017666803826b193/pa/FH45650_676e0751066172a6ea2074a744debed8.jpg',
             'Width': 800}],
 'postal_code': '69650',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Rhône',
 'province_code': 'FR-69',
 'region': 'Auvergne-Rhône-Alpes',
 'region_code': 'FR-84',
 'registration_date': '2014-11-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 308 1.2 e-THP Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2014}
2026-04-27 08:00:31 [auto1.fr] INFO: Saving data for FH45650: {'created_time': 1777276831.958788, 'last_price_update_time': 1777276831.958798, 'has_photos': True, 'auction_closing_time': 1777388461.0}
2026-04-27 08:00:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EF42157> (referer: https://www.auto1.com/v1/car-details-view/EF42157/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XE44101> (referer: https://www.auto1.com/v1/car-details-view/XE44101/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9b4d35d-ce92-581e-9a30-d49a0f2949fb with identifier: EF42157
2026-04-27 08:00:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9b4d35d-ce92-581e-9a30-d49a0f2949fb with scrape type 1
2026-04-27 08:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item e9b4d35d-ce92-581e-9a30-d49a0f2949fb
2026-04-27 08:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/b5/17b562e7c0b33622083635bf09fcf20a/pa/EF42157_b300363d52ab0e0728afddb6c2215c18.jpg not downloaded yet
2026-04-27 08:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/b5/17b562e7c0b33622083635bf09fcf20a/pa/EF42157_9b399fac8a0eea3efd4218d56fd463ff.jpg not downloaded yet
2026-04-27 08:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/b5/17b562e7c0b33622083635bf09fcf20a/pa/EF42157_b63582f439bad237ceebcf562a7d84b5.jpg not downloaded yet
2026-04-27 08:00:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38eafa69-c12d-5119-b98b-31fa0fd03db0 with identifier: XE44101
2026-04-27 08:00:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38eafa69-c12d-5119-b98b-31fa0fd03db0 with scrape type 1
2026-04-27 08:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 38eafa69-c12d-5119-b98b-31fa0fd03db0
2026-04-27 08:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/f6/e9f6ce980c86e08abb6c1111b4ee567e/pa/XE44101_b8e51a34991eaeb89a889adb061fecce.jpg not downloaded yet
2026-04-27 08:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/b5/17b562e7c0b33622083635bf09fcf20a/pa/EF42157_ec6ce6fe5093a45fa09bab1463be2987.jpg not downloaded yet
2026-04-27 08:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/f6/e9f6ce980c86e08abb6c1111b4ee567e/pa/XE44101_6501dc17187a6240709b0428f5f3f766.jpg not downloaded yet
2026-04-27 08:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/b5/17b562e7c0b33622083635bf09fcf20a/pa/EF42157_91c237e473282b8c654377a71400100b.jpg not downloaded yet
2026-04-27 08:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/f6/e9f6ce980c86e08abb6c1111b4ee567e/pa/XE44101_be308257905f507c2bcbe8dba512e379.jpg not downloaded yet
2026-04-27 08:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/b5/17b562e7c0b33622083635bf09fcf20a/pa/EF42157_fb73c334a4383f23a3e22cb88f5478d3.jpg not downloaded yet
2026-04-27 08:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/f6/e9f6ce980c86e08abb6c1111b4ee567e/pa/XE44101_34c79c75930182bc957fe90be600a339.jpg not downloaded yet
2026-04-27 08:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/f6/e9f6ce980c86e08abb6c1111b4ee567e/pa/XE44101_6b16ed216ca4aa0306a944969f4ac351.jpg not downloaded yet
2026-04-27 08:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/f6/e9f6ce980c86e08abb6c1111b4ee567e/pa/XE44101_bde80866b8356c8abf7e9addd25102b5.jpg not downloaded yet
2026-04-27 08:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/f6/e9f6ce980c86e08abb6c1111b4ee567e/pa/XE44101_f6c53cfcc6ba49d7249d89efa803c2f2.jpg not downloaded yet
2026-04-27 08:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/f6/e9f6ce980c86e08abb6c1111b4ee567e/pa/XE44101_cff3105ebc971af45c86fb592dfb70bb.jpg not downloaded yet
2026-04-27 08:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/f6/e9f6ce980c86e08abb6c1111b4ee567e/pa/XE44101_adbd72cb90fff2f74b5fe59a9db08101.jpg not downloaded yet
2026-04-27 08:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/f6/e9f6ce980c86e08abb6c1111b4ee567e/pa/XE44101_87b2f1448e0457690fb31c50442b7cea.jpg not downloaded yet
2026-04-27 08:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ME56071/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ES75996/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/f6/e9f6ce980c86e08abb6c1111b4ee567e/pa/XE44101_87b2f1448e0457690fb31c50442b7cea.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bf8ec10>
2026-04-27 08:00:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38eafa69-c12d-5119-b98b-31fa0fd03db0/38eafa69-c12d-5119-b98b-31fa0fd03db0_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/f6/e9f6ce980c86e08abb6c1111b4ee567e/pa/XE44101_87b2f1448e0457690fb31c50442b7cea.jpg saved to cache
2026-04-27 08:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 38eafa69-c12d-5119-b98b-31fa0fd03db0
2026-04-27 08:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KZ84979> (referer: https://www.auto1.com/v1/car-details-view/KZ84979/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/f6/e9f6ce980c86e08abb6c1111b4ee567e/pa/XE44101_adbd72cb90fff2f74b5fe59a9db08101.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df6dfcc3-f6dd-50da-9856-13cb27edb29f with identifier: KZ84979
2026-04-27 08:00:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df6dfcc3-f6dd-50da-9856-13cb27edb29f with scrape type 1
2026-04-27 08:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item df6dfcc3-f6dd-50da-9856-13cb27edb29f
2026-04-27 08:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/43/65431c0bc4b772ca091575cbd037e35d/pa/KZ84979_6c5b826aad6b345308831bf5b13ce887.jpg not downloaded yet
2026-04-27 08:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/43/65431c0bc4b772ca091575cbd037e35d/pa/KZ84979_1013fccf88821f6d51e1051452fa98bc.jpg not downloaded yet
2026-04-27 08:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/43/65431c0bc4b772ca091575cbd037e35d/pa/KZ84979_a5c59e6f70ab1e34179a4ee55553b69a.jpg not downloaded yet
2026-04-27 08:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/f6/e9f6ce980c86e08abb6c1111b4ee567e/pa/XE44101_cff3105ebc971af45c86fb592dfb70bb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/43/65431c0bc4b772ca091575cbd037e35d/pa/KZ84979_5f699224761456c48c5eb3d42bdbc349.jpg not downloaded yet
2026-04-27 08:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/43/65431c0bc4b772ca091575cbd037e35d/pa/KZ84979_1e87b19f5992955b6c6a220f77b235f4.jpg not downloaded yet
2026-04-27 08:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/43/65431c0bc4b772ca091575cbd037e35d/pa/KZ84979_ac6098200428a403de35365a8eced17b.jpg not downloaded yet
2026-04-27 08:00:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d7c790>
2026-04-27 08:00:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38eafa69-c12d-5119-b98b-31fa0fd03db0/38eafa69-c12d-5119-b98b-31fa0fd03db0_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/f6/e9f6ce980c86e08abb6c1111b4ee567e/pa/XE44101_adbd72cb90fff2f74b5fe59a9db08101.jpg saved to cache
2026-04-27 08:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 38eafa69-c12d-5119-b98b-31fa0fd03db0
2026-04-27 08:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/43/65431c0bc4b772ca091575cbd037e35d/pa/KZ84979_47541d675d2e0812ff2c1ec164d29cd6.jpg not downloaded yet
2026-04-27 08:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/43/65431c0bc4b772ca091575cbd037e35d/pa/KZ84979_345683d2f3f0496df0beae4fac850711.jpg not downloaded yet
2026-04-27 08:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/43/65431c0bc4b772ca091575cbd037e35d/pa/KZ84979_7ead78ab589a616b45786f27c395c281.jpg not downloaded yet
2026-04-27 08:00:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438cde910>
2026-04-27 08:00:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38eafa69-c12d-5119-b98b-31fa0fd03db0/38eafa69-c12d-5119-b98b-31fa0fd03db0_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/f6/e9f6ce980c86e08abb6c1111b4ee567e/pa/XE44101_cff3105ebc971af45c86fb592dfb70bb.jpg saved to cache
2026-04-27 08:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 38eafa69-c12d-5119-b98b-31fa0fd03db0
2026-04-27 08:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/43/65431c0bc4b772ca091575cbd037e35d/pa/KZ84979_a8cbe5c9bf3c9bcade3775e40079fbe5.jpg not downloaded yet
2026-04-27 08:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/43/65431c0bc4b772ca091575cbd037e35d/pa/KZ84979_a5c59e6f70ab1e34179a4ee55553b69a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438df8290>
2026-04-27 08:00:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df6dfcc3-f6dd-50da-9856-13cb27edb29f/df6dfcc3-f6dd-50da-9856-13cb27edb29f_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/43/65431c0bc4b772ca091575cbd037e35d/pa/KZ84979_a5c59e6f70ab1e34179a4ee55553b69a.jpg saved to cache
2026-04-27 08:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item df6dfcc3-f6dd-50da-9856-13cb27edb29f
2026-04-27 08:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/43/65431c0bc4b772ca091575cbd037e35d/pa/KZ84979_a8cbe5c9bf3c9bcade3775e40079fbe5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b96490>
2026-04-27 08:00:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df6dfcc3-f6dd-50da-9856-13cb27edb29f/df6dfcc3-f6dd-50da-9856-13cb27edb29f_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/43/65431c0bc4b772ca091575cbd037e35d/pa/KZ84979_a8cbe5c9bf3c9bcade3775e40079fbe5.jpg saved to cache
2026-04-27 08:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item df6dfcc3-f6dd-50da-9856-13cb27edb29f
2026-04-27 08:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JJ39391/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DA56679> (referer: https://www.auto1.com/v1/car-details-view/DA56679/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/43/65431c0bc4b772ca091575cbd037e35d/pa/KZ84979_7ead78ab589a616b45786f27c395c281.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a8076b0-2a35-5ed0-b922-c719b30269d4 with identifier: DA56679
2026-04-27 08:00:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a8076b0-2a35-5ed0-b922-c719b30269d4 with scrape type 1
2026-04-27 08:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 0a8076b0-2a35-5ed0-b922-c719b30269d4
2026-04-27 08:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/93/7a93e5af9e30e970685166032b1f78d9/pa/DA56679_9b156894e731505c3fe9883d9c46c4c5.jpg not downloaded yet
2026-04-27 08:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/93/7a93e5af9e30e970685166032b1f78d9/pa/DA56679_814efedcc108eb0cc94c7078ee1f80e6.jpg not downloaded yet
2026-04-27 08:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/93/7a93e5af9e30e970685166032b1f78d9/pa/DA56679_bc3b2279362a0c86f2b081a6acd72837.jpg not downloaded yet
2026-04-27 08:00:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d7fa90>
2026-04-27 08:00:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df6dfcc3-f6dd-50da-9856-13cb27edb29f/df6dfcc3-f6dd-50da-9856-13cb27edb29f_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/43/65431c0bc4b772ca091575cbd037e35d/pa/KZ84979_7ead78ab589a616b45786f27c395c281.jpg saved to cache
2026-04-27 08:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item df6dfcc3-f6dd-50da-9856-13cb27edb29f
2026-04-27 08:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/93/7a93e5af9e30e970685166032b1f78d9/pa/DA56679_2dc90a46b2b51a739557ddcb5af21f87.jpg not downloaded yet
2026-04-27 08:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/43/65431c0bc4b772ca091575cbd037e35d/pa/KZ84979_ac6098200428a403de35365a8eced17b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/43/65431c0bc4b772ca091575cbd037e35d/pa/KZ84979_345683d2f3f0496df0beae4fac850711.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/93/7a93e5af9e30e970685166032b1f78d9/pa/DA56679_706e42d7421d59c012d7e80654e1b4e1.jpg not downloaded yet
2026-04-27 08:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/93/7a93e5af9e30e970685166032b1f78d9/pa/DA56679_f8b020d083f2dcb791ab634b0817fac0.jpg not downloaded yet
2026-04-27 08:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/43/65431c0bc4b772ca091575cbd037e35d/pa/KZ84979_47541d675d2e0812ff2c1ec164d29cd6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VL77818> (referer: https://www.auto1.com/v1/car-details-view/VL77818/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/93/7a93e5af9e30e970685166032b1f78d9/pa/DA56679_bc3b2279362a0c86f2b081a6acd72837.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438038d50>
2026-04-27 08:00:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df6dfcc3-f6dd-50da-9856-13cb27edb29f/df6dfcc3-f6dd-50da-9856-13cb27edb29f_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/43/65431c0bc4b772ca091575cbd037e35d/pa/KZ84979_ac6098200428a403de35365a8eced17b.jpg saved to cache
2026-04-27 08:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item df6dfcc3-f6dd-50da-9856-13cb27edb29f
2026-04-27 08:00:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bf7b1d0>
2026-04-27 08:00:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df6dfcc3-f6dd-50da-9856-13cb27edb29f/df6dfcc3-f6dd-50da-9856-13cb27edb29f_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/43/65431c0bc4b772ca091575cbd037e35d/pa/KZ84979_345683d2f3f0496df0beae4fac850711.jpg saved to cache
2026-04-27 08:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item df6dfcc3-f6dd-50da-9856-13cb27edb29f
2026-04-27 08:00:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438cf9b10>
2026-04-27 08:00:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df6dfcc3-f6dd-50da-9856-13cb27edb29f/df6dfcc3-f6dd-50da-9856-13cb27edb29f_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/43/65431c0bc4b772ca091575cbd037e35d/pa/KZ84979_47541d675d2e0812ff2c1ec164d29cd6.jpg saved to cache
2026-04-27 08:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item df6dfcc3-f6dd-50da-9856-13cb27edb29f
2026-04-27 08:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/93/7a93e5af9e30e970685166032b1f78d9/pa/DA56679_814efedcc108eb0cc94c7078ee1f80e6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/93/7a93e5af9e30e970685166032b1f78d9/pa/DA56679_2dc90a46b2b51a739557ddcb5af21f87.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/93/7a93e5af9e30e970685166032b1f78d9/pa/DA56679_f8b020d083f2dcb791ab634b0817fac0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd0691ab-ae65-59bb-b636-1bc1f04b0c01 with identifier: VL77818
2026-04-27 08:00:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd0691ab-ae65-59bb-b636-1bc1f04b0c01 with scrape type 1
2026-04-27 08:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fd0691ab-ae65-59bb-b636-1bc1f04b0c01
2026-04-27 08:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/f4/46f40c0518b3e214d47cf08e3b4a37b0/pa/VL77818_ba98cba56b831a4c0252af0f1b6acf6d.jpg not downloaded yet
2026-04-27 08:00:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438077610>
2026-04-27 08:00:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a8076b0-2a35-5ed0-b922-c719b30269d4/0a8076b0-2a35-5ed0-b922-c719b30269d4_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/93/7a93e5af9e30e970685166032b1f78d9/pa/DA56679_bc3b2279362a0c86f2b081a6acd72837.jpg saved to cache
2026-04-27 08:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0a8076b0-2a35-5ed0-b922-c719b30269d4
2026-04-27 08:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/f4/46f40c0518b3e214d47cf08e3b4a37b0/pa/VL77818_5fdb8731d0cddddc3ed5a4d0c4fbdb99.jpg not downloaded yet
2026-04-27 08:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/93/7a93e5af9e30e970685166032b1f78d9/pa/DA56679_9b156894e731505c3fe9883d9c46c4c5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/f4/46f40c0518b3e214d47cf08e3b4a37b0/pa/VL77818_302cbd9609d626d4febb5b3223460311.jpg not downloaded yet
2026-04-27 08:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/f4/46f40c0518b3e214d47cf08e3b4a37b0/pa/VL77818_18089039db435466861d4872a359fe5c.jpg not downloaded yet
2026-04-27 08:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/f4/46f40c0518b3e214d47cf08e3b4a37b0/pa/VL77818_edeba77402667b9ed2baf5702830b52f.jpg not downloaded yet
2026-04-27 08:00:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438e05810>
2026-04-27 08:00:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a8076b0-2a35-5ed0-b922-c719b30269d4/0a8076b0-2a35-5ed0-b922-c719b30269d4_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/93/7a93e5af9e30e970685166032b1f78d9/pa/DA56679_814efedcc108eb0cc94c7078ee1f80e6.jpg saved to cache
2026-04-27 08:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0a8076b0-2a35-5ed0-b922-c719b30269d4
2026-04-27 08:00:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438209ed0>
2026-04-27 08:00:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a8076b0-2a35-5ed0-b922-c719b30269d4/0a8076b0-2a35-5ed0-b922-c719b30269d4_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/93/7a93e5af9e30e970685166032b1f78d9/pa/DA56679_2dc90a46b2b51a739557ddcb5af21f87.jpg saved to cache
2026-04-27 08:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0a8076b0-2a35-5ed0-b922-c719b30269d4
2026-04-27 08:00:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143805d050>
2026-04-27 08:00:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a8076b0-2a35-5ed0-b922-c719b30269d4/0a8076b0-2a35-5ed0-b922-c719b30269d4_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/93/7a93e5af9e30e970685166032b1f78d9/pa/DA56679_f8b020d083f2dcb791ab634b0817fac0.jpg saved to cache
2026-04-27 08:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0a8076b0-2a35-5ed0-b922-c719b30269d4
2026-04-27 08:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/93/7a93e5af9e30e970685166032b1f78d9/pa/DA56679_706e42d7421d59c012d7e80654e1b4e1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/f4/46f40c0518b3e214d47cf08e3b4a37b0/pa/VL77818_849c501661d19b35dcc091b74ad9251e.jpg not downloaded yet
2026-04-27 08:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/f4/46f40c0518b3e214d47cf08e3b4a37b0/pa/VL77818_ba98cba56b831a4c0252af0f1b6acf6d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/f4/46f40c0518b3e214d47cf08e3b4a37b0/pa/VL77818_f21875a4525804229a47b253068aa7b7.jpg not downloaded yet
2026-04-27 08:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/f4/46f40c0518b3e214d47cf08e3b4a37b0/pa/VL77818_50822ff81317596fefa4ac462c305f95.jpg not downloaded yet
2026-04-27 08:00:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438e01ed0>
2026-04-27 08:00:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a8076b0-2a35-5ed0-b922-c719b30269d4/0a8076b0-2a35-5ed0-b922-c719b30269d4_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/93/7a93e5af9e30e970685166032b1f78d9/pa/DA56679_9b156894e731505c3fe9883d9c46c4c5.jpg saved to cache
2026-04-27 08:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0a8076b0-2a35-5ed0-b922-c719b30269d4
2026-04-27 08:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/f4/46f40c0518b3e214d47cf08e3b4a37b0/pa/VL77818_18089039db435466861d4872a359fe5c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/f4/46f40c0518b3e214d47cf08e3b4a37b0/pa/VL77818_edeba77402667b9ed2baf5702830b52f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/f4/46f40c0518b3e214d47cf08e3b4a37b0/pa/VL77818_d3832e4de2b125aa4c9de0296c790628.jpg not downloaded yet
2026-04-27 08:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/43/65431c0bc4b772ca091575cbd037e35d/pa/KZ84979_1e87b19f5992955b6c6a220f77b235f4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/f4/46f40c0518b3e214d47cf08e3b4a37b0/pa/VL77818_c8538bf1d7fbadae31e969d802a82b64.jpg not downloaded yet
2026-04-27 08:00:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bfd65d0>
2026-04-27 08:00:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a8076b0-2a35-5ed0-b922-c719b30269d4/0a8076b0-2a35-5ed0-b922-c719b30269d4_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/93/7a93e5af9e30e970685166032b1f78d9/pa/DA56679_706e42d7421d59c012d7e80654e1b4e1.jpg saved to cache
2026-04-27 08:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0a8076b0-2a35-5ed0-b922-c719b30269d4
2026-04-27 08:00:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0a8076b0-2a35-5ed0-b922-c719b30269d4, skipping ID generation
2026-04-27 08:00:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a8076b0-2a35-5ed0-b922-c719b30269d4 with scrape type 1
2026-04-27 08:00:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0a8076b0-2a35-5ed0-b922-c719b30269d4 sending to next pipeline
2026-04-27 08:00:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0a8076b0-2a35-5ed0-b922-c719b30269d4, identifier: DA56679
2026-04-27 08:00:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0a8076b0-2a35-5ed0-b922-c719b30269d4 with identifier: DA56679
2026-04-27 08:00:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0a8076b0-2a35-5ed0-b922-c719b30269d4 with identifier: DA56679
2026-04-27 08:00:36 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 0a8076b0-2a35-5ed0-b922-c719b30269d4 with identifier: DA56679 to the API
2026-04-27 08:00:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:36 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img7a/93/7a93e5af9e30e970685166032b1f78d9/pa/DA56679_706e42d7421d59c012d7e80654e1b4e1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'city': 'Loyettes',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 85,
 'expiration_date': '2026-04-28T15:43:57Z',
 'fuel_type': 'petrol',
 'id': '0a8076b0-2a35-5ed0-b922-c719b30269d4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 45.7766,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DA56679',
 'listing': 'auction',
 'location': 'FR, Loyettes',
 'location_confidence': 'geocoded',
 'longitude': 5.2069,
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 157056,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0a8076b0-2a35-5ed0-b922-c719b30269d4/0a8076b0-2a35-5ed0-b922-c719b30269d4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81345,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/93/7a93e5af9e30e970685166032b1f78d9/pa/DA56679_9b156894e731505c3fe9883d9c46c4c5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0a8076b0-2a35-5ed0-b922-c719b30269d4/0a8076b0-2a35-5ed0-b922-c719b30269d4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73523,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/93/7a93e5af9e30e970685166032b1f78d9/pa/DA56679_814efedcc108eb0cc94c7078ee1f80e6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0a8076b0-2a35-5ed0-b922-c719b30269d4/0a8076b0-2a35-5ed0-b922-c719b30269d4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70446,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/93/7a93e5af9e30e970685166032b1f78d9/pa/DA56679_bc3b2279362a0c86f2b081a6acd72837.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0a8076b0-2a35-5ed0-b922-c719b30269d4/0a8076b0-2a35-5ed0-b922-c719b30269d4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55893,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/93/7a93e5af9e30e970685166032b1f78d9/pa/DA56679_2dc90a46b2b51a739557ddcb5af21f87.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0a8076b0-2a35-5ed0-b922-c719b30269d4/0a8076b0-2a35-5ed0-b922-c719b30269d4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77905,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/93/7a93e5af9e30e970685166032b1f78d9/pa/DA56679_706e42d7421d59c012d7e80654e1b4e1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0a8076b0-2a35-5ed0-b922-c719b30269d4/0a8076b0-2a35-5ed0-b922-c719b30269d4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42421,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/93/7a93e5af9e30e970685166032b1f78d9/pa/DA56679_f8b020d083f2dcb791ab634b0817fac0.jpg',
             'Width': 800}],
 'postal_code': '01360',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Ain',
 'province_code': 'FR-01',
 'region': 'Auvergne-Rhône-Alpes',
 'region_code': 'FR-84',
 'registration_date': '2012-03-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Corsa 1.2 150 ème Anniversaire',
 'transmission': 'manual',
 'trim': '150 ème Anniversaire',
 'year': 2012}
2026-04-27 08:00:36 [auto1.fr] INFO: Saving data for DA56679: {'created_time': 1777276836.715198, 'last_price_update_time': 1777276836.71521, 'has_photos': True, 'auction_closing_time': 1777391037.0}
2026-04-27 08:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/f4/46f40c0518b3e214d47cf08e3b4a37b0/pa/VL77818_f21875a4525804229a47b253068aa7b7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143819bcd0>
2026-04-27 08:00:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd0691ab-ae65-59bb-b636-1bc1f04b0c01/fd0691ab-ae65-59bb-b636-1bc1f04b0c01_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/f4/46f40c0518b3e214d47cf08e3b4a37b0/pa/VL77818_ba98cba56b831a4c0252af0f1b6acf6d.jpg saved to cache
2026-04-27 08:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fd0691ab-ae65-59bb-b636-1bc1f04b0c01
2026-04-27 08:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/f4/46f40c0518b3e214d47cf08e3b4a37b0/pa/VL77818_50822ff81317596fefa4ac462c305f95.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/f4/46f40c0518b3e214d47cf08e3b4a37b0/pa/VL77818_d3832e4de2b125aa4c9de0296c790628.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438bfd650>
2026-04-27 08:00:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd0691ab-ae65-59bb-b636-1bc1f04b0c01/fd0691ab-ae65-59bb-b636-1bc1f04b0c01_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/f4/46f40c0518b3e214d47cf08e3b4a37b0/pa/VL77818_18089039db435466861d4872a359fe5c.jpg saved to cache
2026-04-27 08:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fd0691ab-ae65-59bb-b636-1bc1f04b0c01
2026-04-27 08:00:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d35a90>
2026-04-27 08:00:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd0691ab-ae65-59bb-b636-1bc1f04b0c01/fd0691ab-ae65-59bb-b636-1bc1f04b0c01_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/f4/46f40c0518b3e214d47cf08e3b4a37b0/pa/VL77818_edeba77402667b9ed2baf5702830b52f.jpg saved to cache
2026-04-27 08:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fd0691ab-ae65-59bb-b636-1bc1f04b0c01
2026-04-27 08:00:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14381989d0>
2026-04-27 08:00:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df6dfcc3-f6dd-50da-9856-13cb27edb29f/df6dfcc3-f6dd-50da-9856-13cb27edb29f_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/43/65431c0bc4b772ca091575cbd037e35d/pa/KZ84979_1e87b19f5992955b6c6a220f77b235f4.jpg saved to cache
2026-04-27 08:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item df6dfcc3-f6dd-50da-9856-13cb27edb29f
2026-04-27 08:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/f4/46f40c0518b3e214d47cf08e3b4a37b0/pa/VL77818_c8538bf1d7fbadae31e969d802a82b64.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438cdebd0>
2026-04-27 08:00:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd0691ab-ae65-59bb-b636-1bc1f04b0c01/fd0691ab-ae65-59bb-b636-1bc1f04b0c01_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/f4/46f40c0518b3e214d47cf08e3b4a37b0/pa/VL77818_f21875a4525804229a47b253068aa7b7.jpg saved to cache
2026-04-27 08:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fd0691ab-ae65-59bb-b636-1bc1f04b0c01
2026-04-27 08:00:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438eab850>
2026-04-27 08:00:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd0691ab-ae65-59bb-b636-1bc1f04b0c01/fd0691ab-ae65-59bb-b636-1bc1f04b0c01_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/f4/46f40c0518b3e214d47cf08e3b4a37b0/pa/VL77818_50822ff81317596fefa4ac462c305f95.jpg saved to cache
2026-04-27 08:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fd0691ab-ae65-59bb-b636-1bc1f04b0c01
2026-04-27 08:00:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143812d710>
2026-04-27 08:00:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd0691ab-ae65-59bb-b636-1bc1f04b0c01/fd0691ab-ae65-59bb-b636-1bc1f04b0c01_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/f4/46f40c0518b3e214d47cf08e3b4a37b0/pa/VL77818_d3832e4de2b125aa4c9de0296c790628.jpg saved to cache
2026-04-27 08:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fd0691ab-ae65-59bb-b636-1bc1f04b0c01
2026-04-27 08:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/f4/46f40c0518b3e214d47cf08e3b4a37b0/pa/VL77818_849c501661d19b35dcc091b74ad9251e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/f4/46f40c0518b3e214d47cf08e3b4a37b0/pa/VL77818_302cbd9609d626d4febb5b3223460311.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14381aea10>
2026-04-27 08:00:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd0691ab-ae65-59bb-b636-1bc1f04b0c01/fd0691ab-ae65-59bb-b636-1bc1f04b0c01_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/f4/46f40c0518b3e214d47cf08e3b4a37b0/pa/VL77818_c8538bf1d7fbadae31e969d802a82b64.jpg saved to cache
2026-04-27 08:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fd0691ab-ae65-59bb-b636-1bc1f04b0c01
2026-04-27 08:00:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c6c090>
2026-04-27 08:00:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd0691ab-ae65-59bb-b636-1bc1f04b0c01/fd0691ab-ae65-59bb-b636-1bc1f04b0c01_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/f4/46f40c0518b3e214d47cf08e3b4a37b0/pa/VL77818_849c501661d19b35dcc091b74ad9251e.jpg saved to cache
2026-04-27 08:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fd0691ab-ae65-59bb-b636-1bc1f04b0c01
2026-04-27 08:00:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ff01d0>
2026-04-27 08:00:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd0691ab-ae65-59bb-b636-1bc1f04b0c01/fd0691ab-ae65-59bb-b636-1bc1f04b0c01_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/f4/46f40c0518b3e214d47cf08e3b4a37b0/pa/VL77818_302cbd9609d626d4febb5b3223460311.jpg saved to cache
2026-04-27 08:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fd0691ab-ae65-59bb-b636-1bc1f04b0c01
2026-04-27 08:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/f4/46f40c0518b3e214d47cf08e3b4a37b0/pa/VL77818_5fdb8731d0cddddc3ed5a4d0c4fbdb99.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/43/65431c0bc4b772ca091575cbd037e35d/pa/KZ84979_5f699224761456c48c5eb3d42bdbc349.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/43/65431c0bc4b772ca091575cbd037e35d/pa/KZ84979_6c5b826aad6b345308831bf5b13ce887.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438cfa310>
2026-04-27 08:00:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd0691ab-ae65-59bb-b636-1bc1f04b0c01/fd0691ab-ae65-59bb-b636-1bc1f04b0c01_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/f4/46f40c0518b3e214d47cf08e3b4a37b0/pa/VL77818_5fdb8731d0cddddc3ed5a4d0c4fbdb99.jpg saved to cache
2026-04-27 08:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fd0691ab-ae65-59bb-b636-1bc1f04b0c01
2026-04-27 08:00:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fd0691ab-ae65-59bb-b636-1bc1f04b0c01, skipping ID generation
2026-04-27 08:00:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd0691ab-ae65-59bb-b636-1bc1f04b0c01 with scrape type 1
2026-04-27 08:00:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fd0691ab-ae65-59bb-b636-1bc1f04b0c01 sending to next pipeline
2026-04-27 08:00:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: fd0691ab-ae65-59bb-b636-1bc1f04b0c01, identifier: VL77818
2026-04-27 08:00:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: fd0691ab-ae65-59bb-b636-1bc1f04b0c01 with identifier: VL77818
2026-04-27 08:00:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: fd0691ab-ae65-59bb-b636-1bc1f04b0c01 with identifier: VL77818
2026-04-27 08:00:37 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: fd0691ab-ae65-59bb-b636-1bc1f04b0c01 with identifier: VL77818 to the API
2026-04-27 08:00:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:37 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img46/f4/46f40c0518b3e214d47cf08e3b4a37b0/pa/VL77818_5fdb8731d0cddddc3ed5a4d0c4fbdb99.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 158,
 'category': None,
 'city': 'Allennes-les-Marais',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 258,
 'expiration_date': '2026-04-28T15:24:15Z',
 'fuel_type': 'diesel',
 'id': 'fd0691ab-ae65-59bb-b636-1bc1f04b0c01',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 50.5375,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VL77818',
 'listing': 'auction',
 'location': 'FR, Allennes-les-Marais',
 'location_confidence': 'geocoded',
 'longitude': 2.9536,
 'make': 'BMW',
 'model': 'X5',
 'odometer': 291091,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fd0691ab-ae65-59bb-b636-1bc1f04b0c01/fd0691ab-ae65-59bb-b636-1bc1f04b0c01_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69359,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/f4/46f40c0518b3e214d47cf08e3b4a37b0/pa/VL77818_ba98cba56b831a4c0252af0f1b6acf6d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fd0691ab-ae65-59bb-b636-1bc1f04b0c01/fd0691ab-ae65-59bb-b636-1bc1f04b0c01_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65923,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/f4/46f40c0518b3e214d47cf08e3b4a37b0/pa/VL77818_5fdb8731d0cddddc3ed5a4d0c4fbdb99.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fd0691ab-ae65-59bb-b636-1bc1f04b0c01/fd0691ab-ae65-59bb-b636-1bc1f04b0c01_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66812,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/f4/46f40c0518b3e214d47cf08e3b4a37b0/pa/VL77818_302cbd9609d626d4febb5b3223460311.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fd0691ab-ae65-59bb-b636-1bc1f04b0c01/fd0691ab-ae65-59bb-b636-1bc1f04b0c01_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58022,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/f4/46f40c0518b3e214d47cf08e3b4a37b0/pa/VL77818_18089039db435466861d4872a359fe5c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fd0691ab-ae65-59bb-b636-1bc1f04b0c01/fd0691ab-ae65-59bb-b636-1bc1f04b0c01_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55379,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/f4/46f40c0518b3e214d47cf08e3b4a37b0/pa/VL77818_edeba77402667b9ed2baf5702830b52f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fd0691ab-ae65-59bb-b636-1bc1f04b0c01/fd0691ab-ae65-59bb-b636-1bc1f04b0c01_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73292,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/f4/46f40c0518b3e214d47cf08e3b4a37b0/pa/VL77818_849c501661d19b35dcc091b74ad9251e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fd0691ab-ae65-59bb-b636-1bc1f04b0c01/fd0691ab-ae65-59bb-b636-1bc1f04b0c01_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64652,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/f4/46f40c0518b3e214d47cf08e3b4a37b0/pa/VL77818_f21875a4525804229a47b253068aa7b7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fd0691ab-ae65-59bb-b636-1bc1f04b0c01/fd0691ab-ae65-59bb-b636-1bc1f04b0c01_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73931,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/f4/46f40c0518b3e214d47cf08e3b4a37b0/pa/VL77818_50822ff81317596fefa4ac462c305f95.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fd0691ab-ae65-59bb-b636-1bc1f04b0c01/fd0691ab-ae65-59bb-b636-1bc1f04b0c01_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72729,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/f4/46f40c0518b3e214d47cf08e3b4a37b0/pa/VL77818_d3832e4de2b125aa4c9de0296c790628.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fd0691ab-ae65-59bb-b636-1bc1f04b0c01/fd0691ab-ae65-59bb-b636-1bc1f04b0c01_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76055,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/f4/46f40c0518b3e214d47cf08e3b4a37b0/pa/VL77818_c8538bf1d7fbadae31e969d802a82b64.jpg',
             'Width': 800}],
 'postal_code': '59251',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Nord',
 'province_code': 'FR-59',
 'region': 'Hauts-de-France',
 'region_code': 'FR-32',
 'registration_date': '2017-04-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X5 xDrive 30d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2017}
2026-04-27 08:00:37 [auto1.fr] INFO: Saving data for VL77818: {'created_time': 1777276837.944677, 'last_price_update_time': 1777276837.944689, 'has_photos': True, 'auction_closing_time': 1777389855.0}
2026-04-27 08:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/43/65431c0bc4b772ca091575cbd037e35d/pa/KZ84979_1013fccf88821f6d51e1051452fa98bc.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/f6/e9f6ce980c86e08abb6c1111b4ee567e/pa/XE44101_f6c53cfcc6ba49d7249d89efa803c2f2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/f6/e9f6ce980c86e08abb6c1111b4ee567e/pa/XE44101_bde80866b8356c8abf7e9addd25102b5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b94d90>
2026-04-27 08:00:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df6dfcc3-f6dd-50da-9856-13cb27edb29f/df6dfcc3-f6dd-50da-9856-13cb27edb29f_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/43/65431c0bc4b772ca091575cbd037e35d/pa/KZ84979_5f699224761456c48c5eb3d42bdbc349.jpg saved to cache
2026-04-27 08:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item df6dfcc3-f6dd-50da-9856-13cb27edb29f
2026-04-27 08:00:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380853d0>
2026-04-27 08:00:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df6dfcc3-f6dd-50da-9856-13cb27edb29f/df6dfcc3-f6dd-50da-9856-13cb27edb29f_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/43/65431c0bc4b772ca091575cbd037e35d/pa/KZ84979_6c5b826aad6b345308831bf5b13ce887.jpg saved to cache
2026-04-27 08:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item df6dfcc3-f6dd-50da-9856-13cb27edb29f
2026-04-27 08:00:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143803ae10>
2026-04-27 08:00:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df6dfcc3-f6dd-50da-9856-13cb27edb29f/df6dfcc3-f6dd-50da-9856-13cb27edb29f_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/43/65431c0bc4b772ca091575cbd037e35d/pa/KZ84979_1013fccf88821f6d51e1051452fa98bc.jpg saved to cache
2026-04-27 08:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item df6dfcc3-f6dd-50da-9856-13cb27edb29f
2026-04-27 08:00:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: df6dfcc3-f6dd-50da-9856-13cb27edb29f, skipping ID generation
2026-04-27 08:00:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df6dfcc3-f6dd-50da-9856-13cb27edb29f with scrape type 1
2026-04-27 08:00:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item df6dfcc3-f6dd-50da-9856-13cb27edb29f sending to next pipeline
2026-04-27 08:00:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: df6dfcc3-f6dd-50da-9856-13cb27edb29f, identifier: KZ84979
2026-04-27 08:00:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: df6dfcc3-f6dd-50da-9856-13cb27edb29f with identifier: KZ84979
2026-04-27 08:00:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: df6dfcc3-f6dd-50da-9856-13cb27edb29f with identifier: KZ84979
2026-04-27 08:00:38 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: df6dfcc3-f6dd-50da-9856-13cb27edb29f with identifier: KZ84979 to the API
2026-04-27 08:00:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:38 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img65/43/65431c0bc4b772ca091575cbd037e35d/pa/KZ84979_1013fccf88821f6d51e1051452fa98bc.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'category': None,
 'city': 'Marseille',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 116,
 'expiration_date': '2026-04-28T15:05:21Z',
 'fuel_type': 'diesel',
 'id': 'df6dfcc3-f6dd-50da-9856-13cb27edb29f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 43.2969,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KZ84979',
 'listing': 'auction',
 'location': 'FR, Marseille',
 'location_confidence': 'geocoded',
 'longitude': 5.3811,
 'make': 'Kia',
 'model': 'Stonic',
 'odometer': 159802,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_df6dfcc3-f6dd-50da-9856-13cb27edb29f/df6dfcc3-f6dd-50da-9856-13cb27edb29f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 161477,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/43/65431c0bc4b772ca091575cbd037e35d/pa/KZ84979_6c5b826aad6b345308831bf5b13ce887.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_df6dfcc3-f6dd-50da-9856-13cb27edb29f/df6dfcc3-f6dd-50da-9856-13cb27edb29f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 169277,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/43/65431c0bc4b772ca091575cbd037e35d/pa/KZ84979_1013fccf88821f6d51e1051452fa98bc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_df6dfcc3-f6dd-50da-9856-13cb27edb29f/df6dfcc3-f6dd-50da-9856-13cb27edb29f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 154654,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/43/65431c0bc4b772ca091575cbd037e35d/pa/KZ84979_a5c59e6f70ab1e34179a4ee55553b69a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_df6dfcc3-f6dd-50da-9856-13cb27edb29f/df6dfcc3-f6dd-50da-9856-13cb27edb29f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52466,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/43/65431c0bc4b772ca091575cbd037e35d/pa/KZ84979_5f699224761456c48c5eb3d42bdbc349.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_df6dfcc3-f6dd-50da-9856-13cb27edb29f/df6dfcc3-f6dd-50da-9856-13cb27edb29f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61282,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/43/65431c0bc4b772ca091575cbd037e35d/pa/KZ84979_1e87b19f5992955b6c6a220f77b235f4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_df6dfcc3-f6dd-50da-9856-13cb27edb29f/df6dfcc3-f6dd-50da-9856-13cb27edb29f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56189,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/43/65431c0bc4b772ca091575cbd037e35d/pa/KZ84979_ac6098200428a403de35365a8eced17b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_df6dfcc3-f6dd-50da-9856-13cb27edb29f/df6dfcc3-f6dd-50da-9856-13cb27edb29f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 137762,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/43/65431c0bc4b772ca091575cbd037e35d/pa/KZ84979_47541d675d2e0812ff2c1ec164d29cd6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_df6dfcc3-f6dd-50da-9856-13cb27edb29f/df6dfcc3-f6dd-50da-9856-13cb27edb29f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107679,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/43/65431c0bc4b772ca091575cbd037e35d/pa/KZ84979_345683d2f3f0496df0beae4fac850711.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_df6dfcc3-f6dd-50da-9856-13cb27edb29f/df6dfcc3-f6dd-50da-9856-13cb27edb29f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85936,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/43/65431c0bc4b772ca091575cbd037e35d/pa/KZ84979_7ead78ab589a616b45786f27c395c281.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_df6dfcc3-f6dd-50da-9856-13cb27edb29f/df6dfcc3-f6dd-50da-9856-13cb27edb29f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82410,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/43/65431c0bc4b772ca091575cbd037e35d/pa/KZ84979_a8cbe5c9bf3c9bcade3775e40079fbe5.jpg',
             'Width': 800}],
 'postal_code': '13000',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Bouches-du-Rhône',
 'province_code': 'FR-13',
 'region': "Provence-Alpes-Côte d'Azur",
 'region_code': 'FR-93',
 'registration_date': '2020-06-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Stonic 1.6 CRDi Premium',
 'transmission': 'manual',
 'trim': 'Premium',
 'year': 2020}
2026-04-27 08:00:38 [auto1.fr] INFO: Saving data for KZ84979: {'created_time': 1777276838.658599, 'last_price_update_time': 1777276838.658617, 'has_photos': True, 'auction_closing_time': 1777388721.0}
2026-04-27 08:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/f6/e9f6ce980c86e08abb6c1111b4ee567e/pa/XE44101_34c79c75930182bc957fe90be600a339.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/b5/17b562e7c0b33622083635bf09fcf20a/pa/EF42157_fb73c334a4383f23a3e22cb88f5478d3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/f6/e9f6ce980c86e08abb6c1111b4ee567e/pa/XE44101_6b16ed216ca4aa0306a944969f4ac351.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NN12776> (referer: https://www.auto1.com/v1/car-details-view/NN12776/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143803a250>
2026-04-27 08:00:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38eafa69-c12d-5119-b98b-31fa0fd03db0/38eafa69-c12d-5119-b98b-31fa0fd03db0_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/f6/e9f6ce980c86e08abb6c1111b4ee567e/pa/XE44101_f6c53cfcc6ba49d7249d89efa803c2f2.jpg saved to cache
2026-04-27 08:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 38eafa69-c12d-5119-b98b-31fa0fd03db0
2026-04-27 08:00:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d7f110>
2026-04-27 08:00:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38eafa69-c12d-5119-b98b-31fa0fd03db0/38eafa69-c12d-5119-b98b-31fa0fd03db0_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/f6/e9f6ce980c86e08abb6c1111b4ee567e/pa/XE44101_bde80866b8356c8abf7e9addd25102b5.jpg saved to cache
2026-04-27 08:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 38eafa69-c12d-5119-b98b-31fa0fd03db0
2026-04-27 08:00:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143809b6d0>
2026-04-27 08:00:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38eafa69-c12d-5119-b98b-31fa0fd03db0/38eafa69-c12d-5119-b98b-31fa0fd03db0_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/f6/e9f6ce980c86e08abb6c1111b4ee567e/pa/XE44101_34c79c75930182bc957fe90be600a339.jpg saved to cache
2026-04-27 08:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 38eafa69-c12d-5119-b98b-31fa0fd03db0
2026-04-27 08:00:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143819ab50>
2026-04-27 08:00:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9b4d35d-ce92-581e-9a30-d49a0f2949fb/e9b4d35d-ce92-581e-9a30-d49a0f2949fb_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/b5/17b562e7c0b33622083635bf09fcf20a/pa/EF42157_fb73c334a4383f23a3e22cb88f5478d3.jpg saved to cache
2026-04-27 08:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e9b4d35d-ce92-581e-9a30-d49a0f2949fb
2026-04-27 08:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/f6/e9f6ce980c86e08abb6c1111b4ee567e/pa/XE44101_6501dc17187a6240709b0428f5f3f766.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438cb5c10>
2026-04-27 08:00:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38eafa69-c12d-5119-b98b-31fa0fd03db0/38eafa69-c12d-5119-b98b-31fa0fd03db0_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/f6/e9f6ce980c86e08abb6c1111b4ee567e/pa/XE44101_6b16ed216ca4aa0306a944969f4ac351.jpg saved to cache
2026-04-27 08:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 38eafa69-c12d-5119-b98b-31fa0fd03db0
2026-04-27 08:00:38 [auto1.fr] INFO: Channel: 24h | Page: 11 | totalHits: 4744 | hits on page: 40
2026-04-27 08:00:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36780e94-7bd1-5041-b5d9-49dd98b9b9b2 with identifier: NN12776
2026-04-27 08:00:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36780e94-7bd1-5041-b5d9-49dd98b9b9b2 with scrape type 1
2026-04-27 08:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 36780e94-7bd1-5041-b5d9-49dd98b9b9b2
2026-04-27 08:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/c8/a7c8da4cc70c94002f3e216660c1247f/pa/NN12776_af3ca421e05277201b82a0be74f5497f.jpg not downloaded yet
2026-04-27 08:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/f6/e9f6ce980c86e08abb6c1111b4ee567e/pa/XE44101_be308257905f507c2bcbe8dba512e379.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/b5/17b562e7c0b33622083635bf09fcf20a/pa/EF42157_ec6ce6fe5093a45fa09bab1463be2987.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:38 [auto1.fr] INFO: Found listing with ID: ZB78862
2026-04-27 08:00:38 [auto1.fr] INFO: Scrape type for ZB78862: 0
2026-04-27 08:00:38 [auto1.fr] INFO: Found listing with ID: KL75694
2026-04-27 08:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/c8/a7c8da4cc70c94002f3e216660c1247f/pa/NN12776_da5f09ebf6ac9e865d8b8f978fbbc8cc.jpg not downloaded yet
2026-04-27 08:00:38 [auto1.fr] INFO: Found listing with ID: ZS24433
2026-04-27 08:00:39 [auto1.fr] INFO: Scrape type for ZS24433: 0
2026-04-27 08:00:39 [auto1.fr] INFO: Found listing with ID: DP12800
2026-04-27 08:00:39 [auto1.fr] INFO: Scrape type for DP12800: 0
2026-04-27 08:00:39 [auto1.fr] INFO: Found listing with ID: KF38228
2026-04-27 08:00:39 [auto1.fr] INFO: Scrape type for KF38228: 0
2026-04-27 08:00:39 [auto1.fr] INFO: Found listing with ID: KW37033
2026-04-27 08:00:39 [auto1.fr] INFO: Scrape type for KW37033: 1
2026-04-27 08:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/c8/a7c8da4cc70c94002f3e216660c1247f/pa/NN12776_53d08cf4bd8d561e00d30ff65bbc06ee.jpg not downloaded yet
2026-04-27 08:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/b5/17b562e7c0b33622083635bf09fcf20a/pa/EF42157_91c237e473282b8c654377a71400100b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:39 [auto1.fr] INFO: Found listing with ID: MB19012
2026-04-27 08:00:39 [auto1.fr] INFO: Scrape type for MB19012: 1
2026-04-27 08:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/c8/a7c8da4cc70c94002f3e216660c1247f/pa/NN12776_61223cd3845ad45ac677c40e636a648a.jpg not downloaded yet
2026-04-27 08:00:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142be0a690>
2026-04-27 08:00:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38eafa69-c12d-5119-b98b-31fa0fd03db0/38eafa69-c12d-5119-b98b-31fa0fd03db0_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/f6/e9f6ce980c86e08abb6c1111b4ee567e/pa/XE44101_6501dc17187a6240709b0428f5f3f766.jpg saved to cache
2026-04-27 08:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 38eafa69-c12d-5119-b98b-31fa0fd03db0
2026-04-27 08:00:39 [auto1.fr] INFO: Found listing with ID: WR79626
2026-04-27 08:00:39 [auto1.fr] INFO: Scrape type for WR79626: 2
2026-04-27 08:00:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1da28a83-09dd-52fa-a0f1-c439173c203b with identifier: WR79626
2026-04-27 08:00:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1da28a83-09dd-52fa-a0f1-c439173c203b with scrape type 2
2026-04-27 08:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1da28a83-09dd-52fa-a0f1-c439173c203b with scrape type 2
2026-04-27 08:00:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 1da28a83-09dd-52fa-a0f1-c439173c203b, identifier: WR79626
2026-04-27 08:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/c8/a7c8da4cc70c94002f3e216660c1247f/pa/NN12776_600470ca6b2ecc9fda504bd6ce6b2f54.jpg not downloaded yet
2026-04-27 08:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/b5/17b562e7c0b33622083635bf09fcf20a/pa/EF42157_b63582f439bad237ceebcf562a7d84b5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 1da28a83-09dd-52fa-a0f1-c439173c203b with identifier: WR79626
2026-04-27 08:00:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 1da28a83-09dd-52fa-a0f1-c439173c203b with identifier: WR79626
2026-04-27 08:00:39 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 1da28a83-09dd-52fa-a0f1-c439173c203b with identifier: WR79626 to the API
2026-04-27 08:00:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:39 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-04-28T15:37:21Z',
 'fuel_type': 'diesel',
 'id': '1da28a83-09dd-52fa-a0f1-c439173c203b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WR79626',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 70251,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2018-10-30',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-04-27 08:00:39 [auto1.fr] INFO: Saving data for WR79626: {'auction_closing_time': 1777390641.0, 'created_time': 1777022678.468483, 'has_photos': True, 'last_price_update_time': 1777276839.615746}
2026-04-27 08:00:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438e03790>
2026-04-27 08:00:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38eafa69-c12d-5119-b98b-31fa0fd03db0/38eafa69-c12d-5119-b98b-31fa0fd03db0_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/f6/e9f6ce980c86e08abb6c1111b4ee567e/pa/XE44101_be308257905f507c2bcbe8dba512e379.jpg saved to cache
2026-04-27 08:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 38eafa69-c12d-5119-b98b-31fa0fd03db0
2026-04-27 08:00:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bfd24d0>
2026-04-27 08:00:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9b4d35d-ce92-581e-9a30-d49a0f2949fb/e9b4d35d-ce92-581e-9a30-d49a0f2949fb_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/b5/17b562e7c0b33622083635bf09fcf20a/pa/EF42157_ec6ce6fe5093a45fa09bab1463be2987.jpg saved to cache
2026-04-27 08:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e9b4d35d-ce92-581e-9a30-d49a0f2949fb
2026-04-27 08:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/c8/a7c8da4cc70c94002f3e216660c1247f/pa/NN12776_af3ca421e05277201b82a0be74f5497f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:39 [auto1.fr] INFO: Found listing with ID: AP60631
2026-04-27 08:00:39 [auto1.fr] INFO: Scrape type for AP60631: 2
2026-04-27 08:00:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f079d1a-c9bf-58c9-af94-46435c7b88fa with identifier: AP60631
2026-04-27 08:00:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f079d1a-c9bf-58c9-af94-46435c7b88fa with scrape type 2
2026-04-27 08:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1f079d1a-c9bf-58c9-af94-46435c7b88fa with scrape type 2
2026-04-27 08:00:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 1f079d1a-c9bf-58c9-af94-46435c7b88fa, identifier: AP60631
2026-04-27 08:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/c8/a7c8da4cc70c94002f3e216660c1247f/pa/NN12776_75d17c97037b6fd972351b50a638b6f8.jpg not downloaded yet
2026-04-27 08:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/f6/e9f6ce980c86e08abb6c1111b4ee567e/pa/XE44101_b8e51a34991eaeb89a889adb061fecce.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/c8/a7c8da4cc70c94002f3e216660c1247f/pa/NN12776_53d08cf4bd8d561e00d30ff65bbc06ee.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 1f079d1a-c9bf-58c9-af94-46435c7b88fa with identifier: AP60631
2026-04-27 08:00:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 1f079d1a-c9bf-58c9-af94-46435c7b88fa with identifier: AP60631
2026-04-27 08:00:40 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 1f079d1a-c9bf-58c9-af94-46435c7b88fa with identifier: AP60631 to the API
2026-04-27 08:00:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:40 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 131,
 'expiration_date': '2026-04-28T15:19:39Z',
 'fuel_type': 'diesel',
 'id': '1f079d1a-c9bf-58c9-af94-46435c7b88fa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AP60631',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Ford',
 'model': 'Transit Custom',
 'odometer': 166279,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2022-03-06',
 'seller_name': None,
 'title': 'Ford Transit Custom 2.0 TDCi 300 L2 Active',
 'transmission': 'manual',
 'trim': '300 L2 Active',
 'year': 2022}
2026-04-27 08:00:40 [auto1.fr] INFO: Saving data for AP60631: {'auction_closing_time': 1777389579.0, 'created_time': 1777019879.939947, 'has_photos': True, 'last_price_update_time': 1777276840.290576}
2026-04-27 08:00:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a3f5d0>
2026-04-27 08:00:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9b4d35d-ce92-581e-9a30-d49a0f2949fb/e9b4d35d-ce92-581e-9a30-d49a0f2949fb_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/b5/17b562e7c0b33622083635bf09fcf20a/pa/EF42157_91c237e473282b8c654377a71400100b.jpg saved to cache
2026-04-27 08:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e9b4d35d-ce92-581e-9a30-d49a0f2949fb
2026-04-27 08:00:40 [auto1.fr] INFO: Found listing with ID: NK66456
2026-04-27 08:00:40 [auto1.fr] INFO: Scrape type for NK66456: 2
2026-04-27 08:00:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4e27e50-c541-5de3-98b7-0f2cf8f98e15 with identifier: NK66456
2026-04-27 08:00:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4e27e50-c541-5de3-98b7-0f2cf8f98e15 with scrape type 2
2026-04-27 08:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f4e27e50-c541-5de3-98b7-0f2cf8f98e15 with scrape type 2
2026-04-27 08:00:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f4e27e50-c541-5de3-98b7-0f2cf8f98e15, identifier: NK66456
2026-04-27 08:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/c8/a7c8da4cc70c94002f3e216660c1247f/pa/NN12776_0d876e38e35e21b71f9e96277fb798ef.jpg not downloaded yet
2026-04-27 08:00:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f4e27e50-c541-5de3-98b7-0f2cf8f98e15 with identifier: NK66456
2026-04-27 08:00:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f4e27e50-c541-5de3-98b7-0f2cf8f98e15 with identifier: NK66456
2026-04-27 08:00:40 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f4e27e50-c541-5de3-98b7-0f2cf8f98e15 with identifier: NK66456 to the API
2026-04-27 08:00:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:40 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-04-28T15:24:28Z',
 'fuel_type': 'diesel',
 'id': 'f4e27e50-c541-5de3-98b7-0f2cf8f98e15',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NK66456',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 221493,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2014-12-22',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.6 TDI Ambiente',
 'transmission': 'automatic',
 'trim': 'Ambiente',
 'year': 2014}
2026-04-27 08:00:40 [auto1.fr] INFO: Saving data for NK66456: {'auction_closing_time': 1777389868.0, 'created_time': 1777022215.567261, 'has_photos': True, 'last_price_update_time': 1777276840.775245}
2026-04-27 08:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AX33817> (referer: https://www.auto1.com/v1/car-details-view/AX33817/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143805c490>
2026-04-27 08:00:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9b4d35d-ce92-581e-9a30-d49a0f2949fb/e9b4d35d-ce92-581e-9a30-d49a0f2949fb_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/b5/17b562e7c0b33622083635bf09fcf20a/pa/EF42157_b63582f439bad237ceebcf562a7d84b5.jpg saved to cache
2026-04-27 08:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e9b4d35d-ce92-581e-9a30-d49a0f2949fb
2026-04-27 08:00:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c69fd0>
2026-04-27 08:00:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36780e94-7bd1-5041-b5d9-49dd98b9b9b2/36780e94-7bd1-5041-b5d9-49dd98b9b9b2_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/c8/a7c8da4cc70c94002f3e216660c1247f/pa/NN12776_af3ca421e05277201b82a0be74f5497f.jpg saved to cache
2026-04-27 08:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 36780e94-7bd1-5041-b5d9-49dd98b9b9b2
2026-04-27 08:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/c8/a7c8da4cc70c94002f3e216660c1247f/pa/NN12776_600470ca6b2ecc9fda504bd6ce6b2f54.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/c8/a7c8da4cc70c94002f3e216660c1247f/pa/NN12776_61223cd3845ad45ac677c40e636a648a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:40 [auto1.fr] INFO: Found listing with ID: RV01663
2026-04-27 08:00:40 [auto1.fr] INFO: Scrape type for RV01663: 1
2026-04-27 08:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/c8/a7c8da4cc70c94002f3e216660c1247f/pa/NN12776_ae284eead65bdd631a077cf11c932a3d.jpg not downloaded yet
2026-04-27 08:00:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14381ba310>
2026-04-27 08:00:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38eafa69-c12d-5119-b98b-31fa0fd03db0/38eafa69-c12d-5119-b98b-31fa0fd03db0_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/f6/e9f6ce980c86e08abb6c1111b4ee567e/pa/XE44101_b8e51a34991eaeb89a889adb061fecce.jpg saved to cache
2026-04-27 08:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 38eafa69-c12d-5119-b98b-31fa0fd03db0
2026-04-27 08:00:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 38eafa69-c12d-5119-b98b-31fa0fd03db0, skipping ID generation
2026-04-27 08:00:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38eafa69-c12d-5119-b98b-31fa0fd03db0 with scrape type 1
2026-04-27 08:00:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 38eafa69-c12d-5119-b98b-31fa0fd03db0 sending to next pipeline
2026-04-27 08:00:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 38eafa69-c12d-5119-b98b-31fa0fd03db0, identifier: XE44101
2026-04-27 08:00:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143820b750>
2026-04-27 08:00:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36780e94-7bd1-5041-b5d9-49dd98b9b9b2/36780e94-7bd1-5041-b5d9-49dd98b9b9b2_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/c8/a7c8da4cc70c94002f3e216660c1247f/pa/NN12776_53d08cf4bd8d561e00d30ff65bbc06ee.jpg saved to cache
2026-04-27 08:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 36780e94-7bd1-5041-b5d9-49dd98b9b9b2
2026-04-27 08:00:41 [auto1.fr] INFO: Found listing with ID: ZL01600
2026-04-27 08:00:41 [auto1.fr] INFO: Scrape type for ZL01600: 2
2026-04-27 08:00:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bfcb1b40-fbfa-5044-81e1-05e0c15efc5c with identifier: ZL01600
2026-04-27 08:00:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bfcb1b40-fbfa-5044-81e1-05e0c15efc5c with scrape type 2
2026-04-27 08:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bfcb1b40-fbfa-5044-81e1-05e0c15efc5c with scrape type 2
2026-04-27 08:00:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: bfcb1b40-fbfa-5044-81e1-05e0c15efc5c, identifier: ZL01600
2026-04-27 08:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/c8/a7c8da4cc70c94002f3e216660c1247f/pa/NN12776_5d08861d83af7e65cd766bffa6afe1d9.jpg not downloaded yet
2026-04-27 08:00:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 38eafa69-c12d-5119-b98b-31fa0fd03db0 with identifier: XE44101
2026-04-27 08:00:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 38eafa69-c12d-5119-b98b-31fa0fd03db0 with identifier: XE44101
2026-04-27 08:00:41 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 38eafa69-c12d-5119-b98b-31fa0fd03db0 with identifier: XE44101 to the API
2026-04-27 08:00:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:41 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge9/f6/e9f6ce980c86e08abb6c1111b4ee567e/pa/XE44101_b8e51a34991eaeb89a889adb061fecce.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'city': 'Marseille',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 110,
 'expiration_date': '2026-04-28T15:47:25Z',
 'fuel_type': 'diesel',
 'id': '38eafa69-c12d-5119-b98b-31fa0fd03db0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 43.2969,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XE44101',
 'listing': 'auction',
 'location': 'FR, Marseille',
 'location_confidence': 'geocoded',
 'longitude': 5.3811,
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 170910,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_38eafa69-c12d-5119-b98b-31fa0fd03db0/38eafa69-c12d-5119-b98b-31fa0fd03db0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85001,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/f6/e9f6ce980c86e08abb6c1111b4ee567e/pa/XE44101_b8e51a34991eaeb89a889adb061fecce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_38eafa69-c12d-5119-b98b-31fa0fd03db0/38eafa69-c12d-5119-b98b-31fa0fd03db0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84018,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/f6/e9f6ce980c86e08abb6c1111b4ee567e/pa/XE44101_6501dc17187a6240709b0428f5f3f766.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_38eafa69-c12d-5119-b98b-31fa0fd03db0/38eafa69-c12d-5119-b98b-31fa0fd03db0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91301,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/f6/e9f6ce980c86e08abb6c1111b4ee567e/pa/XE44101_be308257905f507c2bcbe8dba512e379.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_38eafa69-c12d-5119-b98b-31fa0fd03db0/38eafa69-c12d-5119-b98b-31fa0fd03db0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63521,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/f6/e9f6ce980c86e08abb6c1111b4ee567e/pa/XE44101_34c79c75930182bc957fe90be600a339.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_38eafa69-c12d-5119-b98b-31fa0fd03db0/38eafa69-c12d-5119-b98b-31fa0fd03db0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84169,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/f6/e9f6ce980c86e08abb6c1111b4ee567e/pa/XE44101_6b16ed216ca4aa0306a944969f4ac351.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_38eafa69-c12d-5119-b98b-31fa0fd03db0/38eafa69-c12d-5119-b98b-31fa0fd03db0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94625,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/f6/e9f6ce980c86e08abb6c1111b4ee567e/pa/XE44101_bde80866b8356c8abf7e9addd25102b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_38eafa69-c12d-5119-b98b-31fa0fd03db0/38eafa69-c12d-5119-b98b-31fa0fd03db0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70980,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/f6/e9f6ce980c86e08abb6c1111b4ee567e/pa/XE44101_f6c53cfcc6ba49d7249d89efa803c2f2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_38eafa69-c12d-5119-b98b-31fa0fd03db0/38eafa69-c12d-5119-b98b-31fa0fd03db0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93529,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/f6/e9f6ce980c86e08abb6c1111b4ee567e/pa/XE44101_cff3105ebc971af45c86fb592dfb70bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_38eafa69-c12d-5119-b98b-31fa0fd03db0/38eafa69-c12d-5119-b98b-31fa0fd03db0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83071,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/f6/e9f6ce980c86e08abb6c1111b4ee567e/pa/XE44101_adbd72cb90fff2f74b5fe59a9db08101.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_38eafa69-c12d-5119-b98b-31fa0fd03db0/38eafa69-c12d-5119-b98b-31fa0fd03db0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85304,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/f6/e9f6ce980c86e08abb6c1111b4ee567e/pa/XE44101_87b2f1448e0457690fb31c50442b7cea.jpg',
             'Width': 800}],
 'postal_code': '13000',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Bouches-du-Rhône',
 'province_code': 'FR-13',
 'region': "Provence-Alpes-Côte d'Azur",
 'region_code': 'FR-93',
 'registration_date': '2011-08-31',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Peugeot 5008 1.6 HDi Premium',
 'transmission': 'manual',
 'trim': 'Premium',
 'year': 2011}
2026-04-27 08:00:41 [auto1.fr] INFO: Saving data for XE44101: {'created_time': 1777276841.755969, 'last_price_update_time': 1777276841.755982, 'has_photos': True, 'auction_closing_time': 1777391245.0}
2026-04-27 08:00:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: bfcb1b40-fbfa-5044-81e1-05e0c15efc5c with identifier: ZL01600
2026-04-27 08:00:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: bfcb1b40-fbfa-5044-81e1-05e0c15efc5c with identifier: ZL01600
2026-04-27 08:00:41 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: bfcb1b40-fbfa-5044-81e1-05e0c15efc5c with identifier: ZL01600 to the API
2026-04-27 08:00:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:41 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-04-28T15:43:04Z',
 'fuel_type': 'petrol',
 'id': 'bfcb1b40-fbfa-5044-81e1-05e0c15efc5c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZL01600',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 38363,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2021-10-11',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 TSI Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2021}
2026-04-27 08:00:42 [auto1.fr] INFO: Saving data for ZL01600: {'auction_closing_time': 1777390984.0, 'created_time': 1777022565.080717, 'has_photos': True, 'last_price_update_time': 1777276842.106093}
2026-04-27 08:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/c8/a7c8da4cc70c94002f3e216660c1247f/pa/NN12776_0d876e38e35e21b71f9e96277fb798ef.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:42 [auto1.fr] INFO: Found listing with ID: YR97651
2026-04-27 08:00:42 [auto1.fr] INFO: Scrape type for YR97651: 1
2026-04-27 08:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/c8/a7c8da4cc70c94002f3e216660c1247f/pa/NN12776_1434ba7d01b1f43c0226f3fc569436f0.jpg not downloaded yet
2026-04-27 08:00:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dfaff259-5165-5149-a517-0f9d4f2b990f with identifier: AX33817
2026-04-27 08:00:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dfaff259-5165-5149-a517-0f9d4f2b990f with scrape type 1
2026-04-27 08:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dfaff259-5165-5149-a517-0f9d4f2b990f
2026-04-27 08:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/5c/c95c06ef27981aa715253d0bd9240cf0/pa/AX33817_a5defada8c25b3c59ec9dcfa4b750c67.jpg not downloaded yet
2026-04-27 08:00:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438169a90>
2026-04-27 08:00:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36780e94-7bd1-5041-b5d9-49dd98b9b9b2/36780e94-7bd1-5041-b5d9-49dd98b9b9b2_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/c8/a7c8da4cc70c94002f3e216660c1247f/pa/NN12776_600470ca6b2ecc9fda504bd6ce6b2f54.jpg saved to cache
2026-04-27 08:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 36780e94-7bd1-5041-b5d9-49dd98b9b9b2
2026-04-27 08:00:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438074c90>
2026-04-27 08:00:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36780e94-7bd1-5041-b5d9-49dd98b9b9b2/36780e94-7bd1-5041-b5d9-49dd98b9b9b2_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/c8/a7c8da4cc70c94002f3e216660c1247f/pa/NN12776_61223cd3845ad45ac677c40e636a648a.jpg saved to cache
2026-04-27 08:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 36780e94-7bd1-5041-b5d9-49dd98b9b9b2
2026-04-27 08:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/c8/a7c8da4cc70c94002f3e216660c1247f/pa/NN12776_da5f09ebf6ac9e865d8b8f978fbbc8cc.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/c8/a7c8da4cc70c94002f3e216660c1247f/pa/NN12776_75d17c97037b6fd972351b50a638b6f8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:42 [auto1.fr] INFO: Found listing with ID: XW13347
2026-04-27 08:00:42 [auto1.fr] INFO: Scrape type for XW13347: 2
2026-04-27 08:00:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00dfcb95-ed1e-5268-a514-6d67d8941469 with identifier: XW13347
2026-04-27 08:00:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00dfcb95-ed1e-5268-a514-6d67d8941469 with scrape type 2
2026-04-27 08:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 00dfcb95-ed1e-5268-a514-6d67d8941469 with scrape type 2
2026-04-27 08:00:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 00dfcb95-ed1e-5268-a514-6d67d8941469, identifier: XW13347
2026-04-27 08:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/5c/c95c06ef27981aa715253d0bd9240cf0/pa/AX33817_3f4ad7ad9fc1f4716c7e01ea1825857c.jpg not downloaded yet
2026-04-27 08:00:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 00dfcb95-ed1e-5268-a514-6d67d8941469 with identifier: XW13347
2026-04-27 08:00:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 00dfcb95-ed1e-5268-a514-6d67d8941469 with identifier: XW13347
2026-04-27 08:00:42 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 00dfcb95-ed1e-5268-a514-6d67d8941469 with identifier: XW13347 to the API
2026-04-27 08:00:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:42 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 175,
 'expiration_date': '2026-04-28T15:51:26Z',
 'fuel_type': 'diesel',
 'id': '00dfcb95-ed1e-5268-a514-6d67d8941469',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XW13347',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Volkswagen',
 'model': 'Touareg',
 'odometer': 252037,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2007-02-28',
 'seller_name': None,
 'title': 'Volkswagen Touareg 2.5 TDI R5 Carat',
 'transmission': 'automatic',
 'trim': 'R5 Carat',
 'year': 2007}
2026-04-27 08:00:43 [auto1.fr] INFO: Saving data for XW13347: {'auction_closing_time': 1777391486.0, 'created_time': 1777019928.028021, 'has_photos': True, 'last_price_update_time': 1777276843.013732}
2026-04-27 08:00:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438cc4b50>
2026-04-27 08:00:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36780e94-7bd1-5041-b5d9-49dd98b9b9b2/36780e94-7bd1-5041-b5d9-49dd98b9b9b2_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/c8/a7c8da4cc70c94002f3e216660c1247f/pa/NN12776_0d876e38e35e21b71f9e96277fb798ef.jpg saved to cache
2026-04-27 08:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 36780e94-7bd1-5041-b5d9-49dd98b9b9b2
2026-04-27 08:00:43 [auto1.fr] INFO: Found listing with ID: KZ53312
2026-04-27 08:00:43 [auto1.fr] INFO: Scrape type for KZ53312: 2
2026-04-27 08:00:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a8551cd-459b-501d-aba0-84bc59875245 with identifier: KZ53312
2026-04-27 08:00:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a8551cd-459b-501d-aba0-84bc59875245 with scrape type 2
2026-04-27 08:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a8551cd-459b-501d-aba0-84bc59875245 with scrape type 2
2026-04-27 08:00:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7a8551cd-459b-501d-aba0-84bc59875245, identifier: KZ53312
2026-04-27 08:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/5c/c95c06ef27981aa715253d0bd9240cf0/pa/AX33817_7d11cc4c4d1fd090acaaa34c308e0447.jpg not downloaded yet
2026-04-27 08:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/c8/a7c8da4cc70c94002f3e216660c1247f/pa/NN12776_5d08861d83af7e65cd766bffa6afe1d9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7a8551cd-459b-501d-aba0-84bc59875245 with identifier: KZ53312
2026-04-27 08:00:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7a8551cd-459b-501d-aba0-84bc59875245 with identifier: KZ53312
2026-04-27 08:00:43 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 7a8551cd-459b-501d-aba0-84bc59875245 with identifier: KZ53312 to the API
2026-04-27 08:00:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:43 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-04-28T15:20:52Z',
 'fuel_type': 'diesel',
 'id': '7a8551cd-459b-501d-aba0-84bc59875245',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KZ53312',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Citroen',
 'model': 'C4 Picasso',
 'odometer': 196659,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2013-03-05',
 'seller_name': None,
 'title': 'Citroen C4 Picasso 1.6 HDi Millenium',
 'transmission': 'manual',
 'trim': 'Millenium',
 'year': 2013}
2026-04-27 08:00:43 [auto1.fr] INFO: Saving data for KZ53312: {'auction_closing_time': 1777389652.0, 'created_time': 1777021075.805454, 'has_photos': True, 'last_price_update_time': 1777276843.501598}
2026-04-27 08:00:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438e154d0>
2026-04-27 08:00:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36780e94-7bd1-5041-b5d9-49dd98b9b9b2/36780e94-7bd1-5041-b5d9-49dd98b9b9b2_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/c8/a7c8da4cc70c94002f3e216660c1247f/pa/NN12776_da5f09ebf6ac9e865d8b8f978fbbc8cc.jpg saved to cache
2026-04-27 08:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 36780e94-7bd1-5041-b5d9-49dd98b9b9b2
2026-04-27 08:00:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a74e90>
2026-04-27 08:00:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36780e94-7bd1-5041-b5d9-49dd98b9b9b2/36780e94-7bd1-5041-b5d9-49dd98b9b9b2_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/c8/a7c8da4cc70c94002f3e216660c1247f/pa/NN12776_75d17c97037b6fd972351b50a638b6f8.jpg saved to cache
2026-04-27 08:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 36780e94-7bd1-5041-b5d9-49dd98b9b9b2
2026-04-27 08:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/c8/a7c8da4cc70c94002f3e216660c1247f/pa/NN12776_ae284eead65bdd631a077cf11c932a3d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:43 [auto1.fr] INFO: Found listing with ID: BF91886
2026-04-27 08:00:43 [auto1.fr] INFO: Scrape type for BF91886: 2
2026-04-27 08:00:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74c78484-bd41-5d0b-a680-a2474b02ad91 with identifier: BF91886
2026-04-27 08:00:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74c78484-bd41-5d0b-a680-a2474b02ad91 with scrape type 2
2026-04-27 08:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 74c78484-bd41-5d0b-a680-a2474b02ad91 with scrape type 2
2026-04-27 08:00:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 74c78484-bd41-5d0b-a680-a2474b02ad91, identifier: BF91886
2026-04-27 08:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/5c/c95c06ef27981aa715253d0bd9240cf0/pa/AX33817_9cb7178ab5f518c9f6ea3f514bcbbd14.jpg not downloaded yet
2026-04-27 08:00:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 74c78484-bd41-5d0b-a680-a2474b02ad91 with identifier: BF91886
2026-04-27 08:00:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 74c78484-bd41-5d0b-a680-a2474b02ad91 with identifier: BF91886
2026-04-27 08:00:43 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 74c78484-bd41-5d0b-a680-a2474b02ad91 with identifier: BF91886 to the API
2026-04-27 08:00:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:43 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 210,
 'expiration_date': '2026-04-28T15:34:39Z',
 'fuel_type': 'petrol',
 'id': '74c78484-bd41-5d0b-a680-a2474b02ad91',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BF91886',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 199752,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2013-12-03',
 'seller_name': None,
 'title': 'Audi Q3 2.0 TFSI quattro Ambition Luxe',
 'transmission': 'automatic',
 'trim': 'quattro Ambition Luxe',
 'year': 2013}
2026-04-27 08:00:44 [auto1.fr] INFO: Saving data for BF91886: {'auction_closing_time': 1777390479.0, 'created_time': 1777021148.014972, 'has_photos': True, 'last_price_update_time': 1777276844.041896}
2026-04-27 08:00:44 [auto1.fr] INFO: Found listing with ID: HG76668
2026-04-27 08:00:44 [auto1.fr] INFO: Scrape type for HG76668: 2
2026-04-27 08:00:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ca2c292-155d-57b6-9bb5-7d19e8e48f19 with identifier: HG76668
2026-04-27 08:00:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ca2c292-155d-57b6-9bb5-7d19e8e48f19 with scrape type 2
2026-04-27 08:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3ca2c292-155d-57b6-9bb5-7d19e8e48f19 with scrape type 2
2026-04-27 08:00:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3ca2c292-155d-57b6-9bb5-7d19e8e48f19, identifier: HG76668
2026-04-27 08:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/5c/c95c06ef27981aa715253d0bd9240cf0/pa/AX33817_a7c4d94f6bc9f0e8b0aa086080938056.jpg not downloaded yet
2026-04-27 08:00:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143adc4e90>
2026-04-27 08:00:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36780e94-7bd1-5041-b5d9-49dd98b9b9b2/36780e94-7bd1-5041-b5d9-49dd98b9b9b2_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/c8/a7c8da4cc70c94002f3e216660c1247f/pa/NN12776_5d08861d83af7e65cd766bffa6afe1d9.jpg saved to cache
2026-04-27 08:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 36780e94-7bd1-5041-b5d9-49dd98b9b9b2
2026-04-27 08:00:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3ca2c292-155d-57b6-9bb5-7d19e8e48f19 with identifier: HG76668
2026-04-27 08:00:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3ca2c292-155d-57b6-9bb5-7d19e8e48f19 with identifier: HG76668
2026-04-27 08:00:44 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 3ca2c292-155d-57b6-9bb5-7d19e8e48f19 with identifier: HG76668 to the API
2026-04-27 08:00:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:44 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 107,
 'expiration_date': '2026-04-28T15:37:44Z',
 'fuel_type': 'diesel',
 'id': '3ca2c292-155d-57b6-9bb5-7d19e8e48f19',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HG76668',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 134127,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2016-05-16',
 'seller_name': None,
 'title': 'Dacia Duster 1.5 dCi Prestige 4x2',
 'transmission': 'manual',
 'trim': 'Prestige 4x2',
 'year': 2016}
2026-04-27 08:00:44 [auto1.fr] INFO: Saving data for HG76668: {'auction_closing_time': 1777390664.0, 'created_time': 1777022550.821815, 'has_photos': True, 'last_price_update_time': 1777276844.549899}
2026-04-27 08:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/5c/c95c06ef27981aa715253d0bd9240cf0/pa/AX33817_3f4ad7ad9fc1f4716c7e01ea1825857c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:44 [auto1.fr] INFO: Found listing with ID: SH60378
2026-04-27 08:00:44 [auto1.fr] INFO: Scrape type for SH60378: 2
2026-04-27 08:00:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b44142a-9b34-59ca-889f-049c60667f57 with identifier: SH60378
2026-04-27 08:00:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b44142a-9b34-59ca-889f-049c60667f57 with scrape type 2
2026-04-27 08:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b44142a-9b34-59ca-889f-049c60667f57 with scrape type 2
2026-04-27 08:00:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6b44142a-9b34-59ca-889f-049c60667f57, identifier: SH60378
2026-04-27 08:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/5c/c95c06ef27981aa715253d0bd9240cf0/pa/AX33817_df4fa5e91486a3d36b90b82f5db7bfce.jpg not downloaded yet
2026-04-27 08:00:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438074f90>
2026-04-27 08:00:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36780e94-7bd1-5041-b5d9-49dd98b9b9b2/36780e94-7bd1-5041-b5d9-49dd98b9b9b2_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/c8/a7c8da4cc70c94002f3e216660c1247f/pa/NN12776_ae284eead65bdd631a077cf11c932a3d.jpg saved to cache
2026-04-27 08:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 36780e94-7bd1-5041-b5d9-49dd98b9b9b2
2026-04-27 08:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/5c/c95c06ef27981aa715253d0bd9240cf0/pa/AX33817_7d11cc4c4d1fd090acaaa34c308e0447.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6b44142a-9b34-59ca-889f-049c60667f57 with identifier: SH60378
2026-04-27 08:00:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6b44142a-9b34-59ca-889f-049c60667f57 with identifier: SH60378
2026-04-27 08:00:44 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6b44142a-9b34-59ca-889f-049c60667f57 with identifier: SH60378 to the API
2026-04-27 08:00:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:44 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 120,
 'expiration_date': '2026-04-28T15:45:01Z',
 'fuel_type': 'diesel',
 'id': '6b44142a-9b34-59ca-889f-049c60667f57',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SH60378',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Peugeot',
 'model': 'Expert',
 'odometer': 154051,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2019-07-23',
 'seller_name': None,
 'title': 'Peugeot Expert 1.5 Blue-HDi Premium L2',
 'transmission': 'manual',
 'trim': 'Premium L2',
 'year': 2019}
2026-04-27 08:00:45 [auto1.fr] INFO: Saving data for SH60378: {'auction_closing_time': 1777391101.0, 'created_time': 1777022075.005961, 'has_photos': True, 'last_price_update_time': 1777276845.031966}
2026-04-27 08:00:45 [auto1.fr] INFO: Found listing with ID: AB15378
2026-04-27 08:00:45 [auto1.fr] INFO: Scrape type for AB15378: 2
2026-04-27 08:00:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ab11fa6-9142-5df9-8644-ab8f9c9ceaa2 with identifier: AB15378
2026-04-27 08:00:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ab11fa6-9142-5df9-8644-ab8f9c9ceaa2 with scrape type 2
2026-04-27 08:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2ab11fa6-9142-5df9-8644-ab8f9c9ceaa2 with scrape type 2
2026-04-27 08:00:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2ab11fa6-9142-5df9-8644-ab8f9c9ceaa2, identifier: AB15378
2026-04-27 08:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/5c/c95c06ef27981aa715253d0bd9240cf0/pa/AX33817_499f685cf8c68dbf7bb63ab29424d3ae.jpg not downloaded yet
2026-04-27 08:00:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2ab11fa6-9142-5df9-8644-ab8f9c9ceaa2 with identifier: AB15378
2026-04-27 08:00:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2ab11fa6-9142-5df9-8644-ab8f9c9ceaa2 with identifier: AB15378
2026-04-27 08:00:45 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2ab11fa6-9142-5df9-8644-ab8f9c9ceaa2 with identifier: AB15378 to the API
2026-04-27 08:00:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:45 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-04-28T15:31:53Z',
 'fuel_type': 'petrol',
 'id': '2ab11fa6-9142-5df9-8644-ab8f9c9ceaa2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB15378',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 108318,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2011-04-27',
 'seller_name': None,
 'title': 'MINI Countryman Cooper S',
 'transmission': 'automatic',
 'trim': '',
 'year': 2011}
2026-04-27 08:00:45 [auto1.fr] INFO: Saving data for AB15378: {'auction_closing_time': 1777390313.0, 'created_time': 1777021533.563807, 'has_photos': True, 'last_price_update_time': 1777276845.466731}
2026-04-27 08:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VR99778/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142be09dd0>
2026-04-27 08:00:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfaff259-5165-5149-a517-0f9d4f2b990f/dfaff259-5165-5149-a517-0f9d4f2b990f_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/5c/c95c06ef27981aa715253d0bd9240cf0/pa/AX33817_3f4ad7ad9fc1f4716c7e01ea1825857c.jpg saved to cache
2026-04-27 08:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dfaff259-5165-5149-a517-0f9d4f2b990f
2026-04-27 08:00:45 [auto1.fr] INFO: Found listing with ID: SL99447
2026-04-27 08:00:45 [auto1.fr] INFO: Scrape type for SL99447: 1
2026-04-27 08:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/5c/c95c06ef27981aa715253d0bd9240cf0/pa/AX33817_d4944fa83432df742ec8431904830f8d.jpg not downloaded yet
2026-04-27 08:00:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/5c/c95c06ef27981aa715253d0bd9240cf0/pa/AX33817_a7c4d94f6bc9f0e8b0aa086080938056.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14551b2950>
2026-04-27 08:00:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfaff259-5165-5149-a517-0f9d4f2b990f/dfaff259-5165-5149-a517-0f9d4f2b990f_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/5c/c95c06ef27981aa715253d0bd9240cf0/pa/AX33817_7d11cc4c4d1fd090acaaa34c308e0447.jpg saved to cache
2026-04-27 08:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dfaff259-5165-5149-a517-0f9d4f2b990f
2026-04-27 08:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/5c/c95c06ef27981aa715253d0bd9240cf0/pa/AX33817_9cb7178ab5f518c9f6ea3f514bcbbd14.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:45 [auto1.fr] INFO: Found listing with ID: JD41728
2026-04-27 08:00:45 [auto1.fr] INFO: Scrape type for JD41728: 1
2026-04-27 08:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/5c/c95c06ef27981aa715253d0bd9240cf0/pa/AX33817_eac8926f38e232b9828fcba0eb6bc676.jpg not downloaded yet
2026-04-27 08:00:45 [auto1.fr] INFO: Found listing with ID: RL83119
2026-04-27 08:00:45 [auto1.fr] INFO: Scrape type for RL83119: 1
2026-04-27 08:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/5c/c95c06ef27981aa715253d0bd9240cf0/pa/AX33817_e9cb18262c9a30c9b170fda7e8197300.jpg not downloaded yet
2026-04-27 08:00:45 [auto1.fr] INFO: Found listing with ID: AC55074
2026-04-27 08:00:45 [auto1.fr] INFO: Scrape type for AC55074: 1
2026-04-27 08:00:45 [auto1.fr] INFO: Found listing with ID: AR54753
2026-04-27 08:00:45 [auto1.fr] INFO: Scrape type for AR54753: 2
2026-04-27 08:00:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 342399f4-a508-5ab9-b49b-8b7bc83e3371 with identifier: AR54753
2026-04-27 08:00:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 342399f4-a508-5ab9-b49b-8b7bc83e3371 with scrape type 2
2026-04-27 08:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 342399f4-a508-5ab9-b49b-8b7bc83e3371 with scrape type 2
2026-04-27 08:00:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 342399f4-a508-5ab9-b49b-8b7bc83e3371, identifier: AR54753
2026-04-27 08:00:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 342399f4-a508-5ab9-b49b-8b7bc83e3371 with identifier: AR54753
2026-04-27 08:00:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 342399f4-a508-5ab9-b49b-8b7bc83e3371 with identifier: AR54753
2026-04-27 08:00:46 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 342399f4-a508-5ab9-b49b-8b7bc83e3371 with identifier: AR54753 to the API
2026-04-27 08:00:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:46 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-04-28T15:07:35Z',
 'fuel_type': 'diesel',
 'id': '342399f4-a508-5ab9-b49b-8b7bc83e3371',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AR54753',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 130524,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2005-08-08',
 'seller_name': None,
 'title': 'Citroen C3 1.4 HDi Advance',
 'transmission': 'manual',
 'trim': 'Advance',
 'year': 2005}
2026-04-27 08:00:46 [auto1.fr] INFO: Saving data for AR54753: {'auction_closing_time': 1777388855.0, 'created_time': 1777020359.577026, 'has_photos': True, 'last_price_update_time': 1777276846.196451}
2026-04-27 08:00:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c38810>
2026-04-27 08:00:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfaff259-5165-5149-a517-0f9d4f2b990f/dfaff259-5165-5149-a517-0f9d4f2b990f_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/5c/c95c06ef27981aa715253d0bd9240cf0/pa/AX33817_a7c4d94f6bc9f0e8b0aa086080938056.jpg saved to cache
2026-04-27 08:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dfaff259-5165-5149-a517-0f9d4f2b990f
2026-04-27 08:00:46 [auto1.fr] INFO: Found listing with ID: RR97759
2026-04-27 08:00:46 [auto1.fr] INFO: Scrape type for RR97759: 1
2026-04-27 08:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/5c/c95c06ef27981aa715253d0bd9240cf0/pa/AX33817_499f685cf8c68dbf7bb63ab29424d3ae.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/5c/c95c06ef27981aa715253d0bd9240cf0/pa/AX33817_d4944fa83432df742ec8431904830f8d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/5c/c95c06ef27981aa715253d0bd9240cf0/pa/AX33817_df4fa5e91486a3d36b90b82f5db7bfce.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:46 [auto1.fr] INFO: Found listing with ID: FR44519
2026-04-27 08:00:46 [auto1.fr] INFO: Scrape type for FR44519: 1
2026-04-27 08:00:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d22f90>
2026-04-27 08:00:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfaff259-5165-5149-a517-0f9d4f2b990f/dfaff259-5165-5149-a517-0f9d4f2b990f_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/5c/c95c06ef27981aa715253d0bd9240cf0/pa/AX33817_9cb7178ab5f518c9f6ea3f514bcbbd14.jpg saved to cache
2026-04-27 08:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dfaff259-5165-5149-a517-0f9d4f2b990f
2026-04-27 08:00:46 [auto1.fr] INFO: Found listing with ID: YE52567
2026-04-27 08:00:46 [auto1.fr] INFO: Scrape type for YE52567: 2
2026-04-27 08:00:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac48a1c0-15e9-5916-a7c6-e61a41c7b256 with identifier: YE52567
2026-04-27 08:00:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac48a1c0-15e9-5916-a7c6-e61a41c7b256 with scrape type 2
2026-04-27 08:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ac48a1c0-15e9-5916-a7c6-e61a41c7b256 with scrape type 2
2026-04-27 08:00:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ac48a1c0-15e9-5916-a7c6-e61a41c7b256, identifier: YE52567
2026-04-27 08:00:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ac48a1c0-15e9-5916-a7c6-e61a41c7b256 with identifier: YE52567
2026-04-27 08:00:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ac48a1c0-15e9-5916-a7c6-e61a41c7b256 with identifier: YE52567
2026-04-27 08:00:46 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ac48a1c0-15e9-5916-a7c6-e61a41c7b256 with identifier: YE52567 to the API
2026-04-27 08:00:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:46 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 90,
 'expiration_date': '2026-04-28T15:58:52Z',
 'fuel_type': 'diesel',
 'id': 'ac48a1c0-15e9-5916-a7c6-e61a41c7b256',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YE52567',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Renault',
 'model': 'Kangoo',
 'odometer': 154755,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2015-12-21',
 'seller_name': None,
 'title': 'Renault Kangoo 1.5 dCi Furgón Maxi 5P Profesional',
 'transmission': 'manual',
 'trim': 'Furgón Maxi 5P Profesional',
 'year': 2015}
2026-04-27 08:00:46 [auto1.fr] INFO: Saving data for YE52567: {'auction_closing_time': 1777391932.0, 'created_time': 1777019844.973485, 'has_photos': True, 'last_price_update_time': 1777276846.71532}
2026-04-27 08:00:46 [auto1.fr] INFO: Found listing with ID: ZT54716
2026-04-27 08:00:46 [auto1.fr] INFO: Scrape type for ZT54716: 1
2026-04-27 08:00:46 [auto1.fr] INFO: Found listing with ID: VS59315
2026-04-27 08:00:46 [auto1.fr] INFO: Scrape type for VS59315: 1
2026-04-27 08:00:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143809fa90>
2026-04-27 08:00:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfaff259-5165-5149-a517-0f9d4f2b990f/dfaff259-5165-5149-a517-0f9d4f2b990f_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/5c/c95c06ef27981aa715253d0bd9240cf0/pa/AX33817_499f685cf8c68dbf7bb63ab29424d3ae.jpg saved to cache
2026-04-27 08:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dfaff259-5165-5149-a517-0f9d4f2b990f
2026-04-27 08:00:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a74990>
2026-04-27 08:00:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfaff259-5165-5149-a517-0f9d4f2b990f/dfaff259-5165-5149-a517-0f9d4f2b990f_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/5c/c95c06ef27981aa715253d0bd9240cf0/pa/AX33817_d4944fa83432df742ec8431904830f8d.jpg saved to cache
2026-04-27 08:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dfaff259-5165-5149-a517-0f9d4f2b990f
2026-04-27 08:00:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438aeedd0>
2026-04-27 08:00:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfaff259-5165-5149-a517-0f9d4f2b990f/dfaff259-5165-5149-a517-0f9d4f2b990f_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/5c/c95c06ef27981aa715253d0bd9240cf0/pa/AX33817_df4fa5e91486a3d36b90b82f5db7bfce.jpg saved to cache
2026-04-27 08:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dfaff259-5165-5149-a517-0f9d4f2b990f
2026-04-27 08:00:46 [auto1.fr] INFO: Found listing with ID: CG60113
2026-04-27 08:00:46 [auto1.fr] INFO: Scrape type for CG60113: 2
2026-04-27 08:00:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eede7fed-128f-59dc-b30c-4432a442acd1 with identifier: CG60113
2026-04-27 08:00:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eede7fed-128f-59dc-b30c-4432a442acd1 with scrape type 2
2026-04-27 08:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eede7fed-128f-59dc-b30c-4432a442acd1 with scrape type 2
2026-04-27 08:00:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: eede7fed-128f-59dc-b30c-4432a442acd1, identifier: CG60113
2026-04-27 08:00:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: eede7fed-128f-59dc-b30c-4432a442acd1 with identifier: CG60113
2026-04-27 08:00:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: eede7fed-128f-59dc-b30c-4432a442acd1 with identifier: CG60113
2026-04-27 08:00:47 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: eede7fed-128f-59dc-b30c-4432a442acd1 with identifier: CG60113 to the API
2026-04-27 08:00:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:47 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-04-28T15:54:51Z',
 'fuel_type': 'diesel',
 'id': 'eede7fed-128f-59dc-b30c-4432a442acd1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CG60113',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 188177,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2011-11-23',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.6 TDI Carat BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Carat BlueMotion Tech',
 'year': 2011}
2026-04-27 08:00:47 [auto1.fr] INFO: Saving data for CG60113: {'auction_closing_time': 1777391691.0, 'created_time': 1777021516.245419, 'has_photos': True, 'last_price_update_time': 1777276847.299164}
2026-04-27 08:00:47 [auto1.fr] INFO: Found listing with ID: WV49622
2026-04-27 08:00:47 [auto1.fr] INFO: Scrape type for WV49622: 2
2026-04-27 08:00:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68df8024-444a-5cf7-90a9-80618ce62204 with identifier: WV49622
2026-04-27 08:00:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68df8024-444a-5cf7-90a9-80618ce62204 with scrape type 2
2026-04-27 08:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 68df8024-444a-5cf7-90a9-80618ce62204 with scrape type 2
2026-04-27 08:00:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 68df8024-444a-5cf7-90a9-80618ce62204, identifier: WV49622
2026-04-27 08:00:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 68df8024-444a-5cf7-90a9-80618ce62204 with identifier: WV49622
2026-04-27 08:00:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 68df8024-444a-5cf7-90a9-80618ce62204 with identifier: WV49622
2026-04-27 08:00:47 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 68df8024-444a-5cf7-90a9-80618ce62204 with identifier: WV49622 to the API
2026-04-27 08:00:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:47 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-04-28T15:00:05Z',
 'fuel_type': 'petrol',
 'id': '68df8024-444a-5cf7-90a9-80618ce62204',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WV49622',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Ford',
 'model': 'B-Max',
 'odometer': 113152,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2014-04-27',
 'seller_name': None,
 'title': 'Ford B-Max 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2014}
2026-04-27 08:00:47 [auto1.fr] INFO: Saving data for WV49622: {'auction_closing_time': 1777388405.0, 'created_time': 1777022636.359248, 'has_photos': True, 'last_price_update_time': 1777276847.797934}
2026-04-27 08:00:47 [auto1.fr] INFO: Found listing with ID: JP78113
2026-04-27 08:00:47 [auto1.fr] INFO: Scrape type for JP78113: 1
2026-04-27 08:00:47 [auto1.fr] INFO: Found listing with ID: DR79618
2026-04-27 08:00:47 [auto1.fr] INFO: Scrape type for DR79618: 1
2026-04-27 08:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LS92623/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:47 [auto1.fr] INFO: Found listing with ID: EH06782
2026-04-27 08:00:47 [auto1.fr] INFO: Scrape type for EH06782: 2
2026-04-27 08:00:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 649d8a33-7597-50dc-ba0b-ba783fa71c38 with identifier: EH06782
2026-04-27 08:00:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 649d8a33-7597-50dc-ba0b-ba783fa71c38 with scrape type 2
2026-04-27 08:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 649d8a33-7597-50dc-ba0b-ba783fa71c38 with scrape type 2
2026-04-27 08:00:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 649d8a33-7597-50dc-ba0b-ba783fa71c38, identifier: EH06782
2026-04-27 08:00:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 649d8a33-7597-50dc-ba0b-ba783fa71c38 with identifier: EH06782
2026-04-27 08:00:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 649d8a33-7597-50dc-ba0b-ba783fa71c38 with identifier: EH06782
2026-04-27 08:00:48 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 649d8a33-7597-50dc-ba0b-ba783fa71c38 with identifier: EH06782 to the API
2026-04-27 08:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:48 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-04-28T15:36:16Z',
 'fuel_type': 'diesel',
 'id': '649d8a33-7597-50dc-ba0b-ba783fa71c38',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EH06782',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 180977,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2019-02-26',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Carat 4Motion BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Carat 4Motion BlueMotion Tech',
 'year': 2019}
2026-04-27 08:00:48 [auto1.fr] INFO: Saving data for EH06782: {'auction_closing_time': 1777390576.0, 'created_time': 1777021195.455022, 'has_photos': True, 'last_price_update_time': 1777276848.327335}
2026-04-27 08:00:48 [auto1.fr] INFO: Found listing with ID: JX82453
2026-04-27 08:00:48 [auto1.fr] INFO: Scrape type for JX82453: 2
2026-04-27 08:00:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1bd8926b-7219-5db1-a466-c33ee2969395 with identifier: JX82453
2026-04-27 08:00:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1bd8926b-7219-5db1-a466-c33ee2969395 with scrape type 2
2026-04-27 08:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1bd8926b-7219-5db1-a466-c33ee2969395 with scrape type 2
2026-04-27 08:00:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 1bd8926b-7219-5db1-a466-c33ee2969395, identifier: JX82453
2026-04-27 08:00:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 1bd8926b-7219-5db1-a466-c33ee2969395 with identifier: JX82453
2026-04-27 08:00:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 1bd8926b-7219-5db1-a466-c33ee2969395 with identifier: JX82453
2026-04-27 08:00:48 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 1bd8926b-7219-5db1-a466-c33ee2969395 with identifier: JX82453 to the API
2026-04-27 08:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:48 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-04-28T15:03:47Z',
 'fuel_type': 'diesel',
 'id': '1bd8926b-7219-5db1-a466-c33ee2969395',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JX82453',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 177691,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2017-10-25',
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 Blue-HDi Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2017}
2026-04-27 08:00:48 [auto1.fr] INFO: Saving data for JX82453: {'auction_closing_time': 1777388627.0, 'created_time': 1777020532.526052, 'has_photos': True, 'last_price_update_time': 1777276848.765549}
2026-04-27 08:00:48 [auto1.fr] INFO: Found listing with ID: KV19037
2026-04-27 08:00:48 [auto1.fr] INFO: Scrape type for KV19037: 2
2026-04-27 08:00:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f31b060d-7969-5668-9277-c31d002122ce with identifier: KV19037
2026-04-27 08:00:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f31b060d-7969-5668-9277-c31d002122ce with scrape type 2
2026-04-27 08:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f31b060d-7969-5668-9277-c31d002122ce with scrape type 2
2026-04-27 08:00:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f31b060d-7969-5668-9277-c31d002122ce, identifier: KV19037
2026-04-27 08:00:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f31b060d-7969-5668-9277-c31d002122ce with identifier: KV19037
2026-04-27 08:00:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f31b060d-7969-5668-9277-c31d002122ce with identifier: KV19037
2026-04-27 08:00:48 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f31b060d-7969-5668-9277-c31d002122ce with identifier: KV19037 to the API
2026-04-27 08:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:49 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-04-28T15:20:43Z',
 'fuel_type': 'petrol',
 'id': 'f31b060d-7969-5668-9277-c31d002122ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV19037',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 150054,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2016-06-08',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.2 N-Connecta',
 'transmission': 'automatic',
 'trim': 'N-Connecta',
 'year': 2016}
2026-04-27 08:00:49 [auto1.fr] INFO: Saving data for KV19037: {'auction_closing_time': 1777389643.0, 'created_time': 1777020846.205678, 'has_photos': True, 'last_price_update_time': 1777276849.160673}
2026-04-27 08:00:49 [auto1.fr] INFO: Found listing with ID: ZA28436
2026-04-27 08:00:49 [auto1.fr] INFO: Scrape type for ZA28436: 2
2026-04-27 08:00:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f251825-8768-587f-8c6a-18e7e86b2c0a with identifier: ZA28436
2026-04-27 08:00:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f251825-8768-587f-8c6a-18e7e86b2c0a with scrape type 2
2026-04-27 08:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f251825-8768-587f-8c6a-18e7e86b2c0a with scrape type 2
2026-04-27 08:00:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0f251825-8768-587f-8c6a-18e7e86b2c0a, identifier: ZA28436
2026-04-27 08:00:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0f251825-8768-587f-8c6a-18e7e86b2c0a with identifier: ZA28436
2026-04-27 08:00:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0f251825-8768-587f-8c6a-18e7e86b2c0a with identifier: ZA28436
2026-04-27 08:00:49 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 0f251825-8768-587f-8c6a-18e7e86b2c0a with identifier: ZA28436 to the API
2026-04-27 08:00:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:49 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-04-28T15:12:46Z',
 'fuel_type': 'diesel',
 'id': '0f251825-8768-587f-8c6a-18e7e86b2c0a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZA28436',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 155368,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2020-02-17',
 'seller_name': None,
 'title': 'BMW X1 sDrive 18d Lounge',
 'transmission': 'automatic',
 'trim': 'Lounge',
 'year': 2020}
2026-04-27 08:00:49 [auto1.fr] INFO: Saving data for ZA28436: {'auction_closing_time': 1777389166.0, 'created_time': 1777021423.85678, 'has_photos': True, 'last_price_update_time': 1777276849.57557}
2026-04-27 08:00:49 [auto1.fr] INFO: Found listing with ID: NC91580
2026-04-27 08:00:49 [auto1.fr] INFO: Scrape type for NC91580: 2
2026-04-27 08:00:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65e89ff0-0a37-5348-8d2b-80903fe87970 with identifier: NC91580
2026-04-27 08:00:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65e89ff0-0a37-5348-8d2b-80903fe87970 with scrape type 2
2026-04-27 08:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 65e89ff0-0a37-5348-8d2b-80903fe87970 with scrape type 2
2026-04-27 08:00:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 65e89ff0-0a37-5348-8d2b-80903fe87970, identifier: NC91580
2026-04-27 08:00:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 65e89ff0-0a37-5348-8d2b-80903fe87970 with identifier: NC91580
2026-04-27 08:00:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 65e89ff0-0a37-5348-8d2b-80903fe87970 with identifier: NC91580
2026-04-27 08:00:49 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 65e89ff0-0a37-5348-8d2b-80903fe87970 with identifier: NC91580 to the API
2026-04-27 08:00:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:49 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 300,
 'expiration_date': '2026-04-28T15:10:45Z',
 'fuel_type': 'hybrid',
 'id': '65e89ff0-0a37-5348-8d2b-80903fe87970',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NC91580',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Opel',
 'model': 'Grandland X',
 'odometer': 77542,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2020-06-16',
 'seller_name': None,
 'title': 'Opel Grandland X 1.6 Plug-in Hybrid 4 Elite',
 'transmission': 'automatic',
 'trim': 'Elite',
 'year': 2020}
2026-04-27 08:00:49 [auto1.fr] INFO: Saving data for NC91580: {'auction_closing_time': 1777389045.0, 'created_time': 1777022221.443747, 'has_photos': True, 'last_price_update_time': 1777276849.958049}
2026-04-27 08:00:49 [auto1.fr] INFO: Found listing with ID: LF93069
2026-04-27 08:00:49 [auto1.fr] INFO: Scrape type for LF93069: 2
2026-04-27 08:00:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d54034ba-697e-59f5-8f1c-10a7bc7905f2 with identifier: LF93069
2026-04-27 08:00:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d54034ba-697e-59f5-8f1c-10a7bc7905f2 with scrape type 2
2026-04-27 08:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d54034ba-697e-59f5-8f1c-10a7bc7905f2 with scrape type 2
2026-04-27 08:00:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d54034ba-697e-59f5-8f1c-10a7bc7905f2, identifier: LF93069
2026-04-27 08:00:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d54034ba-697e-59f5-8f1c-10a7bc7905f2 with identifier: LF93069
2026-04-27 08:00:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d54034ba-697e-59f5-8f1c-10a7bc7905f2 with identifier: LF93069
2026-04-27 08:00:50 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: d54034ba-697e-59f5-8f1c-10a7bc7905f2 with identifier: LF93069 to the API
2026-04-27 08:00:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:50 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 107,
 'expiration_date': '2026-04-28T15:26:51Z',
 'fuel_type': 'diesel',
 'id': 'd54034ba-697e-59f5-8f1c-10a7bc7905f2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LF93069',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 172587,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2010-11-03',
 'seller_name': None,
 'title': 'Dacia Duster 1.5 dCi Prestige 4x2',
 'transmission': 'manual',
 'trim': 'Prestige 4x2',
 'year': 2010}
2026-04-27 08:00:50 [auto1.fr] INFO: Saving data for LF93069: {'auction_closing_time': 1777390011.0, 'created_time': 1777019363.671191, 'has_photos': True, 'last_price_update_time': 1777276850.376823}
2026-04-27 08:00:50 [auto1.fr] INFO: Found listing with ID: PK02389
2026-04-27 08:00:50 [auto1.fr] INFO: Scrape type for PK02389: 2
2026-04-27 08:00:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68ba7d46-0b17-5aa5-8cee-132abb0a7003 with identifier: PK02389
2026-04-27 08:00:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68ba7d46-0b17-5aa5-8cee-132abb0a7003 with scrape type 2
2026-04-27 08:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 68ba7d46-0b17-5aa5-8cee-132abb0a7003 with scrape type 2
2026-04-27 08:00:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 68ba7d46-0b17-5aa5-8cee-132abb0a7003, identifier: PK02389
2026-04-27 08:00:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 68ba7d46-0b17-5aa5-8cee-132abb0a7003 with identifier: PK02389
2026-04-27 08:00:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 68ba7d46-0b17-5aa5-8cee-132abb0a7003 with identifier: PK02389
2026-04-27 08:00:50 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 68ba7d46-0b17-5aa5-8cee-132abb0a7003 with identifier: PK02389 to the API
2026-04-27 08:00:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:50 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-04-28T15:11:20Z',
 'fuel_type': 'diesel',
 'id': '68ba7d46-0b17-5aa5-8cee-132abb0a7003',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PK02389',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 161493,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2016-03-28',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 220 d 4Matic Executive',
 'transmission': 'automatic',
 'trim': '4Matic Executive',
 'year': 2016}
2026-04-27 08:00:50 [auto1.fr] INFO: Saving data for PK02389: {'auction_closing_time': 1777389080.0, 'created_time': 1777020898.951053, 'has_photos': True, 'last_price_update_time': 1777276850.781351}
2026-04-27 08:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YR94758/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KL75694/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RK33125> (referer: https://www.auto1.com/v1/car-details-view/RK33125/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 59916a69-6f3c-54b4-9243-fa4b76ee6aa2 with identifier: RK33125
2026-04-27 08:00:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59916a69-6f3c-54b4-9243-fa4b76ee6aa2 with scrape type 1
2026-04-27 08:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 59916a69-6f3c-54b4-9243-fa4b76ee6aa2
2026-04-27 08:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/15/7f15e4bd84b1260bbec8c4b6c01bd346/pa/RK33125_512eeb9f708ceb6f16375fa6e38d5237.jpg not downloaded yet
2026-04-27 08:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/15/7f15e4bd84b1260bbec8c4b6c01bd346/pa/RK33125_e26be72bede089e8558ae821e073adbd.jpg not downloaded yet
2026-04-27 08:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/15/7f15e4bd84b1260bbec8c4b6c01bd346/pa/RK33125_e3a9b2235e0c773853d8a18e1e35fa5b.jpg not downloaded yet
2026-04-27 08:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/15/7f15e4bd84b1260bbec8c4b6c01bd346/pa/RK33125_51801680ec9ace813d05b9f7d4efac05.jpg not downloaded yet
2026-04-27 08:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/15/7f15e4bd84b1260bbec8c4b6c01bd346/pa/RK33125_43cd8dc73dfe04daf409d896826b9897.jpg not downloaded yet
2026-04-27 08:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/15/7f15e4bd84b1260bbec8c4b6c01bd346/pa/RK33125_d87104a730f5aaa9cda78026bcb85003.jpg not downloaded yet
2026-04-27 08:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/15/7f15e4bd84b1260bbec8c4b6c01bd346/pa/RK33125_40354e7802d61d1f7e1df44d8dc00b29.jpg not downloaded yet
2026-04-27 08:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/15/7f15e4bd84b1260bbec8c4b6c01bd346/pa/RK33125_9fcd1f7feedd6e5ba234eacfdb808857.jpg not downloaded yet
2026-04-27 08:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/15/7f15e4bd84b1260bbec8c4b6c01bd346/pa/RK33125_224015186033c3cebcc7a0c2c76491a9.jpg not downloaded yet
2026-04-27 08:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/15/7f15e4bd84b1260bbec8c4b6c01bd346/pa/RK33125_9234d7a863a9ec1bdb62a19679a59003.jpg not downloaded yet
2026-04-27 08:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JJ39391> (referer: https://www.auto1.com/v1/car-details-view/JJ39391/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MB19012/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5bc3fe21-199a-5ca9-8985-43240aa7b714 with identifier: JJ39391
2026-04-27 08:00:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5bc3fe21-199a-5ca9-8985-43240aa7b714 with scrape type 1
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5bc3fe21-199a-5ca9-8985-43240aa7b714
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/0e/f20e9a1dbde3617110cf1c00f42ff792/pa/JJ39391_8d3829c1db64fd160761e8b582699ff8.jpg not downloaded yet
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/0e/f20e9a1dbde3617110cf1c00f42ff792/pa/JJ39391_00010af21b8ad33be75e6b1cc81577c5.jpg not downloaded yet
2026-04-27 08:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/15/7f15e4bd84b1260bbec8c4b6c01bd346/pa/RK33125_224015186033c3cebcc7a0c2c76491a9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/0e/f20e9a1dbde3617110cf1c00f42ff792/pa/JJ39391_89565992b1051aaf08a62b40a332fb93.jpg not downloaded yet
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/0e/f20e9a1dbde3617110cf1c00f42ff792/pa/JJ39391_2906dfe7eba022902b041ddfa74ddb77.jpg not downloaded yet
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/0e/f20e9a1dbde3617110cf1c00f42ff792/pa/JJ39391_9e4dabb849fbe449d4fd185bfdf5447a.jpg not downloaded yet
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/0e/f20e9a1dbde3617110cf1c00f42ff792/pa/JJ39391_ef2802fa399fceecfd678808bb9ee79c.jpg not downloaded yet
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/0e/f20e9a1dbde3617110cf1c00f42ff792/pa/JJ39391_74da8550c33e8cb04c0cd6357f657d31.jpg not downloaded yet
2026-04-27 08:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/15/7f15e4bd84b1260bbec8c4b6c01bd346/pa/RK33125_9234d7a863a9ec1bdb62a19679a59003.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/0e/f20e9a1dbde3617110cf1c00f42ff792/pa/JJ39391_b0b087a0e7beb7659ce669f3e83d4d6d.jpg not downloaded yet
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/0e/f20e9a1dbde3617110cf1c00f42ff792/pa/JJ39391_f8e4a3caf975a445e74fe2b79d9cbb75.jpg not downloaded yet
2026-04-27 08:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/0e/f20e9a1dbde3617110cf1c00f42ff792/pa/JJ39391_00010af21b8ad33be75e6b1cc81577c5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/0e/f20e9a1dbde3617110cf1c00f42ff792/pa/JJ39391_3bebf12022d63eefec68af95e3b3dd73.jpg not downloaded yet
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143818a190>
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59916a69-6f3c-54b4-9243-fa4b76ee6aa2/59916a69-6f3c-54b4-9243-fa4b76ee6aa2_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/15/7f15e4bd84b1260bbec8c4b6c01bd346/pa/RK33125_224015186033c3cebcc7a0c2c76491a9.jpg saved to cache
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 59916a69-6f3c-54b4-9243-fa4b76ee6aa2
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d2e610>
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59916a69-6f3c-54b4-9243-fa4b76ee6aa2/59916a69-6f3c-54b4-9243-fa4b76ee6aa2_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/15/7f15e4bd84b1260bbec8c4b6c01bd346/pa/RK33125_9234d7a863a9ec1bdb62a19679a59003.jpg saved to cache
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 59916a69-6f3c-54b4-9243-fa4b76ee6aa2
2026-04-27 08:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/0e/f20e9a1dbde3617110cf1c00f42ff792/pa/JJ39391_f8e4a3caf975a445e74fe2b79d9cbb75.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/0e/f20e9a1dbde3617110cf1c00f42ff792/pa/JJ39391_74da8550c33e8cb04c0cd6357f657d31.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d35950>
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bc3fe21-199a-5ca9-8985-43240aa7b714/5bc3fe21-199a-5ca9-8985-43240aa7b714_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/0e/f20e9a1dbde3617110cf1c00f42ff792/pa/JJ39391_00010af21b8ad33be75e6b1cc81577c5.jpg saved to cache
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5bc3fe21-199a-5ca9-8985-43240aa7b714
2026-04-27 08:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/0e/f20e9a1dbde3617110cf1c00f42ff792/pa/JJ39391_3bebf12022d63eefec68af95e3b3dd73.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/0e/f20e9a1dbde3617110cf1c00f42ff792/pa/JJ39391_b0b087a0e7beb7659ce669f3e83d4d6d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14381cdc50>
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bc3fe21-199a-5ca9-8985-43240aa7b714/5bc3fe21-199a-5ca9-8985-43240aa7b714_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/0e/f20e9a1dbde3617110cf1c00f42ff792/pa/JJ39391_f8e4a3caf975a445e74fe2b79d9cbb75.jpg saved to cache
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5bc3fe21-199a-5ca9-8985-43240aa7b714
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143809ca90>
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bc3fe21-199a-5ca9-8985-43240aa7b714/5bc3fe21-199a-5ca9-8985-43240aa7b714_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/0e/f20e9a1dbde3617110cf1c00f42ff792/pa/JJ39391_74da8550c33e8cb04c0cd6357f657d31.jpg saved to cache
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5bc3fe21-199a-5ca9-8985-43240aa7b714
2026-04-27 08:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142be1b710>
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bc3fe21-199a-5ca9-8985-43240aa7b714/5bc3fe21-199a-5ca9-8985-43240aa7b714_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/0e/f20e9a1dbde3617110cf1c00f42ff792/pa/JJ39391_3bebf12022d63eefec68af95e3b3dd73.jpg saved to cache
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5bc3fe21-199a-5ca9-8985-43240aa7b714
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a61250>
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bc3fe21-199a-5ca9-8985-43240aa7b714/5bc3fe21-199a-5ca9-8985-43240aa7b714_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/0e/f20e9a1dbde3617110cf1c00f42ff792/pa/JJ39391_b0b087a0e7beb7659ce669f3e83d4d6d.jpg saved to cache
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5bc3fe21-199a-5ca9-8985-43240aa7b714
2026-04-27 08:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/0e/f20e9a1dbde3617110cf1c00f42ff792/pa/JJ39391_ef2802fa399fceecfd678808bb9ee79c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KW37033/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SY30151/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/0e/f20e9a1dbde3617110cf1c00f42ff792/pa/JJ39391_9e4dabb849fbe449d4fd185bfdf5447a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ES75996> (referer: https://www.auto1.com/v1/car-details-view/ES75996/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:57 [auto1.fr] INFO: Channel: 24h | Page: 12 | totalHits: 4744 | hits on page: 40
2026-04-27 08:00:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bffc890>
2026-04-27 08:00:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bc3fe21-199a-5ca9-8985-43240aa7b714/5bc3fe21-199a-5ca9-8985-43240aa7b714_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/0e/f20e9a1dbde3617110cf1c00f42ff792/pa/JJ39391_ef2802fa399fceecfd678808bb9ee79c.jpg saved to cache
2026-04-27 08:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5bc3fe21-199a-5ca9-8985-43240aa7b714
2026-04-27 08:00:57 [auto1.fr] INFO: Found listing with ID: LG63023
2026-04-27 08:00:57 [auto1.fr] INFO: Scrape type for LG63023: 1
2026-04-27 08:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/0e/f20e9a1dbde3617110cf1c00f42ff792/pa/JJ39391_8d3829c1db64fd160761e8b582699ff8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/0e/f20e9a1dbde3617110cf1c00f42ff792/pa/JJ39391_2906dfe7eba022902b041ddfa74ddb77.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/0e/f20e9a1dbde3617110cf1c00f42ff792/pa/JJ39391_89565992b1051aaf08a62b40a332fb93.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:57 [auto1.fr] INFO: Found listing with ID: CS54070
2026-04-27 08:00:57 [auto1.fr] INFO: Scrape type for CS54070: 1
2026-04-27 08:00:57 [auto1.fr] INFO: Found listing with ID: YH02225
2026-04-27 08:00:57 [auto1.fr] INFO: Scrape type for YH02225: 2
2026-04-27 08:00:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0753ae77-e7c7-5b75-b5b7-515cf216b748 with identifier: YH02225
2026-04-27 08:00:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0753ae77-e7c7-5b75-b5b7-515cf216b748 with scrape type 2
2026-04-27 08:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0753ae77-e7c7-5b75-b5b7-515cf216b748 with scrape type 2
2026-04-27 08:00:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0753ae77-e7c7-5b75-b5b7-515cf216b748, identifier: YH02225
2026-04-27 08:00:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0753ae77-e7c7-5b75-b5b7-515cf216b748 with identifier: YH02225
2026-04-27 08:00:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0753ae77-e7c7-5b75-b5b7-515cf216b748 with identifier: YH02225
2026-04-27 08:00:57 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 0753ae77-e7c7-5b75-b5b7-515cf216b748 with identifier: YH02225 to the API
2026-04-27 08:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:57 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-04-28T15:04:55Z',
 'fuel_type': 'diesel',
 'id': '0753ae77-e7c7-5b75-b5b7-515cf216b748',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH02225',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Audi',
 'model': 'A4 Allroad',
 'odometer': 208487,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2014-10-15',
 'seller_name': None,
 'title': 'Audi A4 Allroad 2.0 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-04-27 08:00:57 [auto1.fr] INFO: Saving data for YH02225: {'auction_closing_time': 1777388695.0, 'created_time': 1777022237.877206, 'has_photos': True, 'last_price_update_time': 1777276857.630474}
2026-04-27 08:00:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438cf8a50>
2026-04-27 08:00:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bc3fe21-199a-5ca9-8985-43240aa7b714/5bc3fe21-199a-5ca9-8985-43240aa7b714_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/0e/f20e9a1dbde3617110cf1c00f42ff792/pa/JJ39391_9e4dabb849fbe449d4fd185bfdf5447a.jpg saved to cache
2026-04-27 08:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5bc3fe21-199a-5ca9-8985-43240aa7b714
2026-04-27 08:00:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b87b37dd-bb05-57ca-9480-c8a45accf666 with identifier: ES75996
2026-04-27 08:00:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b87b37dd-bb05-57ca-9480-c8a45accf666 with scrape type 1
2026-04-27 08:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b87b37dd-bb05-57ca-9480-c8a45accf666
2026-04-27 08:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/ed/55edeacb5dfe4d1f0eff4388c4e774f9/pa/ES75996_97c2e715d7872df4dc07c29f6290ea89.jpg not downloaded yet
2026-04-27 08:00:57 [auto1.fr] INFO: Found listing with ID: WP26002
2026-04-27 08:00:57 [auto1.fr] INFO: Scrape type for WP26002: 1
2026-04-27 08:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/15/7f15e4bd84b1260bbec8c4b6c01bd346/pa/RK33125_9fcd1f7feedd6e5ba234eacfdb808857.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/15/7f15e4bd84b1260bbec8c4b6c01bd346/pa/RK33125_40354e7802d61d1f7e1df44d8dc00b29.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/ed/55edeacb5dfe4d1f0eff4388c4e774f9/pa/ES75996_a126b69be1288b650d39af6e50cd4857.jpg not downloaded yet
2026-04-27 08:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RR97759/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ecac10>
2026-04-27 08:00:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bc3fe21-199a-5ca9-8985-43240aa7b714/5bc3fe21-199a-5ca9-8985-43240aa7b714_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/0e/f20e9a1dbde3617110cf1c00f42ff792/pa/JJ39391_8d3829c1db64fd160761e8b582699ff8.jpg saved to cache
2026-04-27 08:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5bc3fe21-199a-5ca9-8985-43240aa7b714
2026-04-27 08:00:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bf03310>
2026-04-27 08:00:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bc3fe21-199a-5ca9-8985-43240aa7b714/5bc3fe21-199a-5ca9-8985-43240aa7b714_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/0e/f20e9a1dbde3617110cf1c00f42ff792/pa/JJ39391_2906dfe7eba022902b041ddfa74ddb77.jpg saved to cache
2026-04-27 08:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5bc3fe21-199a-5ca9-8985-43240aa7b714
2026-04-27 08:00:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142be083d0>
2026-04-27 08:00:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bc3fe21-199a-5ca9-8985-43240aa7b714/5bc3fe21-199a-5ca9-8985-43240aa7b714_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/0e/f20e9a1dbde3617110cf1c00f42ff792/pa/JJ39391_89565992b1051aaf08a62b40a332fb93.jpg saved to cache
2026-04-27 08:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5bc3fe21-199a-5ca9-8985-43240aa7b714
2026-04-27 08:00:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5bc3fe21-199a-5ca9-8985-43240aa7b714, skipping ID generation
2026-04-27 08:00:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5bc3fe21-199a-5ca9-8985-43240aa7b714 with scrape type 1
2026-04-27 08:00:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5bc3fe21-199a-5ca9-8985-43240aa7b714 sending to next pipeline
2026-04-27 08:00:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5bc3fe21-199a-5ca9-8985-43240aa7b714, identifier: JJ39391
2026-04-27 08:00:58 [auto1.fr] INFO: Found listing with ID: JD28773
2026-04-27 08:00:58 [auto1.fr] INFO: Scrape type for JD28773: 2
2026-04-27 08:00:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 411bca6c-14bf-546c-9776-02015100eed3 with identifier: JD28773
2026-04-27 08:00:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 411bca6c-14bf-546c-9776-02015100eed3 with scrape type 2
2026-04-27 08:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 411bca6c-14bf-546c-9776-02015100eed3 with scrape type 2
2026-04-27 08:00:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 411bca6c-14bf-546c-9776-02015100eed3, identifier: JD28773
2026-04-27 08:00:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ME56071> (referer: https://www.auto1.com/v1/car-details-view/ME56071/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RV01663/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5bc3fe21-199a-5ca9-8985-43240aa7b714 with identifier: JJ39391
2026-04-27 08:00:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5bc3fe21-199a-5ca9-8985-43240aa7b714 with identifier: JJ39391
2026-04-27 08:00:58 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 5bc3fe21-199a-5ca9-8985-43240aa7b714 with identifier: JJ39391 to the API
2026-04-27 08:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:58 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf2/0e/f20e9a1dbde3617110cf1c00f42ff792/pa/JJ39391_89565992b1051aaf08a62b40a332fb93.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'city': 'Beauzelle',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 140,
 'expiration_date': '2026-04-28T15:04:07Z',
 'fuel_type': 'petrol',
 'id': '5bc3fe21-199a-5ca9-8985-43240aa7b714',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 43.6671,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JJ39391',
 'listing': 'auction',
 'location': 'FR, Beauzelle',
 'location_confidence': 'geocoded',
 'longitude': 1.3752,
 'make': 'Abarth',
 'model': '500',
 'odometer': 89145,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5bc3fe21-199a-5ca9-8985-43240aa7b714/5bc3fe21-199a-5ca9-8985-43240aa7b714_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66101,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/0e/f20e9a1dbde3617110cf1c00f42ff792/pa/JJ39391_8d3829c1db64fd160761e8b582699ff8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5bc3fe21-199a-5ca9-8985-43240aa7b714/5bc3fe21-199a-5ca9-8985-43240aa7b714_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67663,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/0e/f20e9a1dbde3617110cf1c00f42ff792/pa/JJ39391_00010af21b8ad33be75e6b1cc81577c5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5bc3fe21-199a-5ca9-8985-43240aa7b714/5bc3fe21-199a-5ca9-8985-43240aa7b714_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69488,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/0e/f20e9a1dbde3617110cf1c00f42ff792/pa/JJ39391_89565992b1051aaf08a62b40a332fb93.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5bc3fe21-199a-5ca9-8985-43240aa7b714/5bc3fe21-199a-5ca9-8985-43240aa7b714_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58475,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/0e/f20e9a1dbde3617110cf1c00f42ff792/pa/JJ39391_2906dfe7eba022902b041ddfa74ddb77.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5bc3fe21-199a-5ca9-8985-43240aa7b714/5bc3fe21-199a-5ca9-8985-43240aa7b714_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78062,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/0e/f20e9a1dbde3617110cf1c00f42ff792/pa/JJ39391_9e4dabb849fbe449d4fd185bfdf5447a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5bc3fe21-199a-5ca9-8985-43240aa7b714/5bc3fe21-199a-5ca9-8985-43240aa7b714_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67009,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/0e/f20e9a1dbde3617110cf1c00f42ff792/pa/JJ39391_ef2802fa399fceecfd678808bb9ee79c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5bc3fe21-199a-5ca9-8985-43240aa7b714/5bc3fe21-199a-5ca9-8985-43240aa7b714_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59049,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/0e/f20e9a1dbde3617110cf1c00f42ff792/pa/JJ39391_74da8550c33e8cb04c0cd6357f657d31.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5bc3fe21-199a-5ca9-8985-43240aa7b714/5bc3fe21-199a-5ca9-8985-43240aa7b714_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67044,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/0e/f20e9a1dbde3617110cf1c00f42ff792/pa/JJ39391_b0b087a0e7beb7659ce669f3e83d4d6d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5bc3fe21-199a-5ca9-8985-43240aa7b714/5bc3fe21-199a-5ca9-8985-43240aa7b714_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62467,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/0e/f20e9a1dbde3617110cf1c00f42ff792/pa/JJ39391_f8e4a3caf975a445e74fe2b79d9cbb75.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5bc3fe21-199a-5ca9-8985-43240aa7b714/5bc3fe21-199a-5ca9-8985-43240aa7b714_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75214,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/0e/f20e9a1dbde3617110cf1c00f42ff792/pa/JJ39391_3bebf12022d63eefec68af95e3b3dd73.jpg',
             'Width': 800}],
 'postal_code': '31700',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Haute-Garonne',
 'province_code': 'FR-31',
 'region': 'Occitanie',
 'region_code': 'FR-76',
 'registration_date': '2016-03-31',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Abarth 500 1.4 Turbo',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-04-27 08:00:58 [auto1.fr] INFO: Saving data for JJ39391: {'created_time': 1777276858.640045, 'last_price_update_time': 1777276858.640058, 'has_photos': True, 'auction_closing_time': 1777388647.0}
2026-04-27 08:00:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 411bca6c-14bf-546c-9776-02015100eed3 with identifier: JD28773
2026-04-27 08:00:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 411bca6c-14bf-546c-9776-02015100eed3 with identifier: JD28773
2026-04-27 08:00:58 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 411bca6c-14bf-546c-9776-02015100eed3 with identifier: JD28773 to the API
2026-04-27 08:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:58 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-04-28T15:36:41Z',
 'fuel_type': 'petrol',
 'id': '411bca6c-14bf-546c-9776-02015100eed3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JD28773',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Peugeot',
 'model': '208',
 'odometer': 88975,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2020-10-25',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech GT Line',
 'transmission': 'manual',
 'trim': 'GT Line',
 'year': 2020}
2026-04-27 08:00:58 [auto1.fr] INFO: Saving data for JD28773: {'auction_closing_time': 1777390601.0, 'created_time': 1777022350.296883, 'has_photos': True, 'last_price_update_time': 1777276858.95168}
2026-04-27 08:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/ed/55edeacb5dfe4d1f0eff4388c4e774f9/pa/ES75996_4e75a191aea206ac0dbab24662a58b8a.jpg not downloaded yet
2026-04-27 08:00:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:58 [auto1.fr] INFO: Found listing with ID: HM93344
2026-04-27 08:00:59 [auto1.fr] INFO: Scrape type for HM93344: 2
2026-04-27 08:00:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ef7e75b-1edb-5dec-aa57-77a7f04574b5 with identifier: HM93344
2026-04-27 08:00:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ef7e75b-1edb-5dec-aa57-77a7f04574b5 with scrape type 2
2026-04-27 08:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9ef7e75b-1edb-5dec-aa57-77a7f04574b5 with scrape type 2
2026-04-27 08:00:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 9ef7e75b-1edb-5dec-aa57-77a7f04574b5, identifier: HM93344
2026-04-27 08:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AC55074/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a82a10>
2026-04-27 08:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59916a69-6f3c-54b4-9243-fa4b76ee6aa2/59916a69-6f3c-54b4-9243-fa4b76ee6aa2_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/15/7f15e4bd84b1260bbec8c4b6c01bd346/pa/RK33125_9fcd1f7feedd6e5ba234eacfdb808857.jpg saved to cache
2026-04-27 08:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 59916a69-6f3c-54b4-9243-fa4b76ee6aa2
2026-04-27 08:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d30890>
2026-04-27 08:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59916a69-6f3c-54b4-9243-fa4b76ee6aa2/59916a69-6f3c-54b4-9243-fa4b76ee6aa2_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/15/7f15e4bd84b1260bbec8c4b6c01bd346/pa/RK33125_40354e7802d61d1f7e1df44d8dc00b29.jpg saved to cache
2026-04-27 08:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 59916a69-6f3c-54b4-9243-fa4b76ee6aa2
2026-04-27 08:00:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 9ef7e75b-1edb-5dec-aa57-77a7f04574b5 with identifier: HM93344
2026-04-27 08:00:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 9ef7e75b-1edb-5dec-aa57-77a7f04574b5 with identifier: HM93344
2026-04-27 08:00:59 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 9ef7e75b-1edb-5dec-aa57-77a7f04574b5 with identifier: HM93344 to the API
2026-04-27 08:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:59 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-04-28T15:34:56Z',
 'fuel_type': 'diesel',
 'id': '9ef7e75b-1edb-5dec-aa57-77a7f04574b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HM93344',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 231365,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2015-09-20',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 d BlueTEC AMG Line',
 'transmission': 'automatic',
 'trim': 'BlueTEC AMG Line',
 'year': 2015}
2026-04-27 08:00:59 [auto1.fr] INFO: Saving data for HM93344: {'auction_closing_time': 1777390496.0, 'created_time': 1777022102.065075, 'has_photos': True, 'last_price_update_time': 1777276859.54099}
2026-04-27 08:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/ed/55edeacb5dfe4d1f0eff4388c4e774f9/pa/ES75996_db6831132383964e7c28ebfbdaa5f62e.jpg not downloaded yet
2026-04-27 08:00:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/ed/55edeacb5dfe4d1f0eff4388c4e774f9/pa/ES75996_97c2e715d7872df4dc07c29f6290ea89.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:59 [auto1.fr] INFO: Found listing with ID: CU34135
2026-04-27 08:00:59 [auto1.fr] INFO: Scrape type for CU34135: 2
2026-04-27 08:00:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc76e4a6-27c0-5187-bc1a-78c296ad8cfe with identifier: CU34135
2026-04-27 08:00:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc76e4a6-27c0-5187-bc1a-78c296ad8cfe with scrape type 2
2026-04-27 08:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bc76e4a6-27c0-5187-bc1a-78c296ad8cfe with scrape type 2
2026-04-27 08:00:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: bc76e4a6-27c0-5187-bc1a-78c296ad8cfe, identifier: CU34135
2026-04-27 08:00:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6c13646-eae3-5047-adc8-149922bde6d6 with identifier: ME56071
2026-04-27 08:00:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6c13646-eae3-5047-adc8-149922bde6d6 with scrape type 1
2026-04-27 08:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e6c13646-eae3-5047-adc8-149922bde6d6
2026-04-27 08:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/ee/57ee939dbc6037af254f3298d373abec/pa/ME56071_6cb88251bebceafeab7f774187711862.jpg not downloaded yet
2026-04-27 08:00:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: bc76e4a6-27c0-5187-bc1a-78c296ad8cfe with identifier: CU34135
2026-04-27 08:00:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: bc76e4a6-27c0-5187-bc1a-78c296ad8cfe with identifier: CU34135
2026-04-27 08:00:59 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: bc76e4a6-27c0-5187-bc1a-78c296ad8cfe with identifier: CU34135 to the API
2026-04-27 08:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:59 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-04-28T15:30:38Z',
 'fuel_type': 'diesel',
 'id': 'bc76e4a6-27c0-5187-bc1a-78c296ad8cfe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CU34135',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 253733,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2011-06-06',
 'seller_name': None,
 'title': 'Renault Megane 1.5 dCi Dynamique',
 'transmission': 'manual',
 'trim': 'Dynamique',
 'year': 2011}
2026-04-27 08:01:00 [auto1.fr] INFO: Saving data for CU34135: {'auction_closing_time': 1777390238.0, 'created_time': 1777021707.292035, 'has_photos': True, 'last_price_update_time': 1777276860.006058}
2026-04-27 08:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/ed/55edeacb5dfe4d1f0eff4388c4e774f9/pa/ES75996_a31ba0b9a7776cd3b2abd12965d0ab9b.jpg not downloaded yet
2026-04-27 08:01:00 [auto1.fr] INFO: Found listing with ID: PA65311
2026-04-27 08:01:00 [auto1.fr] INFO: Scrape type for PA65311: 1
2026-04-27 08:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/ee/57ee939dbc6037af254f3298d373abec/pa/ME56071_37b6813a0f96c5c5d5b2e2090610bcf2.jpg not downloaded yet
2026-04-27 08:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/ed/55edeacb5dfe4d1f0eff4388c4e774f9/pa/ES75996_a126b69be1288b650d39af6e50cd4857.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:00 [scrapy.extensions.logstats] INFO: Crawled 299 pages (at 44 pages/min), scraped 262 items (at 42 items/min)
2026-04-27 08:01:00 [scrapy.extensions.memusage] INFO: Peak memory usage is 373MiB
2026-04-27 08:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/ed/55edeacb5dfe4d1f0eff4388c4e774f9/pa/ES75996_c1c9b063ac7502c80b3d639bd1b9618f.jpg not downloaded yet
2026-04-27 08:01:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1453cbea10>
2026-04-27 08:01:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b87b37dd-bb05-57ca-9480-c8a45accf666/b87b37dd-bb05-57ca-9480-c8a45accf666_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/ed/55edeacb5dfe4d1f0eff4388c4e774f9/pa/ES75996_97c2e715d7872df4dc07c29f6290ea89.jpg saved to cache
2026-04-27 08:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b87b37dd-bb05-57ca-9480-c8a45accf666
2026-04-27 08:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/ed/55edeacb5dfe4d1f0eff4388c4e774f9/pa/ES75996_4e75a191aea206ac0dbab24662a58b8a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:00 [auto1.fr] INFO: Found listing with ID: UL15311
2026-04-27 08:01:00 [auto1.fr] INFO: Scrape type for UL15311: 1
2026-04-27 08:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/ee/57ee939dbc6037af254f3298d373abec/pa/ME56071_85e2aa97a2056fd887cb00ddd9d609a7.jpg not downloaded yet
2026-04-27 08:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VR99778> (referer: https://www.auto1.com/v1/car-details-view/VR99778/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/ed/55edeacb5dfe4d1f0eff4388c4e774f9/pa/ES75996_16d708c93f65bcf8c15ee8b3eb98fa3f.jpg not downloaded yet
2026-04-27 08:01:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:00 [auto1.fr] INFO: Found listing with ID: SN62809
2026-04-27 08:01:00 [auto1.fr] INFO: Scrape type for SN62809: 1
2026-04-27 08:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/ee/57ee939dbc6037af254f3298d373abec/pa/ME56071_5d7d828cc48824c62b83fc84f4734907.jpg not downloaded yet
2026-04-27 08:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/ed/55edeacb5dfe4d1f0eff4388c4e774f9/pa/ES75996_63cc3ac2ec737c00ccb5fce071506529.jpg not downloaded yet
2026-04-27 08:01:00 [auto1.fr] INFO: Found listing with ID: YT50329
2026-04-27 08:01:00 [auto1.fr] INFO: Scrape type for YT50329: 1
2026-04-27 08:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/ee/57ee939dbc6037af254f3298d373abec/pa/ME56071_7e233fe00c4c26f6a1c96eba22bf39fe.jpg not downloaded yet
2026-04-27 08:01:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c34e10>
2026-04-27 08:01:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b87b37dd-bb05-57ca-9480-c8a45accf666/b87b37dd-bb05-57ca-9480-c8a45accf666_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/ed/55edeacb5dfe4d1f0eff4388c4e774f9/pa/ES75996_a126b69be1288b650d39af6e50cd4857.jpg saved to cache
2026-04-27 08:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b87b37dd-bb05-57ca-9480-c8a45accf666
2026-04-27 08:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/ed/55edeacb5dfe4d1f0eff4388c4e774f9/pa/ES75996_a31ba0b9a7776cd3b2abd12965d0ab9b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/ed/55edeacb5dfe4d1f0eff4388c4e774f9/pa/ES75996_196d06d4b8a8e6892c8f9dfc3d716f83.jpg not downloaded yet
2026-04-27 08:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/ee/57ee939dbc6037af254f3298d373abec/pa/ME56071_37b6813a0f96c5c5d5b2e2090610bcf2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:00 [auto1.fr] INFO: Found listing with ID: BS21555
2026-04-27 08:01:00 [auto1.fr] INFO: Scrape type for BS21555: 1
2026-04-27 08:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/ee/57ee939dbc6037af254f3298d373abec/pa/ME56071_695e2d177d856361d595402295fb736d.jpg not downloaded yet
2026-04-27 08:01:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bfd2bd0>
2026-04-27 08:01:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b87b37dd-bb05-57ca-9480-c8a45accf666/b87b37dd-bb05-57ca-9480-c8a45accf666_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/ed/55edeacb5dfe4d1f0eff4388c4e774f9/pa/ES75996_4e75a191aea206ac0dbab24662a58b8a.jpg saved to cache
2026-04-27 08:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b87b37dd-bb05-57ca-9480-c8a45accf666
2026-04-27 08:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/ed/55edeacb5dfe4d1f0eff4388c4e774f9/pa/ES75996_9a7e04584cf34b77ce755b45420855f7.jpg not downloaded yet
2026-04-27 08:01:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a249b8d-4f61-54a2-8efa-c3005989791a with identifier: VR99778
2026-04-27 08:01:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a249b8d-4f61-54a2-8efa-c3005989791a with scrape type 1
2026-04-27 08:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 7a249b8d-4f61-54a2-8efa-c3005989791a
2026-04-27 08:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/41/2c415368711ab116d78e566182b5f5a6/pa/VR99778_8f965f66abe74382e9016aa290780364.jpg not downloaded yet
2026-04-27 08:01:00 [auto1.fr] INFO: Found listing with ID: ZJ95277
2026-04-27 08:01:00 [auto1.fr] INFO: Scrape type for ZJ95277: 2
2026-04-27 08:01:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f27e5d84-fe06-5909-b079-1137fcbd660a with identifier: ZJ95277
2026-04-27 08:01:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f27e5d84-fe06-5909-b079-1137fcbd660a with scrape type 2
2026-04-27 08:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f27e5d84-fe06-5909-b079-1137fcbd660a with scrape type 2
2026-04-27 08:01:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f27e5d84-fe06-5909-b079-1137fcbd660a, identifier: ZJ95277
2026-04-27 08:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/ee/57ee939dbc6037af254f3298d373abec/pa/ME56071_2d00c40705e453b420298f693189af78.jpg not downloaded yet
2026-04-27 08:01:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f27e5d84-fe06-5909-b079-1137fcbd660a with identifier: ZJ95277
2026-04-27 08:01:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f27e5d84-fe06-5909-b079-1137fcbd660a with identifier: ZJ95277
2026-04-27 08:01:00 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f27e5d84-fe06-5909-b079-1137fcbd660a with identifier: ZJ95277 to the API
2026-04-27 08:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:00 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 262,
 'expiration_date': '2026-04-28T15:40:42Z',
 'fuel_type': 'diesel',
 'id': 'f27e5d84-fe06-5909-b079-1137fcbd660a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZJ95277',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Volkswagen',
 'model': 'Touareg',
 'odometer': 206724,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2016-06-30',
 'seller_name': None,
 'title': 'Volkswagen Touareg 3.0 V6 TDI Carat Edition 4Motion',
 'transmission': 'automatic',
 'trim': 'Carat Edition 4Motion',
 'year': 2016}
2026-04-27 08:01:01 [auto1.fr] INFO: Saving data for ZJ95277: {'auction_closing_time': 1777390842.0, 'created_time': 1777021324.44652, 'has_photos': True, 'last_price_update_time': 1777276861.010984}
2026-04-27 08:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/41/2c415368711ab116d78e566182b5f5a6/pa/VR99778_cffde45a6ce8209dccd0f003f7a0f34e.jpg not downloaded yet
2026-04-27 08:01:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ea9390>
2026-04-27 08:01:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b87b37dd-bb05-57ca-9480-c8a45accf666/b87b37dd-bb05-57ca-9480-c8a45accf666_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/ed/55edeacb5dfe4d1f0eff4388c4e774f9/pa/ES75996_a31ba0b9a7776cd3b2abd12965d0ab9b.jpg saved to cache
2026-04-27 08:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b87b37dd-bb05-57ca-9480-c8a45accf666
2026-04-27 08:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/ed/55edeacb5dfe4d1f0eff4388c4e774f9/pa/ES75996_63cc3ac2ec737c00ccb5fce071506529.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:01 [auto1.fr] INFO: Found listing with ID: PA01531
2026-04-27 08:01:01 [auto1.fr] INFO: Scrape type for PA01531: 1
2026-04-27 08:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/ee/57ee939dbc6037af254f3298d373abec/pa/ME56071_a7d7db523da6cd286570d3b22a549212.jpg not downloaded yet
2026-04-27 08:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/41/2c415368711ab116d78e566182b5f5a6/pa/VR99778_20e92b4e17fc364c35307c54472ed866.jpg not downloaded yet
2026-04-27 08:01:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d73950>
2026-04-27 08:01:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6c13646-eae3-5047-adc8-149922bde6d6/e6c13646-eae3-5047-adc8-149922bde6d6_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/ee/57ee939dbc6037af254f3298d373abec/pa/ME56071_37b6813a0f96c5c5d5b2e2090610bcf2.jpg saved to cache
2026-04-27 08:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e6c13646-eae3-5047-adc8-149922bde6d6
2026-04-27 08:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/ee/57ee939dbc6037af254f3298d373abec/pa/ME56071_7e233fe00c4c26f6a1c96eba22bf39fe.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:01 [auto1.fr] INFO: Found listing with ID: GD47514
2026-04-27 08:01:01 [auto1.fr] INFO: Scrape type for GD47514: 2
2026-04-27 08:01:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3252822-30bd-5e7e-a57e-5f54e9aed3de with identifier: GD47514
2026-04-27 08:01:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3252822-30bd-5e7e-a57e-5f54e9aed3de with scrape type 2
2026-04-27 08:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b3252822-30bd-5e7e-a57e-5f54e9aed3de with scrape type 2
2026-04-27 08:01:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b3252822-30bd-5e7e-a57e-5f54e9aed3de, identifier: GD47514
2026-04-27 08:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/ee/57ee939dbc6037af254f3298d373abec/pa/ME56071_c49b3b9e97b2a4de0bb9d874c556eb1a.jpg not downloaded yet
2026-04-27 08:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LS92623> (referer: https://www.auto1.com/v1/car-details-view/LS92623/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JP78113/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KW37033> (referer: https://www.auto1.com/v1/car-details-view/KW37033/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b3252822-30bd-5e7e-a57e-5f54e9aed3de with identifier: GD47514
2026-04-27 08:01:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b3252822-30bd-5e7e-a57e-5f54e9aed3de with identifier: GD47514
2026-04-27 08:01:01 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b3252822-30bd-5e7e-a57e-5f54e9aed3de with identifier: GD47514 to the API
2026-04-27 08:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:01 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-04-28T15:12:50Z',
 'fuel_type': 'petrol',
 'id': 'b3252822-30bd-5e7e-a57e-5f54e9aed3de',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GD47514',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Volkswagen',
 'model': 'T-Cross',
 'odometer': 14146,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2023-03-28',
 'seller_name': None,
 'title': 'Volkswagen T-Cross 1.0 TSI R-Line Tech',
 'transmission': 'automatic',
 'trim': 'R-Line Tech',
 'year': 2023}
2026-04-27 08:01:01 [auto1.fr] INFO: Saving data for GD47514: {'auction_closing_time': 1777389170.0, 'created_time': 1777021369.261317, 'has_photos': True, 'last_price_update_time': 1777276861.647038}
2026-04-27 08:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/41/2c415368711ab116d78e566182b5f5a6/pa/VR99778_0b6cb942fc293a755a01da680fa1747f.jpg not downloaded yet
2026-04-27 08:01:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:01 [auto1.fr] INFO: Found listing with ID: XP78105
2026-04-27 08:01:01 [auto1.fr] INFO: Scrape type for XP78105: 1
2026-04-27 08:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/ee/57ee939dbc6037af254f3298d373abec/pa/ME56071_1365e1fc704e9d093234e580872a3bc1.jpg not downloaded yet
2026-04-27 08:01:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ea8e90>
2026-04-27 08:01:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b87b37dd-bb05-57ca-9480-c8a45accf666/b87b37dd-bb05-57ca-9480-c8a45accf666_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/ed/55edeacb5dfe4d1f0eff4388c4e774f9/pa/ES75996_63cc3ac2ec737c00ccb5fce071506529.jpg saved to cache
2026-04-27 08:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b87b37dd-bb05-57ca-9480-c8a45accf666
2026-04-27 08:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/ee/57ee939dbc6037af254f3298d373abec/pa/ME56071_2d00c40705e453b420298f693189af78.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/41/2c415368711ab116d78e566182b5f5a6/pa/VR99778_8e4c1e00cabc95ce00666ec11a208430.jpg not downloaded yet
2026-04-27 08:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YR94758> (referer: https://www.auto1.com/v1/car-details-view/YR94758/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:01 [auto1.fr] INFO: Found listing with ID: YZ25603
2026-04-27 08:01:01 [auto1.fr] INFO: Scrape type for YZ25603: 1
2026-04-27 08:01:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KL75694> (referer: https://www.auto1.com/v1/car-details-view/KL75694/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bfb6b90>
2026-04-27 08:01:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6c13646-eae3-5047-adc8-149922bde6d6/e6c13646-eae3-5047-adc8-149922bde6d6_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/ee/57ee939dbc6037af254f3298d373abec/pa/ME56071_7e233fe00c4c26f6a1c96eba22bf39fe.jpg saved to cache
2026-04-27 08:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e6c13646-eae3-5047-adc8-149922bde6d6
2026-04-27 08:01:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ede6990a-e7dd-5a03-ae54-44ec0c621440 with identifier: LS92623
2026-04-27 08:01:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ede6990a-e7dd-5a03-ae54-44ec0c621440 with scrape type 1
2026-04-27 08:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ede6990a-e7dd-5a03-ae54-44ec0c621440
2026-04-27 08:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/0b/7f0b7088b40dafe183a8447898e229dd/pa/LS92623_531265922bab7ef418aa86a911f39d21.jpg not downloaded yet
2026-04-27 08:01:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79bc9b0d-db94-501e-b2dd-b8a4bd20f020 with identifier: KW37033
2026-04-27 08:01:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79bc9b0d-db94-501e-b2dd-b8a4bd20f020 with scrape type 1
2026-04-27 08:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 79bc9b0d-db94-501e-b2dd-b8a4bd20f020
2026-04-27 08:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/9e/199eac146c3dc1752d32d51222853629/pa/KW37033_f61eac9a924117c79bfad98740620e2e.jpg not downloaded yet
2026-04-27 08:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/ee/57ee939dbc6037af254f3298d373abec/pa/ME56071_a7d7db523da6cd286570d3b22a549212.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/41/2c415368711ab116d78e566182b5f5a6/pa/VR99778_378ddca60853e00ea9b450454df0d6d4.jpg not downloaded yet
2026-04-27 08:01:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:02 [auto1.fr] INFO: Found listing with ID: HS98603
2026-04-27 08:01:02 [auto1.fr] INFO: Scrape type for HS98603: 1
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/0b/7f0b7088b40dafe183a8447898e229dd/pa/LS92623_9e30f4e0492f6f838bcd58af126cde3f.jpg not downloaded yet
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/9e/199eac146c3dc1752d32d51222853629/pa/KW37033_715b06e5466d68cf0a744d574be9cef6.jpg not downloaded yet
2026-04-27 08:01:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d6cb90>
2026-04-27 08:01:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6c13646-eae3-5047-adc8-149922bde6d6/e6c13646-eae3-5047-adc8-149922bde6d6_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/ee/57ee939dbc6037af254f3298d373abec/pa/ME56071_2d00c40705e453b420298f693189af78.jpg saved to cache
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e6c13646-eae3-5047-adc8-149922bde6d6
2026-04-27 08:01:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a5b47128-234d-5bd3-8080-5a370901ab37 with identifier: YR94758
2026-04-27 08:01:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5b47128-234d-5bd3-8080-5a370901ab37 with scrape type 1
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item a5b47128-234d-5bd3-8080-5a370901ab37
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/63/4b6382b0303d74741db5398d8df031c7/pa/YR94758_fb5f11ae37a34f737272638e9d8b91c4.jpg not downloaded yet
2026-04-27 08:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/41/2c415368711ab116d78e566182b5f5a6/pa/VR99778_20e92b4e17fc364c35307c54472ed866.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/41/2c415368711ab116d78e566182b5f5a6/pa/VR99778_cffde45a6ce8209dccd0f003f7a0f34e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:02 [auto1.fr] INFO: Found listing with ID: YJ90773
2026-04-27 08:01:02 [auto1.fr] INFO: Scrape type for YJ90773: 1
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/0b/7f0b7088b40dafe183a8447898e229dd/pa/LS92623_f0d64d739d69380b9dada13b49164c87.jpg not downloaded yet
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/9e/199eac146c3dc1752d32d51222853629/pa/KW37033_04eab17ffc66303213de09d1d4b4bfe2.jpg not downloaded yet
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/63/4b6382b0303d74741db5398d8df031c7/pa/YR94758_f2d23306f107d54137cdebfc6a900e91.jpg not downloaded yet
2026-04-27 08:01:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3308c1b0-2410-5f92-8e87-9ef534df5fbc with identifier: KL75694
2026-04-27 08:01:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3308c1b0-2410-5f92-8e87-9ef534df5fbc with scrape type 1
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3308c1b0-2410-5f92-8e87-9ef534df5fbc
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/41/fa41a81cf5db1951d5643e2591403562/pa/KL75694_17b07b2658d56655850d90fb2e398b69.jpg not downloaded yet
2026-04-27 08:01:02 [auto1.fr] INFO: Found listing with ID: DR82210
2026-04-27 08:01:02 [auto1.fr] INFO: Scrape type for DR82210: 2
2026-04-27 08:01:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff632e8a-1da3-569e-94dc-cca8b975b09c with identifier: DR82210
2026-04-27 08:01:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff632e8a-1da3-569e-94dc-cca8b975b09c with scrape type 2
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ff632e8a-1da3-569e-94dc-cca8b975b09c with scrape type 2
2026-04-27 08:01:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ff632e8a-1da3-569e-94dc-cca8b975b09c, identifier: DR82210
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/0b/7f0b7088b40dafe183a8447898e229dd/pa/LS92623_b226e308107f4822b8f789d50c608797.jpg not downloaded yet
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/9e/199eac146c3dc1752d32d51222853629/pa/KW37033_4d6e8e8d18b6288fd5918be5319e64fb.jpg not downloaded yet
2026-04-27 08:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/41/2c415368711ab116d78e566182b5f5a6/pa/VR99778_0b6cb942fc293a755a01da680fa1747f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ff632e8a-1da3-569e-94dc-cca8b975b09c with identifier: DR82210
2026-04-27 08:01:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ff632e8a-1da3-569e-94dc-cca8b975b09c with identifier: DR82210
2026-04-27 08:01:02 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ff632e8a-1da3-569e-94dc-cca8b975b09c with identifier: DR82210 to the API
2026-04-27 08:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:02 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 404,
 'expiration_date': '2026-04-28T15:11:12Z',
 'fuel_type': 'hybrid',
 'id': 'ff632e8a-1da3-569e-94dc-cca8b975b09c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DR82210',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Land Rover',
 'model': 'Range Rover Sport',
 'odometer': 80728,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2019-04-01',
 'seller_name': None,
 'title': 'Land Rover Range Rover Sport 2.0 Hybrid Autobiography Dynamic',
 'transmission': 'automatic',
 'trim': 'Autobiography Dynamic',
 'year': 2019}
2026-04-27 08:01:02 [auto1.fr] INFO: Saving data for DR82210: {'auction_closing_time': 1777389072.0, 'created_time': 1777019959.652042, 'has_photos': True, 'last_price_update_time': 1777276862.921541}
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/63/4b6382b0303d74741db5398d8df031c7/pa/YR94758_cda0f088dd7d9dd831cc424cbeaeb903.jpg not downloaded yet
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/41/fa41a81cf5db1951d5643e2591403562/pa/KL75694_cf362788e911b9414cc8e9dd18a2802a.jpg not downloaded yet
2026-04-27 08:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/41/2c415368711ab116d78e566182b5f5a6/pa/VR99778_8e4c1e00cabc95ce00666ec11a208430.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:02 [auto1.fr] INFO: Found listing with ID: AD19719
2026-04-27 08:01:02 [auto1.fr] INFO: Scrape type for AD19719: 2
2026-04-27 08:01:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c680adc-144f-59f3-93b3-cd2e9a9382ba with identifier: AD19719
2026-04-27 08:01:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c680adc-144f-59f3-93b3-cd2e9a9382ba with scrape type 2
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c680adc-144f-59f3-93b3-cd2e9a9382ba with scrape type 2
2026-04-27 08:01:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8c680adc-144f-59f3-93b3-cd2e9a9382ba, identifier: AD19719
2026-04-27 08:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/0b/7f0b7088b40dafe183a8447898e229dd/pa/LS92623_70bab704b408abf7483c081226e24daa.jpg not downloaded yet
2026-04-27 08:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/9e/199eac146c3dc1752d32d51222853629/pa/KW37033_6ea5f890aec12032587e9f2f988dcaae.jpg not downloaded yet
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438dd5ad0>
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6c13646-eae3-5047-adc8-149922bde6d6/e6c13646-eae3-5047-adc8-149922bde6d6_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/ee/57ee939dbc6037af254f3298d373abec/pa/ME56071_a7d7db523da6cd286570d3b22a549212.jpg saved to cache
2026-04-27 08:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e6c13646-eae3-5047-adc8-149922bde6d6
2026-04-27 08:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/ee/57ee939dbc6037af254f3298d373abec/pa/ME56071_1365e1fc704e9d093234e580872a3bc1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8c680adc-144f-59f3-93b3-cd2e9a9382ba with identifier: AD19719
2026-04-27 08:01:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8c680adc-144f-59f3-93b3-cd2e9a9382ba with identifier: AD19719
2026-04-27 08:01:03 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 8c680adc-144f-59f3-93b3-cd2e9a9382ba with identifier: AD19719 to the API
2026-04-27 08:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:03 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-04-28T15:15:53Z',
 'fuel_type': 'diesel',
 'id': '8c680adc-144f-59f3-93b3-cd2e9a9382ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AD19719',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 138313,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2017-11-10',
 'seller_name': None,
 'title': 'Audi Q5 2.0 TDI quattro S line',
 'transmission': 'automatic',
 'trim': 'quattro S line',
 'year': 2017}
2026-04-27 08:01:03 [auto1.fr] INFO: Saving data for AD19719: {'auction_closing_time': 1777389353.0, 'created_time': 1777019397.682776, 'has_photos': True, 'last_price_update_time': 1777276863.570562}
2026-04-27 08:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/63/4b6382b0303d74741db5398d8df031c7/pa/YR94758_7f038c6dc0519935b79515196a3c7570.jpg not downloaded yet
2026-04-27 08:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/41/fa41a81cf5db1951d5643e2591403562/pa/KL75694_f2929b1c88d9a585f2db52ca09f0a971.jpg not downloaded yet
2026-04-27 08:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LG63023/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/63/4b6382b0303d74741db5398d8df031c7/pa/YR94758_fb5f11ae37a34f737272638e9d8b91c4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/9e/199eac146c3dc1752d32d51222853629/pa/KW37033_715b06e5466d68cf0a744d574be9cef6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:03 [auto1.fr] INFO: Found listing with ID: LT67510
2026-04-27 08:01:03 [auto1.fr] INFO: Scrape type for LT67510: 1
2026-04-27 08:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/0b/7f0b7088b40dafe183a8447898e229dd/pa/LS92623_ed70938ddddfd4349cf90dc9d65c2bb7.jpg not downloaded yet
2026-04-27 08:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/9e/199eac146c3dc1752d32d51222853629/pa/KW37033_528145b3400474799acbc8a5bc42d81b.jpg not downloaded yet
2026-04-27 08:01:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MB19012> (referer: https://www.auto1.com/v1/car-details-view/MB19012/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c8c510>
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a249b8d-4f61-54a2-8efa-c3005989791a/7a249b8d-4f61-54a2-8efa-c3005989791a_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/41/2c415368711ab116d78e566182b5f5a6/pa/VR99778_20e92b4e17fc364c35307c54472ed866.jpg saved to cache
2026-04-27 08:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7a249b8d-4f61-54a2-8efa-c3005989791a
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ae9210>
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a249b8d-4f61-54a2-8efa-c3005989791a/7a249b8d-4f61-54a2-8efa-c3005989791a_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/41/2c415368711ab116d78e566182b5f5a6/pa/VR99778_cffde45a6ce8209dccd0f003f7a0f34e.jpg saved to cache
2026-04-27 08:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7a249b8d-4f61-54a2-8efa-c3005989791a
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438134ad0>
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a249b8d-4f61-54a2-8efa-c3005989791a/7a249b8d-4f61-54a2-8efa-c3005989791a_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/41/2c415368711ab116d78e566182b5f5a6/pa/VR99778_0b6cb942fc293a755a01da680fa1747f.jpg saved to cache
2026-04-27 08:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7a249b8d-4f61-54a2-8efa-c3005989791a
2026-04-27 08:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/63/4b6382b0303d74741db5398d8df031c7/pa/YR94758_813aacf801dcf52b715aec5775737e44.jpg not downloaded yet
2026-04-27 08:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/41/fa41a81cf5db1951d5643e2591403562/pa/KL75694_234c3dd17b23431f06719537b47c104d.jpg not downloaded yet
2026-04-27 08:01:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438e54ad0>
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a249b8d-4f61-54a2-8efa-c3005989791a/7a249b8d-4f61-54a2-8efa-c3005989791a_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/41/2c415368711ab116d78e566182b5f5a6/pa/VR99778_8e4c1e00cabc95ce00666ec11a208430.jpg saved to cache
2026-04-27 08:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7a249b8d-4f61-54a2-8efa-c3005989791a
2026-04-27 08:01:03 [auto1.fr] INFO: Found listing with ID: NK86276
2026-04-27 08:01:03 [auto1.fr] INFO: Scrape type for NK86276: 1
2026-04-27 08:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/0b/7f0b7088b40dafe183a8447898e229dd/pa/LS92623_aa7a286ade948d1cb7b9c2819fc2458e.jpg not downloaded yet
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a70050>
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6c13646-eae3-5047-adc8-149922bde6d6/e6c13646-eae3-5047-adc8-149922bde6d6_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/ee/57ee939dbc6037af254f3298d373abec/pa/ME56071_1365e1fc704e9d093234e580872a3bc1.jpg saved to cache
2026-04-27 08:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e6c13646-eae3-5047-adc8-149922bde6d6
2026-04-27 08:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/9e/199eac146c3dc1752d32d51222853629/pa/KW37033_4d6e8e8d18b6288fd5918be5319e64fb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/0b/7f0b7088b40dafe183a8447898e229dd/pa/LS92623_b226e308107f4822b8f789d50c608797.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/63/4b6382b0303d74741db5398d8df031c7/pa/YR94758_454b430eb76582b19a7e46a061ac4630.jpg not downloaded yet
2026-04-27 08:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/41/fa41a81cf5db1951d5643e2591403562/pa/KL75694_250380b321b8df4a05e173b9722cec7d.jpg not downloaded yet
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143814cd90>
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5b47128-234d-5bd3-8080-5a370901ab37/a5b47128-234d-5bd3-8080-5a370901ab37_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/63/4b6382b0303d74741db5398d8df031c7/pa/YR94758_fb5f11ae37a34f737272638e9d8b91c4.jpg saved to cache
2026-04-27 08:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a5b47128-234d-5bd3-8080-5a370901ab37
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143803a4d0>
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79bc9b0d-db94-501e-b2dd-b8a4bd20f020/79bc9b0d-db94-501e-b2dd-b8a4bd20f020_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/9e/199eac146c3dc1752d32d51222853629/pa/KW37033_715b06e5466d68cf0a744d574be9cef6.jpg saved to cache
2026-04-27 08:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 79bc9b0d-db94-501e-b2dd-b8a4bd20f020
2026-04-27 08:01:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b2e2793-aa9c-51bc-ad0a-850dfdc8ef49 with identifier: MB19012
2026-04-27 08:01:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b2e2793-aa9c-51bc-ad0a-850dfdc8ef49 with scrape type 1
2026-04-27 08:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2b2e2793-aa9c-51bc-ad0a-850dfdc8ef49
2026-04-27 08:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/05/550580bfbcf5b96bc7d80e0c0346bd49/pa/MB19012_3f49e9125096bfb353f30a60e4c299fd.jpg not downloaded yet
2026-04-27 08:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/41/fa41a81cf5db1951d5643e2591403562/pa/KL75694_cf362788e911b9414cc8e9dd18a2802a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:04 [auto1.fr] INFO: Found listing with ID: PE67276
2026-04-27 08:01:04 [auto1.fr] INFO: Scrape type for PE67276: 2
2026-04-27 08:01:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3b03870-871a-558b-89d6-1c6b36cea753 with identifier: PE67276
2026-04-27 08:01:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3b03870-871a-558b-89d6-1c6b36cea753 with scrape type 2
2026-04-27 08:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b3b03870-871a-558b-89d6-1c6b36cea753 with scrape type 2
2026-04-27 08:01:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b3b03870-871a-558b-89d6-1c6b36cea753, identifier: PE67276
2026-04-27 08:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/0b/7f0b7088b40dafe183a8447898e229dd/pa/LS92623_4dfb52504b8f0c099def11f05ab3f415.jpg not downloaded yet
2026-04-27 08:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SY30151> (referer: https://www.auto1.com/v1/car-details-view/SY30151/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/9e/199eac146c3dc1752d32d51222853629/pa/KW37033_6ea5f890aec12032587e9f2f988dcaae.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b3b03870-871a-558b-89d6-1c6b36cea753 with identifier: PE67276
2026-04-27 08:01:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b3b03870-871a-558b-89d6-1c6b36cea753 with identifier: PE67276
2026-04-27 08:01:04 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b3b03870-871a-558b-89d6-1c6b36cea753 with identifier: PE67276 to the API
2026-04-27 08:01:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:04 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-04-28T15:33:51Z',
 'fuel_type': 'petrol',
 'id': 'b3b03870-871a-558b-89d6-1c6b36cea753',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PE67276',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 35191,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2022-10-10',
 'seller_name': None,
 'title': 'Citroen C3 1.2 PureTech Feel',
 'transmission': 'manual',
 'trim': 'Feel',
 'year': 2022}
2026-04-27 08:01:04 [auto1.fr] INFO: Saving data for PE67276: {'auction_closing_time': 1777390431.0, 'created_time': 1777020387.668924, 'has_photos': True, 'last_price_update_time': 1777276864.601377}
2026-04-27 08:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/41/fa41a81cf5db1951d5643e2591403562/pa/KL75694_9740e0c4058585d471e97ff112943c6b.jpg not downloaded yet
2026-04-27 08:01:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/05/550580bfbcf5b96bc7d80e0c0346bd49/pa/MB19012_50ec844930904c7d2cc7d998e0edb1cd.jpg not downloaded yet
2026-04-27 08:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/0b/7f0b7088b40dafe183a8447898e229dd/pa/LS92623_70bab704b408abf7483c081226e24daa.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:04 [auto1.fr] INFO: Found listing with ID: ZX13537
2026-04-27 08:01:04 [auto1.fr] INFO: Scrape type for ZX13537: 1
2026-04-27 08:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/0b/7f0b7088b40dafe183a8447898e229dd/pa/LS92623_9aeb6d89307a49a05ea41d6a58320bbc.jpg not downloaded yet
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d6edd0>
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79bc9b0d-db94-501e-b2dd-b8a4bd20f020/79bc9b0d-db94-501e-b2dd-b8a4bd20f020_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/9e/199eac146c3dc1752d32d51222853629/pa/KW37033_4d6e8e8d18b6288fd5918be5319e64fb.jpg saved to cache
2026-04-27 08:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 79bc9b0d-db94-501e-b2dd-b8a4bd20f020
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143812c550>
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ede6990a-e7dd-5a03-ae54-44ec0c621440/ede6990a-e7dd-5a03-ae54-44ec0c621440_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/0b/7f0b7088b40dafe183a8447898e229dd/pa/LS92623_b226e308107f4822b8f789d50c608797.jpg saved to cache
2026-04-27 08:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ede6990a-e7dd-5a03-ae54-44ec0c621440
2026-04-27 08:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/41/fa41a81cf5db1951d5643e2591403562/pa/KL75694_218a5b3e804216752b82893ef79ce99e.jpg not downloaded yet
2026-04-27 08:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/05/550580bfbcf5b96bc7d80e0c0346bd49/pa/MB19012_de58128efcb012be2274d4bec617aabf.jpg not downloaded yet
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b7e210>
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3308c1b0-2410-5f92-8e87-9ef534df5fbc/3308c1b0-2410-5f92-8e87-9ef534df5fbc_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/41/fa41a81cf5db1951d5643e2591403562/pa/KL75694_cf362788e911b9414cc8e9dd18a2802a.jpg saved to cache
2026-04-27 08:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3308c1b0-2410-5f92-8e87-9ef534df5fbc
2026-04-27 08:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/41/fa41a81cf5db1951d5643e2591403562/pa/KL75694_234c3dd17b23431f06719537b47c104d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/63/4b6382b0303d74741db5398d8df031c7/pa/YR94758_813aacf801dcf52b715aec5775737e44.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:04 [auto1.fr] INFO: Found listing with ID: GD46628
2026-04-27 08:01:05 [auto1.fr] INFO: Scrape type for GD46628: 1
2026-04-27 08:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/0b/7f0b7088b40dafe183a8447898e229dd/pa/LS92623_30800d6cdce47e7f766837ea2017d837.jpg not downloaded yet
2026-04-27 08:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d75c6f4-e6fb-5bd0-aecc-167c7929daed with identifier: SY30151
2026-04-27 08:01:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d75c6f4-e6fb-5bd0-aecc-167c7929daed with scrape type 1
2026-04-27 08:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0d75c6f4-e6fb-5bd0-aecc-167c7929daed
2026-04-27 08:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/c1/d4c1216727f797573ca16942a154c2ea/pa/SY30151_a0b29362139ffa0af418a6f344b50df6.jpg not downloaded yet
2026-04-27 08:01:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ea9f50>
2026-04-27 08:01:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79bc9b0d-db94-501e-b2dd-b8a4bd20f020/79bc9b0d-db94-501e-b2dd-b8a4bd20f020_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/9e/199eac146c3dc1752d32d51222853629/pa/KW37033_6ea5f890aec12032587e9f2f988dcaae.jpg saved to cache
2026-04-27 08:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 79bc9b0d-db94-501e-b2dd-b8a4bd20f020
2026-04-27 08:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/41/fa41a81cf5db1951d5643e2591403562/pa/KL75694_5143dc77336d045a4b98e1c27d704d8d.jpg not downloaded yet
2026-04-27 08:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/05/550580bfbcf5b96bc7d80e0c0346bd49/pa/MB19012_5ec141711717a67a630c4185f0dc838f.jpg not downloaded yet
2026-04-27 08:01:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438fa43d0>
2026-04-27 08:01:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ede6990a-e7dd-5a03-ae54-44ec0c621440/ede6990a-e7dd-5a03-ae54-44ec0c621440_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/0b/7f0b7088b40dafe183a8447898e229dd/pa/LS92623_70bab704b408abf7483c081226e24daa.jpg saved to cache
2026-04-27 08:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ede6990a-e7dd-5a03-ae54-44ec0c621440
2026-04-27 08:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/05/550580bfbcf5b96bc7d80e0c0346bd49/pa/MB19012_3f49e9125096bfb353f30a60e4c299fd.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/0b/7f0b7088b40dafe183a8447898e229dd/pa/LS92623_aa7a286ade948d1cb7b9c2819fc2458e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:05 [auto1.fr] INFO: Found listing with ID: HD25172
2026-04-27 08:01:05 [auto1.fr] INFO: Scrape type for HD25172: 2
2026-04-27 08:01:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2abcd60b-a3f0-5ad6-b576-f62bdab94027 with identifier: HD25172
2026-04-27 08:01:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2abcd60b-a3f0-5ad6-b576-f62bdab94027 with scrape type 2
2026-04-27 08:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2abcd60b-a3f0-5ad6-b576-f62bdab94027 with scrape type 2
2026-04-27 08:01:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2abcd60b-a3f0-5ad6-b576-f62bdab94027, identifier: HD25172
2026-04-27 08:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/c1/d4c1216727f797573ca16942a154c2ea/pa/SY30151_fdaf4118f1cff1649c153f93e0457db3.jpg not downloaded yet
2026-04-27 08:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/0b/7f0b7088b40dafe183a8447898e229dd/pa/LS92623_4dfb52504b8f0c099def11f05ab3f415.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2abcd60b-a3f0-5ad6-b576-f62bdab94027 with identifier: HD25172
2026-04-27 08:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-27 08:01:05 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=orange HTTP/1.1" 200 None
2026-04-27 08:01:06 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-27 08:01:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2abcd60b-a3f0-5ad6-b576-f62bdab94027 with identifier: HD25172
2026-04-27 08:01:06 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2abcd60b-a3f0-5ad6-b576-f62bdab94027 with identifier: HD25172 to the API
2026-04-27 08:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:07 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-04-28T15:44:07Z',
 'fuel_type': 'petrol',
 'id': '2abcd60b-a3f0-5ad6-b576-f62bdab94027',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HD25172',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 47808,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2018-07-26',
 'seller_name': None,
 'title': 'Citroen C3 1.2 PureTech Feel',
 'transmission': 'manual',
 'trim': 'Feel',
 'year': 2018}
2026-04-27 08:01:07 [auto1.fr] INFO: Saving data for HD25172: {'auction_closing_time': 1777391047.0, 'created_time': 1777022469.866349, 'has_photos': True, 'last_price_update_time': 1777276867.153232}
2026-04-27 08:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/41/fa41a81cf5db1951d5643e2591403562/pa/KL75694_f715a1bfdfde57cffcea206b1a813cf7.jpg not downloaded yet
2026-04-27 08:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/05/550580bfbcf5b96bc7d80e0c0346bd49/pa/MB19012_15351aa8fc68a9687178a081bbbdd801.jpg not downloaded yet
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c2ced0>
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3308c1b0-2410-5f92-8e87-9ef534df5fbc/3308c1b0-2410-5f92-8e87-9ef534df5fbc_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/41/fa41a81cf5db1951d5643e2591403562/pa/KL75694_234c3dd17b23431f06719537b47c104d.jpg saved to cache
2026-04-27 08:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3308c1b0-2410-5f92-8e87-9ef534df5fbc
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bfad490>
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5b47128-234d-5bd3-8080-5a370901ab37/a5b47128-234d-5bd3-8080-5a370901ab37_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/63/4b6382b0303d74741db5398d8df031c7/pa/YR94758_813aacf801dcf52b715aec5775737e44.jpg saved to cache
2026-04-27 08:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a5b47128-234d-5bd3-8080-5a370901ab37
2026-04-27 08:01:07 [auto1.fr] INFO: Channel: 24h | Page: 13 | totalHits: 4744 | hits on page: 40
2026-04-27 08:01:07 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item a5b47128-234d-5bd3-8080-5a370901ab37 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:01:07 [auto1.fr] INFO: Found listing with ID: CS24682
2026-04-27 08:01:07 [auto1.fr] INFO: Scrape type for CS24682: 1
2026-04-27 08:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/c1/d4c1216727f797573ca16942a154c2ea/pa/SY30151_1b4274f62fa8ca66acad3e6986c33a6a.jpg not downloaded yet
2026-04-27 08:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WP26002/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/41/fa41a81cf5db1951d5643e2591403562/pa/KL75694_fc9cb734eabffc4455846f981979ce47.jpg not downloaded yet
2026-04-27 08:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/05/550580bfbcf5b96bc7d80e0c0346bd49/pa/MB19012_d301d6809aab34d5f97a3a53e5a06228.jpg not downloaded yet
2026-04-27 08:01:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:07 [auto1.fr] INFO: Found listing with ID: LZ58861
2026-04-27 08:01:07 [auto1.fr] INFO: Scrape type for LZ58861: 2
2026-04-27 08:01:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bfb5f0a3-ed98-56be-9fcd-79e88ff83edb with identifier: LZ58861
2026-04-27 08:01:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bfb5f0a3-ed98-56be-9fcd-79e88ff83edb with scrape type 2
2026-04-27 08:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bfb5f0a3-ed98-56be-9fcd-79e88ff83edb with scrape type 2
2026-04-27 08:01:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: bfb5f0a3-ed98-56be-9fcd-79e88ff83edb, identifier: LZ58861
2026-04-27 08:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CS54070/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bf03210>
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b2e2793-aa9c-51bc-ad0a-850dfdc8ef49/2b2e2793-aa9c-51bc-ad0a-850dfdc8ef49_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/05/550580bfbcf5b96bc7d80e0c0346bd49/pa/MB19012_3f49e9125096bfb353f30a60e4c299fd.jpg saved to cache
2026-04-27 08:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2b2e2793-aa9c-51bc-ad0a-850dfdc8ef49
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143adc4b90>
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ede6990a-e7dd-5a03-ae54-44ec0c621440/ede6990a-e7dd-5a03-ae54-44ec0c621440_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/0b/7f0b7088b40dafe183a8447898e229dd/pa/LS92623_aa7a286ade948d1cb7b9c2819fc2458e.jpg saved to cache
2026-04-27 08:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ede6990a-e7dd-5a03-ae54-44ec0c621440
2026-04-27 08:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/c1/d4c1216727f797573ca16942a154c2ea/pa/SY30151_a0b29362139ffa0af418a6f344b50df6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/05/550580bfbcf5b96bc7d80e0c0346bd49/pa/MB19012_de58128efcb012be2274d4bec617aabf.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/0b/7f0b7088b40dafe183a8447898e229dd/pa/LS92623_9aeb6d89307a49a05ea41d6a58320bbc.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:07 [auto1.fr] INFO: Found listing with ID: YB40717
2026-04-27 08:01:07 [auto1.fr] INFO: Scrape type for YB40717: 2
2026-04-27 08:01:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d2a66fb-e9d6-581c-80d2-02e3d5d642b1 with identifier: YB40717
2026-04-27 08:01:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d2a66fb-e9d6-581c-80d2-02e3d5d642b1 with scrape type 2
2026-04-27 08:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2d2a66fb-e9d6-581c-80d2-02e3d5d642b1 with scrape type 2
2026-04-27 08:01:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2d2a66fb-e9d6-581c-80d2-02e3d5d642b1, identifier: YB40717
2026-04-27 08:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/c1/d4c1216727f797573ca16942a154c2ea/pa/SY30151_2cc32749096ad289f0ddc9a62c8d662f.jpg not downloaded yet
2026-04-27 08:01:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: bfb5f0a3-ed98-56be-9fcd-79e88ff83edb with identifier: LZ58861
2026-04-27 08:01:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: bfb5f0a3-ed98-56be-9fcd-79e88ff83edb with identifier: LZ58861
2026-04-27 08:01:07 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: bfb5f0a3-ed98-56be-9fcd-79e88ff83edb with identifier: LZ58861 to the API
2026-04-27 08:01:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:08 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-04-28T15:24:54Z',
 'fuel_type': 'diesel',
 'id': 'bfb5f0a3-ed98-56be-9fcd-79e88ff83edb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LZ58861',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Renault',
 'model': 'Koleos',
 'odometer': 152056,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2017-10-23',
 'seller_name': None,
 'title': 'Renault Koleos 2.0 dCi Energy Initiale Paris 4x4',
 'transmission': 'automatic',
 'trim': 'Initiale Paris 4x4',
 'year': 2017}
2026-04-27 08:01:08 [auto1.fr] INFO: Saving data for LZ58861: {'auction_closing_time': 1777389894.0, 'created_time': 1777022512.950852, 'has_photos': True, 'last_price_update_time': 1777276868.141317}
2026-04-27 08:01:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438e57510>
2026-04-27 08:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ede6990a-e7dd-5a03-ae54-44ec0c621440/ede6990a-e7dd-5a03-ae54-44ec0c621440_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/0b/7f0b7088b40dafe183a8447898e229dd/pa/LS92623_4dfb52504b8f0c099def11f05ab3f415.jpg saved to cache
2026-04-27 08:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ede6990a-e7dd-5a03-ae54-44ec0c621440
2026-04-27 08:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/0b/7f0b7088b40dafe183a8447898e229dd/pa/LS92623_30800d6cdce47e7f766837ea2017d837.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:08 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item 3308c1b0-2410-5f92-8e87-9ef534df5fbc due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:01:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2d2a66fb-e9d6-581c-80d2-02e3d5d642b1 with identifier: YB40717
2026-04-27 08:01:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2d2a66fb-e9d6-581c-80d2-02e3d5d642b1 with identifier: YB40717
2026-04-27 08:01:08 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2d2a66fb-e9d6-581c-80d2-02e3d5d642b1 with identifier: YB40717 to the API
2026-04-27 08:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:08 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-04-28T15:55:35Z',
 'fuel_type': 'diesel',
 'id': '2d2a66fb-e9d6-581c-80d2-02e3d5d642b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YB40717',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 59757,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2022-11-21',
 'seller_name': None,
 'title': 'Dacia Duster 1.5 Blue dCi Prestige',
 'transmission': 'manual',
 'trim': 'Prestige',
 'year': 2022}
2026-04-27 08:01:08 [auto1.fr] INFO: Saving data for YB40717: {'auction_closing_time': 1777391735.0, 'created_time': 1777020748.475351, 'has_photos': True, 'last_price_update_time': 1777276868.619319}
2026-04-27 08:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/05/550580bfbcf5b96bc7d80e0c0346bd49/pa/MB19012_d49200d9306e2dc44e325f80dcae1064.jpg not downloaded yet
2026-04-27 08:01:08 [auto1.fr] INFO: Found listing with ID: DZ93005
2026-04-27 08:01:08 [auto1.fr] INFO: Scrape type for DZ93005: 2
2026-04-27 08:01:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f072a4c6-f8c4-5171-840a-b35ae3cf7214 with identifier: DZ93005
2026-04-27 08:01:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f072a4c6-f8c4-5171-840a-b35ae3cf7214 with scrape type 2
2026-04-27 08:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f072a4c6-f8c4-5171-840a-b35ae3cf7214 with scrape type 2
2026-04-27 08:01:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f072a4c6-f8c4-5171-840a-b35ae3cf7214, identifier: DZ93005
2026-04-27 08:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/05/550580bfbcf5b96bc7d80e0c0346bd49/pa/MB19012_5ec141711717a67a630c4185f0dc838f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:08 [auto1.fr] INFO: Found listing with ID: JA87898
2026-04-27 08:01:08 [auto1.fr] INFO: Scrape type for JA87898: 2
2026-04-27 08:01:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9ddfe53-439b-5d85-9f7b-6573cf6f5994 with identifier: JA87898
2026-04-27 08:01:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9ddfe53-439b-5d85-9f7b-6573cf6f5994 with scrape type 2
2026-04-27 08:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e9ddfe53-439b-5d85-9f7b-6573cf6f5994 with scrape type 2
2026-04-27 08:01:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e9ddfe53-439b-5d85-9f7b-6573cf6f5994, identifier: JA87898
2026-04-27 08:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/c1/d4c1216727f797573ca16942a154c2ea/pa/SY30151_b22a5b6f3c310119c88d2a4c5e60c3e6.jpg not downloaded yet
2026-04-27 08:01:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f072a4c6-f8c4-5171-840a-b35ae3cf7214 with identifier: DZ93005
2026-04-27 08:01:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f072a4c6-f8c4-5171-840a-b35ae3cf7214 with identifier: DZ93005
2026-04-27 08:01:09 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f072a4c6-f8c4-5171-840a-b35ae3cf7214 with identifier: DZ93005 to the API
2026-04-27 08:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:09 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-04-28T15:25:40Z',
 'fuel_type': 'petrol',
 'id': 'f072a4c6-f8c4-5171-840a-b35ae3cf7214',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DZ93005',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Suzuki',
 'model': 'Ignis',
 'odometer': 67553,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2018-06-20',
 'seller_name': None,
 'title': 'Suzuki Ignis 1.2 DualJet Pack',
 'transmission': 'manual',
 'trim': 'Pack',
 'year': 2018}
2026-04-27 08:01:09 [auto1.fr] INFO: Saving data for DZ93005: {'auction_closing_time': 1777389940.0, 'created_time': 1777020420.637913, 'has_photos': True, 'last_price_update_time': 1777276869.263638}
2026-04-27 08:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XP78105/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e9ddfe53-439b-5d85-9f7b-6573cf6f5994 with identifier: JA87898
2026-04-27 08:01:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e9ddfe53-439b-5d85-9f7b-6573cf6f5994 with identifier: JA87898
2026-04-27 08:01:09 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e9ddfe53-439b-5d85-9f7b-6573cf6f5994 with identifier: JA87898 to the API
2026-04-27 08:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:09 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 158,
 'expiration_date': '2026-04-28T15:22:54Z',
 'fuel_type': 'petrol',
 'id': 'e9ddfe53-439b-5d85-9f7b-6573cf6f5994',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JA87898',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Renault',
 'model': 'Arkana',
 'odometer': 49421,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2023-10-24',
 'seller_name': None,
 'title': 'Renault Arkana 1.3 TCe Mild-Hybrid R.S. Line',
 'transmission': 'automatic',
 'trim': 'R.S. Line',
 'year': 2023}
2026-04-27 08:01:09 [auto1.fr] INFO: Saving data for JA87898: {'auction_closing_time': 1777389774.0, 'created_time': 1777020178.293992, 'has_photos': True, 'last_price_update_time': 1777276869.585485}
2026-04-27 08:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/05/550580bfbcf5b96bc7d80e0c0346bd49/pa/MB19012_a9ef17448ec2074ab7a92c34865e4d13.jpg not downloaded yet
2026-04-27 08:01:09 [auto1.fr] INFO: Found listing with ID: ZX76031
2026-04-27 08:01:09 [auto1.fr] INFO: Scrape type for ZX76031: 2
2026-04-27 08:01:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f78d0100-7cb4-5982-bff5-95b5338640d5 with identifier: ZX76031
2026-04-27 08:01:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f78d0100-7cb4-5982-bff5-95b5338640d5 with scrape type 2
2026-04-27 08:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f78d0100-7cb4-5982-bff5-95b5338640d5 with scrape type 2
2026-04-27 08:01:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f78d0100-7cb4-5982-bff5-95b5338640d5, identifier: ZX76031
2026-04-27 08:01:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143819cf10>
2026-04-27 08:01:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d75c6f4-e6fb-5bd0-aecc-167c7929daed/0d75c6f4-e6fb-5bd0-aecc-167c7929daed_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/c1/d4c1216727f797573ca16942a154c2ea/pa/SY30151_a0b29362139ffa0af418a6f344b50df6.jpg saved to cache
2026-04-27 08:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0d75c6f4-e6fb-5bd0-aecc-167c7929daed
2026-04-27 08:01:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380a5750>
2026-04-27 08:01:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b2e2793-aa9c-51bc-ad0a-850dfdc8ef49/2b2e2793-aa9c-51bc-ad0a-850dfdc8ef49_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/05/550580bfbcf5b96bc7d80e0c0346bd49/pa/MB19012_de58128efcb012be2274d4bec617aabf.jpg saved to cache
2026-04-27 08:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2b2e2793-aa9c-51bc-ad0a-850dfdc8ef49
2026-04-27 08:01:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438afab50>
2026-04-27 08:01:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ede6990a-e7dd-5a03-ae54-44ec0c621440/ede6990a-e7dd-5a03-ae54-44ec0c621440_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/0b/7f0b7088b40dafe183a8447898e229dd/pa/LS92623_9aeb6d89307a49a05ea41d6a58320bbc.jpg saved to cache
2026-04-27 08:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ede6990a-e7dd-5a03-ae54-44ec0c621440
2026-04-27 08:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/c1/d4c1216727f797573ca16942a154c2ea/pa/SY30151_1b4274f62fa8ca66acad3e6986c33a6a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:09 [auto1.fr] INFO: Found listing with ID: YZ66084
2026-04-27 08:01:09 [auto1.fr] INFO: Scrape type for YZ66084: 2
2026-04-27 08:01:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c76cf918-7adc-54b3-8c85-5b80fd542cf2 with identifier: YZ66084
2026-04-27 08:01:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c76cf918-7adc-54b3-8c85-5b80fd542cf2 with scrape type 2
2026-04-27 08:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c76cf918-7adc-54b3-8c85-5b80fd542cf2 with scrape type 2
2026-04-27 08:01:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c76cf918-7adc-54b3-8c85-5b80fd542cf2, identifier: YZ66084
2026-04-27 08:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/c1/d4c1216727f797573ca16942a154c2ea/pa/SY30151_874ee83dd9848c297821c193af528946.jpg not downloaded yet
2026-04-27 08:01:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f78d0100-7cb4-5982-bff5-95b5338640d5 with identifier: ZX76031
2026-04-27 08:01:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f78d0100-7cb4-5982-bff5-95b5338640d5 with identifier: ZX76031
2026-04-27 08:01:10 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f78d0100-7cb4-5982-bff5-95b5338640d5 with identifier: ZX76031 to the API
2026-04-27 08:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:10 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-04-28T15:21:21Z',
 'fuel_type': 'petrol',
 'id': 'f78d0100-7cb4-5982-bff5-95b5338640d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZX76031',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 99433,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2005-01-20',
 'seller_name': None,
 'title': 'Renault Twingo 1.2 Kenzo',
 'transmission': 'manual',
 'trim': 'Kenzo',
 'year': 2005}
2026-04-27 08:01:10 [auto1.fr] INFO: Saving data for ZX76031: {'auction_closing_time': 1777389681.0, 'created_time': 1777020981.698138, 'has_photos': True, 'last_price_update_time': 1777276870.353583}
2026-04-27 08:01:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380670d0>
2026-04-27 08:01:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ede6990a-e7dd-5a03-ae54-44ec0c621440/ede6990a-e7dd-5a03-ae54-44ec0c621440_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/0b/7f0b7088b40dafe183a8447898e229dd/pa/LS92623_30800d6cdce47e7f766837ea2017d837.jpg saved to cache
2026-04-27 08:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ede6990a-e7dd-5a03-ae54-44ec0c621440
2026-04-27 08:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/05/550580bfbcf5b96bc7d80e0c0346bd49/pa/MB19012_15351aa8fc68a9687178a081bbbdd801.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/41/fa41a81cf5db1951d5643e2591403562/pa/KL75694_f715a1bfdfde57cffcea206b1a813cf7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c76cf918-7adc-54b3-8c85-5b80fd542cf2 with identifier: YZ66084
2026-04-27 08:01:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c76cf918-7adc-54b3-8c85-5b80fd542cf2 with identifier: YZ66084
2026-04-27 08:01:10 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c76cf918-7adc-54b3-8c85-5b80fd542cf2 with identifier: YZ66084 to the API
2026-04-27 08:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:10 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 165,
 'expiration_date': '2026-04-28T15:02:33Z',
 'fuel_type': 'petrol',
 'id': 'c76cf918-7adc-54b3-8c85-5b80fd542cf2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YZ66084',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 86818,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2017-05-30',
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 THP GT Line',
 'transmission': 'automatic',
 'trim': 'GT Line',
 'year': 2017}
2026-04-27 08:01:10 [auto1.fr] INFO: Saving data for YZ66084: {'auction_closing_time': 1777388553.0, 'created_time': 1777020885.55306, 'has_photos': True, 'last_price_update_time': 1777276870.708005}
2026-04-27 08:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/05/550580bfbcf5b96bc7d80e0c0346bd49/pa/MB19012_e9ae2e626968354a88dfff5ddeb3c47c.jpg not downloaded yet
2026-04-27 08:01:10 [auto1.fr] INFO: Found listing with ID: TX89064
2026-04-27 08:01:10 [auto1.fr] INFO: Scrape type for TX89064: 2
2026-04-27 08:01:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67c4c33b-5a0a-51a9-bfc8-70e62a7762b1 with identifier: TX89064
2026-04-27 08:01:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67c4c33b-5a0a-51a9-bfc8-70e62a7762b1 with scrape type 2
2026-04-27 08:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 67c4c33b-5a0a-51a9-bfc8-70e62a7762b1 with scrape type 2
2026-04-27 08:01:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 67c4c33b-5a0a-51a9-bfc8-70e62a7762b1, identifier: TX89064
2026-04-27 08:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/c1/d4c1216727f797573ca16942a154c2ea/pa/SY30151_2cc32749096ad289f0ddc9a62c8d662f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/05/550580bfbcf5b96bc7d80e0c0346bd49/pa/MB19012_d301d6809aab34d5f97a3a53e5a06228.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:10 [auto1.fr] INFO: Found listing with ID: KX23637
2026-04-27 08:01:10 [auto1.fr] INFO: Scrape type for KX23637: 1
2026-04-27 08:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/c1/d4c1216727f797573ca16942a154c2ea/pa/SY30151_a986eddb694b68529af4b6135effc955.jpg not downloaded yet
2026-04-27 08:01:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 67c4c33b-5a0a-51a9-bfc8-70e62a7762b1 with identifier: TX89064
2026-04-27 08:01:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 67c4c33b-5a0a-51a9-bfc8-70e62a7762b1 with identifier: TX89064
2026-04-27 08:01:11 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 67c4c33b-5a0a-51a9-bfc8-70e62a7762b1 with identifier: TX89064 to the API
2026-04-27 08:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:11 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-04-28T15:06:51Z',
 'fuel_type': 'diesel',
 'id': '67c4c33b-5a0a-51a9-bfc8-70e62a7762b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TX89064',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Citroen',
 'model': 'C4 Picasso',
 'odometer': 198882,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2014-12-22',
 'seller_name': None,
 'title': 'Citroen C4 Picasso 1.6 e-HDi Exclusive',
 'transmission': 'manual',
 'trim': 'Exclusive',
 'year': 2014}
2026-04-27 08:01:11 [auto1.fr] INFO: Saving data for TX89064: {'auction_closing_time': 1777388811.0, 'created_time': 1777020849.764119, 'has_photos': True, 'last_price_update_time': 1777276871.194885}
2026-04-27 08:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RR97759> (referer: https://www.auto1.com/v1/car-details-view/RR97759/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c64310>
2026-04-27 08:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b2e2793-aa9c-51bc-ad0a-850dfdc8ef49/2b2e2793-aa9c-51bc-ad0a-850dfdc8ef49_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/05/550580bfbcf5b96bc7d80e0c0346bd49/pa/MB19012_5ec141711717a67a630c4185f0dc838f.jpg saved to cache
2026-04-27 08:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2b2e2793-aa9c-51bc-ad0a-850dfdc8ef49
2026-04-27 08:01:11 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 0d75c6f4-e6fb-5bd0-aecc-167c7929daed due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/05/550580bfbcf5b96bc7d80e0c0346bd49/pa/MB19012_de734e9acefd8b47919229ab24a56497.jpg not downloaded yet
2026-04-27 08:01:11 [auto1.fr] INFO: Found listing with ID: GA30489
2026-04-27 08:01:11 [auto1.fr] INFO: Scrape type for GA30489: 2
2026-04-27 08:01:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 973ede7f-900a-548b-8860-d4932c91b669 with identifier: GA30489
2026-04-27 08:01:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 973ede7f-900a-548b-8860-d4932c91b669 with scrape type 2
2026-04-27 08:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 973ede7f-900a-548b-8860-d4932c91b669 with scrape type 2
2026-04-27 08:01:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 973ede7f-900a-548b-8860-d4932c91b669, identifier: GA30489
2026-04-27 08:01:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:11 [auto1.fr] INFO: Found listing with ID: GV65376
2026-04-27 08:01:11 [auto1.fr] INFO: Scrape type for GV65376: 1
2026-04-27 08:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/c1/d4c1216727f797573ca16942a154c2ea/pa/SY30151_791afc3e3f6f4f0b5265a3f694c4b9b3.jpg not downloaded yet
2026-04-27 08:01:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 973ede7f-900a-548b-8860-d4932c91b669 with identifier: GA30489
2026-04-27 08:01:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 973ede7f-900a-548b-8860-d4932c91b669 with identifier: GA30489
2026-04-27 08:01:11 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 973ede7f-900a-548b-8860-d4932c91b669 with identifier: GA30489 to the API
2026-04-27 08:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:11 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-04-28T15:31:33Z',
 'fuel_type': 'diesel',
 'id': '973ede7f-900a-548b-8860-d4932c91b669',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GA30489',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 199166,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2019-12-09',
 'seller_name': None,
 'title': 'Peugeot 2008 1.5 Blue-HDi Crossway',
 'transmission': 'automatic',
 'trim': 'Crossway',
 'year': 2019}
2026-04-27 08:01:11 [auto1.fr] INFO: Saving data for GA30489: {'auction_closing_time': 1777390293.0, 'created_time': 1777020278.338556, 'has_photos': True, 'last_price_update_time': 1777276871.762627}
2026-04-27 08:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bf79850>
2026-04-27 08:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d75c6f4-e6fb-5bd0-aecc-167c7929daed/0d75c6f4-e6fb-5bd0-aecc-167c7929daed_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/c1/d4c1216727f797573ca16942a154c2ea/pa/SY30151_1b4274f62fa8ca66acad3e6986c33a6a.jpg saved to cache
2026-04-27 08:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0d75c6f4-e6fb-5bd0-aecc-167c7929daed
2026-04-27 08:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142be15010>
2026-04-27 08:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b2e2793-aa9c-51bc-ad0a-850dfdc8ef49/2b2e2793-aa9c-51bc-ad0a-850dfdc8ef49_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/05/550580bfbcf5b96bc7d80e0c0346bd49/pa/MB19012_15351aa8fc68a9687178a081bbbdd801.jpg saved to cache
2026-04-27 08:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2b2e2793-aa9c-51bc-ad0a-850dfdc8ef49
2026-04-27 08:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bfd2590>
2026-04-27 08:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3308c1b0-2410-5f92-8e87-9ef534df5fbc/3308c1b0-2410-5f92-8e87-9ef534df5fbc_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/41/fa41a81cf5db1951d5643e2591403562/pa/KL75694_f715a1bfdfde57cffcea206b1a813cf7.jpg saved to cache
2026-04-27 08:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3308c1b0-2410-5f92-8e87-9ef534df5fbc
2026-04-27 08:01:11 [auto1.fr] INFO: Found listing with ID: GT20132
2026-04-27 08:01:12 [auto1.fr] INFO: Scrape type for GT20132: 2
2026-04-27 08:01:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e83c9f3a-67ec-5758-a81d-e587e1bb1f42 with identifier: GT20132
2026-04-27 08:01:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e83c9f3a-67ec-5758-a81d-e587e1bb1f42 with scrape type 2
2026-04-27 08:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e83c9f3a-67ec-5758-a81d-e587e1bb1f42 with scrape type 2
2026-04-27 08:01:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e83c9f3a-67ec-5758-a81d-e587e1bb1f42, identifier: GT20132
2026-04-27 08:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438e7ee10>
2026-04-27 08:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d75c6f4-e6fb-5bd0-aecc-167c7929daed/0d75c6f4-e6fb-5bd0-aecc-167c7929daed_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/c1/d4c1216727f797573ca16942a154c2ea/pa/SY30151_2cc32749096ad289f0ddc9a62c8d662f.jpg saved to cache
2026-04-27 08:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0d75c6f4-e6fb-5bd0-aecc-167c7929daed
2026-04-27 08:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bf91450>
2026-04-27 08:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b2e2793-aa9c-51bc-ad0a-850dfdc8ef49/2b2e2793-aa9c-51bc-ad0a-850dfdc8ef49_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/05/550580bfbcf5b96bc7d80e0c0346bd49/pa/MB19012_d301d6809aab34d5f97a3a53e5a06228.jpg saved to cache
2026-04-27 08:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2b2e2793-aa9c-51bc-ad0a-850dfdc8ef49
2026-04-27 08:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/c1/d4c1216727f797573ca16942a154c2ea/pa/SY30151_b22a5b6f3c310119c88d2a4c5e60c3e6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/c1/d4c1216727f797573ca16942a154c2ea/pa/SY30151_874ee83dd9848c297821c193af528946.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:12 [auto1.fr] INFO: Found listing with ID: SS62373
2026-04-27 08:01:12 [auto1.fr] INFO: Scrape type for SS62373: 1
2026-04-27 08:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/c1/d4c1216727f797573ca16942a154c2ea/pa/SY30151_7ea8db9b6ed82e3ac3d4ed030359fb8c.jpg not downloaded yet
2026-04-27 08:01:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e83c9f3a-67ec-5758-a81d-e587e1bb1f42 with identifier: GT20132
2026-04-27 08:01:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e83c9f3a-67ec-5758-a81d-e587e1bb1f42 with identifier: GT20132
2026-04-27 08:01:12 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e83c9f3a-67ec-5758-a81d-e587e1bb1f42 with identifier: GT20132 to the API
2026-04-27 08:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:12 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-04-28T15:36:13Z',
 'fuel_type': 'petrol',
 'id': 'e83c9f3a-67ec-5758-a81d-e587e1bb1f42',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GT20132',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Opel',
 'model': 'Mokka',
 'odometer': 93069,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2016-08-30',
 'seller_name': None,
 'title': 'Opel Mokka 1.4 Turbo Color Edition ecoFlex',
 'transmission': 'manual',
 'trim': 'Color Edition ecoFlex',
 'year': 2016}
2026-04-27 08:01:12 [auto1.fr] INFO: Saving data for GT20132: {'auction_closing_time': 1777390573.0, 'created_time': 1777022467.59282, 'has_photos': True, 'last_price_update_time': 1777276872.511227}
2026-04-27 08:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/41/fa41a81cf5db1951d5643e2591403562/pa/KL75694_fc9cb734eabffc4455846f981979ce47.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/05/550580bfbcf5b96bc7d80e0c0346bd49/pa/MB19012_a9ef17448ec2074ab7a92c34865e4d13.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:12 [auto1.fr] INFO: Found listing with ID: EZ24746
2026-04-27 08:01:12 [auto1.fr] INFO: Scrape type for EZ24746: 2
2026-04-27 08:01:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fce51e32-2212-5c6f-8b7b-41b9eac0f655 with identifier: EZ24746
2026-04-27 08:01:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fce51e32-2212-5c6f-8b7b-41b9eac0f655 with scrape type 2
2026-04-27 08:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fce51e32-2212-5c6f-8b7b-41b9eac0f655 with scrape type 2
2026-04-27 08:01:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: fce51e32-2212-5c6f-8b7b-41b9eac0f655, identifier: EZ24746
2026-04-27 08:01:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ec2e98d-2a63-59b3-92a4-07d52ea7a15f with identifier: RR97759
2026-04-27 08:01:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ec2e98d-2a63-59b3-92a4-07d52ea7a15f with scrape type 1
2026-04-27 08:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1ec2e98d-2a63-59b3-92a4-07d52ea7a15f
2026-04-27 08:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/3e/143edc043d0d25521847ba35b0dbc02a/pa/RR97759_baa3f24e1439b230b4baf16549d7ea26.jpg not downloaded yet
2026-04-27 08:01:12 [auto1.fr] INFO: Found listing with ID: LJ15402
2026-04-27 08:01:12 [auto1.fr] INFO: Scrape type for LJ15402: 1
2026-04-27 08:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/c1/d4c1216727f797573ca16942a154c2ea/pa/SY30151_c20e76faf63a58fd3eace1f4db423671.jpg not downloaded yet
2026-04-27 08:01:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: fce51e32-2212-5c6f-8b7b-41b9eac0f655 with identifier: EZ24746
2026-04-27 08:01:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: fce51e32-2212-5c6f-8b7b-41b9eac0f655 with identifier: EZ24746
2026-04-27 08:01:12 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: fce51e32-2212-5c6f-8b7b-41b9eac0f655 with identifier: EZ24746 to the API
2026-04-27 08:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:12 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 180,
 'expiration_date': '2026-04-28T15:43:19Z',
 'fuel_type': 'petrol',
 'id': 'fce51e32-2212-5c6f-8b7b-41b9eac0f655',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EZ24746',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Abarth',
 'model': '595',
 'odometer': 94949,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2015-12-31',
 'seller_name': None,
 'title': 'Abarth 595 1.4 Competizione',
 'transmission': 'manual',
 'trim': 'Competizione',
 'year': 2015}
2026-04-27 08:01:13 [auto1.fr] INFO: Saving data for EZ24746: {'auction_closing_time': 1777390999.0, 'created_time': 1777021140.745951, 'has_photos': True, 'last_price_update_time': 1777276873.040482}
2026-04-27 08:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/05/550580bfbcf5b96bc7d80e0c0346bd49/pa/MB19012_e9ae2e626968354a88dfff5ddeb3c47c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:13 [auto1.fr] INFO: Found listing with ID: NW36655
2026-04-27 08:01:13 [auto1.fr] INFO: Scrape type for NW36655: 2
2026-04-27 08:01:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ba3f02e-ecb2-5c29-8353-c41314d3cd02 with identifier: NW36655
2026-04-27 08:01:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ba3f02e-ecb2-5c29-8353-c41314d3cd02 with scrape type 2
2026-04-27 08:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7ba3f02e-ecb2-5c29-8353-c41314d3cd02 with scrape type 2
2026-04-27 08:01:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7ba3f02e-ecb2-5c29-8353-c41314d3cd02, identifier: NW36655
2026-04-27 08:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/3e/143edc043d0d25521847ba35b0dbc02a/pa/RR97759_3ef3272b87c15e2b1174b00d58aa0a0b.jpg not downloaded yet
2026-04-27 08:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c5ce90>
2026-04-27 08:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d75c6f4-e6fb-5bd0-aecc-167c7929daed/0d75c6f4-e6fb-5bd0-aecc-167c7929daed_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/c1/d4c1216727f797573ca16942a154c2ea/pa/SY30151_b22a5b6f3c310119c88d2a4c5e60c3e6.jpg saved to cache
2026-04-27 08:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0d75c6f4-e6fb-5bd0-aecc-167c7929daed
2026-04-27 08:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438074cd0>
2026-04-27 08:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d75c6f4-e6fb-5bd0-aecc-167c7929daed/0d75c6f4-e6fb-5bd0-aecc-167c7929daed_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/c1/d4c1216727f797573ca16942a154c2ea/pa/SY30151_874ee83dd9848c297821c193af528946.jpg saved to cache
2026-04-27 08:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0d75c6f4-e6fb-5bd0-aecc-167c7929daed
2026-04-27 08:01:13 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 2b2e2793-aa9c-51bc-ad0a-850dfdc8ef49 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:01:13 [auto1.fr] INFO: Found listing with ID: GX16265
2026-04-27 08:01:13 [auto1.fr] INFO: Scrape type for GX16265: 2
2026-04-27 08:01:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 51b7877a-ff54-5fdd-9ada-e61b806ac857 with identifier: GX16265
2026-04-27 08:01:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51b7877a-ff54-5fdd-9ada-e61b806ac857 with scrape type 2
2026-04-27 08:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 51b7877a-ff54-5fdd-9ada-e61b806ac857 with scrape type 2
2026-04-27 08:01:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 51b7877a-ff54-5fdd-9ada-e61b806ac857, identifier: GX16265
2026-04-27 08:01:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7ba3f02e-ecb2-5c29-8353-c41314d3cd02 with identifier: NW36655
2026-04-27 08:01:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7ba3f02e-ecb2-5c29-8353-c41314d3cd02 with identifier: NW36655
2026-04-27 08:01:13 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 7ba3f02e-ecb2-5c29-8353-c41314d3cd02 with identifier: NW36655 to the API
2026-04-27 08:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:13 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-04-28T15:42:31Z',
 'fuel_type': 'diesel',
 'id': '7ba3f02e-ecb2-5c29-8353-c41314d3cd02',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NW36655',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Volkswagen',
 'model': 'Arteon',
 'odometer': 178730,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2017-06-05',
 'seller_name': None,
 'title': 'Volkswagen Arteon 2.0 TDI R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2017}
2026-04-27 08:01:13 [auto1.fr] INFO: Saving data for NW36655: {'auction_closing_time': 1777390951.0, 'created_time': 1777020559.97319, 'has_photos': True, 'last_price_update_time': 1777276873.681884}
2026-04-27 08:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PA01531/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438be9710>
2026-04-27 08:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3308c1b0-2410-5f92-8e87-9ef534df5fbc/3308c1b0-2410-5f92-8e87-9ef534df5fbc_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/41/fa41a81cf5db1951d5643e2591403562/pa/KL75694_fc9cb734eabffc4455846f981979ce47.jpg saved to cache
2026-04-27 08:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3308c1b0-2410-5f92-8e87-9ef534df5fbc
2026-04-27 08:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438eca750>
2026-04-27 08:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b2e2793-aa9c-51bc-ad0a-850dfdc8ef49/2b2e2793-aa9c-51bc-ad0a-850dfdc8ef49_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/05/550580bfbcf5b96bc7d80e0c0346bd49/pa/MB19012_a9ef17448ec2074ab7a92c34865e4d13.jpg saved to cache
2026-04-27 08:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2b2e2793-aa9c-51bc-ad0a-850dfdc8ef49
2026-04-27 08:01:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 51b7877a-ff54-5fdd-9ada-e61b806ac857 with identifier: GX16265
2026-04-27 08:01:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 51b7877a-ff54-5fdd-9ada-e61b806ac857 with identifier: GX16265
2026-04-27 08:01:14 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 51b7877a-ff54-5fdd-9ada-e61b806ac857 with identifier: GX16265 to the API
2026-04-27 08:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:14 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-04-28T15:07:35Z',
 'fuel_type': 'diesel',
 'id': '51b7877a-ff54-5fdd-9ada-e61b806ac857',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GX16265',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 155355,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2020-12-13',
 'seller_name': None,
 'title': 'Renault Captur 1.5 BLUE dCi Intens',
 'transmission': 'manual',
 'trim': 'Intens',
 'year': 2020}
2026-04-27 08:01:14 [auto1.fr] INFO: Saving data for GX16265: {'auction_closing_time': 1777388855.0, 'created_time': 1777020175.850828, 'has_photos': True, 'last_price_update_time': 1777276874.317816}
2026-04-27 08:01:14 [auto1.fr] INFO: Found listing with ID: VY16395
2026-04-27 08:01:14 [auto1.fr] INFO: Scrape type for VY16395: 2
2026-04-27 08:01:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e74d7529-6f71-5ff0-90c4-e014c761ec6d with identifier: VY16395
2026-04-27 08:01:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e74d7529-6f71-5ff0-90c4-e014c761ec6d with scrape type 2
2026-04-27 08:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e74d7529-6f71-5ff0-90c4-e014c761ec6d with scrape type 2
2026-04-27 08:01:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e74d7529-6f71-5ff0-90c4-e014c761ec6d, identifier: VY16395
2026-04-27 08:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/3e/143edc043d0d25521847ba35b0dbc02a/pa/RR97759_c6b44210f3d0eccaff8def1d0c80f842.jpg not downloaded yet
2026-04-27 08:01:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/05/550580bfbcf5b96bc7d80e0c0346bd49/pa/MB19012_de734e9acefd8b47919229ab24a56497.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:14 [auto1.fr] INFO: Found listing with ID: AJ03424
2026-04-27 08:01:14 [auto1.fr] INFO: Scrape type for AJ03424: 2
2026-04-27 08:01:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9abda0e6-d1f7-59f7-8323-c957532c58bc with identifier: AJ03424
2026-04-27 08:01:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9abda0e6-d1f7-59f7-8323-c957532c58bc with scrape type 2
2026-04-27 08:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9abda0e6-d1f7-59f7-8323-c957532c58bc with scrape type 2
2026-04-27 08:01:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 9abda0e6-d1f7-59f7-8323-c957532c58bc, identifier: AJ03424
2026-04-27 08:01:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e74d7529-6f71-5ff0-90c4-e014c761ec6d with identifier: VY16395
2026-04-27 08:01:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e74d7529-6f71-5ff0-90c4-e014c761ec6d with identifier: VY16395
2026-04-27 08:01:14 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e74d7529-6f71-5ff0-90c4-e014c761ec6d with identifier: VY16395 to the API
2026-04-27 08:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:14 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-04-28T15:16:21Z',
 'fuel_type': 'petrol',
 'id': 'e74d7529-6f71-5ff0-90c4-e014c761ec6d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VY16395',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 160971,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2009-06-14',
 'seller_name': None,
 'title': 'Renault Twingo 1.2 Expression',
 'transmission': 'manual',
 'trim': 'Expression',
 'year': 2009}
2026-04-27 08:01:14 [auto1.fr] INFO: Saving data for VY16395: {'auction_closing_time': 1777389381.0, 'created_time': 1777021526.307296, 'has_photos': True, 'last_price_update_time': 1777276874.862317}
2026-04-27 08:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380be410>
2026-04-27 08:01:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b2e2793-aa9c-51bc-ad0a-850dfdc8ef49/2b2e2793-aa9c-51bc-ad0a-850dfdc8ef49_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/05/550580bfbcf5b96bc7d80e0c0346bd49/pa/MB19012_e9ae2e626968354a88dfff5ddeb3c47c.jpg saved to cache
2026-04-27 08:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2b2e2793-aa9c-51bc-ad0a-850dfdc8ef49
2026-04-27 08:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/c1/d4c1216727f797573ca16942a154c2ea/pa/SY30151_791afc3e3f6f4f0b5265a3f694c4b9b3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/c1/d4c1216727f797573ca16942a154c2ea/pa/SY30151_7ea8db9b6ed82e3ac3d4ed030359fb8c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 9abda0e6-d1f7-59f7-8323-c957532c58bc with identifier: AJ03424
2026-04-27 08:01:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 9abda0e6-d1f7-59f7-8323-c957532c58bc with identifier: AJ03424
2026-04-27 08:01:15 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 9abda0e6-d1f7-59f7-8323-c957532c58bc with identifier: AJ03424 to the API
2026-04-27 08:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:15 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-04-28T15:29:26Z',
 'fuel_type': 'diesel',
 'id': '9abda0e6-d1f7-59f7-8323-c957532c58bc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AJ03424',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Mercedes-Benz',
 'model': 'GLK-Klasse',
 'odometer': 285693,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2011-11-03',
 'seller_name': None,
 'title': 'Mercedes-Benz GLK-Klasse GLK 220 CDI 4Matic BlueEfficiency',
 'transmission': 'automatic',
 'trim': '4Matic BlueEfficiency',
 'year': 2011}
2026-04-27 08:01:15 [auto1.fr] INFO: Saving data for AJ03424: {'auction_closing_time': 1777390166.0, 'created_time': 1777019556.663116, 'has_photos': True, 'last_price_update_time': 1777276875.205358}
2026-04-27 08:01:15 [auto1.fr] INFO: Found listing with ID: PD48536
2026-04-27 08:01:15 [auto1.fr] INFO: Scrape type for PD48536: 2
2026-04-27 08:01:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f826aa0-c784-5ab5-aca7-37c06a295a5b with identifier: PD48536
2026-04-27 08:01:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f826aa0-c784-5ab5-aca7-37c06a295a5b with scrape type 2
2026-04-27 08:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6f826aa0-c784-5ab5-aca7-37c06a295a5b with scrape type 2
2026-04-27 08:01:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6f826aa0-c784-5ab5-aca7-37c06a295a5b, identifier: PD48536
2026-04-27 08:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/3e/143edc043d0d25521847ba35b0dbc02a/pa/RR97759_b5607295ef4c02d899a7ad2ebd594ac4.jpg not downloaded yet
2026-04-27 08:01:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/3e/143edc043d0d25521847ba35b0dbc02a/pa/RR97759_baa3f24e1439b230b4baf16549d7ea26.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:15 [auto1.fr] INFO: Found listing with ID: SU63674
2026-04-27 08:01:15 [auto1.fr] INFO: Scrape type for SU63674: 1
2026-04-27 08:01:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6f826aa0-c784-5ab5-aca7-37c06a295a5b with identifier: PD48536
2026-04-27 08:01:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6f826aa0-c784-5ab5-aca7-37c06a295a5b with identifier: PD48536
2026-04-27 08:01:15 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6f826aa0-c784-5ab5-aca7-37c06a295a5b with identifier: PD48536 to the API
2026-04-27 08:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:15 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 120,
 'expiration_date': '2026-04-28T15:14:33Z',
 'fuel_type': 'diesel',
 'id': '6f826aa0-c784-5ab5-aca7-37c06a295a5b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PD48536',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Citroen',
 'model': 'Jumpy',
 'odometer': 281494,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2008-01-30',
 'seller_name': None,
 'title': 'Citroen Jumpy 2.0 HDi L1 Confort',
 'transmission': 'manual',
 'trim': 'L1 Confort',
 'year': 2008}
2026-04-27 08:01:15 [auto1.fr] INFO: Saving data for PD48536: {'auction_closing_time': 1777389273.0, 'created_time': 1777021811.659595, 'has_photos': True, 'last_price_update_time': 1777276875.644092}
2026-04-27 08:01:15 [auto1.fr] INFO: Found listing with ID: KV97324
2026-04-27 08:01:15 [auto1.fr] INFO: Scrape type for KV97324: 1
2026-04-27 08:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/3e/143edc043d0d25521847ba35b0dbc02a/pa/RR97759_fb8f2f5cf013e7fc04b453406da0b907.jpg not downloaded yet
2026-04-27 08:01:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14381fb910>
2026-04-27 08:01:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b2e2793-aa9c-51bc-ad0a-850dfdc8ef49/2b2e2793-aa9c-51bc-ad0a-850dfdc8ef49_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/05/550580bfbcf5b96bc7d80e0c0346bd49/pa/MB19012_de734e9acefd8b47919229ab24a56497.jpg saved to cache
2026-04-27 08:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2b2e2793-aa9c-51bc-ad0a-850dfdc8ef49
2026-04-27 08:01:15 [auto1.fr] INFO: Found listing with ID: WG00689
2026-04-27 08:01:15 [auto1.fr] INFO: Scrape type for WG00689: 1
2026-04-27 08:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/3e/143edc043d0d25521847ba35b0dbc02a/pa/RR97759_3ef3272b87c15e2b1174b00d58aa0a0b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/c1/d4c1216727f797573ca16942a154c2ea/pa/SY30151_c20e76faf63a58fd3eace1f4db423671.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:15 [auto1.fr] INFO: Found listing with ID: KH97076
2026-04-27 08:01:15 [auto1.fr] INFO: Scrape type for KH97076: 1
2026-04-27 08:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/3e/143edc043d0d25521847ba35b0dbc02a/pa/RR97759_50528a93487f5b6a6611664ae19e577c.jpg not downloaded yet
2026-04-27 08:01:15 [auto1.fr] INFO: Channel: 24h | Page: 14 | totalHits: 4745 | hits on page: 40
2026-04-27 08:01:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ae47d0>
2026-04-27 08:01:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d75c6f4-e6fb-5bd0-aecc-167c7929daed/0d75c6f4-e6fb-5bd0-aecc-167c7929daed_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/c1/d4c1216727f797573ca16942a154c2ea/pa/SY30151_791afc3e3f6f4f0b5265a3f694c4b9b3.jpg saved to cache
2026-04-27 08:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0d75c6f4-e6fb-5bd0-aecc-167c7929daed
2026-04-27 08:01:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c3de90>
2026-04-27 08:01:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d75c6f4-e6fb-5bd0-aecc-167c7929daed/0d75c6f4-e6fb-5bd0-aecc-167c7929daed_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/c1/d4c1216727f797573ca16942a154c2ea/pa/SY30151_7ea8db9b6ed82e3ac3d4ed030359fb8c.jpg saved to cache
2026-04-27 08:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0d75c6f4-e6fb-5bd0-aecc-167c7929daed
2026-04-27 08:01:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142be19c90>
2026-04-27 08:01:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ec2e98d-2a63-59b3-92a4-07d52ea7a15f/1ec2e98d-2a63-59b3-92a4-07d52ea7a15f_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/3e/143edc043d0d25521847ba35b0dbc02a/pa/RR97759_baa3f24e1439b230b4baf16549d7ea26.jpg saved to cache
2026-04-27 08:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1ec2e98d-2a63-59b3-92a4-07d52ea7a15f
2026-04-27 08:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/3e/143edc043d0d25521847ba35b0dbc02a/pa/RR97759_c6b44210f3d0eccaff8def1d0c80f842.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:15 [auto1.fr] INFO: Found listing with ID: BN95548
2026-04-27 08:01:15 [auto1.fr] INFO: Scrape type for BN95548: 2
2026-04-27 08:01:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 506b39e9-7315-55ae-952a-2a1085c7ab77 with identifier: BN95548
2026-04-27 08:01:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 506b39e9-7315-55ae-952a-2a1085c7ab77 with scrape type 2
2026-04-27 08:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 506b39e9-7315-55ae-952a-2a1085c7ab77 with scrape type 2
2026-04-27 08:01:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 506b39e9-7315-55ae-952a-2a1085c7ab77, identifier: BN95548
2026-04-27 08:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/c1/d4c1216727f797573ca16942a154c2ea/pa/SY30151_a986eddb694b68529af4b6135effc955.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 506b39e9-7315-55ae-952a-2a1085c7ab77 with identifier: BN95548
2026-04-27 08:01:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 506b39e9-7315-55ae-952a-2a1085c7ab77 with identifier: BN95548
2026-04-27 08:01:16 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 506b39e9-7315-55ae-952a-2a1085c7ab77 with identifier: BN95548 to the API
2026-04-27 08:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:16 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-04-28T15:25:23Z',
 'fuel_type': 'petrol',
 'id': '506b39e9-7315-55ae-952a-2a1085c7ab77',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BN95548',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 159849,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2014-05-31',
 'seller_name': None,
 'title': 'Citroen C3 1.2 VTi Collection',
 'transmission': 'manual',
 'trim': 'Collection',
 'year': 2014}
2026-04-27 08:01:16 [auto1.fr] INFO: Saving data for BN95548: {'auction_closing_time': 1777389923.0, 'created_time': 1777021912.341254, 'has_photos': True, 'last_price_update_time': 1777276876.291944}
2026-04-27 08:01:16 [auto1.fr] INFO: Found listing with ID: FP08474
2026-04-27 08:01:16 [auto1.fr] INFO: Scrape type for FP08474: 2
2026-04-27 08:01:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 103c2fd2-0ec8-5d1a-9e0a-aa0263141668 with identifier: FP08474
2026-04-27 08:01:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 103c2fd2-0ec8-5d1a-9e0a-aa0263141668 with scrape type 2
2026-04-27 08:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 103c2fd2-0ec8-5d1a-9e0a-aa0263141668 with scrape type 2
2026-04-27 08:01:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 103c2fd2-0ec8-5d1a-9e0a-aa0263141668, identifier: FP08474
2026-04-27 08:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/3e/143edc043d0d25521847ba35b0dbc02a/pa/RR97759_c8757a4bccf22f2b20cf927068c69254.jpg not downloaded yet
2026-04-27 08:01:16 [auto1.fr] INFO: Found listing with ID: VK19723
2026-04-27 08:01:16 [auto1.fr] INFO: Scrape type for VK19723: 1
2026-04-27 08:01:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 103c2fd2-0ec8-5d1a-9e0a-aa0263141668 with identifier: FP08474
2026-04-27 08:01:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 103c2fd2-0ec8-5d1a-9e0a-aa0263141668 with identifier: FP08474
2026-04-27 08:01:16 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 103c2fd2-0ec8-5d1a-9e0a-aa0263141668 with identifier: FP08474 to the API
2026-04-27 08:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:16 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 95,
 'expiration_date': '2026-04-28T15:25:01Z',
 'fuel_type': 'petrol',
 'id': '103c2fd2-0ec8-5d1a-9e0a-aa0263141668',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FP08474',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Peugeot',
 'model': '207',
 'odometer': 223709,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2009-02-04',
 'seller_name': None,
 'title': 'Peugeot 207 1.4 VTi Premium Pack',
 'transmission': 'manual',
 'trim': 'Premium Pack',
 'year': 2009}
2026-04-27 08:01:16 [auto1.fr] INFO: Saving data for FP08474: {'auction_closing_time': 1777389901.0, 'created_time': 1777023048.45409, 'has_photos': True, 'last_price_update_time': 1777276876.796912}
2026-04-27 08:01:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ed9090>
2026-04-27 08:01:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ec2e98d-2a63-59b3-92a4-07d52ea7a15f/1ec2e98d-2a63-59b3-92a4-07d52ea7a15f_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/3e/143edc043d0d25521847ba35b0dbc02a/pa/RR97759_3ef3272b87c15e2b1174b00d58aa0a0b.jpg saved to cache
2026-04-27 08:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1ec2e98d-2a63-59b3-92a4-07d52ea7a15f
2026-04-27 08:01:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142be0cc90>
2026-04-27 08:01:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d75c6f4-e6fb-5bd0-aecc-167c7929daed/0d75c6f4-e6fb-5bd0-aecc-167c7929daed_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/c1/d4c1216727f797573ca16942a154c2ea/pa/SY30151_c20e76faf63a58fd3eace1f4db423671.jpg saved to cache
2026-04-27 08:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0d75c6f4-e6fb-5bd0-aecc-167c7929daed
2026-04-27 08:01:16 [auto1.fr] INFO: Found listing with ID: PP18123
2026-04-27 08:01:16 [auto1.fr] INFO: Scrape type for PP18123: 1
2026-04-27 08:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/3e/143edc043d0d25521847ba35b0dbc02a/pa/RR97759_8951d756eae44bb7eb5821c44a867ca9.jpg not downloaded yet
2026-04-27 08:01:16 [auto1.fr] INFO: Found listing with ID: HR99177
2026-04-27 08:01:16 [auto1.fr] INFO: Scrape type for HR99177: 2
2026-04-27 08:01:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b0d03bf-4841-59c0-aa27-24c2e3e181ab with identifier: HR99177
2026-04-27 08:01:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b0d03bf-4841-59c0-aa27-24c2e3e181ab with scrape type 2
2026-04-27 08:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9b0d03bf-4841-59c0-aa27-24c2e3e181ab with scrape type 2
2026-04-27 08:01:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 9b0d03bf-4841-59c0-aa27-24c2e3e181ab, identifier: HR99177
2026-04-27 08:01:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/3e/143edc043d0d25521847ba35b0dbc02a/pa/RR97759_fb8f2f5cf013e7fc04b453406da0b907.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 9b0d03bf-4841-59c0-aa27-24c2e3e181ab with identifier: HR99177
2026-04-27 08:01:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 9b0d03bf-4841-59c0-aa27-24c2e3e181ab with identifier: HR99177
2026-04-27 08:01:17 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 9b0d03bf-4841-59c0-aa27-24c2e3e181ab with identifier: HR99177 to the API
2026-04-27 08:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:17 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-04-28T15:38:46Z',
 'fuel_type': 'diesel',
 'id': '9b0d03bf-4841-59c0-aa27-24c2e3e181ab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HR99177',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 114138,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2018-05-30',
 'seller_name': None,
 'title': 'Audi A5 Sportback 2.0 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-04-27 08:01:17 [auto1.fr] INFO: Saving data for HR99177: {'auction_closing_time': 1777390726.0, 'created_time': 1777020877.666945, 'has_photos': True, 'last_price_update_time': 1777276877.36653}
2026-04-27 08:01:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ae9710>
2026-04-27 08:01:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ec2e98d-2a63-59b3-92a4-07d52ea7a15f/1ec2e98d-2a63-59b3-92a4-07d52ea7a15f_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/3e/143edc043d0d25521847ba35b0dbc02a/pa/RR97759_c6b44210f3d0eccaff8def1d0c80f842.jpg saved to cache
2026-04-27 08:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1ec2e98d-2a63-59b3-92a4-07d52ea7a15f
2026-04-27 08:01:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bfac110>
2026-04-27 08:01:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d75c6f4-e6fb-5bd0-aecc-167c7929daed/0d75c6f4-e6fb-5bd0-aecc-167c7929daed_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/c1/d4c1216727f797573ca16942a154c2ea/pa/SY30151_a986eddb694b68529af4b6135effc955.jpg saved to cache
2026-04-27 08:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0d75c6f4-e6fb-5bd0-aecc-167c7929daed
2026-04-27 08:01:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0d75c6f4-e6fb-5bd0-aecc-167c7929daed, skipping ID generation
2026-04-27 08:01:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d75c6f4-e6fb-5bd0-aecc-167c7929daed with scrape type 1
2026-04-27 08:01:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0d75c6f4-e6fb-5bd0-aecc-167c7929daed sending to next pipeline
2026-04-27 08:01:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0d75c6f4-e6fb-5bd0-aecc-167c7929daed, identifier: SY30151
2026-04-27 08:01:17 [auto1.fr] INFO: Found listing with ID: TD30440
2026-04-27 08:01:17 [auto1.fr] INFO: Scrape type for TD30440: 1
2026-04-27 08:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/3e/143edc043d0d25521847ba35b0dbc02a/pa/RR97759_1392321feee5b923360b75691addd91f.jpg not downloaded yet
2026-04-27 08:01:17 [auto1.fr] INFO: Found listing with ID: KY02364
2026-04-27 08:01:17 [auto1.fr] INFO: Scrape type for KY02364: 1
2026-04-27 08:01:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0d75c6f4-e6fb-5bd0-aecc-167c7929daed with identifier: SY30151
2026-04-27 08:01:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0d75c6f4-e6fb-5bd0-aecc-167c7929daed with identifier: SY30151
2026-04-27 08:01:17 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 0d75c6f4-e6fb-5bd0-aecc-167c7929daed with identifier: SY30151 to the API
2026-04-27 08:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:17 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd4/c1/d4c1216727f797573ca16942a154c2ea/pa/SY30151_a986eddb694b68529af4b6135effc955.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'category': None,
 'city': 'Boé',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 125,
 'expiration_date': '2026-04-28T15:01:44Z',
 'fuel_type': 'petrol',
 'id': '0d75c6f4-e6fb-5bd0-aecc-167c7929daed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 44.1602,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SY30151',
 'listing': 'auction',
 'location': 'FR, Boé',
 'location_confidence': 'geocoded',
 'longitude': 0.6281,
 'make': 'Ford',
 'model': 'Puma',
 'odometer': 126696,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 18,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0d75c6f4-e6fb-5bd0-aecc-167c7929daed/0d75c6f4-e6fb-5bd0-aecc-167c7929daed_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44190,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/c1/d4c1216727f797573ca16942a154c2ea/pa/SY30151_a0b29362139ffa0af418a6f344b50df6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0d75c6f4-e6fb-5bd0-aecc-167c7929daed/0d75c6f4-e6fb-5bd0-aecc-167c7929daed_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46437,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/c1/d4c1216727f797573ca16942a154c2ea/pa/SY30151_1b4274f62fa8ca66acad3e6986c33a6a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0d75c6f4-e6fb-5bd0-aecc-167c7929daed/0d75c6f4-e6fb-5bd0-aecc-167c7929daed_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40635,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/c1/d4c1216727f797573ca16942a154c2ea/pa/SY30151_2cc32749096ad289f0ddc9a62c8d662f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0d75c6f4-e6fb-5bd0-aecc-167c7929daed/0d75c6f4-e6fb-5bd0-aecc-167c7929daed_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48996,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/c1/d4c1216727f797573ca16942a154c2ea/pa/SY30151_b22a5b6f3c310119c88d2a4c5e60c3e6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0d75c6f4-e6fb-5bd0-aecc-167c7929daed/0d75c6f4-e6fb-5bd0-aecc-167c7929daed_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49421,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/c1/d4c1216727f797573ca16942a154c2ea/pa/SY30151_874ee83dd9848c297821c193af528946.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0d75c6f4-e6fb-5bd0-aecc-167c7929daed/0d75c6f4-e6fb-5bd0-aecc-167c7929daed_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40688,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/c1/d4c1216727f797573ca16942a154c2ea/pa/SY30151_a986eddb694b68529af4b6135effc955.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0d75c6f4-e6fb-5bd0-aecc-167c7929daed/0d75c6f4-e6fb-5bd0-aecc-167c7929daed_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97664,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/c1/d4c1216727f797573ca16942a154c2ea/pa/SY30151_791afc3e3f6f4f0b5265a3f694c4b9b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0d75c6f4-e6fb-5bd0-aecc-167c7929daed/0d75c6f4-e6fb-5bd0-aecc-167c7929daed_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71306,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/c1/d4c1216727f797573ca16942a154c2ea/pa/SY30151_7ea8db9b6ed82e3ac3d4ed030359fb8c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0d75c6f4-e6fb-5bd0-aecc-167c7929daed/0d75c6f4-e6fb-5bd0-aecc-167c7929daed_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66460,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/c1/d4c1216727f797573ca16942a154c2ea/pa/SY30151_c20e76faf63a58fd3eace1f4db423671.jpg',
             'Width': 800}],
 'postal_code': '47550',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Lot-et-Garonne',
 'province_code': 'FR-47',
 'region': 'Nouvelle-Aquitaine',
 'region_code': 'FR-75',
 'registration_date': '2022-11-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Puma 1.0 EcoBoost Mild-Hybrid Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2022}
2026-04-27 08:01:17 [auto1.fr] INFO: Saving data for SY30151: {'created_time': 1777276877.88396, 'last_price_update_time': 1777276877.883969, 'has_photos': True, 'auction_closing_time': 1777388504.0}
2026-04-27 08:01:17 [auto1.fr] INFO: Found listing with ID: KH72577
2026-04-27 08:01:17 [auto1.fr] INFO: Scrape type for KH72577: 2
2026-04-27 08:01:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16fe0df9-c766-5afb-af15-d100ed8ae57b with identifier: KH72577
2026-04-27 08:01:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16fe0df9-c766-5afb-af15-d100ed8ae57b with scrape type 2
2026-04-27 08:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 16fe0df9-c766-5afb-af15-d100ed8ae57b with scrape type 2
2026-04-27 08:01:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 16fe0df9-c766-5afb-af15-d100ed8ae57b, identifier: KH72577
2026-04-27 08:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/3e/143edc043d0d25521847ba35b0dbc02a/pa/RR97759_9a6cc6e50a3123fe8d8447fe9f372676.jpg not downloaded yet
2026-04-27 08:01:18 [auto1.fr] INFO: Found listing with ID: SV53673
2026-04-27 08:01:18 [auto1.fr] INFO: Scrape type for SV53673: 1
2026-04-27 08:01:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b29290>
2026-04-27 08:01:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ec2e98d-2a63-59b3-92a4-07d52ea7a15f/1ec2e98d-2a63-59b3-92a4-07d52ea7a15f_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/3e/143edc043d0d25521847ba35b0dbc02a/pa/RR97759_fb8f2f5cf013e7fc04b453406da0b907.jpg saved to cache
2026-04-27 08:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1ec2e98d-2a63-59b3-92a4-07d52ea7a15f
2026-04-27 08:01:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 16fe0df9-c766-5afb-af15-d100ed8ae57b with identifier: KH72577
2026-04-27 08:01:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 16fe0df9-c766-5afb-af15-d100ed8ae57b with identifier: KH72577
2026-04-27 08:01:18 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 16fe0df9-c766-5afb-af15-d100ed8ae57b with identifier: KH72577 to the API
2026-04-27 08:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:18 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-04-28T15:33:14Z',
 'fuel_type': 'petrol',
 'id': '16fe0df9-c766-5afb-af15-d100ed8ae57b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KH72577',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 98744,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2016-06-29',
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2016}
2026-04-27 08:01:18 [auto1.fr] INFO: Saving data for KH72577: {'auction_closing_time': 1777390394.0, 'created_time': 1777021505.909291, 'has_photos': True, 'last_price_update_time': 1777276878.402556}
2026-04-27 08:01:18 [auto1.fr] INFO: Found listing with ID: JB08558
2026-04-27 08:01:18 [auto1.fr] INFO: Scrape type for JB08558: 1
2026-04-27 08:01:18 [auto1.fr] INFO: Found listing with ID: MX01852
2026-04-27 08:01:18 [auto1.fr] INFO: Scrape type for MX01852: 1
2026-04-27 08:01:18 [auto1.fr] INFO: Found listing with ID: PZ40280
2026-04-27 08:01:18 [auto1.fr] INFO: Scrape type for PZ40280: 1
2026-04-27 08:01:18 [auto1.fr] INFO: Found listing with ID: VL45066
2026-04-27 08:01:18 [auto1.fr] INFO: Scrape type for VL45066: 2
2026-04-27 08:01:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5744641-b964-5c6b-b72e-2b4116842ad7 with identifier: VL45066
2026-04-27 08:01:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5744641-b964-5c6b-b72e-2b4116842ad7 with scrape type 2
2026-04-27 08:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c5744641-b964-5c6b-b72e-2b4116842ad7 with scrape type 2
2026-04-27 08:01:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c5744641-b964-5c6b-b72e-2b4116842ad7, identifier: VL45066
2026-04-27 08:01:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c5744641-b964-5c6b-b72e-2b4116842ad7 with identifier: VL45066
2026-04-27 08:01:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c5744641-b964-5c6b-b72e-2b4116842ad7 with identifier: VL45066
2026-04-27 08:01:18 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c5744641-b964-5c6b-b72e-2b4116842ad7 with identifier: VL45066 to the API
2026-04-27 08:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:18 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-04-28T15:18:26Z',
 'fuel_type': 'diesel',
 'id': 'c5744641-b964-5c6b-b72e-2b4116842ad7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VL45066',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Mercedes-Benz',
 'model': 'GLK-Klasse',
 'odometer': 303714,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2011-04-19',
 'seller_name': None,
 'title': 'Mercedes-Benz GLK-Klasse GLK 220 CDI 4Matic BlueEfficiency',
 'transmission': 'automatic',
 'trim': '4Matic BlueEfficiency',
 'year': 2011}
2026-04-27 08:01:18 [auto1.fr] INFO: Saving data for VL45066: {'auction_closing_time': 1777389506.0, 'created_time': 1777022267.314614, 'has_photos': True, 'last_price_update_time': 1777276878.894516}
2026-04-27 08:01:19 [auto1.fr] INFO: Found listing with ID: XD56636
2026-04-27 08:01:19 [auto1.fr] INFO: Scrape type for XD56636: 1
2026-04-27 08:01:19 [auto1.fr] INFO: Found listing with ID: TT43743
2026-04-27 08:01:19 [auto1.fr] INFO: Scrape type for TT43743: 2
2026-04-27 08:01:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c956d3d-2f17-5e74-b03a-89981552e32d with identifier: TT43743
2026-04-27 08:01:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c956d3d-2f17-5e74-b03a-89981552e32d with scrape type 2
2026-04-27 08:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6c956d3d-2f17-5e74-b03a-89981552e32d with scrape type 2
2026-04-27 08:01:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6c956d3d-2f17-5e74-b03a-89981552e32d, identifier: TT43743
2026-04-27 08:01:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6c956d3d-2f17-5e74-b03a-89981552e32d with identifier: TT43743
2026-04-27 08:01:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6c956d3d-2f17-5e74-b03a-89981552e32d with identifier: TT43743
2026-04-27 08:01:19 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6c956d3d-2f17-5e74-b03a-89981552e32d with identifier: TT43743 to the API
2026-04-27 08:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:19 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-04-28T15:54:08Z',
 'fuel_type': 'diesel',
 'id': '6c956d3d-2f17-5e74-b03a-89981552e32d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TT43743',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 145140,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2020-12-01',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-04-27 08:01:19 [auto1.fr] INFO: Saving data for TT43743: {'auction_closing_time': 1777391648.0, 'created_time': 1777021027.568194, 'has_photos': True, 'last_price_update_time': 1777276879.421955}
2026-04-27 08:01:19 [auto1.fr] INFO: Found listing with ID: VN64150
2026-04-27 08:01:19 [auto1.fr] INFO: Scrape type for VN64150: 1
2026-04-27 08:01:19 [auto1.fr] INFO: Found listing with ID: NC01103
2026-04-27 08:01:19 [auto1.fr] INFO: Scrape type for NC01103: 1
2026-04-27 08:01:19 [auto1.fr] INFO: Found listing with ID: TR20925
2026-04-27 08:01:19 [auto1.fr] INFO: Scrape type for TR20925: 1
2026-04-27 08:01:19 [auto1.fr] INFO: Found listing with ID: KD43260
2026-04-27 08:01:19 [auto1.fr] INFO: Scrape type for KD43260: 2
2026-04-27 08:01:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: feaeaf1a-3938-50ee-aebf-2a2d75cf438c with identifier: KD43260
2026-04-27 08:01:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item feaeaf1a-3938-50ee-aebf-2a2d75cf438c with scrape type 2
2026-04-27 08:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item feaeaf1a-3938-50ee-aebf-2a2d75cf438c with scrape type 2
2026-04-27 08:01:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: feaeaf1a-3938-50ee-aebf-2a2d75cf438c, identifier: KD43260
2026-04-27 08:01:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: feaeaf1a-3938-50ee-aebf-2a2d75cf438c with identifier: KD43260
2026-04-27 08:01:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: feaeaf1a-3938-50ee-aebf-2a2d75cf438c with identifier: KD43260
2026-04-27 08:01:19 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: feaeaf1a-3938-50ee-aebf-2a2d75cf438c with identifier: KD43260 to the API
2026-04-27 08:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:19 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-04-28T15:35:08Z',
 'fuel_type': 'diesel',
 'id': 'feaeaf1a-3938-50ee-aebf-2a2d75cf438c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KD43260',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Renault',
 'model': 'Espace',
 'odometer': 127513,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2019-04-24',
 'seller_name': None,
 'title': 'Renault Espace 2.0 BLUE dCi Initiale Paris',
 'transmission': 'automatic',
 'trim': 'Initiale Paris',
 'year': 2019}
2026-04-27 08:01:19 [auto1.fr] INFO: Saving data for KD43260: {'auction_closing_time': 1777390508.0, 'created_time': 1777020206.553857, 'has_photos': True, 'last_price_update_time': 1777276879.968679}
2026-04-27 08:01:19 [auto1.fr] INFO: Found listing with ID: AT67197
2026-04-27 08:01:19 [auto1.fr] INFO: Scrape type for AT67197: 2
2026-04-27 08:01:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f559df6-a416-5c5f-b59c-52475b22b49c with identifier: AT67197
2026-04-27 08:01:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f559df6-a416-5c5f-b59c-52475b22b49c with scrape type 2
2026-04-27 08:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f559df6-a416-5c5f-b59c-52475b22b49c with scrape type 2
2026-04-27 08:01:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0f559df6-a416-5c5f-b59c-52475b22b49c, identifier: AT67197
2026-04-27 08:01:20 [auto1.fr] INFO: Found listing with ID: FX33595
2026-04-27 08:01:20 [auto1.fr] INFO: Scrape type for FX33595: 1
2026-04-27 08:01:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0f559df6-a416-5c5f-b59c-52475b22b49c with identifier: AT67197
2026-04-27 08:01:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0f559df6-a416-5c5f-b59c-52475b22b49c with identifier: AT67197
2026-04-27 08:01:20 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 0f559df6-a416-5c5f-b59c-52475b22b49c with identifier: AT67197 to the API
2026-04-27 08:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:20 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-04-28T15:11:56Z',
 'fuel_type': 'petrol',
 'id': '0f559df6-a416-5c5f-b59c-52475b22b49c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AT67197',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Peugeot',
 'model': '207',
 'odometer': 166381,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2011-05-12',
 'seller_name': None,
 'title': 'Peugeot 207 1.4 VTi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2011}
2026-04-27 08:01:20 [auto1.fr] INFO: Saving data for AT67197: {'auction_closing_time': 1777389116.0, 'created_time': 1777021675.020258, 'has_photos': True, 'last_price_update_time': 1777276880.365605}
2026-04-27 08:01:20 [auto1.fr] INFO: Found listing with ID: TB56422
2026-04-27 08:01:20 [auto1.fr] INFO: Scrape type for TB56422: 2
2026-04-27 08:01:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7f316cd-d542-562b-83e2-cede3c4b02eb with identifier: TB56422
2026-04-27 08:01:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7f316cd-d542-562b-83e2-cede3c4b02eb with scrape type 2
2026-04-27 08:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7f316cd-d542-562b-83e2-cede3c4b02eb with scrape type 2
2026-04-27 08:01:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b7f316cd-d542-562b-83e2-cede3c4b02eb, identifier: TB56422
2026-04-27 08:01:20 [auto1.fr] INFO: Found listing with ID: XZ61201
2026-04-27 08:01:20 [auto1.fr] INFO: Scrape type for XZ61201: 1
2026-04-27 08:01:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b7f316cd-d542-562b-83e2-cede3c4b02eb with identifier: TB56422
2026-04-27 08:01:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b7f316cd-d542-562b-83e2-cede3c4b02eb with identifier: TB56422
2026-04-27 08:01:20 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b7f316cd-d542-562b-83e2-cede3c4b02eb with identifier: TB56422 to the API
2026-04-27 08:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:20 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-04-28T15:50:41Z',
 'fuel_type': 'diesel',
 'id': 'b7f316cd-d542-562b-83e2-cede3c4b02eb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TB56422',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 119491,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2016-10-02',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 220 4Matic Exclusive',
 'transmission': 'automatic',
 'trim': '4Matic Exclusive',
 'year': 2016}
2026-04-27 08:01:20 [auto1.fr] INFO: Saving data for TB56422: {'auction_closing_time': 1777391441.0, 'created_time': 1777021029.371522, 'has_photos': True, 'last_price_update_time': 1777276880.770879}
2026-04-27 08:01:20 [auto1.fr] INFO: Found listing with ID: AV65681
2026-04-27 08:01:20 [auto1.fr] INFO: Scrape type for AV65681: 1
2026-04-27 08:01:20 [auto1.fr] INFO: Found listing with ID: RG55649
2026-04-27 08:01:20 [auto1.fr] INFO: Scrape type for RG55649: 1
2026-04-27 08:01:20 [auto1.fr] INFO: Found listing with ID: UL64685
2026-04-27 08:01:20 [auto1.fr] INFO: Scrape type for UL64685: 1
2026-04-27 08:01:20 [auto1.fr] INFO: Found listing with ID: ZK94381
2026-04-27 08:01:20 [auto1.fr] INFO: Scrape type for ZK94381: 2
2026-04-27 08:01:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ddda3fc-37f2-5e71-805e-e8139496cee7 with identifier: ZK94381
2026-04-27 08:01:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ddda3fc-37f2-5e71-805e-e8139496cee7 with scrape type 2
2026-04-27 08:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4ddda3fc-37f2-5e71-805e-e8139496cee7 with scrape type 2
2026-04-27 08:01:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4ddda3fc-37f2-5e71-805e-e8139496cee7, identifier: ZK94381
2026-04-27 08:01:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4ddda3fc-37f2-5e71-805e-e8139496cee7 with identifier: ZK94381
2026-04-27 08:01:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4ddda3fc-37f2-5e71-805e-e8139496cee7 with identifier: ZK94381
2026-04-27 08:01:21 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 4ddda3fc-37f2-5e71-805e-e8139496cee7 with identifier: ZK94381 to the API
2026-04-27 08:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:21 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-04-28T15:05:11Z',
 'fuel_type': 'diesel',
 'id': '4ddda3fc-37f2-5e71-805e-e8139496cee7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZK94381',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 125908,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2013-10-06',
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2013}
2026-04-27 08:01:21 [auto1.fr] INFO: Saving data for ZK94381: {'auction_closing_time': 1777388711.0, 'created_time': 1777022321.570432, 'has_photos': True, 'last_price_update_time': 1777276881.233237}
2026-04-27 08:01:21 [auto1.fr] INFO: Found listing with ID: BZ29202
2026-04-27 08:01:21 [auto1.fr] INFO: Scrape type for BZ29202: 2
2026-04-27 08:01:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e952c6e4-1b1e-594f-87a4-3aff9ae7e14c with identifier: BZ29202
2026-04-27 08:01:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e952c6e4-1b1e-594f-87a4-3aff9ae7e14c with scrape type 2
2026-04-27 08:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e952c6e4-1b1e-594f-87a4-3aff9ae7e14c with scrape type 2
2026-04-27 08:01:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e952c6e4-1b1e-594f-87a4-3aff9ae7e14c, identifier: BZ29202
2026-04-27 08:01:21 [auto1.fr] INFO: Found listing with ID: FM61260
2026-04-27 08:01:21 [auto1.fr] INFO: Scrape type for FM61260: 2
2026-04-27 08:01:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89439115-e9f2-5d6c-a0df-dd7047a5bdfb with identifier: FM61260
2026-04-27 08:01:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89439115-e9f2-5d6c-a0df-dd7047a5bdfb with scrape type 2
2026-04-27 08:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 89439115-e9f2-5d6c-a0df-dd7047a5bdfb with scrape type 2
2026-04-27 08:01:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 89439115-e9f2-5d6c-a0df-dd7047a5bdfb, identifier: FM61260
2026-04-27 08:01:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e952c6e4-1b1e-594f-87a4-3aff9ae7e14c with identifier: BZ29202
2026-04-27 08:01:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e952c6e4-1b1e-594f-87a4-3aff9ae7e14c with identifier: BZ29202
2026-04-27 08:01:21 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e952c6e4-1b1e-594f-87a4-3aff9ae7e14c with identifier: BZ29202 to the API
2026-04-27 08:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:21 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-04-28T15:25:21Z',
 'fuel_type': 'diesel',
 'id': 'e952c6e4-1b1e-594f-87a4-3aff9ae7e14c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BZ29202',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Citroen',
 'model': 'C3 Picasso',
 'odometer': 144991,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2015-12-06',
 'seller_name': None,
 'title': 'Citroen C3 Picasso 1.6 Blue-HDi Confort',
 'transmission': 'manual',
 'trim': 'Confort',
 'year': 2015}
2026-04-27 08:01:21 [auto1.fr] INFO: Saving data for BZ29202: {'auction_closing_time': 1777389921.0, 'created_time': 1777022543.741127, 'has_photos': True, 'last_price_update_time': 1777276881.857134}
2026-04-27 08:01:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 89439115-e9f2-5d6c-a0df-dd7047a5bdfb with identifier: FM61260
2026-04-27 08:01:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 89439115-e9f2-5d6c-a0df-dd7047a5bdfb with identifier: FM61260
2026-04-27 08:01:21 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 89439115-e9f2-5d6c-a0df-dd7047a5bdfb with identifier: FM61260 to the API
2026-04-27 08:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:22 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-04-28T15:26:15Z',
 'fuel_type': 'petrol',
 'id': '89439115-e9f2-5d6c-a0df-dd7047a5bdfb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FM61260',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 59980,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2021-01-10',
 'seller_name': None,
 'title': 'Volvo XC40 1.5 Inscription 2WD',
 'transmission': 'automatic',
 'trim': 'Inscription 2WD',
 'year': 2021}
2026-04-27 08:01:22 [auto1.fr] INFO: Saving data for FM61260: {'auction_closing_time': 1777389975.0, 'created_time': 1777019278.556375, 'has_photos': True, 'last_price_update_time': 1777276882.17513}
2026-04-27 08:01:22 [auto1.fr] INFO: Found listing with ID: DW43291
2026-04-27 08:01:22 [auto1.fr] INFO: Scrape type for DW43291: 2
2026-04-27 08:01:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4847e3ed-b2a2-5700-b77b-e854dbedbe43 with identifier: DW43291
2026-04-27 08:01:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4847e3ed-b2a2-5700-b77b-e854dbedbe43 with scrape type 2
2026-04-27 08:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4847e3ed-b2a2-5700-b77b-e854dbedbe43 with scrape type 2
2026-04-27 08:01:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4847e3ed-b2a2-5700-b77b-e854dbedbe43, identifier: DW43291
2026-04-27 08:01:22 [auto1.fr] INFO: Found listing with ID: BF76567
2026-04-27 08:01:22 [auto1.fr] INFO: Scrape type for BF76567: 2
2026-04-27 08:01:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f099d0f-9252-56ed-8cae-6d91cbcdfee2 with identifier: BF76567
2026-04-27 08:01:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f099d0f-9252-56ed-8cae-6d91cbcdfee2 with scrape type 2
2026-04-27 08:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6f099d0f-9252-56ed-8cae-6d91cbcdfee2 with scrape type 2
2026-04-27 08:01:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6f099d0f-9252-56ed-8cae-6d91cbcdfee2, identifier: BF76567
2026-04-27 08:01:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4847e3ed-b2a2-5700-b77b-e854dbedbe43 with identifier: DW43291
2026-04-27 08:01:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4847e3ed-b2a2-5700-b77b-e854dbedbe43 with identifier: DW43291
2026-04-27 08:01:22 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 4847e3ed-b2a2-5700-b77b-e854dbedbe43 with identifier: DW43291 to the API
2026-04-27 08:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:22 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 462,
 'expiration_date': '2026-04-28T15:35:54Z',
 'fuel_type': 'hybrid',
 'id': '4847e3ed-b2a2-5700-b77b-e854dbedbe43',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW43291',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Porsche',
 'model': 'Cayenne',
 'odometer': 138926,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2020-12-27',
 'seller_name': None,
 'title': 'Porsche Cayenne E-Hybrid',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-04-27 08:01:22 [auto1.fr] INFO: Saving data for DW43291: {'auction_closing_time': 1777390554.0, 'created_time': 1777020750.610249, 'has_photos': True, 'last_price_update_time': 1777276882.739812}
2026-04-27 08:01:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6f099d0f-9252-56ed-8cae-6d91cbcdfee2 with identifier: BF76567
2026-04-27 08:01:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6f099d0f-9252-56ed-8cae-6d91cbcdfee2 with identifier: BF76567
2026-04-27 08:01:22 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6f099d0f-9252-56ed-8cae-6d91cbcdfee2 with identifier: BF76567 to the API
2026-04-27 08:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:22 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-04-28T15:48:51Z',
 'fuel_type': 'diesel',
 'id': '6f099d0f-9252-56ed-8cae-6d91cbcdfee2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BF76567',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Hyundai',
 'model': 'Matrix',
 'odometer': 283131,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2008-05-05',
 'seller_name': None,
 'title': 'Hyundai Matrix 1.5 CRDi CRDI GLS',
 'transmission': 'manual',
 'trim': 'CRDI GLS',
 'year': 2008}
2026-04-27 08:01:23 [auto1.fr] INFO: Saving data for BF76567: {'auction_closing_time': 1777391331.0, 'created_time': 1777021168.191716, 'has_photos': True, 'last_price_update_time': 1777276883.035979}
2026-04-27 08:01:23 [auto1.fr] INFO: Found listing with ID: TB95178
2026-04-27 08:01:23 [auto1.fr] INFO: Scrape type for TB95178: 2
2026-04-27 08:01:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68cb4a9e-36eb-5433-b761-a89dbc016d95 with identifier: TB95178
2026-04-27 08:01:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68cb4a9e-36eb-5433-b761-a89dbc016d95 with scrape type 2
2026-04-27 08:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 68cb4a9e-36eb-5433-b761-a89dbc016d95 with scrape type 2
2026-04-27 08:01:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 68cb4a9e-36eb-5433-b761-a89dbc016d95, identifier: TB95178
2026-04-27 08:01:23 [auto1.fr] INFO: Found listing with ID: XU96844
2026-04-27 08:01:23 [auto1.fr] INFO: Scrape type for XU96844: 2
2026-04-27 08:01:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0fedde1c-1d60-5e6e-be9b-2982b0bea5fa with identifier: XU96844
2026-04-27 08:01:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0fedde1c-1d60-5e6e-be9b-2982b0bea5fa with scrape type 2
2026-04-27 08:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0fedde1c-1d60-5e6e-be9b-2982b0bea5fa with scrape type 2
2026-04-27 08:01:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0fedde1c-1d60-5e6e-be9b-2982b0bea5fa, identifier: XU96844
2026-04-27 08:01:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 68cb4a9e-36eb-5433-b761-a89dbc016d95 with identifier: TB95178
2026-04-27 08:01:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 68cb4a9e-36eb-5433-b761-a89dbc016d95 with identifier: TB95178
2026-04-27 08:01:23 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 68cb4a9e-36eb-5433-b761-a89dbc016d95 with identifier: TB95178 to the API
2026-04-27 08:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:23 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-04-28T15:33:30Z',
 'fuel_type': 'petrol',
 'id': '68cb4a9e-36eb-5433-b761-a89dbc016d95',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TB95178',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Peugeot',
 'model': '307',
 'odometer': 134400,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2004-10-07',
 'seller_name': None,
 'title': 'Peugeot 307 1.6 XR Presence',
 'transmission': 'manual',
 'trim': 'XR Presence',
 'year': 2004}
2026-04-27 08:01:23 [auto1.fr] INFO: Saving data for TB95178: {'auction_closing_time': 1777390410.0, 'created_time': 1777021766.741379, 'has_photos': True, 'last_price_update_time': 1777276883.551534}
2026-04-27 08:01:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0fedde1c-1d60-5e6e-be9b-2982b0bea5fa with identifier: XU96844
2026-04-27 08:01:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0fedde1c-1d60-5e6e-be9b-2982b0bea5fa with identifier: XU96844
2026-04-27 08:01:23 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 0fedde1c-1d60-5e6e-be9b-2982b0bea5fa with identifier: XU96844 to the API
2026-04-27 08:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:23 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-04-28T15:14:08Z',
 'fuel_type': 'diesel',
 'id': '0fedde1c-1d60-5e6e-be9b-2982b0bea5fa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XU96844',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 292636,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2011-01-05',
 'seller_name': None,
 'title': 'Toyota Yaris 1.4 D-4D Confort Pack',
 'transmission': 'manual',
 'trim': 'Confort Pack',
 'year': 2011}
2026-04-27 08:01:23 [auto1.fr] INFO: Saving data for XU96844: {'auction_closing_time': 1777389248.0, 'created_time': 1777020785.621853, 'has_photos': True, 'last_price_update_time': 1777276883.863451}
2026-04-27 08:01:23 [auto1.fr] INFO: Found listing with ID: KD23440
2026-04-27 08:01:23 [auto1.fr] INFO: Scrape type for KD23440: 1
2026-04-27 08:01:23 [auto1.fr] INFO: Found listing with ID: SV67354
2026-04-27 08:01:23 [auto1.fr] INFO: Scrape type for SV67354: 2
2026-04-27 08:01:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77745a76-2dd0-57a4-a8d9-b3a4e444933c with identifier: SV67354
2026-04-27 08:01:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77745a76-2dd0-57a4-a8d9-b3a4e444933c with scrape type 2
2026-04-27 08:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 77745a76-2dd0-57a4-a8d9-b3a4e444933c with scrape type 2
2026-04-27 08:01:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 77745a76-2dd0-57a4-a8d9-b3a4e444933c, identifier: SV67354
2026-04-27 08:01:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 77745a76-2dd0-57a4-a8d9-b3a4e444933c with identifier: SV67354
2026-04-27 08:01:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 77745a76-2dd0-57a4-a8d9-b3a4e444933c with identifier: SV67354
2026-04-27 08:01:24 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 77745a76-2dd0-57a4-a8d9-b3a4e444933c with identifier: SV67354 to the API
2026-04-27 08:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:24 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-04-28T15:51:29Z',
 'fuel_type': 'hybrid',
 'id': '77745a76-2dd0-57a4-a8d9-b3a4e444933c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV67354',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 86155,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2020-02-27',
 'seller_name': None,
 'title': 'Ford Kuga 2.5 Plug-in Hybrid ST-Line X',
 'transmission': 'automatic',
 'trim': 'ST-Line X',
 'year': 2020}
2026-04-27 08:01:24 [auto1.fr] INFO: Saving data for SV67354: {'auction_closing_time': 1777391489.0, 'created_time': 1777020415.382407, 'has_photos': True, 'last_price_update_time': 1777276884.284474}
2026-04-27 08:01:24 [auto1.fr] INFO: Found listing with ID: DY47155
2026-04-27 08:01:24 [auto1.fr] INFO: Scrape type for DY47155: 1
2026-04-27 08:01:24 [auto1.fr] INFO: Found listing with ID: LW12860
2026-04-27 08:01:24 [auto1.fr] INFO: Scrape type for LW12860: 2
2026-04-27 08:01:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 396ea8e0-098b-5f9e-aaf4-05785464806a with identifier: LW12860
2026-04-27 08:01:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 396ea8e0-098b-5f9e-aaf4-05785464806a with scrape type 2
2026-04-27 08:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 396ea8e0-098b-5f9e-aaf4-05785464806a with scrape type 2
2026-04-27 08:01:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 396ea8e0-098b-5f9e-aaf4-05785464806a, identifier: LW12860
2026-04-27 08:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LG63023> (referer: https://www.auto1.com/v1/car-details-view/LG63023/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 396ea8e0-098b-5f9e-aaf4-05785464806a with identifier: LW12860
2026-04-27 08:01:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 396ea8e0-098b-5f9e-aaf4-05785464806a with identifier: LW12860
2026-04-27 08:01:24 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 396ea8e0-098b-5f9e-aaf4-05785464806a with identifier: LW12860 to the API
2026-04-27 08:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:24 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-04-28T15:14:22Z',
 'fuel_type': 'petrol',
 'id': '396ea8e0-098b-5f9e-aaf4-05785464806a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LW12860',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 62898,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2017-05-30',
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Crossway',
 'transmission': 'automatic',
 'trim': 'Crossway',
 'year': 2017}
2026-04-27 08:01:24 [auto1.fr] INFO: Saving data for LW12860: {'auction_closing_time': 1777389262.0, 'created_time': 1777020814.525425, 'has_photos': True, 'last_price_update_time': 1777276884.723272}
2026-04-27 08:01:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:24 [auto1.fr] INFO: Found listing with ID: GF28469
2026-04-27 08:01:24 [auto1.fr] INFO: Scrape type for GF28469: 2
2026-04-27 08:01:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d24c9030-6f79-55c5-b5f9-3369b3e84285 with identifier: GF28469
2026-04-27 08:01:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d24c9030-6f79-55c5-b5f9-3369b3e84285 with scrape type 2
2026-04-27 08:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d24c9030-6f79-55c5-b5f9-3369b3e84285 with scrape type 2
2026-04-27 08:01:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d24c9030-6f79-55c5-b5f9-3369b3e84285, identifier: GF28469
2026-04-27 08:01:24 [auto1.fr] INFO: Found listing with ID: LS55307
2026-04-27 08:01:24 [auto1.fr] INFO: Scrape type for LS55307: 1
2026-04-27 08:01:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d24c9030-6f79-55c5-b5f9-3369b3e84285 with identifier: GF28469
2026-04-27 08:01:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d24c9030-6f79-55c5-b5f9-3369b3e84285 with identifier: GF28469
2026-04-27 08:01:24 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: d24c9030-6f79-55c5-b5f9-3369b3e84285 with identifier: GF28469 to the API
2026-04-27 08:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:25 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-04-28T15:50:24Z',
 'fuel_type': 'diesel',
 'id': 'd24c9030-6f79-55c5-b5f9-3369b3e84285',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GF28469',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'BMW',
 'model': 'X3',
 'odometer': 270967,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2019-10-15',
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2019}
2026-04-27 08:01:25 [auto1.fr] INFO: Saving data for GF28469: {'auction_closing_time': 1777391424.0, 'created_time': 1777022551.92953, 'has_photos': True, 'last_price_update_time': 1777276885.1313}
2026-04-27 08:01:25 [auto1.fr] INFO: Found listing with ID: SG00976
2026-04-27 08:01:25 [auto1.fr] INFO: Scrape type for SG00976: 2
2026-04-27 08:01:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bfcb745e-dcc2-5817-8da7-d317d386aea9 with identifier: SG00976
2026-04-27 08:01:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bfcb745e-dcc2-5817-8da7-d317d386aea9 with scrape type 2
2026-04-27 08:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bfcb745e-dcc2-5817-8da7-d317d386aea9 with scrape type 2
2026-04-27 08:01:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: bfcb745e-dcc2-5817-8da7-d317d386aea9, identifier: SG00976
2026-04-27 08:01:25 [auto1.fr] INFO: Found listing with ID: JY62240
2026-04-27 08:01:25 [auto1.fr] INFO: Scrape type for JY62240: 2
2026-04-27 08:01:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: abd6c20b-29d1-503d-b658-56b69d341159 with identifier: JY62240
2026-04-27 08:01:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abd6c20b-29d1-503d-b658-56b69d341159 with scrape type 2
2026-04-27 08:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item abd6c20b-29d1-503d-b658-56b69d341159 with scrape type 2
2026-04-27 08:01:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: abd6c20b-29d1-503d-b658-56b69d341159, identifier: JY62240
2026-04-27 08:01:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: bfcb745e-dcc2-5817-8da7-d317d386aea9 with identifier: SG00976
2026-04-27 08:01:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: bfcb745e-dcc2-5817-8da7-d317d386aea9 with identifier: SG00976
2026-04-27 08:01:25 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: bfcb745e-dcc2-5817-8da7-d317d386aea9 with identifier: SG00976 to the API
2026-04-27 08:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:25 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-04-28T15:19:55Z',
 'fuel_type': 'diesel',
 'id': 'bfcb745e-dcc2-5817-8da7-d317d386aea9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG00976',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Toyota',
 'model': 'Land Cruiser',
 'odometer': 304691,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2003-07-07',
 'seller_name': None,
 'title': 'Toyota Land Cruiser 3.0 D-4D VXE',
 'transmission': 'automatic',
 'trim': 'VXE',
 'year': 2003}
2026-04-27 08:01:25 [auto1.fr] INFO: Saving data for SG00976: {'auction_closing_time': 1777389595.0, 'created_time': 1777021683.04046, 'has_photos': True, 'last_price_update_time': 1777276885.74795}
2026-04-27 08:01:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: abd6c20b-29d1-503d-b658-56b69d341159 with identifier: JY62240
2026-04-27 08:01:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: abd6c20b-29d1-503d-b658-56b69d341159 with identifier: JY62240
2026-04-27 08:01:25 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: abd6c20b-29d1-503d-b658-56b69d341159 with identifier: JY62240 to the API
2026-04-27 08:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:25 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 73,
 'expiration_date': '2026-04-28T15:15:22Z',
 'fuel_type': 'petrol',
 'id': 'abd6c20b-29d1-503d-b658-56b69d341159',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JY62240',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 23744,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2019-08-18',
 'seller_name': None,
 'title': 'Dacia Sandero 1.0 Access',
 'transmission': 'manual',
 'trim': 'Access',
 'year': 2019}
2026-04-27 08:01:26 [auto1.fr] INFO: Saving data for JY62240: {'auction_closing_time': 1777389322.0, 'created_time': 1777022388.881537, 'has_photos': True, 'last_price_update_time': 1777276886.033347}
2026-04-27 08:01:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89cd1d2d-ac08-5559-b4ed-73373e2aebfd with identifier: LG63023
2026-04-27 08:01:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89cd1d2d-ac08-5559-b4ed-73373e2aebfd with scrape type 1
2026-04-27 08:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 89cd1d2d-ac08-5559-b4ed-73373e2aebfd
2026-04-27 08:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/a6/65a6d69b2a238978c0e72cffed4a27aa/pa/LG63023_a79110b4d9c17b789744e944b9e7b890.jpg not downloaded yet
2026-04-27 08:01:26 [auto1.fr] INFO: Found listing with ID: KP94491
2026-04-27 08:01:26 [auto1.fr] INFO: Scrape type for KP94491: 1
2026-04-27 08:01:26 [auto1.fr] INFO: Found listing with ID: TF88155
2026-04-27 08:01:26 [auto1.fr] INFO: Scrape type for TF88155: 1
2026-04-27 08:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZX13537/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CS54070> (referer: https://www.auto1.com/v1/car-details-view/CS54070/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/a6/65a6d69b2a238978c0e72cffed4a27aa/pa/LG63023_55631285080c6f4c8ffb6bbbe193f2ca.jpg not downloaded yet
2026-04-27 08:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WP26002> (referer: https://www.auto1.com/v1/car-details-view/WP26002/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:26 [auto1.fr] INFO: Found listing with ID: ZZ03906
2026-04-27 08:01:26 [auto1.fr] INFO: Scrape type for ZZ03906: 1
2026-04-27 08:01:26 [auto1.fr] INFO: Found listing with ID: CL01176
2026-04-27 08:01:26 [auto1.fr] INFO: Scrape type for CL01176: 2
2026-04-27 08:01:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fdcb7c7a-57f0-5578-aa8e-03c960092660 with identifier: CL01176
2026-04-27 08:01:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fdcb7c7a-57f0-5578-aa8e-03c960092660 with scrape type 2
2026-04-27 08:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fdcb7c7a-57f0-5578-aa8e-03c960092660 with scrape type 2
2026-04-27 08:01:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: fdcb7c7a-57f0-5578-aa8e-03c960092660, identifier: CL01176
2026-04-27 08:01:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CS24682/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AC55074> (referer: https://www.auto1.com/v1/car-details-view/AC55074/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: fdcb7c7a-57f0-5578-aa8e-03c960092660 with identifier: CL01176
2026-04-27 08:01:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: fdcb7c7a-57f0-5578-aa8e-03c960092660 with identifier: CL01176
2026-04-27 08:01:26 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: fdcb7c7a-57f0-5578-aa8e-03c960092660 with identifier: CL01176 to the API
2026-04-27 08:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:26 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-04-28T15:51:06Z',
 'fuel_type': 'diesel',
 'id': 'fdcb7c7a-57f0-5578-aa8e-03c960092660',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CL01176',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Volkswagen',
 'model': 'Passat CC',
 'odometer': 214701,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2008-09-01',
 'seller_name': None,
 'title': 'Volkswagen Passat CC 2.0 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2008}
2026-04-27 08:01:26 [auto1.fr] INFO: Saving data for CL01176: {'auction_closing_time': 1777391466.0, 'created_time': 1777022214.762303, 'has_photos': True, 'last_price_update_time': 1777276886.543214}
2026-04-27 08:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/a6/65a6d69b2a238978c0e72cffed4a27aa/pa/LG63023_5d8a6c1421589963bd191176da77913f.jpg not downloaded yet
2026-04-27 08:01:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:26 [auto1.fr] INFO: Found listing with ID: AC64067
2026-04-27 08:01:26 [auto1.fr] INFO: Scrape type for AC64067: 2
2026-04-27 08:01:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52f6c8bf-7138-5aef-93c1-8a44843a9c02 with identifier: AC64067
2026-04-27 08:01:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52f6c8bf-7138-5aef-93c1-8a44843a9c02 with scrape type 2
2026-04-27 08:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 52f6c8bf-7138-5aef-93c1-8a44843a9c02 with scrape type 2
2026-04-27 08:01:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 52f6c8bf-7138-5aef-93c1-8a44843a9c02, identifier: AC64067
2026-04-27 08:01:26 [auto1.fr] INFO: Found listing with ID: UV73863
2026-04-27 08:01:26 [auto1.fr] INFO: Scrape type for UV73863: 1
2026-04-27 08:01:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 52f6c8bf-7138-5aef-93c1-8a44843a9c02 with identifier: AC64067
2026-04-27 08:01:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 52f6c8bf-7138-5aef-93c1-8a44843a9c02 with identifier: AC64067
2026-04-27 08:01:26 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 52f6c8bf-7138-5aef-93c1-8a44843a9c02 with identifier: AC64067 to the API
2026-04-27 08:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:26 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 165,
 'expiration_date': '2026-04-28T15:01:46Z',
 'fuel_type': 'diesel',
 'id': '52f6c8bf-7138-5aef-93c1-8a44843a9c02',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AC64067',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Opel',
 'model': 'Zafira Tourer',
 'odometer': 166580,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2013-04-29',
 'seller_name': None,
 'title': 'Opel Zafira Tourer 2.0 CDTI Cosmo Pack',
 'transmission': 'automatic',
 'trim': 'Cosmo Pack',
 'year': 2013}
2026-04-27 08:01:26 [auto1.fr] INFO: Saving data for AC64067: {'auction_closing_time': 1777388506.0, 'created_time': 1777022214.062638, 'has_photos': True, 'last_price_update_time': 1777276886.947577}
2026-04-27 08:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/a6/65a6d69b2a238978c0e72cffed4a27aa/pa/LG63023_983317a2d76e9f6a9d898ddecc970ffb.jpg not downloaded yet
2026-04-27 08:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/a6/65a6d69b2a238978c0e72cffed4a27aa/pa/LG63023_a79110b4d9c17b789744e944b9e7b890.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:26 [auto1.fr] INFO: Found listing with ID: KA87751
2026-04-27 08:01:27 [auto1.fr] INFO: Scrape type for KA87751: 2
2026-04-27 08:01:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea07526f-faaa-5358-8d0e-fde6ef4cd845 with identifier: KA87751
2026-04-27 08:01:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea07526f-faaa-5358-8d0e-fde6ef4cd845 with scrape type 2
2026-04-27 08:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea07526f-faaa-5358-8d0e-fde6ef4cd845 with scrape type 2
2026-04-27 08:01:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ea07526f-faaa-5358-8d0e-fde6ef4cd845, identifier: KA87751
2026-04-27 08:01:27 [auto1.fr] INFO: Found listing with ID: SG66178
2026-04-27 08:01:27 [auto1.fr] INFO: Scrape type for SG66178: 1
2026-04-27 08:01:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ea07526f-faaa-5358-8d0e-fde6ef4cd845 with identifier: KA87751
2026-04-27 08:01:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ea07526f-faaa-5358-8d0e-fde6ef4cd845 with identifier: KA87751
2026-04-27 08:01:27 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ea07526f-faaa-5358-8d0e-fde6ef4cd845 with identifier: KA87751 to the API
2026-04-27 08:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:27 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-04-28T15:50:14Z',
 'fuel_type': 'diesel',
 'id': 'ea07526f-faaa-5358-8d0e-fde6ef4cd845',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KA87751',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 83522,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2021-11-23',
 'seller_name': None,
 'title': 'Ford Transit 2.0 TDCi 470 L3 Einzelkabine Trend',
 'transmission': 'manual',
 'trim': '470 L3 Einzelkabine Trend',
 'year': 2021}
2026-04-27 08:01:27 [auto1.fr] INFO: Saving data for KA87751: {'auction_closing_time': 1777391414.0, 'created_time': 1777021336.574134, 'has_photos': True, 'last_price_update_time': 1777276887.391324}
2026-04-27 08:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/a6/65a6d69b2a238978c0e72cffed4a27aa/pa/LG63023_76015bd5bfc1d6accb575a0bf1d689bc.jpg not downloaded yet
2026-04-27 08:01:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ad1fc8f-78a4-5e5c-b1e6-2588312b7847 with identifier: CS54070
2026-04-27 08:01:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ad1fc8f-78a4-5e5c-b1e6-2588312b7847 with scrape type 1
2026-04-27 08:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2ad1fc8f-78a4-5e5c-b1e6-2588312b7847
2026-04-27 08:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/94/c394a6f2a84927e0e63ff4e532d9a6c0/pa/CS54070_3531135aa4f964c2683f3361bb4aea45.jpg not downloaded yet
2026-04-27 08:01:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e19fdb36-92fd-577b-aaba-b8f0b4b67f7c with identifier: WP26002
2026-04-27 08:01:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e19fdb36-92fd-577b-aaba-b8f0b4b67f7c with scrape type 1
2026-04-27 08:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item e19fdb36-92fd-577b-aaba-b8f0b4b67f7c
2026-04-27 08:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/f9/e8f96765af5dffa9d81d57865e986165/pa/WP26002_a18afe5e437e6cdbe92a9dfb4e0476f0.jpg not downloaded yet
2026-04-27 08:01:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4693e5fd-40a8-5b79-a5c9-e14c3ec71fba with identifier: AC55074
2026-04-27 08:01:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4693e5fd-40a8-5b79-a5c9-e14c3ec71fba with scrape type 1
2026-04-27 08:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4693e5fd-40a8-5b79-a5c9-e14c3ec71fba
2026-04-27 08:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/1c/7d1c93ca4bbe89621b8efcb6585e9b8c/pa/AC55074_b1a3e55d6e7a131b35d2eef500fee8b0.jpg not downloaded yet
2026-04-27 08:01:27 [auto1.fr] INFO: Found listing with ID: CB45480
2026-04-27 08:01:27 [auto1.fr] INFO: Scrape type for CB45480: 1
2026-04-27 08:01:27 [auto1.fr] INFO: Found listing with ID: TF52830
2026-04-27 08:01:27 [auto1.fr] INFO: Scrape type for TF52830: 1
2026-04-27 08:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/a6/65a6d69b2a238978c0e72cffed4a27aa/pa/LG63023_a3b47e838821215f1cdda3a9f6cb0df2.jpg not downloaded yet
2026-04-27 08:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/94/c394a6f2a84927e0e63ff4e532d9a6c0/pa/CS54070_ab88b62d6ecc45f840cc41407401ab26.jpg not downloaded yet
2026-04-27 08:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/f9/e8f96765af5dffa9d81d57865e986165/pa/WP26002_46db82b30aaac8d16b32fc54b202eee8.jpg not downloaded yet
2026-04-27 08:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/1c/7d1c93ca4bbe89621b8efcb6585e9b8c/pa/AC55074_70211e4675816e3d169120bacbfb34e0.jpg not downloaded yet
2026-04-27 08:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/a6/65a6d69b2a238978c0e72cffed4a27aa/pa/LG63023_55631285080c6f4c8ffb6bbbe193f2ca.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:27 [auto1.fr] INFO: Found listing with ID: KR77540
2026-04-27 08:01:27 [auto1.fr] INFO: Scrape type for KR77540: 2
2026-04-27 08:01:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f16d49c2-9048-5972-a451-a7055f128781 with identifier: KR77540
2026-04-27 08:01:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f16d49c2-9048-5972-a451-a7055f128781 with scrape type 2
2026-04-27 08:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f16d49c2-9048-5972-a451-a7055f128781 with scrape type 2
2026-04-27 08:01:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f16d49c2-9048-5972-a451-a7055f128781, identifier: KR77540
2026-04-27 08:01:27 [auto1.fr] INFO: Found listing with ID: TJ12777
2026-04-27 08:01:27 [auto1.fr] INFO: Scrape type for TJ12777: 1
2026-04-27 08:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a68850>
2026-04-27 08:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89cd1d2d-ac08-5559-b4ed-73373e2aebfd/89cd1d2d-ac08-5559-b4ed-73373e2aebfd_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/a6/65a6d69b2a238978c0e72cffed4a27aa/pa/LG63023_a79110b4d9c17b789744e944b9e7b890.jpg saved to cache
2026-04-27 08:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 89cd1d2d-ac08-5559-b4ed-73373e2aebfd
2026-04-27 08:01:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f16d49c2-9048-5972-a451-a7055f128781 with identifier: KR77540
2026-04-27 08:01:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f16d49c2-9048-5972-a451-a7055f128781 with identifier: KR77540
2026-04-27 08:01:27 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f16d49c2-9048-5972-a451-a7055f128781 with identifier: KR77540 to the API
2026-04-27 08:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:27 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-04-28T15:58:12Z',
 'fuel_type': 'diesel',
 'id': 'f16d49c2-9048-5972-a451-a7055f128781',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KR77540',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 145675,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2018-02-28',
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 200 d Fascination',
 'transmission': 'automatic',
 'trim': 'Fascination',
 'year': 2018}
2026-04-27 08:01:28 [auto1.fr] INFO: Saving data for KR77540: {'auction_closing_time': 1777391892.0, 'created_time': 1777022038.758522, 'has_photos': True, 'last_price_update_time': 1777276888.060212}
2026-04-27 08:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/a6/65a6d69b2a238978c0e72cffed4a27aa/pa/LG63023_e7ea8172caaca8c106dda897b884892f.jpg not downloaded yet
2026-04-27 08:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/94/c394a6f2a84927e0e63ff4e532d9a6c0/pa/CS54070_c9e983fa37da0177a4f8c209b26ce11b.jpg not downloaded yet
2026-04-27 08:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/f9/e8f96765af5dffa9d81d57865e986165/pa/WP26002_1569715bd973639489ef03155222f96e.jpg not downloaded yet
2026-04-27 08:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/1c/7d1c93ca4bbe89621b8efcb6585e9b8c/pa/AC55074_6c2f4550f3ff8eca6da3658284f114f4.jpg not downloaded yet
2026-04-27 08:01:28 [auto1.fr] INFO: Found listing with ID: WC58866
2026-04-27 08:01:28 [auto1.fr] INFO: Scrape type for WC58866: 1
2026-04-27 08:01:28 [auto1.fr] INFO: Found listing with ID: YP51372
2026-04-27 08:01:28 [auto1.fr] INFO: Scrape type for YP51372: 2
2026-04-27 08:01:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43d4bacd-b51f-5297-b1cf-1a3aadc598e1 with identifier: YP51372
2026-04-27 08:01:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43d4bacd-b51f-5297-b1cf-1a3aadc598e1 with scrape type 2
2026-04-27 08:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 43d4bacd-b51f-5297-b1cf-1a3aadc598e1 with scrape type 2
2026-04-27 08:01:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 43d4bacd-b51f-5297-b1cf-1a3aadc598e1, identifier: YP51372
2026-04-27 08:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/a6/65a6d69b2a238978c0e72cffed4a27aa/pa/LG63023_983317a2d76e9f6a9d898ddecc970ffb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 43d4bacd-b51f-5297-b1cf-1a3aadc598e1 with identifier: YP51372
2026-04-27 08:01:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 43d4bacd-b51f-5297-b1cf-1a3aadc598e1 with identifier: YP51372
2026-04-27 08:01:28 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 43d4bacd-b51f-5297-b1cf-1a3aadc598e1 with identifier: YP51372 to the API
2026-04-27 08:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:28 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 92,
 'expiration_date': '2026-04-28T15:46:14Z',
 'fuel_type': 'diesel',
 'id': '43d4bacd-b51f-5297-b1cf-1a3aadc598e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YP51372',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Citroen',
 'model': 'C4',
 'odometer': 316855,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2012-12-27',
 'seller_name': None,
 'title': 'Citroen C4 1.6 HDi Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2012}
2026-04-27 08:01:28 [auto1.fr] INFO: Saving data for YP51372: {'auction_closing_time': 1777391174.0, 'created_time': 1777022713.853277, 'has_photos': True, 'last_price_update_time': 1777276888.700915}
2026-04-27 08:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/a6/65a6d69b2a238978c0e72cffed4a27aa/pa/LG63023_a41c879ca787dbbc67fadfcacdb851c7.jpg not downloaded yet
2026-04-27 08:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/94/c394a6f2a84927e0e63ff4e532d9a6c0/pa/CS54070_a2013f70c84ffb078be108ca024e78f5.jpg not downloaded yet
2026-04-27 08:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/f9/e8f96765af5dffa9d81d57865e986165/pa/WP26002_05d4ea1f30b1db09f2b3cd961dfadbe3.jpg not downloaded yet
2026-04-27 08:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/1c/7d1c93ca4bbe89621b8efcb6585e9b8c/pa/AC55074_f1a5a8e6f0ab6c65a29482da5cb62fd2.jpg not downloaded yet
2026-04-27 08:01:28 [auto1.fr] INFO: Found listing with ID: VK19723
2026-04-27 08:01:28 [auto1.fr] INFO: Found listing with ID: KJ24442
2026-04-27 08:01:28 [auto1.fr] INFO: Scrape type for KJ24442: 1
2026-04-27 08:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142be1acd0>
2026-04-27 08:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89cd1d2d-ac08-5559-b4ed-73373e2aebfd/89cd1d2d-ac08-5559-b4ed-73373e2aebfd_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/a6/65a6d69b2a238978c0e72cffed4a27aa/pa/LG63023_55631285080c6f4c8ffb6bbbe193f2ca.jpg saved to cache
2026-04-27 08:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 89cd1d2d-ac08-5559-b4ed-73373e2aebfd
2026-04-27 08:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/a6/65a6d69b2a238978c0e72cffed4a27aa/pa/LG63023_83747aad1880cc742840e303327901d7.jpg not downloaded yet
2026-04-27 08:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/94/c394a6f2a84927e0e63ff4e532d9a6c0/pa/CS54070_cb52d22086a3a07fd458b597145cfb13.jpg not downloaded yet
2026-04-27 08:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/f9/e8f96765af5dffa9d81d57865e986165/pa/WP26002_5fbd02df05f1084f87f5bb7a1d937188.jpg not downloaded yet
2026-04-27 08:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/1c/7d1c93ca4bbe89621b8efcb6585e9b8c/pa/AC55074_4227f0e85005263c34210dc2d3fbfd31.jpg not downloaded yet
2026-04-27 08:01:28 [auto1.fr] INFO: Found listing with ID: EJ46418
2026-04-27 08:01:28 [auto1.fr] INFO: Scrape type for EJ46418: 1
2026-04-27 08:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GV65376/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XP78105> (referer: https://www.auto1.com/v1/car-details-view/XP78105/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SS62373/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LJ15402/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438bf2bd0>
2026-04-27 08:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89cd1d2d-ac08-5559-b4ed-73373e2aebfd/89cd1d2d-ac08-5559-b4ed-73373e2aebfd_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/a6/65a6d69b2a238978c0e72cffed4a27aa/pa/LG63023_983317a2d76e9f6a9d898ddecc970ffb.jpg saved to cache
2026-04-27 08:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 89cd1d2d-ac08-5559-b4ed-73373e2aebfd
2026-04-27 08:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/a6/65a6d69b2a238978c0e72cffed4a27aa/pa/LG63023_4fa86a22f7536aabf0119b800920d4db.jpg not downloaded yet
2026-04-27 08:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/94/c394a6f2a84927e0e63ff4e532d9a6c0/pa/CS54070_67a355459a438721d639f13eb0fbe5ec.jpg not downloaded yet
2026-04-27 08:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/f9/e8f96765af5dffa9d81d57865e986165/pa/WP26002_78047611314937d7f543235ec2a2cdfc.jpg not downloaded yet
2026-04-27 08:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/1c/7d1c93ca4bbe89621b8efcb6585e9b8c/pa/AC55074_688f2282e8c9c5739f688246336c2597.jpg not downloaded yet
2026-04-27 08:01:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:29 [auto1.fr] INFO: Found listing with ID: LN71029
2026-04-27 08:01:29 [auto1.fr] INFO: Scrape type for LN71029: 1
2026-04-27 08:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/94/c394a6f2a84927e0e63ff4e532d9a6c0/pa/CS54070_9c5fc469e3cb0e140ecb59ea7201b8dc.jpg not downloaded yet
2026-04-27 08:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/1c/7d1c93ca4bbe89621b8efcb6585e9b8c/pa/AC55074_16bd4d5fffaedfbf2e0509811380ee74.jpg not downloaded yet
2026-04-27 08:01:29 [auto1.fr] INFO: Found listing with ID: EJ49197
2026-04-27 08:01:29 [auto1.fr] INFO: Scrape type for EJ49197: 1
2026-04-27 08:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/94/c394a6f2a84927e0e63ff4e532d9a6c0/pa/CS54070_98e34c5e8644a56121068573b278c867.jpg not downloaded yet
2026-04-27 08:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/1c/7d1c93ca4bbe89621b8efcb6585e9b8c/pa/AC55074_85446462f10ecf2e1caec7eb2f8400f5.jpg not downloaded yet
2026-04-27 08:01:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77f790f4-3e0a-5702-98e2-d24f664e169f with identifier: XP78105
2026-04-27 08:01:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77f790f4-3e0a-5702-98e2-d24f664e169f with scrape type 1
2026-04-27 08:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 77f790f4-3e0a-5702-98e2-d24f664e169f
2026-04-27 08:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/4c/e54c1895b9cbd3b0f8ec6d982c510e3c/pa/XP78105_48524bff1427010c887f1ba7f6d7fce6.jpg not downloaded yet
2026-04-27 08:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/1c/7d1c93ca4bbe89621b8efcb6585e9b8c/pa/AC55074_6c2f4550f3ff8eca6da3658284f114f4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:29 [auto1.fr] INFO: Found listing with ID: EE30564
2026-04-27 08:01:29 [auto1.fr] INFO: Scrape type for EE30564: 1
2026-04-27 08:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/94/c394a6f2a84927e0e63ff4e532d9a6c0/pa/CS54070_f55e68dc391ca4982e863a4ca681c732.jpg not downloaded yet
2026-04-27 08:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/1c/7d1c93ca4bbe89621b8efcb6585e9b8c/pa/AC55074_bd3b91309540c66ffe16f9d1204b5f6c.jpg not downloaded yet
2026-04-27 08:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/4c/e54c1895b9cbd3b0f8ec6d982c510e3c/pa/XP78105_dbac5f41d64502ed62291ae9b21069ce.jpg not downloaded yet
2026-04-27 08:01:29 [auto1.fr] INFO: Found listing with ID: AX86714
2026-04-27 08:01:29 [auto1.fr] INFO: Scrape type for AX86714: 1
2026-04-27 08:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/94/c394a6f2a84927e0e63ff4e532d9a6c0/pa/CS54070_011de4a681ca8c407b36794940979349.jpg not downloaded yet
2026-04-27 08:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/1c/7d1c93ca4bbe89621b8efcb6585e9b8c/pa/AC55074_528e971c4d9c7880158f9fa7e41e399b.jpg not downloaded yet
2026-04-27 08:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/4c/e54c1895b9cbd3b0f8ec6d982c510e3c/pa/XP78105_8bcb02351ad73cd7aadd78e9172edc3e.jpg not downloaded yet
2026-04-27 08:01:29 [auto1.fr] INFO: Found listing with ID: BR87224
2026-04-27 08:01:29 [auto1.fr] INFO: Scrape type for BR87224: 2
2026-04-27 08:01:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6eb20c2-25a8-50e3-8105-3c60953b3154 with identifier: BR87224
2026-04-27 08:01:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6eb20c2-25a8-50e3-8105-3c60953b3154 with scrape type 2
2026-04-27 08:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d6eb20c2-25a8-50e3-8105-3c60953b3154 with scrape type 2
2026-04-27 08:01:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d6eb20c2-25a8-50e3-8105-3c60953b3154, identifier: BR87224
2026-04-27 08:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/a6/65a6d69b2a238978c0e72cffed4a27aa/pa/LG63023_83747aad1880cc742840e303327901d7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/94/c394a6f2a84927e0e63ff4e532d9a6c0/pa/CS54070_cb52d22086a3a07fd458b597145cfb13.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/1c/7d1c93ca4bbe89621b8efcb6585e9b8c/pa/AC55074_4227f0e85005263c34210dc2d3fbfd31.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d6eb20c2-25a8-50e3-8105-3c60953b3154 with identifier: BR87224
2026-04-27 08:01:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d6eb20c2-25a8-50e3-8105-3c60953b3154 with identifier: BR87224
2026-04-27 08:01:29 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: d6eb20c2-25a8-50e3-8105-3c60953b3154 with identifier: BR87224 to the API
2026-04-27 08:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:29 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-04-28T15:30:15Z',
 'fuel_type': 'diesel',
 'id': 'd6eb20c2-25a8-50e3-8105-3c60953b3154',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BR87224',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Hyundai',
 'model': 'i20',
 'odometer': 177719,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2014-07-03',
 'seller_name': None,
 'title': 'Hyundai i20 1.1 CRDi Intuitive',
 'transmission': 'manual',
 'trim': 'Intuitive',
 'year': 2014}
2026-04-27 08:01:29 [auto1.fr] INFO: Saving data for BR87224: {'auction_closing_time': 1777390215.0, 'created_time': 1777020069.242724, 'has_photos': True, 'last_price_update_time': 1777276889.680196}
2026-04-27 08:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/4c/e54c1895b9cbd3b0f8ec6d982c510e3c/pa/XP78105_3c673f181350f05ab29cb9f38a1ac592.jpg not downloaded yet
2026-04-27 08:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/f9/e8f96765af5dffa9d81d57865e986165/pa/WP26002_5fbd02df05f1084f87f5bb7a1d937188.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:29 [auto1.fr] INFO: Found listing with ID: LP40212
2026-04-27 08:01:29 [auto1.fr] INFO: Scrape type for LP40212: 1
2026-04-27 08:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GD46628/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14381edd50>
2026-04-27 08:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4693e5fd-40a8-5b79-a5c9-e14c3ec71fba/4693e5fd-40a8-5b79-a5c9-e14c3ec71fba_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/1c/7d1c93ca4bbe89621b8efcb6585e9b8c/pa/AC55074_6c2f4550f3ff8eca6da3658284f114f4.jpg saved to cache
2026-04-27 08:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4693e5fd-40a8-5b79-a5c9-e14c3ec71fba
2026-04-27 08:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/4c/e54c1895b9cbd3b0f8ec6d982c510e3c/pa/XP78105_ec1fd60399136242abf181b079202e51.jpg not downloaded yet
2026-04-27 08:01:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:29 [auto1.fr] INFO: Found listing with ID: UT77845
2026-04-27 08:01:29 [auto1.fr] INFO: Scrape type for UT77845: 2
2026-04-27 08:01:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91eb2d05-135e-5b8a-8f21-d198dfd77de5 with identifier: UT77845
2026-04-27 08:01:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91eb2d05-135e-5b8a-8f21-d198dfd77de5 with scrape type 2
2026-04-27 08:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 91eb2d05-135e-5b8a-8f21-d198dfd77de5 with scrape type 2
2026-04-27 08:01:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 91eb2d05-135e-5b8a-8f21-d198dfd77de5, identifier: UT77845
2026-04-27 08:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438caa750>
2026-04-27 08:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89cd1d2d-ac08-5559-b4ed-73373e2aebfd/89cd1d2d-ac08-5559-b4ed-73373e2aebfd_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/a6/65a6d69b2a238978c0e72cffed4a27aa/pa/LG63023_83747aad1880cc742840e303327901d7.jpg saved to cache
2026-04-27 08:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 89cd1d2d-ac08-5559-b4ed-73373e2aebfd
2026-04-27 08:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c55c50>
2026-04-27 08:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ad1fc8f-78a4-5e5c-b1e6-2588312b7847/2ad1fc8f-78a4-5e5c-b1e6-2588312b7847_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/94/c394a6f2a84927e0e63ff4e532d9a6c0/pa/CS54070_cb52d22086a3a07fd458b597145cfb13.jpg saved to cache
2026-04-27 08:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2ad1fc8f-78a4-5e5c-b1e6-2588312b7847
2026-04-27 08:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438fb8190>
2026-04-27 08:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4693e5fd-40a8-5b79-a5c9-e14c3ec71fba/4693e5fd-40a8-5b79-a5c9-e14c3ec71fba_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/1c/7d1c93ca4bbe89621b8efcb6585e9b8c/pa/AC55074_4227f0e85005263c34210dc2d3fbfd31.jpg saved to cache
2026-04-27 08:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4693e5fd-40a8-5b79-a5c9-e14c3ec71fba
2026-04-27 08:01:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 91eb2d05-135e-5b8a-8f21-d198dfd77de5 with identifier: UT77845
2026-04-27 08:01:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 91eb2d05-135e-5b8a-8f21-d198dfd77de5 with identifier: UT77845
2026-04-27 08:01:30 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 91eb2d05-135e-5b8a-8f21-d198dfd77de5 with identifier: UT77845 to the API
2026-04-27 08:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:30 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 85,
 'expiration_date': '2026-04-28T15:18:51Z',
 'fuel_type': 'petrol',
 'id': '91eb2d05-135e-5b8a-8f21-d198dfd77de5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UT77845',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 162194,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2013-01-24',
 'seller_name': None,
 'title': 'Smart fortwo 1.0 Turbo Basis pulse',
 'transmission': 'automatic',
 'trim': 'Basis pulse',
 'year': 2013}
2026-04-27 08:01:30 [auto1.fr] INFO: Saving data for UT77845: {'auction_closing_time': 1777389531.0, 'created_time': 1777021971.69813, 'has_photos': True, 'last_price_update_time': 1777276890.357305}
2026-04-27 08:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/4c/e54c1895b9cbd3b0f8ec6d982c510e3c/pa/XP78105_c634a9eb6e2148882ae87b4dd7ccb1b6.jpg not downloaded yet
2026-04-27 08:01:30 [auto1.fr] INFO: Found listing with ID: ZN19344
2026-04-27 08:01:30 [auto1.fr] INFO: Scrape type for ZN19344: 2
2026-04-27 08:01:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13d3758f-f7dd-5b5f-a4c5-13dede0a4756 with identifier: ZN19344
2026-04-27 08:01:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13d3758f-f7dd-5b5f-a4c5-13dede0a4756 with scrape type 2
2026-04-27 08:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 13d3758f-f7dd-5b5f-a4c5-13dede0a4756 with scrape type 2
2026-04-27 08:01:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 13d3758f-f7dd-5b5f-a4c5-13dede0a4756, identifier: ZN19344
2026-04-27 08:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/1c/7d1c93ca4bbe89621b8efcb6585e9b8c/pa/AC55074_528e971c4d9c7880158f9fa7e41e399b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/4c/e54c1895b9cbd3b0f8ec6d982c510e3c/pa/XP78105_8bcb02351ad73cd7aadd78e9172edc3e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/94/c394a6f2a84927e0e63ff4e532d9a6c0/pa/CS54070_011de4a681ca8c407b36794940979349.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 13d3758f-f7dd-5b5f-a4c5-13dede0a4756 with identifier: ZN19344
2026-04-27 08:01:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 13d3758f-f7dd-5b5f-a4c5-13dede0a4756 with identifier: ZN19344
2026-04-27 08:01:30 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 13d3758f-f7dd-5b5f-a4c5-13dede0a4756 with identifier: ZN19344 to the API
2026-04-27 08:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:30 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-04-28T15:19:00Z',
 'fuel_type': 'diesel',
 'id': '13d3758f-f7dd-5b5f-a4c5-13dede0a4756',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZN19344',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Peugeot',
 'model': '308',
 'odometer': 213344,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2007-10-29',
 'seller_name': None,
 'title': 'Peugeot 308 1.6 HDi Premium',
 'transmission': 'manual',
 'trim': 'Premium',
 'year': 2007}
2026-04-27 08:01:30 [auto1.fr] INFO: Saving data for ZN19344: {'auction_closing_time': 1777389540.0, 'created_time': 1777022312.980853, 'has_photos': True, 'last_price_update_time': 1777276890.849328}
2026-04-27 08:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1448f7aed0>
2026-04-27 08:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e19fdb36-92fd-577b-aaba-b8f0b4b67f7c/e19fdb36-92fd-577b-aaba-b8f0b4b67f7c_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/f9/e8f96765af5dffa9d81d57865e986165/pa/WP26002_5fbd02df05f1084f87f5bb7a1d937188.jpg saved to cache
2026-04-27 08:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e19fdb36-92fd-577b-aaba-b8f0b4b67f7c
2026-04-27 08:01:30 [auto1.fr] INFO: Found listing with ID: SB97802
2026-04-27 08:01:30 [auto1.fr] INFO: Scrape type for SB97802: 2
2026-04-27 08:01:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f22e12b7-5b4b-5592-befc-e42c9443d901 with identifier: SB97802
2026-04-27 08:01:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f22e12b7-5b4b-5592-befc-e42c9443d901 with scrape type 2
2026-04-27 08:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f22e12b7-5b4b-5592-befc-e42c9443d901 with scrape type 2
2026-04-27 08:01:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f22e12b7-5b4b-5592-befc-e42c9443d901, identifier: SB97802
2026-04-27 08:01:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f22e12b7-5b4b-5592-befc-e42c9443d901 with identifier: SB97802
2026-04-27 08:01:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f22e12b7-5b4b-5592-befc-e42c9443d901 with identifier: SB97802
2026-04-27 08:01:31 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f22e12b7-5b4b-5592-befc-e42c9443d901 with identifier: SB97802 to the API
2026-04-27 08:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:31 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 71,
 'expiration_date': '2026-04-28T15:51:38Z',
 'fuel_type': 'petrol',
 'id': 'f22e12b7-5b4b-5592-befc-e42c9443d901',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SB97802',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Nissan',
 'model': 'Micra',
 'odometer': 43678,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2018-05-15',
 'seller_name': None,
 'title': 'Nissan Micra 1.0 Visia Pack',
 'transmission': 'manual',
 'trim': 'Visia Pack',
 'year': 2018}
2026-04-27 08:01:31 [auto1.fr] INFO: Saving data for SB97802: {'auction_closing_time': 1777391498.0, 'created_time': 1777022124.748938, 'has_photos': True, 'last_price_update_time': 1777276891.8278}
2026-04-27 08:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VK19723/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:31 [auto1.fr] INFO: Found listing with ID: YV81525
2026-04-27 08:01:31 [auto1.fr] INFO: Scrape type for YV81525: 2
2026-04-27 08:01:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3148f94c-297a-570c-b1bc-fbf7e6b4c332 with identifier: YV81525
2026-04-27 08:01:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3148f94c-297a-570c-b1bc-fbf7e6b4c332 with scrape type 2
2026-04-27 08:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3148f94c-297a-570c-b1bc-fbf7e6b4c332 with scrape type 2
2026-04-27 08:01:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3148f94c-297a-570c-b1bc-fbf7e6b4c332, identifier: YV81525
2026-04-27 08:01:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bfd7710>
2026-04-27 08:01:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4693e5fd-40a8-5b79-a5c9-e14c3ec71fba/4693e5fd-40a8-5b79-a5c9-e14c3ec71fba_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/1c/7d1c93ca4bbe89621b8efcb6585e9b8c/pa/AC55074_528e971c4d9c7880158f9fa7e41e399b.jpg saved to cache
2026-04-27 08:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4693e5fd-40a8-5b79-a5c9-e14c3ec71fba
2026-04-27 08:01:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438046190>
2026-04-27 08:01:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77f790f4-3e0a-5702-98e2-d24f664e169f/77f790f4-3e0a-5702-98e2-d24f664e169f_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/4c/e54c1895b9cbd3b0f8ec6d982c510e3c/pa/XP78105_8bcb02351ad73cd7aadd78e9172edc3e.jpg saved to cache
2026-04-27 08:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 77f790f4-3e0a-5702-98e2-d24f664e169f
2026-04-27 08:01:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bfa7350>
2026-04-27 08:01:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ad1fc8f-78a4-5e5c-b1e6-2588312b7847/2ad1fc8f-78a4-5e5c-b1e6-2588312b7847_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/94/c394a6f2a84927e0e63ff4e532d9a6c0/pa/CS54070_011de4a681ca8c407b36794940979349.jpg saved to cache
2026-04-27 08:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2ad1fc8f-78a4-5e5c-b1e6-2588312b7847
2026-04-27 08:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/4c/e54c1895b9cbd3b0f8ec6d982c510e3c/pa/XP78105_c634a9eb6e2148882ae87b4dd7ccb1b6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/4c/e54c1895b9cbd3b0f8ec6d982c510e3c/pa/XP78105_3c673f181350f05ab29cb9f38a1ac592.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3148f94c-297a-570c-b1bc-fbf7e6b4c332 with identifier: YV81525
2026-04-27 08:01:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3148f94c-297a-570c-b1bc-fbf7e6b4c332 with identifier: YV81525
2026-04-27 08:01:32 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 3148f94c-297a-570c-b1bc-fbf7e6b4c332 with identifier: YV81525 to the API
2026-04-27 08:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:32 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-04-28T15:33:50Z',
 'fuel_type': 'petrol',
 'id': '3148f94c-297a-570c-b1bc-fbf7e6b4c332',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YV81525',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 136928,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2018-12-04',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.0 TSI Comfortline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2018}
2026-04-27 08:01:32 [auto1.fr] INFO: Saving data for YV81525: {'auction_closing_time': 1777390430.0, 'created_time': 1777019421.525694, 'has_photos': True, 'last_price_update_time': 1777276892.406148}
2026-04-27 08:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/4c/e54c1895b9cbd3b0f8ec6d982c510e3c/pa/XP78105_ec1fd60399136242abf181b079202e51.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:32 [auto1.fr] INFO: Found listing with ID: PC47151
2026-04-27 08:01:32 [auto1.fr] INFO: Scrape type for PC47151: 1
2026-04-27 08:01:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438060b90>
2026-04-27 08:01:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77f790f4-3e0a-5702-98e2-d24f664e169f/77f790f4-3e0a-5702-98e2-d24f664e169f_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/4c/e54c1895b9cbd3b0f8ec6d982c510e3c/pa/XP78105_c634a9eb6e2148882ae87b4dd7ccb1b6.jpg saved to cache
2026-04-27 08:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 77f790f4-3e0a-5702-98e2-d24f664e169f
2026-04-27 08:01:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14381df910>
2026-04-27 08:01:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77f790f4-3e0a-5702-98e2-d24f664e169f/77f790f4-3e0a-5702-98e2-d24f664e169f_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/4c/e54c1895b9cbd3b0f8ec6d982c510e3c/pa/XP78105_3c673f181350f05ab29cb9f38a1ac592.jpg saved to cache
2026-04-27 08:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 77f790f4-3e0a-5702-98e2-d24f664e169f
2026-04-27 08:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/94/c394a6f2a84927e0e63ff4e532d9a6c0/pa/CS54070_f55e68dc391ca4982e863a4ca681c732.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/4c/e54c1895b9cbd3b0f8ec6d982c510e3c/pa/XP78105_dbac5f41d64502ed62291ae9b21069ce.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d7e210>
2026-04-27 08:01:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77f790f4-3e0a-5702-98e2-d24f664e169f/77f790f4-3e0a-5702-98e2-d24f664e169f_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/4c/e54c1895b9cbd3b0f8ec6d982c510e3c/pa/XP78105_ec1fd60399136242abf181b079202e51.jpg saved to cache
2026-04-27 08:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 77f790f4-3e0a-5702-98e2-d24f664e169f
2026-04-27 08:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/1c/7d1c93ca4bbe89621b8efcb6585e9b8c/pa/AC55074_bd3b91309540c66ffe16f9d1204b5f6c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438faf6d0>
2026-04-27 08:01:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ad1fc8f-78a4-5e5c-b1e6-2588312b7847/2ad1fc8f-78a4-5e5c-b1e6-2588312b7847_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/94/c394a6f2a84927e0e63ff4e532d9a6c0/pa/CS54070_f55e68dc391ca4982e863a4ca681c732.jpg saved to cache
2026-04-27 08:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2ad1fc8f-78a4-5e5c-b1e6-2588312b7847
2026-04-27 08:01:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438084a50>
2026-04-27 08:01:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77f790f4-3e0a-5702-98e2-d24f664e169f/77f790f4-3e0a-5702-98e2-d24f664e169f_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/4c/e54c1895b9cbd3b0f8ec6d982c510e3c/pa/XP78105_dbac5f41d64502ed62291ae9b21069ce.jpg saved to cache
2026-04-27 08:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 77f790f4-3e0a-5702-98e2-d24f664e169f
2026-04-27 08:01:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143807b990>
2026-04-27 08:01:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4693e5fd-40a8-5b79-a5c9-e14c3ec71fba/4693e5fd-40a8-5b79-a5c9-e14c3ec71fba_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/1c/7d1c93ca4bbe89621b8efcb6585e9b8c/pa/AC55074_bd3b91309540c66ffe16f9d1204b5f6c.jpg saved to cache
2026-04-27 08:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4693e5fd-40a8-5b79-a5c9-e14c3ec71fba
2026-04-27 08:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LS55307/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TF88155/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:33 [auto1.fr] INFO: Channel: 24h | Page: 15 | totalHits: 4748 | hits on page: 40
2026-04-27 08:01:33 [auto1.fr] INFO: Found listing with ID: SB97802
2026-04-27 08:01:33 [auto1.fr] INFO: Scrape type for SB97802: 0
2026-04-27 08:01:33 [auto1.fr] INFO: Found listing with ID: YV81525
2026-04-27 08:01:33 [auto1.fr] INFO: Scrape type for YV81525: 0
2026-04-27 08:01:33 [auto1.fr] INFO: Found listing with ID: PC47151
2026-04-27 08:01:33 [auto1.fr] INFO: Found listing with ID: XP66798
2026-04-27 08:01:33 [auto1.fr] INFO: Scrape type for XP66798: 2
2026-04-27 08:01:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f565ed55-c2d6-560b-b744-e2b72f897944 with identifier: XP66798
2026-04-27 08:01:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f565ed55-c2d6-560b-b744-e2b72f897944 with scrape type 2
2026-04-27 08:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f565ed55-c2d6-560b-b744-e2b72f897944 with scrape type 2
2026-04-27 08:01:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f565ed55-c2d6-560b-b744-e2b72f897944, identifier: XP66798
2026-04-27 08:01:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f565ed55-c2d6-560b-b744-e2b72f897944 with identifier: XP66798
2026-04-27 08:01:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f565ed55-c2d6-560b-b744-e2b72f897944 with identifier: XP66798
2026-04-27 08:01:33 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f565ed55-c2d6-560b-b744-e2b72f897944 with identifier: XP66798 to the API
2026-04-27 08:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:33 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 180,
 'expiration_date': '2026-04-28T15:14:13Z',
 'fuel_type': 'diesel',
 'id': 'f565ed55-c2d6-560b-b744-e2b72f897944',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XP66798',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Citroen',
 'model': 'C5',
 'odometer': 237180,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2016-01-25',
 'seller_name': None,
 'title': 'Citroen C5 2.0 Blue-HDi Exclusive',
 'transmission': 'automatic',
 'trim': 'Exclusive',
 'year': 2016}
2026-04-27 08:01:33 [auto1.fr] INFO: Saving data for XP66798: {'auction_closing_time': 1777389253.0, 'created_time': 1777020446.766919, 'has_photos': True, 'last_price_update_time': 1777276893.883055}
2026-04-27 08:01:33 [auto1.fr] INFO: Found listing with ID: ZP81071
2026-04-27 08:01:33 [auto1.fr] INFO: Scrape type for ZP81071: 1
2026-04-27 08:01:33 [auto1.fr] INFO: Found listing with ID: WY35524
2026-04-27 08:01:33 [auto1.fr] INFO: Scrape type for WY35524: 2
2026-04-27 08:01:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a04b19cd-c5c3-5a86-ace1-efcaec7cfe49 with identifier: WY35524
2026-04-27 08:01:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a04b19cd-c5c3-5a86-ace1-efcaec7cfe49 with scrape type 2
2026-04-27 08:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a04b19cd-c5c3-5a86-ace1-efcaec7cfe49 with scrape type 2
2026-04-27 08:01:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a04b19cd-c5c3-5a86-ace1-efcaec7cfe49, identifier: WY35524
2026-04-27 08:01:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a04b19cd-c5c3-5a86-ace1-efcaec7cfe49 with identifier: WY35524
2026-04-27 08:01:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a04b19cd-c5c3-5a86-ace1-efcaec7cfe49 with identifier: WY35524
2026-04-27 08:01:34 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a04b19cd-c5c3-5a86-ace1-efcaec7cfe49 with identifier: WY35524 to the API
2026-04-27 08:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:34 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 160,
 'expiration_date': '2026-04-28T15:34:47Z',
 'fuel_type': 'diesel',
 'id': 'a04b19cd-c5c3-5a86-ace1-efcaec7cfe49',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WY35524',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Renault',
 'model': 'Talisman',
 'odometer': 113387,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2016-07-27',
 'seller_name': None,
 'title': 'Renault Talisman 1.6 dCi Energy Initiale Paris',
 'transmission': 'automatic',
 'trim': 'Initiale Paris',
 'year': 2016}
2026-04-27 08:01:34 [auto1.fr] INFO: Saving data for WY35524: {'auction_closing_time': 1777390487.0, 'created_time': 1777021924.212903, 'has_photos': True, 'last_price_update_time': 1777276894.350827}
2026-04-27 08:01:34 [auto1.fr] INFO: Found listing with ID: AS13711
2026-04-27 08:01:34 [auto1.fr] INFO: Scrape type for AS13711: 2
2026-04-27 08:01:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f27c7163-30be-56da-b11c-3ed3c7da5ce1 with identifier: AS13711
2026-04-27 08:01:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f27c7163-30be-56da-b11c-3ed3c7da5ce1 with scrape type 2
2026-04-27 08:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f27c7163-30be-56da-b11c-3ed3c7da5ce1 with scrape type 2
2026-04-27 08:01:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f27c7163-30be-56da-b11c-3ed3c7da5ce1, identifier: AS13711
2026-04-27 08:01:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f27c7163-30be-56da-b11c-3ed3c7da5ce1 with identifier: AS13711
2026-04-27 08:01:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f27c7163-30be-56da-b11c-3ed3c7da5ce1 with identifier: AS13711
2026-04-27 08:01:34 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f27c7163-30be-56da-b11c-3ed3c7da5ce1 with identifier: AS13711 to the API
2026-04-27 08:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:34 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 60,
 'expiration_date': '2026-04-28T15:51:56Z',
 'fuel_type': 'petrol',
 'id': 'f27c7163-30be-56da-b11c-3ed3c7da5ce1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AS13711',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 126027,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2013-03-10',
 'seller_name': None,
 'title': 'Ford Fiesta 1.25 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2013}
2026-04-27 08:01:34 [auto1.fr] INFO: Saving data for AS13711: {'auction_closing_time': 1777391516.0, 'created_time': 1777021314.852908, 'has_photos': True, 'last_price_update_time': 1777276894.803865}
2026-04-27 08:01:34 [auto1.fr] INFO: Found listing with ID: EF60252
2026-04-27 08:01:34 [auto1.fr] INFO: Scrape type for EF60252: 1
2026-04-27 08:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZZ03906/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:34 [auto1.fr] INFO: Found listing with ID: DZ35713
2026-04-27 08:01:34 [auto1.fr] INFO: Scrape type for DZ35713: 2
2026-04-27 08:01:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7475798-1e05-5682-a64a-ecc04ab83428 with identifier: DZ35713
2026-04-27 08:01:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7475798-1e05-5682-a64a-ecc04ab83428 with scrape type 2
2026-04-27 08:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e7475798-1e05-5682-a64a-ecc04ab83428 with scrape type 2
2026-04-27 08:01:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e7475798-1e05-5682-a64a-ecc04ab83428, identifier: DZ35713
2026-04-27 08:01:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e7475798-1e05-5682-a64a-ecc04ab83428 with identifier: DZ35713
2026-04-27 08:01:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e7475798-1e05-5682-a64a-ecc04ab83428 with identifier: DZ35713
2026-04-27 08:01:35 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e7475798-1e05-5682-a64a-ecc04ab83428 with identifier: DZ35713 to the API
2026-04-27 08:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:35 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-04-28T15:21:11Z',
 'fuel_type': 'petrol',
 'id': 'e7475798-1e05-5682-a64a-ecc04ab83428',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DZ35713',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Peugeot',
 'model': '207',
 'odometer': 125633,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2007-11-12',
 'seller_name': None,
 'title': 'Peugeot 207 1.6 Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2007}
2026-04-27 08:01:35 [auto1.fr] INFO: Saving data for DZ35713: {'auction_closing_time': 1777389671.0, 'created_time': 1777021505.373503, 'has_photos': True, 'last_price_update_time': 1777276895.276746}
2026-04-27 08:01:35 [auto1.fr] INFO: Found listing with ID: DX76467
2026-04-27 08:01:35 [auto1.fr] INFO: Scrape type for DX76467: 2
2026-04-27 08:01:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 556f4f40-8ed2-52e4-b225-49c7164040b4 with identifier: DX76467
2026-04-27 08:01:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 556f4f40-8ed2-52e4-b225-49c7164040b4 with scrape type 2
2026-04-27 08:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 556f4f40-8ed2-52e4-b225-49c7164040b4 with scrape type 2
2026-04-27 08:01:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 556f4f40-8ed2-52e4-b225-49c7164040b4, identifier: DX76467
2026-04-27 08:01:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 556f4f40-8ed2-52e4-b225-49c7164040b4 with identifier: DX76467
2026-04-27 08:01:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 556f4f40-8ed2-52e4-b225-49c7164040b4 with identifier: DX76467
2026-04-27 08:01:35 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 556f4f40-8ed2-52e4-b225-49c7164040b4 with identifier: DX76467 to the API
2026-04-27 08:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:35 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 73,
 'expiration_date': '2026-04-28T15:21:42Z',
 'fuel_type': 'petrol',
 'id': '556f4f40-8ed2-52e4-b225-49c7164040b4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DX76467',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 287721,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2018-09-12',
 'seller_name': None,
 'title': 'Dacia Sandero 1.0 Ambiance',
 'transmission': 'manual',
 'trim': 'Ambiance',
 'year': 2018}
2026-04-27 08:01:35 [auto1.fr] INFO: Saving data for DX76467: {'auction_closing_time': 1777389702.0, 'created_time': 1777020418.515481, 'has_photos': True, 'last_price_update_time': 1777276895.785981}
2026-04-27 08:01:35 [auto1.fr] INFO: Found listing with ID: RH90545
2026-04-27 08:01:35 [auto1.fr] INFO: Scrape type for RH90545: 1
2026-04-27 08:01:35 [auto1.fr] INFO: Found listing with ID: WC43353
2026-04-27 08:01:35 [auto1.fr] INFO: Scrape type for WC43353: 2
2026-04-27 08:01:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c26f2780-6155-51c5-9e24-622a443c7fca with identifier: WC43353
2026-04-27 08:01:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c26f2780-6155-51c5-9e24-622a443c7fca with scrape type 2
2026-04-27 08:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c26f2780-6155-51c5-9e24-622a443c7fca with scrape type 2
2026-04-27 08:01:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c26f2780-6155-51c5-9e24-622a443c7fca, identifier: WC43353
2026-04-27 08:01:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c26f2780-6155-51c5-9e24-622a443c7fca with identifier: WC43353
2026-04-27 08:01:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c26f2780-6155-51c5-9e24-622a443c7fca with identifier: WC43353
2026-04-27 08:01:36 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c26f2780-6155-51c5-9e24-622a443c7fca with identifier: WC43353 to the API
2026-04-27 08:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:36 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-04-28T15:07:02Z',
 'fuel_type': 'diesel',
 'id': 'c26f2780-6155-51c5-9e24-622a443c7fca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC43353',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Opel',
 'model': 'Zafira Tourer',
 'odometer': 182758,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2016-03-01',
 'seller_name': None,
 'title': 'Opel Zafira Tourer 1.6 CDTI DPF Cosmo',
 'transmission': 'manual',
 'trim': 'Cosmo',
 'year': 2016}
2026-04-27 08:01:36 [auto1.fr] INFO: Saving data for WC43353: {'auction_closing_time': 1777388822.0, 'created_time': 1777020118.107874, 'has_photos': True, 'last_price_update_time': 1777276896.24597}
2026-04-27 08:01:36 [auto1.fr] INFO: Found listing with ID: NK06658
2026-04-27 08:01:36 [auto1.fr] INFO: Scrape type for NK06658: 1
2026-04-27 08:01:36 [auto1.fr] INFO: Found listing with ID: CU45750
2026-04-27 08:01:36 [auto1.fr] INFO: Scrape type for CU45750: 1
2026-04-27 08:01:36 [auto1.fr] INFO: Found listing with ID: DF45388
2026-04-27 08:01:36 [auto1.fr] INFO: Scrape type for DF45388: 2
2026-04-27 08:01:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43f2fffe-3d04-5775-a765-d746b6b3eafb with identifier: DF45388
2026-04-27 08:01:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43f2fffe-3d04-5775-a765-d746b6b3eafb with scrape type 2
2026-04-27 08:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 43f2fffe-3d04-5775-a765-d746b6b3eafb with scrape type 2
2026-04-27 08:01:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 43f2fffe-3d04-5775-a765-d746b6b3eafb, identifier: DF45388
2026-04-27 08:01:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 43f2fffe-3d04-5775-a765-d746b6b3eafb with identifier: DF45388
2026-04-27 08:01:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 43f2fffe-3d04-5775-a765-d746b6b3eafb with identifier: DF45388
2026-04-27 08:01:36 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 43f2fffe-3d04-5775-a765-d746b6b3eafb with identifier: DF45388 to the API
2026-04-27 08:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:36 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-04-28T15:14:36Z',
 'fuel_type': 'diesel',
 'id': '43f2fffe-3d04-5775-a765-d746b6b3eafb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF45388',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 141813,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2017-05-31',
 'seller_name': None,
 'title': 'Audi Q5 2.0 TDI quattro S line',
 'transmission': 'automatic',
 'trim': 'quattro S line',
 'year': 2017}
2026-04-27 08:01:36 [auto1.fr] INFO: Saving data for DF45388: {'auction_closing_time': 1777389276.0, 'created_time': 1777019238.560726, 'has_photos': True, 'last_price_update_time': 1777276896.724215}
2026-04-27 08:01:36 [auto1.fr] INFO: Found listing with ID: SR11177
2026-04-27 08:01:36 [auto1.fr] INFO: Scrape type for SR11177: 1
2026-04-27 08:01:36 [auto1.fr] INFO: Found listing with ID: SP86583
2026-04-27 08:01:36 [auto1.fr] INFO: Scrape type for SP86583: 2
2026-04-27 08:01:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 534880c2-a3a0-5a8d-8db1-c5d1f3f50bb0 with identifier: SP86583
2026-04-27 08:01:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 534880c2-a3a0-5a8d-8db1-c5d1f3f50bb0 with scrape type 2
2026-04-27 08:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 534880c2-a3a0-5a8d-8db1-c5d1f3f50bb0 with scrape type 2
2026-04-27 08:01:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 534880c2-a3a0-5a8d-8db1-c5d1f3f50bb0, identifier: SP86583
2026-04-27 08:01:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 534880c2-a3a0-5a8d-8db1-c5d1f3f50bb0 with identifier: SP86583
2026-04-27 08:01:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 534880c2-a3a0-5a8d-8db1-c5d1f3f50bb0 with identifier: SP86583
2026-04-27 08:01:36 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 534880c2-a3a0-5a8d-8db1-c5d1f3f50bb0 with identifier: SP86583 to the API
2026-04-27 08:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:37 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 394,
 'expiration_date': '2026-04-28T15:43:46Z',
 'fuel_type': 'hybrid',
 'id': '534880c2-a3a0-5a8d-8db1-c5d1f3f50bb0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SP86583',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'BMW',
 'model': 'X5',
 'odometer': 94508,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2020-12-16',
 'seller_name': None,
 'title': 'BMW X5 xDrive 45e xLine',
 'transmission': 'automatic',
 'trim': 'xLine',
 'year': 2020}
2026-04-27 08:01:37 [auto1.fr] INFO: Saving data for SP86583: {'auction_closing_time': 1777391026.0, 'created_time': 1777022291.67663, 'has_photos': True, 'last_price_update_time': 1777276897.164394}
2026-04-27 08:01:37 [auto1.fr] INFO: Found listing with ID: BJ46930
2026-04-27 08:01:37 [auto1.fr] INFO: Scrape type for BJ46930: 2
2026-04-27 08:01:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf13a969-a853-53b1-b751-2b57267c31da with identifier: BJ46930
2026-04-27 08:01:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf13a969-a853-53b1-b751-2b57267c31da with scrape type 2
2026-04-27 08:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf13a969-a853-53b1-b751-2b57267c31da with scrape type 2
2026-04-27 08:01:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: cf13a969-a853-53b1-b751-2b57267c31da, identifier: BJ46930
2026-04-27 08:01:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: cf13a969-a853-53b1-b751-2b57267c31da with identifier: BJ46930
2026-04-27 08:01:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: cf13a969-a853-53b1-b751-2b57267c31da with identifier: BJ46930
2026-04-27 08:01:37 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: cf13a969-a853-53b1-b751-2b57267c31da with identifier: BJ46930 to the API
2026-04-27 08:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:37 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-04-28T15:00:11Z',
 'fuel_type': 'diesel',
 'id': 'cf13a969-a853-53b1-b751-2b57267c31da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BJ46930',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Peugeot',
 'model': '508',
 'odometer': 84494,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2019-05-01',
 'seller_name': None,
 'title': 'Peugeot 508 1.5 Blue-HDi Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2019}
2026-04-27 08:01:37 [auto1.fr] INFO: Saving data for BJ46930: {'auction_closing_time': 1777388411.0, 'created_time': 1777021692.210582, 'has_photos': True, 'last_price_update_time': 1777276897.579945}
2026-04-27 08:01:37 [auto1.fr] INFO: Found listing with ID: HS91891
2026-04-27 08:01:37 [auto1.fr] INFO: Scrape type for HS91891: 1
2026-04-27 08:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LP40212/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:37 [auto1.fr] INFO: Found listing with ID: GT31591
2026-04-27 08:01:37 [auto1.fr] INFO: Scrape type for GT31591: 1
2026-04-27 08:01:37 [auto1.fr] INFO: Found listing with ID: LK58488
2026-04-27 08:01:37 [auto1.fr] INFO: Scrape type for LK58488: 2
2026-04-27 08:01:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 329cee5d-08fe-553e-8444-df00d5c0c39a with identifier: LK58488
2026-04-27 08:01:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 329cee5d-08fe-553e-8444-df00d5c0c39a with scrape type 2
2026-04-27 08:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 329cee5d-08fe-553e-8444-df00d5c0c39a with scrape type 2
2026-04-27 08:01:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 329cee5d-08fe-553e-8444-df00d5c0c39a, identifier: LK58488
2026-04-27 08:01:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 329cee5d-08fe-553e-8444-df00d5c0c39a with identifier: LK58488
2026-04-27 08:01:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 329cee5d-08fe-553e-8444-df00d5c0c39a with identifier: LK58488
2026-04-27 08:01:37 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 329cee5d-08fe-553e-8444-df00d5c0c39a with identifier: LK58488 to the API
2026-04-27 08:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:37 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-04-28T15:33:47Z',
 'fuel_type': 'petrol',
 'id': '329cee5d-08fe-553e-8444-df00d5c0c39a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LK58488',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 114487,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2014-07-07',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.2 Tekna',
 'transmission': 'manual',
 'trim': 'Tekna',
 'year': 2014}
2026-04-27 08:01:38 [auto1.fr] INFO: Saving data for LK58488: {'auction_closing_time': 1777390427.0, 'created_time': 1777022696.456594, 'has_photos': True, 'last_price_update_time': 1777276898.032603}
2026-04-27 08:01:38 [auto1.fr] INFO: Found listing with ID: MZ95816
2026-04-27 08:01:38 [auto1.fr] INFO: Scrape type for MZ95816: 1
2026-04-27 08:01:38 [auto1.fr] INFO: Found listing with ID: RH31827
2026-04-27 08:01:38 [auto1.fr] INFO: Scrape type for RH31827: 2
2026-04-27 08:01:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ed29596-dd03-58c5-84dd-5b23d0928f65 with identifier: RH31827
2026-04-27 08:01:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ed29596-dd03-58c5-84dd-5b23d0928f65 with scrape type 2
2026-04-27 08:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9ed29596-dd03-58c5-84dd-5b23d0928f65 with scrape type 2
2026-04-27 08:01:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 9ed29596-dd03-58c5-84dd-5b23d0928f65, identifier: RH31827
2026-04-27 08:01:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 9ed29596-dd03-58c5-84dd-5b23d0928f65 with identifier: RH31827
2026-04-27 08:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-27 08:01:38 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gold HTTP/1.1" 200 None
2026-04-27 08:01:38 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-27 08:01:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 9ed29596-dd03-58c5-84dd-5b23d0928f65 with identifier: RH31827
2026-04-27 08:01:38 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 9ed29596-dd03-58c5-84dd-5b23d0928f65 with identifier: RH31827 to the API
2026-04-27 08:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:38 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gold',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-04-28T15:49:49Z',
 'fuel_type': 'diesel',
 'id': '9ed29596-dd03-58c5-84dd-5b23d0928f65',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RH31827',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Renault',
 'model': 'Scenic',
 'odometer': 180075,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2014-05-25',
 'seller_name': None,
 'title': 'Renault Scenic 1.5 dCi Business',
 'transmission': 'manual',
 'trim': 'Business',
 'year': 2014}
2026-04-27 08:01:38 [auto1.fr] INFO: Saving data for RH31827: {'auction_closing_time': 1777391389.0, 'created_time': 1777021184.349704, 'has_photos': True, 'last_price_update_time': 1777276898.709169}
2026-04-27 08:01:38 [auto1.fr] INFO: Found listing with ID: MS72274
2026-04-27 08:01:38 [auto1.fr] INFO: Scrape type for MS72274: 1
2026-04-27 08:01:38 [auto1.fr] INFO: Found listing with ID: RY45034
2026-04-27 08:01:38 [auto1.fr] INFO: Scrape type for RY45034: 1
2026-04-27 08:01:38 [auto1.fr] INFO: Found listing with ID: SK64553
2026-04-27 08:01:38 [auto1.fr] INFO: Scrape type for SK64553: 2
2026-04-27 08:01:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab91be09-dfba-5910-b00f-7090df9d67e8 with identifier: SK64553
2026-04-27 08:01:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab91be09-dfba-5910-b00f-7090df9d67e8 with scrape type 2
2026-04-27 08:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab91be09-dfba-5910-b00f-7090df9d67e8 with scrape type 2
2026-04-27 08:01:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ab91be09-dfba-5910-b00f-7090df9d67e8, identifier: SK64553
2026-04-27 08:01:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ab91be09-dfba-5910-b00f-7090df9d67e8 with identifier: SK64553
2026-04-27 08:01:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ab91be09-dfba-5910-b00f-7090df9d67e8 with identifier: SK64553
2026-04-27 08:01:38 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ab91be09-dfba-5910-b00f-7090df9d67e8 with identifier: SK64553 to the API
2026-04-27 08:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:39 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-04-28T15:07:32Z',
 'fuel_type': 'diesel',
 'id': 'ab91be09-dfba-5910-b00f-7090df9d67e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SK64553',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Fiat',
 'model': '500X',
 'odometer': 161763,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2015-03-30',
 'seller_name': None,
 'title': 'Fiat 500X 1.6 JTDM Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2015}
2026-04-27 08:01:39 [auto1.fr] INFO: Saving data for SK64553: {'auction_closing_time': 1777388852.0, 'created_time': 1777022056.103951, 'has_photos': True, 'last_price_update_time': 1777276899.158709}
2026-04-27 08:01:39 [auto1.fr] INFO: Found listing with ID: CM53599
2026-04-27 08:01:39 [auto1.fr] INFO: Scrape type for CM53599: 1
2026-04-27 08:01:39 [auto1.fr] INFO: Found listing with ID: CZ28253
2026-04-27 08:01:39 [auto1.fr] INFO: Scrape type for CZ28253: 1
2026-04-27 08:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KV97324/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KD23440/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:39 [auto1.fr] INFO: Found listing with ID: JN01057
2026-04-27 08:01:39 [auto1.fr] INFO: Scrape type for JN01057: 1
2026-04-27 08:01:39 [auto1.fr] INFO: Found listing with ID: UM47720
2026-04-27 08:01:39 [auto1.fr] INFO: Scrape type for UM47720: 1
2026-04-27 08:01:39 [auto1.fr] INFO: Found listing with ID: TX81047
2026-04-27 08:01:39 [auto1.fr] INFO: Scrape type for TX81047: 1
2026-04-27 08:01:39 [auto1.fr] INFO: Found listing with ID: XD98518
2026-04-27 08:01:39 [auto1.fr] INFO: Scrape type for XD98518: 1
2026-04-27 08:01:39 [auto1.fr] INFO: Found listing with ID: NL98546
2026-04-27 08:01:39 [auto1.fr] INFO: Scrape type for NL98546: 1
2026-04-27 08:01:39 [auto1.fr] INFO: Found listing with ID: FC31311
2026-04-27 08:01:39 [auto1.fr] INFO: Scrape type for FC31311: 2
2026-04-27 08:01:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: feabea49-f95b-5eab-a484-6d497a3c6a11 with identifier: FC31311
2026-04-27 08:01:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item feabea49-f95b-5eab-a484-6d497a3c6a11 with scrape type 2
2026-04-27 08:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item feabea49-f95b-5eab-a484-6d497a3c6a11 with scrape type 2
2026-04-27 08:01:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: feabea49-f95b-5eab-a484-6d497a3c6a11, identifier: FC31311
2026-04-27 08:01:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: feabea49-f95b-5eab-a484-6d497a3c6a11 with identifier: FC31311
2026-04-27 08:01:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: feabea49-f95b-5eab-a484-6d497a3c6a11 with identifier: FC31311
2026-04-27 08:01:39 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: feabea49-f95b-5eab-a484-6d497a3c6a11 with identifier: FC31311 to the API
2026-04-27 08:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:39 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-04-28T15:37:51Z',
 'fuel_type': 'diesel',
 'id': 'feabea49-f95b-5eab-a484-6d497a3c6a11',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FC31311',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Citroen',
 'model': 'DS5',
 'odometer': 208603,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2012-12-25',
 'seller_name': None,
 'title': 'Citroen DS5 2.0 HDi Executive',
 'transmission': 'manual',
 'trim': 'Executive',
 'year': 2012}
2026-04-27 08:01:39 [auto1.fr] INFO: Saving data for FC31311: {'auction_closing_time': 1777390671.0, 'created_time': 1777022115.481042, 'has_photos': True, 'last_price_update_time': 1777276899.70895}
2026-04-27 08:01:39 [auto1.fr] INFO: Found listing with ID: WA76064
2026-04-27 08:01:39 [auto1.fr] INFO: Scrape type for WA76064: 1
2026-04-27 08:01:39 [auto1.fr] INFO: Found listing with ID: CU11970
2026-04-27 08:01:39 [auto1.fr] INFO: Scrape type for CU11970: 2
2026-04-27 08:01:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 869f8b24-3823-55fa-9c99-e23db59cac07 with identifier: CU11970
2026-04-27 08:01:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 869f8b24-3823-55fa-9c99-e23db59cac07 with scrape type 2
2026-04-27 08:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 869f8b24-3823-55fa-9c99-e23db59cac07 with scrape type 2
2026-04-27 08:01:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 869f8b24-3823-55fa-9c99-e23db59cac07, identifier: CU11970
2026-04-27 08:01:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 869f8b24-3823-55fa-9c99-e23db59cac07 with identifier: CU11970
2026-04-27 08:01:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 869f8b24-3823-55fa-9c99-e23db59cac07 with identifier: CU11970
2026-04-27 08:01:40 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 869f8b24-3823-55fa-9c99-e23db59cac07 with identifier: CU11970 to the API
2026-04-27 08:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:40 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 99,
 'expiration_date': '2026-04-28T15:45:39Z',
 'fuel_type': 'diesel',
 'id': '869f8b24-3823-55fa-9c99-e23db59cac07',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CU11970',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 193112,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2016-01-28',
 'seller_name': None,
 'title': 'Peugeot 2008 1.6 Blue-HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2016}
2026-04-27 08:01:40 [auto1.fr] INFO: Saving data for CU11970: {'auction_closing_time': 1777391139.0, 'created_time': 1777022100.869554, 'has_photos': True, 'last_price_update_time': 1777276900.268162}
2026-04-27 08:01:40 [auto1.fr] INFO: Found listing with ID: PF14495
2026-04-27 08:01:40 [auto1.fr] INFO: Scrape type for PF14495: 1
2026-04-27 08:01:40 [auto1.fr] INFO: Found listing with ID: WH37826
2026-04-27 08:01:40 [auto1.fr] INFO: Scrape type for WH37826: 2
2026-04-27 08:01:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 110a0358-deba-58bc-bb0f-856e867151ed with identifier: WH37826
2026-04-27 08:01:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 110a0358-deba-58bc-bb0f-856e867151ed with scrape type 2
2026-04-27 08:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 110a0358-deba-58bc-bb0f-856e867151ed with scrape type 2
2026-04-27 08:01:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 110a0358-deba-58bc-bb0f-856e867151ed, identifier: WH37826
2026-04-27 08:01:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 110a0358-deba-58bc-bb0f-856e867151ed with identifier: WH37826
2026-04-27 08:01:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 110a0358-deba-58bc-bb0f-856e867151ed with identifier: WH37826
2026-04-27 08:01:40 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 110a0358-deba-58bc-bb0f-856e867151ed with identifier: WH37826 to the API
2026-04-27 08:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:40 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 160,
 'expiration_date': '2026-04-28T15:30:04Z',
 'fuel_type': 'diesel',
 'id': '110a0358-deba-58bc-bb0f-856e867151ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WH37826',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Renault',
 'model': 'Talisman',
 'odometer': 105078,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2017-03-22',
 'seller_name': None,
 'title': 'Renault Talisman 1.6 dCi Energy Intens',
 'transmission': 'automatic',
 'trim': 'Intens',
 'year': 2017}
2026-04-27 08:01:40 [auto1.fr] INFO: Saving data for WH37826: {'auction_closing_time': 1777390204.0, 'created_time': 1777019974.76815, 'has_photos': True, 'last_price_update_time': 1777276900.741503}
2026-04-27 08:01:40 [auto1.fr] INFO: Found listing with ID: HD20644
2026-04-27 08:01:40 [auto1.fr] INFO: Scrape type for HD20644: 1
2026-04-27 08:01:40 [auto1.fr] INFO: Found listing with ID: BD67804
2026-04-27 08:01:40 [auto1.fr] INFO: Scrape type for BD67804: 1
2026-04-27 08:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EJ49197/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:59 [scrapy.extensions.logstats] INFO: Crawled 333 pages (at 34 pages/min), scraped 330 items (at 68 items/min)
2026-04-27 08:01:59 [scrapy.extensions.memusage] INFO: Peak memory usage is 373MiB
2026-04-27 08:02:16 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.678(s), this was the 1st time calling it.
2026-04-27 08:02:16 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.417698333154305 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:02:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GD46628> (referer: https://www.auto1.com/v1/car-details-view/GD46628/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:02:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:02:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4cde3ab4-9609-5d80-9d7d-da59cafec0e3 with identifier: GD46628
2026-04-27 08:02:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4cde3ab4-9609-5d80-9d7d-da59cafec0e3 with scrape type 1
2026-04-27 08:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4cde3ab4-9609-5d80-9d7d-da59cafec0e3
2026-04-27 08:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/f7/97f7d0b999e0f2d8ca38853478161558/pa/GD46628_b909c7093e550f84dd90e7b8fe5c1729.jpg not downloaded yet
2026-04-27 08:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/f7/97f7d0b999e0f2d8ca38853478161558/pa/GD46628_44c8dc6f9159fd974459bd9aca9d3581.jpg not downloaded yet
2026-04-27 08:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/f7/97f7d0b999e0f2d8ca38853478161558/pa/GD46628_52abe27e257c589dffa1aa4f280ce3b3.jpg not downloaded yet
2026-04-27 08:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/f7/97f7d0b999e0f2d8ca38853478161558/pa/GD46628_577c9f40b518d46e56a23dcdff8afd59.jpg not downloaded yet
2026-04-27 08:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/f7/97f7d0b999e0f2d8ca38853478161558/pa/GD46628_901b58436be5a1ab95b72c6243bac33c.jpg not downloaded yet
2026-04-27 08:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/f7/97f7d0b999e0f2d8ca38853478161558/pa/GD46628_026327ab0e25b61773bc31025c3a78d8.jpg not downloaded yet
2026-04-27 08:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/f7/97f7d0b999e0f2d8ca38853478161558/pa/GD46628_2d222136fd67b344c69aef388fb71d44.jpg not downloaded yet
2026-04-27 08:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/f7/97f7d0b999e0f2d8ca38853478161558/pa/GD46628_d46f3dbaa828aa70050950417b78ffb0.jpg not downloaded yet
2026-04-27 08:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/f7/97f7d0b999e0f2d8ca38853478161558/pa/GD46628_0d7e1fd1a7b6f253ff21fdf89ac3abad.jpg not downloaded yet
2026-04-27 08:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/f7/97f7d0b999e0f2d8ca38853478161558/pa/GD46628_6934ce7805a2f17a61bc5cccf8e3a388.jpg not downloaded yet
2026-04-27 08:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LJ15402> (referer: https://www.auto1.com/v1/car-details-view/LJ15402/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:02:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:02:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ab14a79-c792-5607-8884-1027b7156cca with identifier: LJ15402
2026-04-27 08:02:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ab14a79-c792-5607-8884-1027b7156cca with scrape type 1
2026-04-27 08:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6ab14a79-c792-5607-8884-1027b7156cca
2026-04-27 08:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/50/3550a8341d5e81ea1acb0160f185bc51/pa/LJ15402_cd8773b8a26725109215bfc48f1cb84c.jpg not downloaded yet
2026-04-27 08:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/50/3550a8341d5e81ea1acb0160f185bc51/pa/LJ15402_321cd0e54aece348f43bb2257787167a.jpg not downloaded yet
2026-04-27 08:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/50/3550a8341d5e81ea1acb0160f185bc51/pa/LJ15402_4559e90ebfc57af071ee68da280b90c0.jpg not downloaded yet
2026-04-27 08:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/f7/97f7d0b999e0f2d8ca38853478161558/pa/GD46628_6934ce7805a2f17a61bc5cccf8e3a388.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/50/3550a8341d5e81ea1acb0160f185bc51/pa/LJ15402_acf298731bab87824475e08303a08014.jpg not downloaded yet
2026-04-27 08:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/50/3550a8341d5e81ea1acb0160f185bc51/pa/LJ15402_3dd5401e6b39f1a895579d94f7ea7271.jpg not downloaded yet
2026-04-27 08:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/50/3550a8341d5e81ea1acb0160f185bc51/pa/LJ15402_c5f67e39f7fa59a80335fcf63a2eec9e.jpg not downloaded yet
2026-04-27 08:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/50/3550a8341d5e81ea1acb0160f185bc51/pa/LJ15402_93b5c15d08db7b81fa915f4670216b32.jpg not downloaded yet
2026-04-27 08:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/50/3550a8341d5e81ea1acb0160f185bc51/pa/LJ15402_894abfdf4956dfc847833c43128955ca.jpg not downloaded yet
2026-04-27 08:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/50/3550a8341d5e81ea1acb0160f185bc51/pa/LJ15402_78c554a4ed9be8bcdbbb374f6a1c65e9.jpg not downloaded yet
2026-04-27 08:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/50/3550a8341d5e81ea1acb0160f185bc51/pa/LJ15402_973d95fbc4d70bc0775ec751552ca2c5.jpg not downloaded yet
2026-04-27 08:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d7e710>
2026-04-27 08:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cde3ab4-9609-5d80-9d7d-da59cafec0e3/4cde3ab4-9609-5d80-9d7d-da59cafec0e3_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/f7/97f7d0b999e0f2d8ca38853478161558/pa/GD46628_6934ce7805a2f17a61bc5cccf8e3a388.jpg saved to cache
2026-04-27 08:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4cde3ab4-9609-5d80-9d7d-da59cafec0e3
2026-04-27 08:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/50/3550a8341d5e81ea1acb0160f185bc51/pa/LJ15402_4559e90ebfc57af071ee68da280b90c0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438046f90>
2026-04-27 08:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ab14a79-c792-5607-8884-1027b7156cca/6ab14a79-c792-5607-8884-1027b7156cca_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/50/3550a8341d5e81ea1acb0160f185bc51/pa/LJ15402_4559e90ebfc57af071ee68da280b90c0.jpg saved to cache
2026-04-27 08:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6ab14a79-c792-5607-8884-1027b7156cca
2026-04-27 08:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/50/3550a8341d5e81ea1acb0160f185bc51/pa/LJ15402_973d95fbc4d70bc0775ec751552ca2c5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/50/3550a8341d5e81ea1acb0160f185bc51/pa/LJ15402_78c554a4ed9be8bcdbbb374f6a1c65e9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/50/3550a8341d5e81ea1acb0160f185bc51/pa/LJ15402_894abfdf4956dfc847833c43128955ca.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bfd4050>
2026-04-27 08:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ab14a79-c792-5607-8884-1027b7156cca/6ab14a79-c792-5607-8884-1027b7156cca_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/50/3550a8341d5e81ea1acb0160f185bc51/pa/LJ15402_973d95fbc4d70bc0775ec751552ca2c5.jpg saved to cache
2026-04-27 08:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6ab14a79-c792-5607-8884-1027b7156cca
2026-04-27 08:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bfa7e10>
2026-04-27 08:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ab14a79-c792-5607-8884-1027b7156cca/6ab14a79-c792-5607-8884-1027b7156cca_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/50/3550a8341d5e81ea1acb0160f185bc51/pa/LJ15402_78c554a4ed9be8bcdbbb374f6a1c65e9.jpg saved to cache
2026-04-27 08:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6ab14a79-c792-5607-8884-1027b7156cca
2026-04-27 08:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bfd5910>
2026-04-27 08:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ab14a79-c792-5607-8884-1027b7156cca/6ab14a79-c792-5607-8884-1027b7156cca_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/50/3550a8341d5e81ea1acb0160f185bc51/pa/LJ15402_894abfdf4956dfc847833c43128955ca.jpg saved to cache
2026-04-27 08:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6ab14a79-c792-5607-8884-1027b7156cca
2026-04-27 08:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/50/3550a8341d5e81ea1acb0160f185bc51/pa/LJ15402_93b5c15d08db7b81fa915f4670216b32.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438061650>
2026-04-27 08:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ab14a79-c792-5607-8884-1027b7156cca/6ab14a79-c792-5607-8884-1027b7156cca_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/50/3550a8341d5e81ea1acb0160f185bc51/pa/LJ15402_93b5c15d08db7b81fa915f4670216b32.jpg saved to cache
2026-04-27 08:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6ab14a79-c792-5607-8884-1027b7156cca
2026-04-27 08:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/50/3550a8341d5e81ea1acb0160f185bc51/pa/LJ15402_c5f67e39f7fa59a80335fcf63a2eec9e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143817ead0>
2026-04-27 08:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ab14a79-c792-5607-8884-1027b7156cca/6ab14a79-c792-5607-8884-1027b7156cca_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/50/3550a8341d5e81ea1acb0160f185bc51/pa/LJ15402_c5f67e39f7fa59a80335fcf63a2eec9e.jpg saved to cache
2026-04-27 08:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6ab14a79-c792-5607-8884-1027b7156cca
2026-04-27 08:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/50/3550a8341d5e81ea1acb0160f185bc51/pa/LJ15402_3dd5401e6b39f1a895579d94f7ea7271.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/50/3550a8341d5e81ea1acb0160f185bc51/pa/LJ15402_acf298731bab87824475e08303a08014.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/50/3550a8341d5e81ea1acb0160f185bc51/pa/LJ15402_321cd0e54aece348f43bb2257787167a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c78610>
2026-04-27 08:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ab14a79-c792-5607-8884-1027b7156cca/6ab14a79-c792-5607-8884-1027b7156cca_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/50/3550a8341d5e81ea1acb0160f185bc51/pa/LJ15402_3dd5401e6b39f1a895579d94f7ea7271.jpg saved to cache
2026-04-27 08:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6ab14a79-c792-5607-8884-1027b7156cca
2026-04-27 08:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/50/3550a8341d5e81ea1acb0160f185bc51/pa/LJ15402_cd8773b8a26725109215bfc48f1cb84c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bf19190>
2026-04-27 08:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ab14a79-c792-5607-8884-1027b7156cca/6ab14a79-c792-5607-8884-1027b7156cca_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/50/3550a8341d5e81ea1acb0160f185bc51/pa/LJ15402_acf298731bab87824475e08303a08014.jpg saved to cache
2026-04-27 08:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6ab14a79-c792-5607-8884-1027b7156cca
2026-04-27 08:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c8e610>
2026-04-27 08:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ab14a79-c792-5607-8884-1027b7156cca/6ab14a79-c792-5607-8884-1027b7156cca_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/50/3550a8341d5e81ea1acb0160f185bc51/pa/LJ15402_321cd0e54aece348f43bb2257787167a.jpg saved to cache
2026-04-27 08:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6ab14a79-c792-5607-8884-1027b7156cca
2026-04-27 08:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/f7/97f7d0b999e0f2d8ca38853478161558/pa/GD46628_0d7e1fd1a7b6f253ff21fdf89ac3abad.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bfa4b50>
2026-04-27 08:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ab14a79-c792-5607-8884-1027b7156cca/6ab14a79-c792-5607-8884-1027b7156cca_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/50/3550a8341d5e81ea1acb0160f185bc51/pa/LJ15402_cd8773b8a26725109215bfc48f1cb84c.jpg saved to cache
2026-04-27 08:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6ab14a79-c792-5607-8884-1027b7156cca
2026-04-27 08:02:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6ab14a79-c792-5607-8884-1027b7156cca, skipping ID generation
2026-04-27 08:02:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ab14a79-c792-5607-8884-1027b7156cca with scrape type 1
2026-04-27 08:02:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6ab14a79-c792-5607-8884-1027b7156cca sending to next pipeline
2026-04-27 08:02:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6ab14a79-c792-5607-8884-1027b7156cca, identifier: LJ15402
2026-04-27 08:02:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6ab14a79-c792-5607-8884-1027b7156cca with identifier: LJ15402
2026-04-27 08:02:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6ab14a79-c792-5607-8884-1027b7156cca with identifier: LJ15402
2026-04-27 08:02:57 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:02:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6ab14a79-c792-5607-8884-1027b7156cca with identifier: LJ15402 to the API
2026-04-27 08:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:02:58 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:02:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img35/50/3550a8341d5e81ea1acb0160f185bc51/pa/LJ15402_cd8773b8a26725109215bfc48f1cb84c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'category': None,
 'city': 'LA CHAPELLE LONGUEVILLE',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 122,
 'expiration_date': '2026-04-28T15:46:49Z',
 'fuel_type': 'petrol',
 'id': '6ab14a79-c792-5607-8884-1027b7156cca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LJ15402',
 'listing': 'auction',
 'location': 'FR, LA CHAPELLE LONGUEVILLE',
 'location_confidence': None,
 'longitude': None,
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 158552,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6ab14a79-c792-5607-8884-1027b7156cca/6ab14a79-c792-5607-8884-1027b7156cca_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70927,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/50/3550a8341d5e81ea1acb0160f185bc51/pa/LJ15402_cd8773b8a26725109215bfc48f1cb84c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6ab14a79-c792-5607-8884-1027b7156cca/6ab14a79-c792-5607-8884-1027b7156cca_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69553,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/50/3550a8341d5e81ea1acb0160f185bc51/pa/LJ15402_321cd0e54aece348f43bb2257787167a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6ab14a79-c792-5607-8884-1027b7156cca/6ab14a79-c792-5607-8884-1027b7156cca_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71231,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/50/3550a8341d5e81ea1acb0160f185bc51/pa/LJ15402_4559e90ebfc57af071ee68da280b90c0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6ab14a79-c792-5607-8884-1027b7156cca/6ab14a79-c792-5607-8884-1027b7156cca_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56529,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/50/3550a8341d5e81ea1acb0160f185bc51/pa/LJ15402_acf298731bab87824475e08303a08014.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6ab14a79-c792-5607-8884-1027b7156cca/6ab14a79-c792-5607-8884-1027b7156cca_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71192,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/50/3550a8341d5e81ea1acb0160f185bc51/pa/LJ15402_3dd5401e6b39f1a895579d94f7ea7271.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6ab14a79-c792-5607-8884-1027b7156cca/6ab14a79-c792-5607-8884-1027b7156cca_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65203,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/50/3550a8341d5e81ea1acb0160f185bc51/pa/LJ15402_c5f67e39f7fa59a80335fcf63a2eec9e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6ab14a79-c792-5607-8884-1027b7156cca/6ab14a79-c792-5607-8884-1027b7156cca_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66930,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/50/3550a8341d5e81ea1acb0160f185bc51/pa/LJ15402_93b5c15d08db7b81fa915f4670216b32.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6ab14a79-c792-5607-8884-1027b7156cca/6ab14a79-c792-5607-8884-1027b7156cca_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72896,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/50/3550a8341d5e81ea1acb0160f185bc51/pa/LJ15402_894abfdf4956dfc847833c43128955ca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6ab14a79-c792-5607-8884-1027b7156cca/6ab14a79-c792-5607-8884-1027b7156cca_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64358,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/50/3550a8341d5e81ea1acb0160f185bc51/pa/LJ15402_78c554a4ed9be8bcdbbb374f6a1c65e9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6ab14a79-c792-5607-8884-1027b7156cca/6ab14a79-c792-5607-8884-1027b7156cca_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66620,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/50/3550a8341d5e81ea1acb0160f185bc51/pa/LJ15402_973d95fbc4d70bc0775ec751552ca2c5.jpg',
             'Width': 800}],
 'postal_code': None,
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2013-03-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 TSI Carat BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Carat BlueMotion Tech',
 'year': 2013}
2026-04-27 08:02:58 [auto1.fr] INFO: Saving data for LJ15402: {'created_time': 1777276978.200261, 'last_price_update_time': 1777276978.200272, 'has_photos': True, 'auction_closing_time': 1777391209.0}
2026-04-27 08:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/f7/97f7d0b999e0f2d8ca38853478161558/pa/GD46628_d46f3dbaa828aa70050950417b78ffb0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1439c44f10>
2026-04-27 08:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cde3ab4-9609-5d80-9d7d-da59cafec0e3/4cde3ab4-9609-5d80-9d7d-da59cafec0e3_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/f7/97f7d0b999e0f2d8ca38853478161558/pa/GD46628_0d7e1fd1a7b6f253ff21fdf89ac3abad.jpg saved to cache
2026-04-27 08:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4cde3ab4-9609-5d80-9d7d-da59cafec0e3
2026-04-27 08:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/f7/97f7d0b999e0f2d8ca38853478161558/pa/GD46628_2d222136fd67b344c69aef388fb71d44.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143adb0b90>
2026-04-27 08:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cde3ab4-9609-5d80-9d7d-da59cafec0e3/4cde3ab4-9609-5d80-9d7d-da59cafec0e3_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/f7/97f7d0b999e0f2d8ca38853478161558/pa/GD46628_d46f3dbaa828aa70050950417b78ffb0.jpg saved to cache
2026-04-27 08:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4cde3ab4-9609-5d80-9d7d-da59cafec0e3
2026-04-27 08:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/f7/97f7d0b999e0f2d8ca38853478161558/pa/GD46628_026327ab0e25b61773bc31025c3a78d8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143801ead0>
2026-04-27 08:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cde3ab4-9609-5d80-9d7d-da59cafec0e3/4cde3ab4-9609-5d80-9d7d-da59cafec0e3_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/f7/97f7d0b999e0f2d8ca38853478161558/pa/GD46628_2d222136fd67b344c69aef388fb71d44.jpg saved to cache
2026-04-27 08:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4cde3ab4-9609-5d80-9d7d-da59cafec0e3
2026-04-27 08:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/f7/97f7d0b999e0f2d8ca38853478161558/pa/GD46628_901b58436be5a1ab95b72c6243bac33c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/f7/97f7d0b999e0f2d8ca38853478161558/pa/GD46628_577c9f40b518d46e56a23dcdff8afd59.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d7d4d0>
2026-04-27 08:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cde3ab4-9609-5d80-9d7d-da59cafec0e3/4cde3ab4-9609-5d80-9d7d-da59cafec0e3_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/f7/97f7d0b999e0f2d8ca38853478161558/pa/GD46628_026327ab0e25b61773bc31025c3a78d8.jpg saved to cache
2026-04-27 08:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4cde3ab4-9609-5d80-9d7d-da59cafec0e3
2026-04-27 08:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/f7/97f7d0b999e0f2d8ca38853478161558/pa/GD46628_52abe27e257c589dffa1aa4f280ce3b3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1439c5fe90>
2026-04-27 08:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cde3ab4-9609-5d80-9d7d-da59cafec0e3/4cde3ab4-9609-5d80-9d7d-da59cafec0e3_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/f7/97f7d0b999e0f2d8ca38853478161558/pa/GD46628_901b58436be5a1ab95b72c6243bac33c.jpg saved to cache
2026-04-27 08:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4cde3ab4-9609-5d80-9d7d-da59cafec0e3
2026-04-27 08:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143801c650>
2026-04-27 08:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cde3ab4-9609-5d80-9d7d-da59cafec0e3/4cde3ab4-9609-5d80-9d7d-da59cafec0e3_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/f7/97f7d0b999e0f2d8ca38853478161558/pa/GD46628_577c9f40b518d46e56a23dcdff8afd59.jpg saved to cache
2026-04-27 08:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4cde3ab4-9609-5d80-9d7d-da59cafec0e3
2026-04-27 08:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/f7/97f7d0b999e0f2d8ca38853478161558/pa/GD46628_44c8dc6f9159fd974459bd9aca9d3581.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bffef90>
2026-04-27 08:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cde3ab4-9609-5d80-9d7d-da59cafec0e3/4cde3ab4-9609-5d80-9d7d-da59cafec0e3_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/f7/97f7d0b999e0f2d8ca38853478161558/pa/GD46628_52abe27e257c589dffa1aa4f280ce3b3.jpg saved to cache
2026-04-27 08:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4cde3ab4-9609-5d80-9d7d-da59cafec0e3
2026-04-27 08:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/f7/97f7d0b999e0f2d8ca38853478161558/pa/GD46628_b909c7093e550f84dd90e7b8fe5c1729.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bfd6b50>
2026-04-27 08:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cde3ab4-9609-5d80-9d7d-da59cafec0e3/4cde3ab4-9609-5d80-9d7d-da59cafec0e3_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/f7/97f7d0b999e0f2d8ca38853478161558/pa/GD46628_44c8dc6f9159fd974459bd9aca9d3581.jpg saved to cache
2026-04-27 08:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4cde3ab4-9609-5d80-9d7d-da59cafec0e3
2026-04-27 08:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438126a90>
2026-04-27 08:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cde3ab4-9609-5d80-9d7d-da59cafec0e3/4cde3ab4-9609-5d80-9d7d-da59cafec0e3_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/f7/97f7d0b999e0f2d8ca38853478161558/pa/GD46628_b909c7093e550f84dd90e7b8fe5c1729.jpg saved to cache
2026-04-27 08:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4cde3ab4-9609-5d80-9d7d-da59cafec0e3
2026-04-27 08:02:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4cde3ab4-9609-5d80-9d7d-da59cafec0e3, skipping ID generation
2026-04-27 08:02:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4cde3ab4-9609-5d80-9d7d-da59cafec0e3 with scrape type 1
2026-04-27 08:02:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4cde3ab4-9609-5d80-9d7d-da59cafec0e3 sending to next pipeline
2026-04-27 08:02:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4cde3ab4-9609-5d80-9d7d-da59cafec0e3, identifier: GD46628
2026-04-27 08:02:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4cde3ab4-9609-5d80-9d7d-da59cafec0e3 with identifier: GD46628
2026-04-27 08:02:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4cde3ab4-9609-5d80-9d7d-da59cafec0e3 with identifier: GD46628
2026-04-27 08:02:59 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:02:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 4cde3ab4-9609-5d80-9d7d-da59cafec0e3 with identifier: GD46628 to the API
2026-04-27 08:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:02:59 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:02:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img97/f7/97f7d0b999e0f2d8ca38853478161558/pa/GD46628_b909c7093e550f84dd90e7b8fe5c1729.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'city': 'Beaucaire',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 180,
 'expiration_date': '2026-04-28T15:31:41Z',
 'fuel_type': 'diesel',
 'id': '4cde3ab4-9609-5d80-9d7d-da59cafec0e3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 43.8081,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GD46628',
 'listing': 'auction',
 'location': 'FR, Beaucaire',
 'location_confidence': 'geocoded',
 'longitude': 4.6442,
 'make': 'Peugeot',
 'model': '508',
 'odometer': 132233,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4cde3ab4-9609-5d80-9d7d-da59cafec0e3/4cde3ab4-9609-5d80-9d7d-da59cafec0e3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75930,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img97/f7/97f7d0b999e0f2d8ca38853478161558/pa/GD46628_b909c7093e550f84dd90e7b8fe5c1729.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4cde3ab4-9609-5d80-9d7d-da59cafec0e3/4cde3ab4-9609-5d80-9d7d-da59cafec0e3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76840,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img97/f7/97f7d0b999e0f2d8ca38853478161558/pa/GD46628_44c8dc6f9159fd974459bd9aca9d3581.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4cde3ab4-9609-5d80-9d7d-da59cafec0e3/4cde3ab4-9609-5d80-9d7d-da59cafec0e3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67612,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img97/f7/97f7d0b999e0f2d8ca38853478161558/pa/GD46628_52abe27e257c589dffa1aa4f280ce3b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4cde3ab4-9609-5d80-9d7d-da59cafec0e3/4cde3ab4-9609-5d80-9d7d-da59cafec0e3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71488,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img97/f7/97f7d0b999e0f2d8ca38853478161558/pa/GD46628_577c9f40b518d46e56a23dcdff8afd59.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4cde3ab4-9609-5d80-9d7d-da59cafec0e3/4cde3ab4-9609-5d80-9d7d-da59cafec0e3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60984,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img97/f7/97f7d0b999e0f2d8ca38853478161558/pa/GD46628_901b58436be5a1ab95b72c6243bac33c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4cde3ab4-9609-5d80-9d7d-da59cafec0e3/4cde3ab4-9609-5d80-9d7d-da59cafec0e3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64243,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img97/f7/97f7d0b999e0f2d8ca38853478161558/pa/GD46628_026327ab0e25b61773bc31025c3a78d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4cde3ab4-9609-5d80-9d7d-da59cafec0e3/4cde3ab4-9609-5d80-9d7d-da59cafec0e3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57044,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img97/f7/97f7d0b999e0f2d8ca38853478161558/pa/GD46628_2d222136fd67b344c69aef388fb71d44.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4cde3ab4-9609-5d80-9d7d-da59cafec0e3/4cde3ab4-9609-5d80-9d7d-da59cafec0e3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66738,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img97/f7/97f7d0b999e0f2d8ca38853478161558/pa/GD46628_d46f3dbaa828aa70050950417b78ffb0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4cde3ab4-9609-5d80-9d7d-da59cafec0e3/4cde3ab4-9609-5d80-9d7d-da59cafec0e3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62694,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img97/f7/97f7d0b999e0f2d8ca38853478161558/pa/GD46628_0d7e1fd1a7b6f253ff21fdf89ac3abad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4cde3ab4-9609-5d80-9d7d-da59cafec0e3/4cde3ab4-9609-5d80-9d7d-da59cafec0e3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69057,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img97/f7/97f7d0b999e0f2d8ca38853478161558/pa/GD46628_6934ce7805a2f17a61bc5cccf8e3a388.jpg',
             'Width': 800}],
 'postal_code': '30300',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Gard',
 'province_code': 'FR-30',
 'region': 'Occitanie',
 'region_code': 'FR-76',
 'registration_date': '2015-04-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 508 2.0 Blue-HDi RXH',
 'transmission': 'automatic',
 'trim': 'RXH',
 'year': 2015}
2026-04-27 08:02:59 [auto1.fr] INFO: Saving data for GD46628: {'created_time': 1777276979.659517, 'last_price_update_time': 1777276979.659528, 'has_photos': True, 'auction_closing_time': 1777390301.0}
2026-04-27 08:02:59 [scrapy.extensions.logstats] INFO: Crawled 335 pages (at 2 pages/min), scraped 332 items (at 2 items/min)
2026-04-27 08:02:59 [scrapy.extensions.memusage] INFO: Peak memory usage is 373MiB
2026-04-27 08:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LS55307> (referer: https://www.auto1.com/v1/car-details-view/LS55307/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f185549-71b7-5515-bdf4-508ee5951af1 with identifier: LS55307
2026-04-27 08:03:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f185549-71b7-5515-bdf4-508ee5951af1 with scrape type 1
2026-04-27 08:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 8f185549-71b7-5515-bdf4-508ee5951af1
2026-04-27 08:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/71/6171212dfcf6e4d7ef9db25f05747a5f/pa/LS55307_b087f6931be2430f783d8f40f1f5228f.jpg not downloaded yet
2026-04-27 08:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/71/6171212dfcf6e4d7ef9db25f05747a5f/pa/LS55307_dc353f318b24adbc680013e8d9d2737b.jpg not downloaded yet
2026-04-27 08:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/71/6171212dfcf6e4d7ef9db25f05747a5f/pa/LS55307_45f9e563593827ab67d4df207dd9c49a.jpg not downloaded yet
2026-04-27 08:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/71/6171212dfcf6e4d7ef9db25f05747a5f/pa/LS55307_1230910815f65fa2d196d13ae69e4a29.jpg not downloaded yet
2026-04-27 08:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/71/6171212dfcf6e4d7ef9db25f05747a5f/pa/LS55307_5c984ae949a62e560f9f278cd43faedd.jpg not downloaded yet
2026-04-27 08:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/71/6171212dfcf6e4d7ef9db25f05747a5f/pa/LS55307_40733c1f003c675698540574865554ec.jpg not downloaded yet
2026-04-27 08:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TF88155> (referer: https://www.auto1.com/v1/car-details-view/TF88155/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a91d03e-f44c-5435-a946-4ba7927d55b9 with identifier: TF88155
2026-04-27 08:03:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a91d03e-f44c-5435-a946-4ba7927d55b9 with scrape type 1
2026-04-27 08:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1a91d03e-f44c-5435-a946-4ba7927d55b9
2026-04-27 08:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/7c/d27c9fe292713974d1f2785f0cc07ccc/pa/TF88155_98ff324ce15b26827d26e43ec9227f00.jpg not downloaded yet
2026-04-27 08:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/7c/d27c9fe292713974d1f2785f0cc07ccc/pa/TF88155_dbd774d406dc96f93dd0d4eda729c3ee.jpg not downloaded yet
2026-04-27 08:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/71/6171212dfcf6e4d7ef9db25f05747a5f/pa/LS55307_40733c1f003c675698540574865554ec.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/7c/d27c9fe292713974d1f2785f0cc07ccc/pa/TF88155_452c21a1791905c4b50fbb90906f9757.jpg not downloaded yet
2026-04-27 08:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/7c/d27c9fe292713974d1f2785f0cc07ccc/pa/TF88155_dd158bba06219933d4ed3fc8745a3620.jpg not downloaded yet
2026-04-27 08:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/7c/d27c9fe292713974d1f2785f0cc07ccc/pa/TF88155_c8b2c29f21aa05327a78244bd5c4e540.jpg not downloaded yet
2026-04-27 08:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/7c/d27c9fe292713974d1f2785f0cc07ccc/pa/TF88155_446d331023aa627bad2ef1fb28dae981.jpg not downloaded yet
2026-04-27 08:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/7c/d27c9fe292713974d1f2785f0cc07ccc/pa/TF88155_f10bd9d0337b881e9881b21969a06e40.jpg not downloaded yet
2026-04-27 08:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/7c/d27c9fe292713974d1f2785f0cc07ccc/pa/TF88155_897734442119984357fe2736940b1a1c.jpg not downloaded yet
2026-04-27 08:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/7c/d27c9fe292713974d1f2785f0cc07ccc/pa/TF88155_dbd774d406dc96f93dd0d4eda729c3ee.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/7c/d27c9fe292713974d1f2785f0cc07ccc/pa/TF88155_c1f76d09a370b16e392d45e7dab8c075.jpg not downloaded yet
2026-04-27 08:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bf19310>
2026-04-27 08:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f185549-71b7-5515-bdf4-508ee5951af1/8f185549-71b7-5515-bdf4-508ee5951af1_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/71/6171212dfcf6e4d7ef9db25f05747a5f/pa/LS55307_40733c1f003c675698540574865554ec.jpg saved to cache
2026-04-27 08:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8f185549-71b7-5515-bdf4-508ee5951af1
2026-04-27 08:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/7c/d27c9fe292713974d1f2785f0cc07ccc/pa/TF88155_6cd8bffa71b50df814fb9020f57f9163.jpg not downloaded yet
2026-04-27 08:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438038990>
2026-04-27 08:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a91d03e-f44c-5435-a946-4ba7927d55b9/1a91d03e-f44c-5435-a946-4ba7927d55b9_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/7c/d27c9fe292713974d1f2785f0cc07ccc/pa/TF88155_dbd774d406dc96f93dd0d4eda729c3ee.jpg saved to cache
2026-04-27 08:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1a91d03e-f44c-5435-a946-4ba7927d55b9
2026-04-27 08:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/7c/d27c9fe292713974d1f2785f0cc07ccc/pa/TF88155_897734442119984357fe2736940b1a1c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438063ed0>
2026-04-27 08:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a91d03e-f44c-5435-a946-4ba7927d55b9/1a91d03e-f44c-5435-a946-4ba7927d55b9_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/7c/d27c9fe292713974d1f2785f0cc07ccc/pa/TF88155_897734442119984357fe2736940b1a1c.jpg saved to cache
2026-04-27 08:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1a91d03e-f44c-5435-a946-4ba7927d55b9
2026-04-27 08:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/7c/d27c9fe292713974d1f2785f0cc07ccc/pa/TF88155_6cd8bffa71b50df814fb9020f57f9163.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/7c/d27c9fe292713974d1f2785f0cc07ccc/pa/TF88155_c1f76d09a370b16e392d45e7dab8c075.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14381deb10>
2026-04-27 08:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a91d03e-f44c-5435-a946-4ba7927d55b9/1a91d03e-f44c-5435-a946-4ba7927d55b9_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/7c/d27c9fe292713974d1f2785f0cc07ccc/pa/TF88155_6cd8bffa71b50df814fb9020f57f9163.jpg saved to cache
2026-04-27 08:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1a91d03e-f44c-5435-a946-4ba7927d55b9
2026-04-27 08:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14381df890>
2026-04-27 08:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a91d03e-f44c-5435-a946-4ba7927d55b9/1a91d03e-f44c-5435-a946-4ba7927d55b9_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/7c/d27c9fe292713974d1f2785f0cc07ccc/pa/TF88155_c1f76d09a370b16e392d45e7dab8c075.jpg saved to cache
2026-04-27 08:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1a91d03e-f44c-5435-a946-4ba7927d55b9
2026-04-27 08:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/7c/d27c9fe292713974d1f2785f0cc07ccc/pa/TF88155_f10bd9d0337b881e9881b21969a06e40.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/7c/d27c9fe292713974d1f2785f0cc07ccc/pa/TF88155_446d331023aa627bad2ef1fb28dae981.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/7c/d27c9fe292713974d1f2785f0cc07ccc/pa/TF88155_c8b2c29f21aa05327a78244bd5c4e540.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b7cf50>
2026-04-27 08:03:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a91d03e-f44c-5435-a946-4ba7927d55b9/1a91d03e-f44c-5435-a946-4ba7927d55b9_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/7c/d27c9fe292713974d1f2785f0cc07ccc/pa/TF88155_f10bd9d0337b881e9881b21969a06e40.jpg saved to cache
2026-04-27 08:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1a91d03e-f44c-5435-a946-4ba7927d55b9
2026-04-27 08:03:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438087310>
2026-04-27 08:03:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a91d03e-f44c-5435-a946-4ba7927d55b9/1a91d03e-f44c-5435-a946-4ba7927d55b9_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/7c/d27c9fe292713974d1f2785f0cc07ccc/pa/TF88155_446d331023aa627bad2ef1fb28dae981.jpg saved to cache
2026-04-27 08:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1a91d03e-f44c-5435-a946-4ba7927d55b9
2026-04-27 08:03:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143803a850>
2026-04-27 08:03:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a91d03e-f44c-5435-a946-4ba7927d55b9/1a91d03e-f44c-5435-a946-4ba7927d55b9_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/7c/d27c9fe292713974d1f2785f0cc07ccc/pa/TF88155_c8b2c29f21aa05327a78244bd5c4e540.jpg saved to cache
2026-04-27 08:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1a91d03e-f44c-5435-a946-4ba7927d55b9
2026-04-27 08:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/7c/d27c9fe292713974d1f2785f0cc07ccc/pa/TF88155_dd158bba06219933d4ed3fc8745a3620.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/7c/d27c9fe292713974d1f2785f0cc07ccc/pa/TF88155_452c21a1791905c4b50fbb90906f9757.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/7c/d27c9fe292713974d1f2785f0cc07ccc/pa/TF88155_98ff324ce15b26827d26e43ec9227f00.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438086fd0>
2026-04-27 08:03:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a91d03e-f44c-5435-a946-4ba7927d55b9/1a91d03e-f44c-5435-a946-4ba7927d55b9_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/7c/d27c9fe292713974d1f2785f0cc07ccc/pa/TF88155_dd158bba06219933d4ed3fc8745a3620.jpg saved to cache
2026-04-27 08:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1a91d03e-f44c-5435-a946-4ba7927d55b9
2026-04-27 08:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/71/6171212dfcf6e4d7ef9db25f05747a5f/pa/LS55307_5c984ae949a62e560f9f278cd43faedd.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14381c8710>
2026-04-27 08:03:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a91d03e-f44c-5435-a946-4ba7927d55b9/1a91d03e-f44c-5435-a946-4ba7927d55b9_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/7c/d27c9fe292713974d1f2785f0cc07ccc/pa/TF88155_452c21a1791905c4b50fbb90906f9757.jpg saved to cache
2026-04-27 08:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1a91d03e-f44c-5435-a946-4ba7927d55b9
2026-04-27 08:03:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143817fe10>
2026-04-27 08:03:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a91d03e-f44c-5435-a946-4ba7927d55b9/1a91d03e-f44c-5435-a946-4ba7927d55b9_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/7c/d27c9fe292713974d1f2785f0cc07ccc/pa/TF88155_98ff324ce15b26827d26e43ec9227f00.jpg saved to cache
2026-04-27 08:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1a91d03e-f44c-5435-a946-4ba7927d55b9
2026-04-27 08:03:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1a91d03e-f44c-5435-a946-4ba7927d55b9, skipping ID generation
2026-04-27 08:03:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a91d03e-f44c-5435-a946-4ba7927d55b9 with scrape type 1
2026-04-27 08:03:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1a91d03e-f44c-5435-a946-4ba7927d55b9 sending to next pipeline
2026-04-27 08:03:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 1a91d03e-f44c-5435-a946-4ba7927d55b9, identifier: TF88155
2026-04-27 08:03:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 1a91d03e-f44c-5435-a946-4ba7927d55b9 with identifier: TF88155
2026-04-27 08:03:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 1a91d03e-f44c-5435-a946-4ba7927d55b9 with identifier: TF88155
2026-04-27 08:03:19 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:03:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 1a91d03e-f44c-5435-a946-4ba7927d55b9 with identifier: TF88155 to the API
2026-04-27 08:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:03:19 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:03:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd2/7c/d27c9fe292713974d1f2785f0cc07ccc/pa/TF88155_98ff324ce15b26827d26e43ec9227f00.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 202,
 'category': None,
 'city': 'Montataire',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 200,
 'expiration_date': '2026-04-28T15:55:03Z',
 'fuel_type': 'petrol',
 'id': '1a91d03e-f44c-5435-a946-4ba7927d55b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 49.259,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TF88155',
 'listing': 'auction',
 'location': 'FR, Montataire',
 'location_confidence': 'geocoded',
 'longitude': 2.4378,
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 96049,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1a91d03e-f44c-5435-a946-4ba7927d55b9/1a91d03e-f44c-5435-a946-4ba7927d55b9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70539,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/7c/d27c9fe292713974d1f2785f0cc07ccc/pa/TF88155_98ff324ce15b26827d26e43ec9227f00.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1a91d03e-f44c-5435-a946-4ba7927d55b9/1a91d03e-f44c-5435-a946-4ba7927d55b9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72624,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/7c/d27c9fe292713974d1f2785f0cc07ccc/pa/TF88155_dbd774d406dc96f93dd0d4eda729c3ee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1a91d03e-f44c-5435-a946-4ba7927d55b9/1a91d03e-f44c-5435-a946-4ba7927d55b9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73658,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/7c/d27c9fe292713974d1f2785f0cc07ccc/pa/TF88155_452c21a1791905c4b50fbb90906f9757.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1a91d03e-f44c-5435-a946-4ba7927d55b9/1a91d03e-f44c-5435-a946-4ba7927d55b9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66307,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/7c/d27c9fe292713974d1f2785f0cc07ccc/pa/TF88155_dd158bba06219933d4ed3fc8745a3620.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1a91d03e-f44c-5435-a946-4ba7927d55b9/1a91d03e-f44c-5435-a946-4ba7927d55b9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63119,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/7c/d27c9fe292713974d1f2785f0cc07ccc/pa/TF88155_c8b2c29f21aa05327a78244bd5c4e540.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1a91d03e-f44c-5435-a946-4ba7927d55b9/1a91d03e-f44c-5435-a946-4ba7927d55b9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61715,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/7c/d27c9fe292713974d1f2785f0cc07ccc/pa/TF88155_446d331023aa627bad2ef1fb28dae981.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1a91d03e-f44c-5435-a946-4ba7927d55b9/1a91d03e-f44c-5435-a946-4ba7927d55b9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56465,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/7c/d27c9fe292713974d1f2785f0cc07ccc/pa/TF88155_f10bd9d0337b881e9881b21969a06e40.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1a91d03e-f44c-5435-a946-4ba7927d55b9/1a91d03e-f44c-5435-a946-4ba7927d55b9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66103,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/7c/d27c9fe292713974d1f2785f0cc07ccc/pa/TF88155_897734442119984357fe2736940b1a1c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1a91d03e-f44c-5435-a946-4ba7927d55b9/1a91d03e-f44c-5435-a946-4ba7927d55b9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63905,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/7c/d27c9fe292713974d1f2785f0cc07ccc/pa/TF88155_c1f76d09a370b16e392d45e7dab8c075.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1a91d03e-f44c-5435-a946-4ba7927d55b9/1a91d03e-f44c-5435-a946-4ba7927d55b9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46633,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/7c/d27c9fe292713974d1f2785f0cc07ccc/pa/TF88155_6cd8bffa71b50df814fb9020f57f9163.jpg',
             'Width': 800}],
 'postal_code': '60160',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Oise',
 'province_code': 'FR-60',
 'region': 'Hauts-de-France',
 'region_code': 'FR-32',
 'registration_date': '2021-08-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Evoque P200 Mild-Hybrid Autobiography',
 'transmission': 'automatic',
 'trim': 'Autobiography',
 'year': 2021}
2026-04-27 08:03:20 [auto1.fr] INFO: Saving data for TF88155: {'created_time': 1777277000.075189, 'last_price_update_time': 1777277000.075202, 'has_photos': True, 'auction_closing_time': 1777391703.0}
2026-04-27 08:03:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/71/6171212dfcf6e4d7ef9db25f05747a5f/pa/LS55307_1230910815f65fa2d196d13ae69e4a29.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143803b8d0>
2026-04-27 08:03:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f185549-71b7-5515-bdf4-508ee5951af1/8f185549-71b7-5515-bdf4-508ee5951af1_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/71/6171212dfcf6e4d7ef9db25f05747a5f/pa/LS55307_5c984ae949a62e560f9f278cd43faedd.jpg saved to cache
2026-04-27 08:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8f185549-71b7-5515-bdf4-508ee5951af1
2026-04-27 08:03:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14381dd550>
2026-04-27 08:03:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f185549-71b7-5515-bdf4-508ee5951af1/8f185549-71b7-5515-bdf4-508ee5951af1_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/71/6171212dfcf6e4d7ef9db25f05747a5f/pa/LS55307_1230910815f65fa2d196d13ae69e4a29.jpg saved to cache
2026-04-27 08:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8f185549-71b7-5515-bdf4-508ee5951af1
2026-04-27 08:03:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/71/6171212dfcf6e4d7ef9db25f05747a5f/pa/LS55307_45f9e563593827ab67d4df207dd9c49a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/71/6171212dfcf6e4d7ef9db25f05747a5f/pa/LS55307_dc353f318b24adbc680013e8d9d2737b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/71/6171212dfcf6e4d7ef9db25f05747a5f/pa/LS55307_b087f6931be2430f783d8f40f1f5228f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438fac950>
2026-04-27 08:03:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f185549-71b7-5515-bdf4-508ee5951af1/8f185549-71b7-5515-bdf4-508ee5951af1_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/71/6171212dfcf6e4d7ef9db25f05747a5f/pa/LS55307_45f9e563593827ab67d4df207dd9c49a.jpg saved to cache
2026-04-27 08:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8f185549-71b7-5515-bdf4-508ee5951af1
2026-04-27 08:03:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438126850>
2026-04-27 08:03:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f185549-71b7-5515-bdf4-508ee5951af1/8f185549-71b7-5515-bdf4-508ee5951af1_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/71/6171212dfcf6e4d7ef9db25f05747a5f/pa/LS55307_dc353f318b24adbc680013e8d9d2737b.jpg saved to cache
2026-04-27 08:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8f185549-71b7-5515-bdf4-508ee5951af1
2026-04-27 08:03:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14381df150>
2026-04-27 08:03:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f185549-71b7-5515-bdf4-508ee5951af1/8f185549-71b7-5515-bdf4-508ee5951af1_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/71/6171212dfcf6e4d7ef9db25f05747a5f/pa/LS55307_b087f6931be2430f783d8f40f1f5228f.jpg saved to cache
2026-04-27 08:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8f185549-71b7-5515-bdf4-508ee5951af1
2026-04-27 08:03:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8f185549-71b7-5515-bdf4-508ee5951af1, skipping ID generation
2026-04-27 08:03:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f185549-71b7-5515-bdf4-508ee5951af1 with scrape type 1
2026-04-27 08:03:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8f185549-71b7-5515-bdf4-508ee5951af1 sending to next pipeline
2026-04-27 08:03:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8f185549-71b7-5515-bdf4-508ee5951af1, identifier: LS55307
2026-04-27 08:03:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8f185549-71b7-5515-bdf4-508ee5951af1 with identifier: LS55307
2026-04-27 08:03:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8f185549-71b7-5515-bdf4-508ee5951af1 with identifier: LS55307
2026-04-27 08:03:20 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:03:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 8f185549-71b7-5515-bdf4-508ee5951af1 with identifier: LS55307 to the API
2026-04-27 08:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:03:20 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:03:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img61/71/6171212dfcf6e4d7ef9db25f05747a5f/pa/LS55307_b087f6931be2430f783d8f40f1f5228f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 148,
 'category': None,
 'city': 'Marseille',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 3',
 'engine': '1.4L',
 'engine_horse_power': 73,
 'expiration_date': '2026-04-28T15:14:09Z',
 'fuel_type': 'petrol',
 'id': '8f185549-71b7-5515-bdf4-508ee5951af1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 43.2969,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LS55307',
 'listing': 'auction',
 'location': 'FR, Marseille',
 'location_confidence': 'geocoded',
 'longitude': 5.3811,
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 147638,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8f185549-71b7-5515-bdf4-508ee5951af1/8f185549-71b7-5515-bdf4-508ee5951af1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117341,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/71/6171212dfcf6e4d7ef9db25f05747a5f/pa/LS55307_b087f6931be2430f783d8f40f1f5228f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8f185549-71b7-5515-bdf4-508ee5951af1/8f185549-71b7-5515-bdf4-508ee5951af1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107517,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/71/6171212dfcf6e4d7ef9db25f05747a5f/pa/LS55307_dc353f318b24adbc680013e8d9d2737b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8f185549-71b7-5515-bdf4-508ee5951af1/8f185549-71b7-5515-bdf4-508ee5951af1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87479,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/71/6171212dfcf6e4d7ef9db25f05747a5f/pa/LS55307_45f9e563593827ab67d4df207dd9c49a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8f185549-71b7-5515-bdf4-508ee5951af1/8f185549-71b7-5515-bdf4-508ee5951af1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79982,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/71/6171212dfcf6e4d7ef9db25f05747a5f/pa/LS55307_1230910815f65fa2d196d13ae69e4a29.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8f185549-71b7-5515-bdf4-508ee5951af1/8f185549-71b7-5515-bdf4-508ee5951af1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112510,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/71/6171212dfcf6e4d7ef9db25f05747a5f/pa/LS55307_5c984ae949a62e560f9f278cd43faedd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8f185549-71b7-5515-bdf4-508ee5951af1/8f185549-71b7-5515-bdf4-508ee5951af1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38458,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/71/6171212dfcf6e4d7ef9db25f05747a5f/pa/LS55307_40733c1f003c675698540574865554ec.jpg',
             'Width': 800}],
 'postal_code': '13000',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Bouches-du-Rhône',
 'province_code': 'FR-13',
 'region': "Provence-Alpes-Côte d'Azur",
 'region_code': 'FR-93',
 'registration_date': '2003-07-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 1.4 Exclusive',
 'transmission': 'manual',
 'trim': 'Exclusive',
 'year': 2003}
2026-04-27 08:03:20 [auto1.fr] INFO: Saving data for LS55307: {'created_time': 1777277000.912924, 'last_price_update_time': 1777277000.912934, 'has_photos': True, 'auction_closing_time': 1777389249.0}
2026-04-27 08:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KZ52464/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SR11177/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CM53599/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RY45034/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:36 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.703(s), this was the 1st time calling it.
2026-04-27 08:03:36 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.083681617062178 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BD67804/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:03:42 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.519(s), this was the 1st time calling it.
2026-04-27 08:03:42 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.863615617551695 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EJ49197> (referer: https://www.auto1.com/v1/car-details-view/EJ49197/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c4cb04e-fa69-5de2-b7e9-31be35d7f9d0 with identifier: EJ49197
2026-04-27 08:03:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c4cb04e-fa69-5de2-b7e9-31be35d7f9d0 with scrape type 1
2026-04-27 08:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8c4cb04e-fa69-5de2-b7e9-31be35d7f9d0
2026-04-27 08:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/b6/3cb62a1e87add096b6810356c64d69be/pa/EJ49197_a0a803c9d747dde12f680d05371366df.jpg not downloaded yet
2026-04-27 08:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/b6/3cb62a1e87add096b6810356c64d69be/pa/EJ49197_ddc18633bbdcb569ad268a8e32c06ec7.jpg not downloaded yet
2026-04-27 08:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/b6/3cb62a1e87add096b6810356c64d69be/pa/EJ49197_aab0b7c0ff4569bb6b04b1418f1b617c.jpg not downloaded yet
2026-04-27 08:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/b6/3cb62a1e87add096b6810356c64d69be/pa/EJ49197_7ce19db607ae8cffd5917da52f2194fc.jpg not downloaded yet
2026-04-27 08:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/b6/3cb62a1e87add096b6810356c64d69be/pa/EJ49197_99f9f95f2a12d0961868cc01ae58607e.jpg not downloaded yet
2026-04-27 08:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/b6/3cb62a1e87add096b6810356c64d69be/pa/EJ49197_be6d9eb754b1073420a876ba621e32d4.jpg not downloaded yet
2026-04-27 08:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/b6/3cb62a1e87add096b6810356c64d69be/pa/EJ49197_4466f450c6ae48271df0b9fab7a9c63e.jpg not downloaded yet
2026-04-27 08:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/b6/3cb62a1e87add096b6810356c64d69be/pa/EJ49197_d3c523ac5359118eafde6c4a8f62d5ac.jpg not downloaded yet
2026-04-27 08:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/b6/3cb62a1e87add096b6810356c64d69be/pa/EJ49197_72fe04dab09493e39da443332a3e6002.jpg not downloaded yet
2026-04-27 08:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/b6/3cb62a1e87add096b6810356c64d69be/pa/EJ49197_bd10471e6a1c97d89d450460ac7daa4f.jpg not downloaded yet
2026-04-27 08:03:44 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.099(s), this was the 1st time calling it.
2026-04-27 08:03:44 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.0588454132944545 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WG00689/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/b6/3cb62a1e87add096b6810356c64d69be/pa/EJ49197_bd10471e6a1c97d89d450460ac7daa4f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 08:03:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bfa75d0>
2026-04-27 08:03:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c4cb04e-fa69-5de2-b7e9-31be35d7f9d0/8c4cb04e-fa69-5de2-b7e9-31be35d7f9d0_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/b6/3cb62a1e87add096b6810356c64d69be/pa/EJ49197_bd10471e6a1c97d89d450460ac7daa4f.jpg saved to cache
2026-04-27 08:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8c4cb04e-fa69-5de2-b7e9-31be35d7f9d0
2026-04-27 08:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PF14495/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/b6/3cb62a1e87add096b6810356c64d69be/pa/EJ49197_72fe04dab09493e39da443332a3e6002.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bf1b7d0>
2026-04-27 08:03:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c4cb04e-fa69-5de2-b7e9-31be35d7f9d0/8c4cb04e-fa69-5de2-b7e9-31be35d7f9d0_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/b6/3cb62a1e87add096b6810356c64d69be/pa/EJ49197_72fe04dab09493e39da443332a3e6002.jpg saved to cache
2026-04-27 08:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8c4cb04e-fa69-5de2-b7e9-31be35d7f9d0
2026-04-27 08:03:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:03:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:03:48 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.345(s), this was the 1st time calling it.
2026-04-27 08:03:48 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.705673180200964 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:03:48 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.346(s), this was the 1st time calling it.
2026-04-27 08:03:48 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.682259508343606 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZP81071/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/b6/3cb62a1e87add096b6810356c64d69be/pa/EJ49197_d3c523ac5359118eafde6c4a8f62d5ac.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d70fd0>
2026-04-27 08:03:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c4cb04e-fa69-5de2-b7e9-31be35d7f9d0/8c4cb04e-fa69-5de2-b7e9-31be35d7f9d0_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/b6/3cb62a1e87add096b6810356c64d69be/pa/EJ49197_d3c523ac5359118eafde6c4a8f62d5ac.jpg saved to cache
2026-04-27 08:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8c4cb04e-fa69-5de2-b7e9-31be35d7f9d0
2026-04-27 08:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AX86714/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/b6/3cb62a1e87add096b6810356c64d69be/pa/EJ49197_4466f450c6ae48271df0b9fab7a9c63e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KD23440> (referer: https://www.auto1.com/v1/car-details-view/KD23440/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438044250>
2026-04-27 08:03:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c4cb04e-fa69-5de2-b7e9-31be35d7f9d0/8c4cb04e-fa69-5de2-b7e9-31be35d7f9d0_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/b6/3cb62a1e87add096b6810356c64d69be/pa/EJ49197_4466f450c6ae48271df0b9fab7a9c63e.jpg saved to cache
2026-04-27 08:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8c4cb04e-fa69-5de2-b7e9-31be35d7f9d0
2026-04-27 08:03:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ebd9db0d-8f1c-518a-a73b-ca8342047fb6 with identifier: KD23440
2026-04-27 08:03:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ebd9db0d-8f1c-518a-a73b-ca8342047fb6 with scrape type 1
2026-04-27 08:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item ebd9db0d-8f1c-518a-a73b-ca8342047fb6
2026-04-27 08:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/d6/e2d6dc8a08a8f6b5dbe139fb6caaab44/pa/KD23440_784e2171b008336cac20ce288e751681.jpg not downloaded yet
2026-04-27 08:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/d6/e2d6dc8a08a8f6b5dbe139fb6caaab44/pa/KD23440_2fa667aee96190e8960871714867bc33.jpg not downloaded yet
2026-04-27 08:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/d6/e2d6dc8a08a8f6b5dbe139fb6caaab44/pa/KD23440_d8b583105b8ae460af1f9dc5b10faf20.jpg not downloaded yet
2026-04-27 08:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/b6/3cb62a1e87add096b6810356c64d69be/pa/EJ49197_be6d9eb754b1073420a876ba621e32d4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/d6/e2d6dc8a08a8f6b5dbe139fb6caaab44/pa/KD23440_7ab4dab72bdcd9c69c3d6e0bc7215c4a.jpg not downloaded yet
2026-04-27 08:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/d6/e2d6dc8a08a8f6b5dbe139fb6caaab44/pa/KD23440_d3bfc888768b14b7435a3cad89460b0e.jpg not downloaded yet
2026-04-27 08:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/d6/e2d6dc8a08a8f6b5dbe139fb6caaab44/pa/KD23440_226fefc57aab75b00b4776927cd6b1e8.jpg not downloaded yet
2026-04-27 08:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/d6/e2d6dc8a08a8f6b5dbe139fb6caaab44/pa/KD23440_d8b583105b8ae460af1f9dc5b10faf20.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d5ad90>
2026-04-27 08:03:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c4cb04e-fa69-5de2-b7e9-31be35d7f9d0/8c4cb04e-fa69-5de2-b7e9-31be35d7f9d0_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/b6/3cb62a1e87add096b6810356c64d69be/pa/EJ49197_be6d9eb754b1073420a876ba621e32d4.jpg saved to cache
2026-04-27 08:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8c4cb04e-fa69-5de2-b7e9-31be35d7f9d0
2026-04-27 08:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/d6/e2d6dc8a08a8f6b5dbe139fb6caaab44/pa/KD23440_226fefc57aab75b00b4776927cd6b1e8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bffd990>
2026-04-27 08:03:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebd9db0d-8f1c-518a-a73b-ca8342047fb6/ebd9db0d-8f1c-518a-a73b-ca8342047fb6_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/d6/e2d6dc8a08a8f6b5dbe139fb6caaab44/pa/KD23440_d8b583105b8ae460af1f9dc5b10faf20.jpg saved to cache
2026-04-27 08:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ebd9db0d-8f1c-518a-a73b-ca8342047fb6
2026-04-27 08:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TF52830/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438be8810>
2026-04-27 08:03:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebd9db0d-8f1c-518a-a73b-ca8342047fb6/ebd9db0d-8f1c-518a-a73b-ca8342047fb6_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/d6/e2d6dc8a08a8f6b5dbe139fb6caaab44/pa/KD23440_226fefc57aab75b00b4776927cd6b1e8.jpg saved to cache
2026-04-27 08:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ebd9db0d-8f1c-518a-a73b-ca8342047fb6
2026-04-27 08:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/d6/e2d6dc8a08a8f6b5dbe139fb6caaab44/pa/KD23440_d3bfc888768b14b7435a3cad89460b0e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438079850>
2026-04-27 08:03:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebd9db0d-8f1c-518a-a73b-ca8342047fb6/ebd9db0d-8f1c-518a-a73b-ca8342047fb6_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/d6/e2d6dc8a08a8f6b5dbe139fb6caaab44/pa/KD23440_d3bfc888768b14b7435a3cad89460b0e.jpg saved to cache
2026-04-27 08:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ebd9db0d-8f1c-518a-a73b-ca8342047fb6
2026-04-27 08:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KZ52464> (referer: https://www.auto1.com/v1/car-details-view/KZ52464/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/d6/e2d6dc8a08a8f6b5dbe139fb6caaab44/pa/KD23440_2fa667aee96190e8960871714867bc33.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/d6/e2d6dc8a08a8f6b5dbe139fb6caaab44/pa/KD23440_784e2171b008336cac20ce288e751681.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f91721f0-48b9-5dfb-9a19-70f67d1c033f with identifier: KZ52464
2026-04-27 08:03:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f91721f0-48b9-5dfb-9a19-70f67d1c033f with scrape type 1
2026-04-27 08:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f91721f0-48b9-5dfb-9a19-70f67d1c033f
2026-04-27 08:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/54/2854ef87ea875d9327a5bdd1519cbbba/pa/KZ52464_b2977edf681343f0615f73bda770c337.jpg not downloaded yet
2026-04-27 08:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/54/2854ef87ea875d9327a5bdd1519cbbba/pa/KZ52464_fdf666519ece9c4b99b05d1d71bdfc83.jpg not downloaded yet
2026-04-27 08:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/54/2854ef87ea875d9327a5bdd1519cbbba/pa/KZ52464_a580050dc521eae9758ac97f8c407897.jpg not downloaded yet
2026-04-27 08:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/54/2854ef87ea875d9327a5bdd1519cbbba/pa/KZ52464_53973d11c385238369f26b589ce994db.jpg not downloaded yet
2026-04-27 08:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/54/2854ef87ea875d9327a5bdd1519cbbba/pa/KZ52464_2ab6db7eb3d1ac969369652da18e1742.jpg not downloaded yet
2026-04-27 08:03:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143817df50>
2026-04-27 08:03:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebd9db0d-8f1c-518a-a73b-ca8342047fb6/ebd9db0d-8f1c-518a-a73b-ca8342047fb6_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/d6/e2d6dc8a08a8f6b5dbe139fb6caaab44/pa/KD23440_2fa667aee96190e8960871714867bc33.jpg saved to cache
2026-04-27 08:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ebd9db0d-8f1c-518a-a73b-ca8342047fb6
2026-04-27 08:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/54/2854ef87ea875d9327a5bdd1519cbbba/pa/KZ52464_95b2e79c506bee3fdbd1f0b1233e106e.jpg not downloaded yet
2026-04-27 08:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/54/2854ef87ea875d9327a5bdd1519cbbba/pa/KZ52464_29f469cba05f13edb585a162dbd8e6bf.jpg not downloaded yet
2026-04-27 08:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SR11177> (referer: https://www.auto1.com/v1/car-details-view/SR11177/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/b6/3cb62a1e87add096b6810356c64d69be/pa/EJ49197_99f9f95f2a12d0961868cc01ae58607e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/54/2854ef87ea875d9327a5bdd1519cbbba/pa/KZ52464_358c022fe820198c63103663ce661a74.jpg not downloaded yet
2026-04-27 08:03:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c281d0>
2026-04-27 08:03:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebd9db0d-8f1c-518a-a73b-ca8342047fb6/ebd9db0d-8f1c-518a-a73b-ca8342047fb6_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/d6/e2d6dc8a08a8f6b5dbe139fb6caaab44/pa/KD23440_784e2171b008336cac20ce288e751681.jpg saved to cache
2026-04-27 08:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ebd9db0d-8f1c-518a-a73b-ca8342047fb6
2026-04-27 08:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/54/2854ef87ea875d9327a5bdd1519cbbba/pa/KZ52464_e7ede34fbaa7cb9c1973517ef29e56a8.jpg not downloaded yet
2026-04-27 08:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/54/2854ef87ea875d9327a5bdd1519cbbba/pa/KZ52464_837e9528c7c4e9b2c931303dbdd87f13.jpg not downloaded yet
2026-04-27 08:03:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c27dea38-70fc-5099-9cb2-ea154748f7ca with identifier: SR11177
2026-04-27 08:03:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c27dea38-70fc-5099-9cb2-ea154748f7ca with scrape type 1
2026-04-27 08:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c27dea38-70fc-5099-9cb2-ea154748f7ca
2026-04-27 08:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/e7/7fe78e860376592961bea2c7a563b62b/pa/SR11177_2e87a39065419939dca9b237a79e34cd.jpg not downloaded yet
2026-04-27 08:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/e7/7fe78e860376592961bea2c7a563b62b/pa/SR11177_56360fbcbcab2a82621a2d403e55266e.jpg not downloaded yet
2026-04-27 08:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/e7/7fe78e860376592961bea2c7a563b62b/pa/SR11177_9c0d0c6580c8d5bfe4168bdd2b3cbbd3.jpg not downloaded yet
2026-04-27 08:03:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d46810>
2026-04-27 08:03:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c4cb04e-fa69-5de2-b7e9-31be35d7f9d0/8c4cb04e-fa69-5de2-b7e9-31be35d7f9d0_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/b6/3cb62a1e87add096b6810356c64d69be/pa/EJ49197_99f9f95f2a12d0961868cc01ae58607e.jpg saved to cache
2026-04-27 08:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8c4cb04e-fa69-5de2-b7e9-31be35d7f9d0
2026-04-27 08:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/e7/7fe78e860376592961bea2c7a563b62b/pa/SR11177_63da92301785cbf64db876b179ed7263.jpg not downloaded yet
2026-04-27 08:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/e7/7fe78e860376592961bea2c7a563b62b/pa/SR11177_13235b774bd7416b91be51e52e7bc0c9.jpg not downloaded yet
2026-04-27 08:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/e7/7fe78e860376592961bea2c7a563b62b/pa/SR11177_7bd9e73eb10e7ccc762a63864b548b26.jpg not downloaded yet
2026-04-27 08:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HD20644/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/e7/7fe78e860376592961bea2c7a563b62b/pa/SR11177_4574518f0d23bf70fdc3e87fdb93e303.jpg not downloaded yet
2026-04-27 08:03:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/54/2854ef87ea875d9327a5bdd1519cbbba/pa/KZ52464_29f469cba05f13edb585a162dbd8e6bf.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/e7/7fe78e860376592961bea2c7a563b62b/pa/SR11177_d08c9825091ce6d6708cd130961360f2.jpg not downloaded yet
2026-04-27 08:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/e7/7fe78e860376592961bea2c7a563b62b/pa/SR11177_39deade5f3003c0f258c76847deb5e8d.jpg not downloaded yet
2026-04-27 08:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/e7/7fe78e860376592961bea2c7a563b62b/pa/SR11177_5090690fe7f252561c7142a32b87500c.jpg not downloaded yet
2026-04-27 08:03:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ebd9db0d-8f1c-518a-a73b-ca8342047fb6 with identifier: KD23440
2026-04-27 08:03:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ebd9db0d-8f1c-518a-a73b-ca8342047fb6 with identifier: KD23440
2026-04-27 08:03:51 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:03:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ebd9db0d-8f1c-518a-a73b-ca8342047fb6 with identifier: KD23440 to the API
2026-04-27 08:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:03:51 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:03:51 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': 82,
 'category': None,
 'city': 'Marseille',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 90,
 'expiration_date': '2026-04-28T15:10:06Z',
 'fuel_type': 'diesel',
 'id': 'ebd9db0d-8f1c-518a-a73b-ca8342047fb6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 43.2969,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KD23440',
 'listing': 'auction',
 'location': 'FR, Marseille',
 'location_confidence': 'geocoded',
 'longitude': 5.3811,
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 276156,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/imge2/d6/e2d6dc8a08a8f6b5dbe139fb6caaab44/pa/KD23440_784e2171b008336cac20ce288e751681.jpg',
                'https://img-pa.auto1.com/imge2/d6/e2d6dc8a08a8f6b5dbe139fb6caaab44/pa/KD23440_2fa667aee96190e8960871714867bc33.jpg',
                'https://img-pa.auto1.com/imge2/d6/e2d6dc8a08a8f6b5dbe139fb6caaab44/pa/KD23440_d8b583105b8ae460af1f9dc5b10faf20.jpg',
                'https://img-pa.auto1.com/imge2/d6/e2d6dc8a08a8f6b5dbe139fb6caaab44/pa/KD23440_7ab4dab72bdcd9c69c3d6e0bc7215c4a.jpg',
                'https://img-pa.auto1.com/imge2/d6/e2d6dc8a08a8f6b5dbe139fb6caaab44/pa/KD23440_d3bfc888768b14b7435a3cad89460b0e.jpg',
                'https://img-pa.auto1.com/imge2/d6/e2d6dc8a08a8f6b5dbe139fb6caaab44/pa/KD23440_226fefc57aab75b00b4776927cd6b1e8.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ebd9db0d-8f1c-518a-a73b-ca8342047fb6/ebd9db0d-8f1c-518a-a73b-ca8342047fb6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65548,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/d6/e2d6dc8a08a8f6b5dbe139fb6caaab44/pa/KD23440_784e2171b008336cac20ce288e751681.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ebd9db0d-8f1c-518a-a73b-ca8342047fb6/ebd9db0d-8f1c-518a-a73b-ca8342047fb6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66076,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/d6/e2d6dc8a08a8f6b5dbe139fb6caaab44/pa/KD23440_2fa667aee96190e8960871714867bc33.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ebd9db0d-8f1c-518a-a73b-ca8342047fb6/ebd9db0d-8f1c-518a-a73b-ca8342047fb6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70552,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/d6/e2d6dc8a08a8f6b5dbe139fb6caaab44/pa/KD23440_d8b583105b8ae460af1f9dc5b10faf20.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ebd9db0d-8f1c-518a-a73b-ca8342047fb6/ebd9db0d-8f1c-518a-a73b-ca8342047fb6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118337,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/d6/e2d6dc8a08a8f6b5dbe139fb6caaab44/pa/KD23440_d3bfc888768b14b7435a3cad89460b0e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ebd9db0d-8f1c-518a-a73b-ca8342047fb6/ebd9db0d-8f1c-518a-a73b-ca8342047fb6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45786,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/d6/e2d6dc8a08a8f6b5dbe139fb6caaab44/pa/KD23440_226fefc57aab75b00b4776927cd6b1e8.jpg',
             'Width': 800}],
 'postal_code': '13000',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Bouches-du-Rhône',
 'province_code': 'FR-13',
 'region': "Provence-Alpes-Côte d'Azur",
 'region_code': 'FR-93',
 'registration_date': '2016-04-27',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Renault Clio 1.5 dCi Energy Air',
 'transmission': 'manual',
 'trim': 'Air',
 'year': 2016}
2026-04-27 08:03:51 [auto1.fr] INFO: Saving data for KD23440: {'created_time': 1777277031.926202, 'last_price_update_time': 1777277031.926211, 'has_photos': True, 'auction_closing_time': 1777389006.0}
2026-04-27 08:03:51 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item ebd9db0d-8f1c-518a-a73b-ca8342047fb6 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/e7/7fe78e860376592961bea2c7a563b62b/pa/SR11177_4574518f0d23bf70fdc3e87fdb93e303.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CM53599> (referer: https://www.auto1.com/v1/car-details-view/CM53599/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ff10d0>
2026-04-27 08:03:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f91721f0-48b9-5dfb-9a19-70f67d1c033f/f91721f0-48b9-5dfb-9a19-70f67d1c033f_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/54/2854ef87ea875d9327a5bdd1519cbbba/pa/KZ52464_29f469cba05f13edb585a162dbd8e6bf.jpg saved to cache
2026-04-27 08:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f91721f0-48b9-5dfb-9a19-70f67d1c033f
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c29410>
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c27dea38-70fc-5099-9cb2-ea154748f7ca/c27dea38-70fc-5099-9cb2-ea154748f7ca_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/e7/7fe78e860376592961bea2c7a563b62b/pa/SR11177_4574518f0d23bf70fdc3e87fdb93e303.jpg saved to cache
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c27dea38-70fc-5099-9cb2-ea154748f7ca
2026-04-27 08:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BD67804> (referer: https://www.auto1.com/v1/car-details-view/BD67804/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RY45034> (referer: https://www.auto1.com/v1/car-details-view/RY45034/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d807a8c-03ba-518f-8335-7f94119e6c2b with identifier: CM53599
2026-04-27 08:03:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d807a8c-03ba-518f-8335-7f94119e6c2b with scrape type 1
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6d807a8c-03ba-518f-8335-7f94119e6c2b
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/02/5a0270c7e6143d6adfaea3279abe8998/pa/CM53599_3571cb60b839f6913bd130d8ee2825e1.jpg not downloaded yet
2026-04-27 08:03:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/02/5a0270c7e6143d6adfaea3279abe8998/pa/CM53599_2fc318ebdf795ea928bcd4b72606d8cb.jpg not downloaded yet
2026-04-27 08:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/e7/7fe78e860376592961bea2c7a563b62b/pa/SR11177_5090690fe7f252561c7142a32b87500c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fcdb2acd-7aec-5e5d-be0d-95159bae43f4 with identifier: BD67804
2026-04-27 08:03:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fcdb2acd-7aec-5e5d-be0d-95159bae43f4 with scrape type 1
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fcdb2acd-7aec-5e5d-be0d-95159bae43f4
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/f5/09f5d6a9682eb4834665a2f2f648ee37/pa/BD67804_9efde88047cc95cb36ae7e02fc76d1a7.jpg not downloaded yet
2026-04-27 08:03:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1083664b-56bc-56a3-b7ef-e7c78df0a6eb with identifier: RY45034
2026-04-27 08:03:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1083664b-56bc-56a3-b7ef-e7c78df0a6eb with scrape type 1
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1083664b-56bc-56a3-b7ef-e7c78df0a6eb
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/aa/53aa5c1b62a399817eab232ec2d78861/pa/RY45034_7e6c14318baba812a8e3b116b9128b14.jpg not downloaded yet
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/02/5a0270c7e6143d6adfaea3279abe8998/pa/CM53599_81f7ae4c42ae7e2ac594368748ea96c7.jpg not downloaded yet
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/f5/09f5d6a9682eb4834665a2f2f648ee37/pa/BD67804_2511be3bbbbef85e14591741fa6d13d8.jpg not downloaded yet
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/aa/53aa5c1b62a399817eab232ec2d78861/pa/RY45034_14cce715185efa6a9a86cc4e4d28e0b9.jpg not downloaded yet
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/02/5a0270c7e6143d6adfaea3279abe8998/pa/CM53599_efa3ec4003f66ac60623e283b39fceea.jpg not downloaded yet
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item f91721f0-48b9-5dfb-9a19-70f67d1c033f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/f5/09f5d6a9682eb4834665a2f2f648ee37/pa/BD67804_412b182b9a420a63fa76fad3e9f8c859.jpg not downloaded yet
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/aa/53aa5c1b62a399817eab232ec2d78861/pa/RY45034_86e25bc53e2a84285d0f744a2382faef.jpg not downloaded yet
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/02/5a0270c7e6143d6adfaea3279abe8998/pa/CM53599_836868b2782c47bf2dd5a6dae1ebc562.jpg not downloaded yet
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/f5/09f5d6a9682eb4834665a2f2f648ee37/pa/BD67804_474b54d97534a76ca455c0ea16f1e8bb.jpg not downloaded yet
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/aa/53aa5c1b62a399817eab232ec2d78861/pa/RY45034_659dfd6b6075ac081f701cdccd20e014.jpg not downloaded yet
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14478cf2d0>
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c27dea38-70fc-5099-9cb2-ea154748f7ca/c27dea38-70fc-5099-9cb2-ea154748f7ca_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/e7/7fe78e860376592961bea2c7a563b62b/pa/SR11177_5090690fe7f252561c7142a32b87500c.jpg saved to cache
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c27dea38-70fc-5099-9cb2-ea154748f7ca
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/02/5a0270c7e6143d6adfaea3279abe8998/pa/CM53599_bbe3eed944b0a23ea0c442836374549f.jpg not downloaded yet
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/f5/09f5d6a9682eb4834665a2f2f648ee37/pa/BD67804_29254f88669bfa9c3c96e82730da6d5c.jpg not downloaded yet
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/aa/53aa5c1b62a399817eab232ec2d78861/pa/RY45034_3842c22af9489db8179e341bcf685b62.jpg not downloaded yet
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/02/5a0270c7e6143d6adfaea3279abe8998/pa/CM53599_da755c0f47793c1c5fde959bcb541916.jpg not downloaded yet
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item c27dea38-70fc-5099-9cb2-ea154748f7ca due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item c27dea38-70fc-5099-9cb2-ea154748f7ca due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/f5/09f5d6a9682eb4834665a2f2f648ee37/pa/BD67804_6c056745ca3c086d5ceb4edb8dc6be53.jpg not downloaded yet
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/aa/53aa5c1b62a399817eab232ec2d78861/pa/RY45034_a14f8c015ef6212c977db84321fcea5e.jpg not downloaded yet
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/02/5a0270c7e6143d6adfaea3279abe8998/pa/CM53599_5e5b81419417270b9a0b1a28fa991b10.jpg not downloaded yet
2026-04-27 08:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/e7/7fe78e860376592961bea2c7a563b62b/pa/SR11177_63da92301785cbf64db876b179ed7263.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/f5/09f5d6a9682eb4834665a2f2f648ee37/pa/BD67804_9923096a67e7ead5644a5dfca5e13a8a.jpg not downloaded yet
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/aa/53aa5c1b62a399817eab232ec2d78861/pa/RY45034_719ec3a400a4ba303e519e7e55b53786.jpg not downloaded yet
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/02/5a0270c7e6143d6adfaea3279abe8998/pa/CM53599_992bd6a36b5bdcb583c717fb91865350.jpg not downloaded yet
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/f5/09f5d6a9682eb4834665a2f2f648ee37/pa/BD67804_d0851b749a9d80bf021636bd694915e9.jpg not downloaded yet
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/aa/53aa5c1b62a399817eab232ec2d78861/pa/RY45034_a725e6ab5e692c51303baae3d43895d0.jpg not downloaded yet
2026-04-27 08:03:52 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.223(s), this was the 1st time calling it.
2026-04-27 08:03:52 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.608601366978178 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/02/5a0270c7e6143d6adfaea3279abe8998/pa/CM53599_b8d72e2d45f5a6e1c9a02e1a27b02fb2.jpg not downloaded yet
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/f5/09f5d6a9682eb4834665a2f2f648ee37/pa/BD67804_bd76996b2198f5fa85d3067ec7251be3.jpg not downloaded yet
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/aa/53aa5c1b62a399817eab232ec2d78861/pa/RY45034_42212f2ddbf6eb90c406a6cc1d53098a.jpg not downloaded yet
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/f5/09f5d6a9682eb4834665a2f2f648ee37/pa/BD67804_ad8e6a79c98245d51e96a672a264f92e.jpg not downloaded yet
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/aa/53aa5c1b62a399817eab232ec2d78861/pa/RY45034_ed6d2b2cfe0e3c6348225551e0bcfa42.jpg not downloaded yet
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c6bc50>
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c27dea38-70fc-5099-9cb2-ea154748f7ca/c27dea38-70fc-5099-9cb2-ea154748f7ca_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/e7/7fe78e860376592961bea2c7a563b62b/pa/SR11177_63da92301785cbf64db876b179ed7263.jpg saved to cache
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c27dea38-70fc-5099-9cb2-ea154748f7ca
2026-04-27 08:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WG00689> (referer: https://www.auto1.com/v1/car-details-view/WG00689/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/02/5a0270c7e6143d6adfaea3279abe8998/pa/CM53599_5e5b81419417270b9a0b1a28fa991b10.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e93311a4-fbed-51d4-bd71-770b7dccfae5 with identifier: WG00689
2026-04-27 08:03:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e93311a4-fbed-51d4-bd71-770b7dccfae5 with scrape type 1
2026-04-27 08:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e93311a4-fbed-51d4-bd71-770b7dccfae5
2026-04-27 08:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/28/c3282362494f6991ff18c001b07ddd52/pa/WG00689_3000fc747a91dab256e2d80bf7ff4820.jpg not downloaded yet
2026-04-27 08:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/28/c3282362494f6991ff18c001b07ddd52/pa/WG00689_c436c680e2231b988ef154ebf3b32d51.jpg not downloaded yet
2026-04-27 08:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/28/c3282362494f6991ff18c001b07ddd52/pa/WG00689_a85f8653f49efe687078463c8a797b9d.jpg not downloaded yet
2026-04-27 08:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b2ba10>
2026-04-27 08:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d807a8c-03ba-518f-8335-7f94119e6c2b/6d807a8c-03ba-518f-8335-7f94119e6c2b_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/02/5a0270c7e6143d6adfaea3279abe8998/pa/CM53599_5e5b81419417270b9a0b1a28fa991b10.jpg saved to cache
2026-04-27 08:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6d807a8c-03ba-518f-8335-7f94119e6c2b
2026-04-27 08:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/28/c3282362494f6991ff18c001b07ddd52/pa/WG00689_ec477fedb1ababa9ddbfde0039dd7aca.jpg not downloaded yet
2026-04-27 08:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/f5/09f5d6a9682eb4834665a2f2f648ee37/pa/BD67804_ad8e6a79c98245d51e96a672a264f92e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PF14495> (referer: https://www.auto1.com/v1/car-details-view/PF14495/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/28/c3282362494f6991ff18c001b07ddd52/pa/WG00689_82c5c03bc32ed4c98e0a1c88009d0cfe.jpg not downloaded yet
2026-04-27 08:03:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/28/c3282362494f6991ff18c001b07ddd52/pa/WG00689_a68259eb8ec87ca9abacc44117c4f6cb.jpg not downloaded yet
2026-04-27 08:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/28/c3282362494f6991ff18c001b07ddd52/pa/WG00689_aeffb4d0566adcf85fad48fa7977c607.jpg not downloaded yet
2026-04-27 08:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/28/c3282362494f6991ff18c001b07ddd52/pa/WG00689_00c9b86220dc61b68d0608ece49db8c3.jpg not downloaded yet
2026-04-27 08:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/28/c3282362494f6991ff18c001b07ddd52/pa/WG00689_4a65314ac178919eea71c1f23f029549.jpg not downloaded yet
2026-04-27 08:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/28/c3282362494f6991ff18c001b07ddd52/pa/WG00689_952567e6e8bfca4c4e7350e29760c2d5.jpg not downloaded yet
2026-04-27 08:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a76cd0>
2026-04-27 08:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcdb2acd-7aec-5e5d-be0d-95159bae43f4/fcdb2acd-7aec-5e5d-be0d-95159bae43f4_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/f5/09f5d6a9682eb4834665a2f2f648ee37/pa/BD67804_ad8e6a79c98245d51e96a672a264f92e.jpg saved to cache
2026-04-27 08:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fcdb2acd-7aec-5e5d-be0d-95159bae43f4
2026-04-27 08:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/28/c3282362494f6991ff18c001b07ddd52/pa/WG00689_a85f8653f49efe687078463c8a797b9d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49ed4522-e3b6-531b-8b55-7108a6430ac3 with identifier: PF14495
2026-04-27 08:03:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49ed4522-e3b6-531b-8b55-7108a6430ac3 with scrape type 1
2026-04-27 08:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 49ed4522-e3b6-531b-8b55-7108a6430ac3
2026-04-27 08:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/5e/2a5e2585ea3beb677a557de6b79de717/pa/PF14495_59075cf24e546a83b129b03c31b9533d.jpg not downloaded yet
2026-04-27 08:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/5e/2a5e2585ea3beb677a557de6b79de717/pa/PF14495_fbb7fdeda8cb0fba97e88517ad975618.jpg not downloaded yet
2026-04-27 08:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/5e/2a5e2585ea3beb677a557de6b79de717/pa/PF14495_ec561e8133c7d14b00a5fc4efc95a00f.jpg not downloaded yet
2026-04-27 08:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/5e/2a5e2585ea3beb677a557de6b79de717/pa/PF14495_e0097d4bf73d8b8774a8fdf2a8f45ac7.jpg not downloaded yet
2026-04-27 08:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/5e/2a5e2585ea3beb677a557de6b79de717/pa/PF14495_3b9b04e2c7320c7a68fefa50186319dd.jpg not downloaded yet
2026-04-27 08:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/5e/2a5e2585ea3beb677a557de6b79de717/pa/PF14495_2b3a30873e727a36714559b6ba285791.jpg not downloaded yet
2026-04-27 08:03:53 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item c27dea38-70fc-5099-9cb2-ea154748f7ca due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:03:53 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item c27dea38-70fc-5099-9cb2-ea154748f7ca due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/5e/2a5e2585ea3beb677a557de6b79de717/pa/PF14495_59a05557041408e7ab659092a1e966fe.jpg not downloaded yet
2026-04-27 08:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/5e/2a5e2585ea3beb677a557de6b79de717/pa/PF14495_c25593636262a57082315485b99e12c0.jpg not downloaded yet
2026-04-27 08:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438087850>
2026-04-27 08:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e93311a4-fbed-51d4-bd71-770b7dccfae5/e93311a4-fbed-51d4-bd71-770b7dccfae5_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/28/c3282362494f6991ff18c001b07ddd52/pa/WG00689_a85f8653f49efe687078463c8a797b9d.jpg saved to cache
2026-04-27 08:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e93311a4-fbed-51d4-bd71-770b7dccfae5
2026-04-27 08:03:53 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 6d807a8c-03ba-518f-8335-7f94119e6c2b due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/5e/2a5e2585ea3beb677a557de6b79de717/pa/PF14495_afbe7469eefe67477c61e63b75a09dcf.jpg not downloaded yet
2026-04-27 08:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/5e/2a5e2585ea3beb677a557de6b79de717/pa/PF14495_3dafdebded07fe316c064dbf4bcaee0e.jpg not downloaded yet
2026-04-27 08:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/28/c3282362494f6991ff18c001b07ddd52/pa/WG00689_952567e6e8bfca4c4e7350e29760c2d5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:53 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item 1083664b-56bc-56a3-b7ef-e7c78df0a6eb due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:03:53 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item fcdb2acd-7aec-5e5d-be0d-95159bae43f4 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438bf3290>
2026-04-27 08:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e93311a4-fbed-51d4-bd71-770b7dccfae5/e93311a4-fbed-51d4-bd71-770b7dccfae5_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/28/c3282362494f6991ff18c001b07ddd52/pa/WG00689_952567e6e8bfca4c4e7350e29760c2d5.jpg saved to cache
2026-04-27 08:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e93311a4-fbed-51d4-bd71-770b7dccfae5
2026-04-27 08:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/5e/2a5e2585ea3beb677a557de6b79de717/pa/PF14495_3dafdebded07fe316c064dbf4bcaee0e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bfff710>
2026-04-27 08:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49ed4522-e3b6-531b-8b55-7108a6430ac3/49ed4522-e3b6-531b-8b55-7108a6430ac3_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/5e/2a5e2585ea3beb677a557de6b79de717/pa/PF14495_3dafdebded07fe316c064dbf4bcaee0e.jpg saved to cache
2026-04-27 08:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 49ed4522-e3b6-531b-8b55-7108a6430ac3
2026-04-27 08:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/5e/2a5e2585ea3beb677a557de6b79de717/pa/PF14495_59a05557041408e7ab659092a1e966fe.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d80d50>
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49ed4522-e3b6-531b-8b55-7108a6430ac3/49ed4522-e3b6-531b-8b55-7108a6430ac3_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/5e/2a5e2585ea3beb677a557de6b79de717/pa/PF14495_59a05557041408e7ab659092a1e966fe.jpg saved to cache
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 49ed4522-e3b6-531b-8b55-7108a6430ac3
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 1083664b-56bc-56a3-b7ef-e7c78df0a6eb due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TF52830> (referer: https://www.auto1.com/v1/car-details-view/TF52830/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/5e/2a5e2585ea3beb677a557de6b79de717/pa/PF14495_2b3a30873e727a36714559b6ba285791.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/5e/2a5e2585ea3beb677a557de6b79de717/pa/PF14495_e0097d4bf73d8b8774a8fdf2a8f45ac7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03861d78-3c0d-5a34-af3c-a3483d83e8be with identifier: TF52830
2026-04-27 08:03:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03861d78-3c0d-5a34-af3c-a3483d83e8be with scrape type 1
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 03861d78-3c0d-5a34-af3c-a3483d83e8be
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/75/0e75e3189b6c0501999b896f98a676ae/pa/TF52830_3fa90a5b8c6b65dd9323be3c034ef692.jpg not downloaded yet
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/75/0e75e3189b6c0501999b896f98a676ae/pa/TF52830_8cd7c0259758bd9796d95d5fc5ba5889.jpg not downloaded yet
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/75/0e75e3189b6c0501999b896f98a676ae/pa/TF52830_34b9158c874612cc6e2235d58bd76a22.jpg not downloaded yet
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438acddd0>
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49ed4522-e3b6-531b-8b55-7108a6430ac3/49ed4522-e3b6-531b-8b55-7108a6430ac3_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/5e/2a5e2585ea3beb677a557de6b79de717/pa/PF14495_2b3a30873e727a36714559b6ba285791.jpg saved to cache
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 49ed4522-e3b6-531b-8b55-7108a6430ac3
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/75/0e75e3189b6c0501999b896f98a676ae/pa/TF52830_660b981c6ddb991a6b81a5fc00ca6d44.jpg not downloaded yet
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/75/0e75e3189b6c0501999b896f98a676ae/pa/TF52830_9bba109d7e09a78ac0f0ab77e76fe609.jpg not downloaded yet
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/75/0e75e3189b6c0501999b896f98a676ae/pa/TF52830_0580753c2a6263946e82b50e62025cd7.jpg not downloaded yet
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438086050>
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49ed4522-e3b6-531b-8b55-7108a6430ac3/49ed4522-e3b6-531b-8b55-7108a6430ac3_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/5e/2a5e2585ea3beb677a557de6b79de717/pa/PF14495_e0097d4bf73d8b8774a8fdf2a8f45ac7.jpg saved to cache
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 49ed4522-e3b6-531b-8b55-7108a6430ac3
2026-04-27 08:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/5e/2a5e2585ea3beb677a557de6b79de717/pa/PF14495_ec561e8133c7d14b00a5fc4efc95a00f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item e93311a4-fbed-51d4-bd71-770b7dccfae5 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/75/0e75e3189b6c0501999b896f98a676ae/pa/TF52830_34b9158c874612cc6e2235d58bd76a22.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/75/0e75e3189b6c0501999b896f98a676ae/pa/TF52830_8cd7c0259758bd9796d95d5fc5ba5889.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ca90d0>
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49ed4522-e3b6-531b-8b55-7108a6430ac3/49ed4522-e3b6-531b-8b55-7108a6430ac3_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/5e/2a5e2585ea3beb677a557de6b79de717/pa/PF14495_ec561e8133c7d14b00a5fc4efc95a00f.jpg saved to cache
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 49ed4522-e3b6-531b-8b55-7108a6430ac3
2026-04-27 08:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/75/0e75e3189b6c0501999b896f98a676ae/pa/TF52830_3fa90a5b8c6b65dd9323be3c034ef692.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item e93311a4-fbed-51d4-bd71-770b7dccfae5 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item e93311a4-fbed-51d4-bd71-770b7dccfae5 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 49ed4522-e3b6-531b-8b55-7108a6430ac3 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143812ffd0>
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03861d78-3c0d-5a34-af3c-a3483d83e8be/03861d78-3c0d-5a34-af3c-a3483d83e8be_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/75/0e75e3189b6c0501999b896f98a676ae/pa/TF52830_34b9158c874612cc6e2235d58bd76a22.jpg saved to cache
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 03861d78-3c0d-5a34-af3c-a3483d83e8be
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a83f10>
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03861d78-3c0d-5a34-af3c-a3483d83e8be/03861d78-3c0d-5a34-af3c-a3483d83e8be_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/75/0e75e3189b6c0501999b896f98a676ae/pa/TF52830_8cd7c0259758bd9796d95d5fc5ba5889.jpg saved to cache
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 03861d78-3c0d-5a34-af3c-a3483d83e8be
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438be9390>
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03861d78-3c0d-5a34-af3c-a3483d83e8be/03861d78-3c0d-5a34-af3c-a3483d83e8be_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/75/0e75e3189b6c0501999b896f98a676ae/pa/TF52830_3fa90a5b8c6b65dd9323be3c034ef692.jpg saved to cache
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 03861d78-3c0d-5a34-af3c-a3483d83e8be
2026-04-27 08:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/28/c3282362494f6991ff18c001b07ddd52/pa/WG00689_aeffb4d0566adcf85fad48fa7977c607.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 49ed4522-e3b6-531b-8b55-7108a6430ac3 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 49ed4522-e3b6-531b-8b55-7108a6430ac3 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/28/c3282362494f6991ff18c001b07ddd52/pa/WG00689_c436c680e2231b988ef154ebf3b32d51.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/28/c3282362494f6991ff18c001b07ddd52/pa/WG00689_3000fc747a91dab256e2d80bf7ff4820.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380bfc50>
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e93311a4-fbed-51d4-bd71-770b7dccfae5/e93311a4-fbed-51d4-bd71-770b7dccfae5_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/28/c3282362494f6991ff18c001b07ddd52/pa/WG00689_aeffb4d0566adcf85fad48fa7977c607.jpg saved to cache
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e93311a4-fbed-51d4-bd71-770b7dccfae5
2026-04-27 08:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/aa/53aa5c1b62a399817eab232ec2d78861/pa/RY45034_42212f2ddbf6eb90c406a6cc1d53098a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438060890>
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e93311a4-fbed-51d4-bd71-770b7dccfae5/e93311a4-fbed-51d4-bd71-770b7dccfae5_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/28/c3282362494f6991ff18c001b07ddd52/pa/WG00689_c436c680e2231b988ef154ebf3b32d51.jpg saved to cache
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e93311a4-fbed-51d4-bd71-770b7dccfae5
2026-04-27 08:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/f5/09f5d6a9682eb4834665a2f2f648ee37/pa/BD67804_bd76996b2198f5fa85d3067ec7251be3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438057290>
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e93311a4-fbed-51d4-bd71-770b7dccfae5/e93311a4-fbed-51d4-bd71-770b7dccfae5_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/28/c3282362494f6991ff18c001b07ddd52/pa/WG00689_3000fc747a91dab256e2d80bf7ff4820.jpg saved to cache
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e93311a4-fbed-51d4-bd71-770b7dccfae5
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f144751f850>
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1083664b-56bc-56a3-b7ef-e7c78df0a6eb/1083664b-56bc-56a3-b7ef-e7c78df0a6eb_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/aa/53aa5c1b62a399817eab232ec2d78861/pa/RY45034_42212f2ddbf6eb90c406a6cc1d53098a.jpg saved to cache
2026-04-27 08:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1083664b-56bc-56a3-b7ef-e7c78df0a6eb
2026-04-27 08:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380bf890>
2026-04-27 08:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcdb2acd-7aec-5e5d-be0d-95159bae43f4/fcdb2acd-7aec-5e5d-be0d-95159bae43f4_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/f5/09f5d6a9682eb4834665a2f2f648ee37/pa/BD67804_bd76996b2198f5fa85d3067ec7251be3.jpg saved to cache
2026-04-27 08:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fcdb2acd-7aec-5e5d-be0d-95159bae43f4
2026-04-27 08:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/02/5a0270c7e6143d6adfaea3279abe8998/pa/CM53599_b8d72e2d45f5a6e1c9a02e1a27b02fb2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:55 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 49ed4522-e3b6-531b-8b55-7108a6430ac3 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/f5/09f5d6a9682eb4834665a2f2f648ee37/pa/BD67804_d0851b749a9d80bf021636bd694915e9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:03:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HD20644> (referer: https://www.auto1.com/v1/car-details-view/HD20644/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d44ad0>
2026-04-27 08:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d807a8c-03ba-518f-8335-7f94119e6c2b/6d807a8c-03ba-518f-8335-7f94119e6c2b_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/02/5a0270c7e6143d6adfaea3279abe8998/pa/CM53599_b8d72e2d45f5a6e1c9a02e1a27b02fb2.jpg saved to cache
2026-04-27 08:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6d807a8c-03ba-518f-8335-7f94119e6c2b
2026-04-27 08:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c69290>
2026-04-27 08:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcdb2acd-7aec-5e5d-be0d-95159bae43f4/fcdb2acd-7aec-5e5d-be0d-95159bae43f4_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/f5/09f5d6a9682eb4834665a2f2f648ee37/pa/BD67804_d0851b749a9d80bf021636bd694915e9.jpg saved to cache
2026-04-27 08:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fcdb2acd-7aec-5e5d-be0d-95159bae43f4
2026-04-27 08:03:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2150fde2-df16-5b1e-966f-c0d9ba287151 with identifier: HD20644
2026-04-27 08:03:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2150fde2-df16-5b1e-966f-c0d9ba287151 with scrape type 1
2026-04-27 08:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 2150fde2-df16-5b1e-966f-c0d9ba287151
2026-04-27 08:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/78/d3784cc1b525c9caafdcd315b3fe8044/pa/HD20644_ed2bf8f579c73ac3676bc0919f0b8181.jpg not downloaded yet
2026-04-27 08:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/78/d3784cc1b525c9caafdcd315b3fe8044/pa/HD20644_e90359c9e67a709cd0b5ca0de801c1d4.jpg not downloaded yet
2026-04-27 08:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/78/d3784cc1b525c9caafdcd315b3fe8044/pa/HD20644_e026d348869b7b32a8ff9886b1f075be.jpg not downloaded yet
2026-04-27 08:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/78/d3784cc1b525c9caafdcd315b3fe8044/pa/HD20644_1189a9b5935f9bd010bcc6dd037ff8a7.jpg not downloaded yet
2026-04-27 08:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/78/d3784cc1b525c9caafdcd315b3fe8044/pa/HD20644_0ae0fe1bae039d7c26fd7143d2ef510f.jpg not downloaded yet
2026-04-27 08:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/78/d3784cc1b525c9caafdcd315b3fe8044/pa/HD20644_1782b1097a6a19a4345eb5acb9f0f850.jpg not downloaded yet
2026-04-27 08:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/02/5a0270c7e6143d6adfaea3279abe8998/pa/CM53599_992bd6a36b5bdcb583c717fb91865350.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 49ed4522-e3b6-531b-8b55-7108a6430ac3 with identifier: PF14495
2026-04-27 08:03:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 49ed4522-e3b6-531b-8b55-7108a6430ac3 with identifier: PF14495
2026-04-27 08:03:56 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:03:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 49ed4522-e3b6-531b-8b55-7108a6430ac3 with identifier: PF14495 to the API
2026-04-27 08:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:03:56 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:03:56 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'category': None,
 'city': 'Marly-la-Ville',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 110,
 'expiration_date': '2026-04-28T15:09:53Z',
 'fuel_type': 'diesel',
 'id': '49ed4522-e3b6-531b-8b55-7108a6430ac3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 49.082,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PF14495',
 'listing': 'auction',
 'location': 'FR, Marly-la-ville',
 'location_confidence': 'geocoded',
 'longitude': 2.5035,
 'make': 'Renault',
 'model': 'Scenic',
 'odometer': 169513,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img2a/5e/2a5e2585ea3beb677a557de6b79de717/pa/PF14495_59075cf24e546a83b129b03c31b9533d.jpg',
                'https://img-pa.auto1.com/img2a/5e/2a5e2585ea3beb677a557de6b79de717/pa/PF14495_fbb7fdeda8cb0fba97e88517ad975618.jpg',
                'https://img-pa.auto1.com/img2a/5e/2a5e2585ea3beb677a557de6b79de717/pa/PF14495_ec561e8133c7d14b00a5fc4efc95a00f.jpg',
                'https://img-pa.auto1.com/img2a/5e/2a5e2585ea3beb677a557de6b79de717/pa/PF14495_e0097d4bf73d8b8774a8fdf2a8f45ac7.jpg',
                'https://img-pa.auto1.com/img2a/5e/2a5e2585ea3beb677a557de6b79de717/pa/PF14495_3b9b04e2c7320c7a68fefa50186319dd.jpg',
                'https://img-pa.auto1.com/img2a/5e/2a5e2585ea3beb677a557de6b79de717/pa/PF14495_2b3a30873e727a36714559b6ba285791.jpg',
                'https://img-pa.auto1.com/img2a/5e/2a5e2585ea3beb677a557de6b79de717/pa/PF14495_59a05557041408e7ab659092a1e966fe.jpg',
                'https://img-pa.auto1.com/img2a/5e/2a5e2585ea3beb677a557de6b79de717/pa/PF14495_c25593636262a57082315485b99e12c0.jpg',
                'https://img-pa.auto1.com/img2a/5e/2a5e2585ea3beb677a557de6b79de717/pa/PF14495_afbe7469eefe67477c61e63b75a09dcf.jpg',
                'https://img-pa.auto1.com/img2a/5e/2a5e2585ea3beb677a557de6b79de717/pa/PF14495_3dafdebded07fe316c064dbf4bcaee0e.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_49ed4522-e3b6-531b-8b55-7108a6430ac3/49ed4522-e3b6-531b-8b55-7108a6430ac3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60455,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/5e/2a5e2585ea3beb677a557de6b79de717/pa/PF14495_ec561e8133c7d14b00a5fc4efc95a00f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_49ed4522-e3b6-531b-8b55-7108a6430ac3/49ed4522-e3b6-531b-8b55-7108a6430ac3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55570,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/5e/2a5e2585ea3beb677a557de6b79de717/pa/PF14495_e0097d4bf73d8b8774a8fdf2a8f45ac7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_49ed4522-e3b6-531b-8b55-7108a6430ac3/49ed4522-e3b6-531b-8b55-7108a6430ac3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70242,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/5e/2a5e2585ea3beb677a557de6b79de717/pa/PF14495_2b3a30873e727a36714559b6ba285791.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_49ed4522-e3b6-531b-8b55-7108a6430ac3/49ed4522-e3b6-531b-8b55-7108a6430ac3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61971,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/5e/2a5e2585ea3beb677a557de6b79de717/pa/PF14495_59a05557041408e7ab659092a1e966fe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_49ed4522-e3b6-531b-8b55-7108a6430ac3/49ed4522-e3b6-531b-8b55-7108a6430ac3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50874,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/5e/2a5e2585ea3beb677a557de6b79de717/pa/PF14495_3dafdebded07fe316c064dbf4bcaee0e.jpg',
             'Width': 800}],
 'postal_code': '95670',
 'price': 0,
 'price_includes_vat': True,
 'province': "Val-d'Oise",
 'province_code': 'FR-95',
 'region': 'Île-de-France',
 'region_code': 'FR-11',
 'registration_date': '2018-07-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Scenic 1.5 dCi Energy Intens',
 'transmission': 'automatic',
 'trim': 'Intens',
 'year': 2018}
2026-04-27 08:03:56 [auto1.fr] INFO: Saving data for PF14495: {'created_time': 1777277036.292719, 'last_price_update_time': 1777277036.292727, 'has_photos': True, 'auction_closing_time': 1777388993.0}
2026-04-27 08:03:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/f5/09f5d6a9682eb4834665a2f2f648ee37/pa/BD67804_9923096a67e7ead5644a5dfca5e13a8a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:56 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 49ed4522-e3b6-531b-8b55-7108a6430ac3 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:03:56 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item 03861d78-3c0d-5a34-af3c-a3483d83e8be due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:03:56 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 03861d78-3c0d-5a34-af3c-a3483d83e8be due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:03:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 03861d78-3c0d-5a34-af3c-a3483d83e8be with identifier: TF52830
2026-04-27 08:03:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 03861d78-3c0d-5a34-af3c-a3483d83e8be with identifier: TF52830
2026-04-27 08:03:56 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:03:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 03861d78-3c0d-5a34-af3c-a3483d83e8be with identifier: TF52830 to the API
2026-04-27 08:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:03:56 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:03:56 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'category': None,
 'city': 'Marseille',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-04-28T15:48:29Z',
 'fuel_type': 'petrol',
 'id': '03861d78-3c0d-5a34-af3c-a3483d83e8be',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 43.2969,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TF52830',
 'listing': 'auction',
 'location': 'FR, Marseille',
 'location_confidence': 'geocoded',
 'longitude': 5.3811,
 'make': 'Fiat',
 'model': '500',
 'odometer': 114558,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/img0e/75/0e75e3189b6c0501999b896f98a676ae/pa/TF52830_3fa90a5b8c6b65dd9323be3c034ef692.jpg',
                'https://img-pa.auto1.com/img0e/75/0e75e3189b6c0501999b896f98a676ae/pa/TF52830_8cd7c0259758bd9796d95d5fc5ba5889.jpg',
                'https://img-pa.auto1.com/img0e/75/0e75e3189b6c0501999b896f98a676ae/pa/TF52830_34b9158c874612cc6e2235d58bd76a22.jpg',
                'https://img-pa.auto1.com/img0e/75/0e75e3189b6c0501999b896f98a676ae/pa/TF52830_660b981c6ddb991a6b81a5fc00ca6d44.jpg',
                'https://img-pa.auto1.com/img0e/75/0e75e3189b6c0501999b896f98a676ae/pa/TF52830_9bba109d7e09a78ac0f0ab77e76fe609.jpg',
                'https://img-pa.auto1.com/img0e/75/0e75e3189b6c0501999b896f98a676ae/pa/TF52830_0580753c2a6263946e82b50e62025cd7.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_03861d78-3c0d-5a34-af3c-a3483d83e8be/03861d78-3c0d-5a34-af3c-a3483d83e8be_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65950,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/75/0e75e3189b6c0501999b896f98a676ae/pa/TF52830_3fa90a5b8c6b65dd9323be3c034ef692.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_03861d78-3c0d-5a34-af3c-a3483d83e8be/03861d78-3c0d-5a34-af3c-a3483d83e8be_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61386,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/75/0e75e3189b6c0501999b896f98a676ae/pa/TF52830_8cd7c0259758bd9796d95d5fc5ba5889.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_03861d78-3c0d-5a34-af3c-a3483d83e8be/03861d78-3c0d-5a34-af3c-a3483d83e8be_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65690,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/75/0e75e3189b6c0501999b896f98a676ae/pa/TF52830_34b9158c874612cc6e2235d58bd76a22.jpg',
             'Width': 800}],
 'postal_code': '13000',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Bouches-du-Rhône',
 'province_code': 'FR-13',
 'region': "Provence-Alpes-Côte d'Azur",
 'region_code': 'FR-93',
 'registration_date': '2011-02-16',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat 500 1.2 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2011}
2026-04-27 08:03:56 [auto1.fr] INFO: Saving data for TF52830: {'created_time': 1777277036.674666, 'last_price_update_time': 1777277036.674678, 'has_photos': True, 'auction_closing_time': 1777391309.0}
2026-04-27 08:03:56 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item 03861d78-3c0d-5a34-af3c-a3483d83e8be due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:03:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380a5950>
2026-04-27 08:03:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d807a8c-03ba-518f-8335-7f94119e6c2b/6d807a8c-03ba-518f-8335-7f94119e6c2b_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/02/5a0270c7e6143d6adfaea3279abe8998/pa/CM53599_992bd6a36b5bdcb583c717fb91865350.jpg saved to cache
2026-04-27 08:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6d807a8c-03ba-518f-8335-7f94119e6c2b
2026-04-27 08:03:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/78/d3784cc1b525c9caafdcd315b3fe8044/pa/HD20644_e026d348869b7b32a8ff9886b1f075be.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:56 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item e93311a4-fbed-51d4-bd71-770b7dccfae5 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:03:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e93311a4-fbed-51d4-bd71-770b7dccfae5 with identifier: WG00689
2026-04-27 08:03:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e93311a4-fbed-51d4-bd71-770b7dccfae5 with identifier: WG00689
2026-04-27 08:03:56 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:03:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e93311a4-fbed-51d4-bd71-770b7dccfae5 with identifier: WG00689 to the API
2026-04-27 08:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:03:56 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:03:57 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'city': 'Loyettes',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2026-04-28T15:00:47Z',
 'fuel_type': 'petrol',
 'id': 'e93311a4-fbed-51d4-bd71-770b7dccfae5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 45.7766,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG00689',
 'listing': 'auction',
 'location': 'FR, Loyettes',
 'location_confidence': 'geocoded',
 'longitude': 5.2069,
 'make': 'Citroen',
 'model': 'C3 Picasso',
 'odometer': 103252,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgc3/28/c3282362494f6991ff18c001b07ddd52/pa/WG00689_3000fc747a91dab256e2d80bf7ff4820.jpg',
                'https://img-pa.auto1.com/imgc3/28/c3282362494f6991ff18c001b07ddd52/pa/WG00689_c436c680e2231b988ef154ebf3b32d51.jpg',
                'https://img-pa.auto1.com/imgc3/28/c3282362494f6991ff18c001b07ddd52/pa/WG00689_a85f8653f49efe687078463c8a797b9d.jpg',
                'https://img-pa.auto1.com/imgc3/28/c3282362494f6991ff18c001b07ddd52/pa/WG00689_ec477fedb1ababa9ddbfde0039dd7aca.jpg',
                'https://img-pa.auto1.com/imgc3/28/c3282362494f6991ff18c001b07ddd52/pa/WG00689_82c5c03bc32ed4c98e0a1c88009d0cfe.jpg',
                'https://img-pa.auto1.com/imgc3/28/c3282362494f6991ff18c001b07ddd52/pa/WG00689_a68259eb8ec87ca9abacc44117c4f6cb.jpg',
                'https://img-pa.auto1.com/imgc3/28/c3282362494f6991ff18c001b07ddd52/pa/WG00689_aeffb4d0566adcf85fad48fa7977c607.jpg',
                'https://img-pa.auto1.com/imgc3/28/c3282362494f6991ff18c001b07ddd52/pa/WG00689_00c9b86220dc61b68d0608ece49db8c3.jpg',
                'https://img-pa.auto1.com/imgc3/28/c3282362494f6991ff18c001b07ddd52/pa/WG00689_4a65314ac178919eea71c1f23f029549.jpg',
                'https://img-pa.auto1.com/imgc3/28/c3282362494f6991ff18c001b07ddd52/pa/WG00689_952567e6e8bfca4c4e7350e29760c2d5.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e93311a4-fbed-51d4-bd71-770b7dccfae5/e93311a4-fbed-51d4-bd71-770b7dccfae5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77628,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/28/c3282362494f6991ff18c001b07ddd52/pa/WG00689_3000fc747a91dab256e2d80bf7ff4820.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e93311a4-fbed-51d4-bd71-770b7dccfae5/e93311a4-fbed-51d4-bd71-770b7dccfae5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78541,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/28/c3282362494f6991ff18c001b07ddd52/pa/WG00689_c436c680e2231b988ef154ebf3b32d51.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e93311a4-fbed-51d4-bd71-770b7dccfae5/e93311a4-fbed-51d4-bd71-770b7dccfae5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76800,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/28/c3282362494f6991ff18c001b07ddd52/pa/WG00689_a85f8653f49efe687078463c8a797b9d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e93311a4-fbed-51d4-bd71-770b7dccfae5/e93311a4-fbed-51d4-bd71-770b7dccfae5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67209,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/28/c3282362494f6991ff18c001b07ddd52/pa/WG00689_aeffb4d0566adcf85fad48fa7977c607.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e93311a4-fbed-51d4-bd71-770b7dccfae5/e93311a4-fbed-51d4-bd71-770b7dccfae5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51739,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/28/c3282362494f6991ff18c001b07ddd52/pa/WG00689_952567e6e8bfca4c4e7350e29760c2d5.jpg',
             'Width': 800}],
 'postal_code': '01360',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Ain',
 'province_code': 'FR-01',
 'region': 'Auvergne-Rhône-Alpes',
 'region_code': 'FR-84',
 'registration_date': '2016-09-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 Picasso 1.2 PureTech Exclusive',
 'transmission': 'manual',
 'trim': 'Exclusive',
 'year': 2016}
2026-04-27 08:03:57 [auto1.fr] INFO: Saving data for WG00689: {'created_time': 1777277037.030339, 'last_price_update_time': 1777277037.030349, 'has_photos': True, 'auction_closing_time': 1777388447.0}
2026-04-27 08:03:57 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 1083664b-56bc-56a3-b7ef-e7c78df0a6eb due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:03:57 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item e93311a4-fbed-51d4-bd71-770b7dccfae5 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:03:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c559d0>
2026-04-27 08:03:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcdb2acd-7aec-5e5d-be0d-95159bae43f4/fcdb2acd-7aec-5e5d-be0d-95159bae43f4_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/f5/09f5d6a9682eb4834665a2f2f648ee37/pa/BD67804_9923096a67e7ead5644a5dfca5e13a8a.jpg saved to cache
2026-04-27 08:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fcdb2acd-7aec-5e5d-be0d-95159bae43f4
2026-04-27 08:03:57 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 1083664b-56bc-56a3-b7ef-e7c78df0a6eb due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:03:57 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item 2150fde2-df16-5b1e-966f-c0d9ba287151 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:03:57 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item 2150fde2-df16-5b1e-966f-c0d9ba287151 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:03:57 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 2150fde2-df16-5b1e-966f-c0d9ba287151 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:03:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438188c90>
2026-04-27 08:03:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2150fde2-df16-5b1e-966f-c0d9ba287151/2150fde2-df16-5b1e-966f-c0d9ba287151_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/78/d3784cc1b525c9caafdcd315b3fe8044/pa/HD20644_e026d348869b7b32a8ff9886b1f075be.jpg saved to cache
2026-04-27 08:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2150fde2-df16-5b1e-966f-c0d9ba287151
2026-04-27 08:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/02/5a0270c7e6143d6adfaea3279abe8998/pa/CM53599_bbe3eed944b0a23ea0c442836374549f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/aa/53aa5c1b62a399817eab232ec2d78861/pa/RY45034_659dfd6b6075ac081f701cdccd20e014.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/f5/09f5d6a9682eb4834665a2f2f648ee37/pa/BD67804_474b54d97534a76ca455c0ea16f1e8bb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438dfb4d0>
2026-04-27 08:03:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d807a8c-03ba-518f-8335-7f94119e6c2b/6d807a8c-03ba-518f-8335-7f94119e6c2b_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/02/5a0270c7e6143d6adfaea3279abe8998/pa/CM53599_bbe3eed944b0a23ea0c442836374549f.jpg saved to cache
2026-04-27 08:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6d807a8c-03ba-518f-8335-7f94119e6c2b
2026-04-27 08:03:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ca7010>
2026-04-27 08:03:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1083664b-56bc-56a3-b7ef-e7c78df0a6eb/1083664b-56bc-56a3-b7ef-e7c78df0a6eb_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/aa/53aa5c1b62a399817eab232ec2d78861/pa/RY45034_659dfd6b6075ac081f701cdccd20e014.jpg saved to cache
2026-04-27 08:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1083664b-56bc-56a3-b7ef-e7c78df0a6eb
2026-04-27 08:03:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438024cd0>
2026-04-27 08:03:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcdb2acd-7aec-5e5d-be0d-95159bae43f4/fcdb2acd-7aec-5e5d-be0d-95159bae43f4_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/f5/09f5d6a9682eb4834665a2f2f648ee37/pa/BD67804_474b54d97534a76ca455c0ea16f1e8bb.jpg saved to cache
2026-04-27 08:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fcdb2acd-7aec-5e5d-be0d-95159bae43f4
2026-04-27 08:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/02/5a0270c7e6143d6adfaea3279abe8998/pa/CM53599_836868b2782c47bf2dd5a6dae1ebc562.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438209810>
2026-04-27 08:03:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d807a8c-03ba-518f-8335-7f94119e6c2b/6d807a8c-03ba-518f-8335-7f94119e6c2b_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/02/5a0270c7e6143d6adfaea3279abe8998/pa/CM53599_836868b2782c47bf2dd5a6dae1ebc562.jpg saved to cache
2026-04-27 08:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6d807a8c-03ba-518f-8335-7f94119e6c2b
2026-04-27 08:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/02/5a0270c7e6143d6adfaea3279abe8998/pa/CM53599_efa3ec4003f66ac60623e283b39fceea.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/f5/09f5d6a9682eb4834665a2f2f648ee37/pa/BD67804_2511be3bbbbef85e14591741fa6d13d8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:57 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 2150fde2-df16-5b1e-966f-c0d9ba287151 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:03:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438027490>
2026-04-27 08:03:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d807a8c-03ba-518f-8335-7f94119e6c2b/6d807a8c-03ba-518f-8335-7f94119e6c2b_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/02/5a0270c7e6143d6adfaea3279abe8998/pa/CM53599_efa3ec4003f66ac60623e283b39fceea.jpg saved to cache
2026-04-27 08:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6d807a8c-03ba-518f-8335-7f94119e6c2b
2026-04-27 08:03:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438135050>
2026-04-27 08:03:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcdb2acd-7aec-5e5d-be0d-95159bae43f4/fcdb2acd-7aec-5e5d-be0d-95159bae43f4_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/f5/09f5d6a9682eb4834665a2f2f648ee37/pa/BD67804_2511be3bbbbef85e14591741fa6d13d8.jpg saved to cache
2026-04-27 08:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fcdb2acd-7aec-5e5d-be0d-95159bae43f4
2026-04-27 08:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/02/5a0270c7e6143d6adfaea3279abe8998/pa/CM53599_81f7ae4c42ae7e2ac594368748ea96c7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/aa/53aa5c1b62a399817eab232ec2d78861/pa/RY45034_7e6c14318baba812a8e3b116b9128b14.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/f5/09f5d6a9682eb4834665a2f2f648ee37/pa/BD67804_9efde88047cc95cb36ae7e02fc76d1a7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438fb1290>
2026-04-27 08:03:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d807a8c-03ba-518f-8335-7f94119e6c2b/6d807a8c-03ba-518f-8335-7f94119e6c2b_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/02/5a0270c7e6143d6adfaea3279abe8998/pa/CM53599_81f7ae4c42ae7e2ac594368748ea96c7.jpg saved to cache
2026-04-27 08:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6d807a8c-03ba-518f-8335-7f94119e6c2b
2026-04-27 08:03:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14382083d0>
2026-04-27 08:03:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1083664b-56bc-56a3-b7ef-e7c78df0a6eb/1083664b-56bc-56a3-b7ef-e7c78df0a6eb_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/aa/53aa5c1b62a399817eab232ec2d78861/pa/RY45034_7e6c14318baba812a8e3b116b9128b14.jpg saved to cache
2026-04-27 08:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1083664b-56bc-56a3-b7ef-e7c78df0a6eb
2026-04-27 08:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PC47151/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438137450>
2026-04-27 08:03:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcdb2acd-7aec-5e5d-be0d-95159bae43f4/fcdb2acd-7aec-5e5d-be0d-95159bae43f4_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/f5/09f5d6a9682eb4834665a2f2f648ee37/pa/BD67804_9efde88047cc95cb36ae7e02fc76d1a7.jpg saved to cache
2026-04-27 08:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fcdb2acd-7aec-5e5d-be0d-95159bae43f4
2026-04-27 08:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/02/5a0270c7e6143d6adfaea3279abe8998/pa/CM53599_2fc318ebdf795ea928bcd4b72606d8cb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2150fde2-df16-5b1e-966f-c0d9ba287151 with identifier: HD20644
2026-04-27 08:03:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2150fde2-df16-5b1e-966f-c0d9ba287151 with identifier: HD20644
2026-04-27 08:03:58 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:03:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2150fde2-df16-5b1e-966f-c0d9ba287151 with identifier: HD20644 to the API
2026-04-27 08:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:03:58 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:03:58 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': 166,
 'category': None,
 'city': 'Warluis',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 3',
 'engine': '2.1L',
 'engine_horse_power': 122,
 'expiration_date': '2026-04-28T15:02:45Z',
 'fuel_type': 'diesel',
 'id': '2150fde2-df16-5b1e-966f-c0d9ba287151',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 49.3887,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HD20644',
 'listing': 'auction',
 'location': 'FR, Warluis',
 'location_confidence': 'geocoded',
 'longitude': 2.1422,
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 183025,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/imgd3/78/d3784cc1b525c9caafdcd315b3fe8044/pa/HD20644_ed2bf8f579c73ac3676bc0919f0b8181.jpg',
                'https://img-pa.auto1.com/imgd3/78/d3784cc1b525c9caafdcd315b3fe8044/pa/HD20644_e90359c9e67a709cd0b5ca0de801c1d4.jpg',
                'https://img-pa.auto1.com/imgd3/78/d3784cc1b525c9caafdcd315b3fe8044/pa/HD20644_e026d348869b7b32a8ff9886b1f075be.jpg',
                'https://img-pa.auto1.com/imgd3/78/d3784cc1b525c9caafdcd315b3fe8044/pa/HD20644_1189a9b5935f9bd010bcc6dd037ff8a7.jpg',
                'https://img-pa.auto1.com/imgd3/78/d3784cc1b525c9caafdcd315b3fe8044/pa/HD20644_0ae0fe1bae039d7c26fd7143d2ef510f.jpg',
                'https://img-pa.auto1.com/imgd3/78/d3784cc1b525c9caafdcd315b3fe8044/pa/HD20644_1782b1097a6a19a4345eb5acb9f0f850.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2150fde2-df16-5b1e-966f-c0d9ba287151/2150fde2-df16-5b1e-966f-c0d9ba287151_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91730,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/78/d3784cc1b525c9caafdcd315b3fe8044/pa/HD20644_e026d348869b7b32a8ff9886b1f075be.jpg',
             'Width': 800}],
 'postal_code': '60430',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Oise',
 'province_code': 'FR-60',
 'region': 'Hauts-de-France',
 'region_code': 'FR-32',
 'registration_date': '2004-05-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 CDI Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2004}
2026-04-27 08:03:58 [auto1.fr] INFO: Saving data for HD20644: {'created_time': 1777277038.642837, 'last_price_update_time': 1777277038.642846, 'has_photos': True, 'auction_closing_time': 1777388565.0}
2026-04-27 08:03:58 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item fcdb2acd-7aec-5e5d-be0d-95159bae43f4 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/54/2854ef87ea875d9327a5bdd1519cbbba/pa/KZ52464_2ab6db7eb3d1ac969369652da18e1742.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:58 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 2150fde2-df16-5b1e-966f-c0d9ba287151 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:03:58 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 1083664b-56bc-56a3-b7ef-e7c78df0a6eb due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:03:58 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 6d807a8c-03ba-518f-8335-7f94119e6c2b due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:03:58 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item 1083664b-56bc-56a3-b7ef-e7c78df0a6eb due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:03:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: fcdb2acd-7aec-5e5d-be0d-95159bae43f4 with identifier: BD67804
2026-04-27 08:03:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: fcdb2acd-7aec-5e5d-be0d-95159bae43f4 with identifier: BD67804
2026-04-27 08:03:59 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:03:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: fcdb2acd-7aec-5e5d-be0d-95159bae43f4 with identifier: BD67804 to the API
2026-04-27 08:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:03:59 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:03:59 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'city': 'Loyettes',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-04-28T15:53:57Z',
 'fuel_type': 'diesel',
 'id': 'fcdb2acd-7aec-5e5d-be0d-95159bae43f4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 45.7766,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BD67804',
 'listing': 'auction',
 'location': 'FR, Loyettes',
 'location_confidence': 'geocoded',
 'longitude': 5.2069,
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 231094,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img09/f5/09f5d6a9682eb4834665a2f2f648ee37/pa/BD67804_9efde88047cc95cb36ae7e02fc76d1a7.jpg',
                'https://img-pa.auto1.com/img09/f5/09f5d6a9682eb4834665a2f2f648ee37/pa/BD67804_2511be3bbbbef85e14591741fa6d13d8.jpg',
                'https://img-pa.auto1.com/img09/f5/09f5d6a9682eb4834665a2f2f648ee37/pa/BD67804_412b182b9a420a63fa76fad3e9f8c859.jpg',
                'https://img-pa.auto1.com/img09/f5/09f5d6a9682eb4834665a2f2f648ee37/pa/BD67804_474b54d97534a76ca455c0ea16f1e8bb.jpg',
                'https://img-pa.auto1.com/img09/f5/09f5d6a9682eb4834665a2f2f648ee37/pa/BD67804_29254f88669bfa9c3c96e82730da6d5c.jpg',
                'https://img-pa.auto1.com/img09/f5/09f5d6a9682eb4834665a2f2f648ee37/pa/BD67804_6c056745ca3c086d5ceb4edb8dc6be53.jpg',
                'https://img-pa.auto1.com/img09/f5/09f5d6a9682eb4834665a2f2f648ee37/pa/BD67804_9923096a67e7ead5644a5dfca5e13a8a.jpg',
                'https://img-pa.auto1.com/img09/f5/09f5d6a9682eb4834665a2f2f648ee37/pa/BD67804_d0851b749a9d80bf021636bd694915e9.jpg',
                'https://img-pa.auto1.com/img09/f5/09f5d6a9682eb4834665a2f2f648ee37/pa/BD67804_bd76996b2198f5fa85d3067ec7251be3.jpg',
                'https://img-pa.auto1.com/img09/f5/09f5d6a9682eb4834665a2f2f648ee37/pa/BD67804_ad8e6a79c98245d51e96a672a264f92e.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fcdb2acd-7aec-5e5d-be0d-95159bae43f4/fcdb2acd-7aec-5e5d-be0d-95159bae43f4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78304,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/f5/09f5d6a9682eb4834665a2f2f648ee37/pa/BD67804_9efde88047cc95cb36ae7e02fc76d1a7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fcdb2acd-7aec-5e5d-be0d-95159bae43f4/fcdb2acd-7aec-5e5d-be0d-95159bae43f4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77524,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/f5/09f5d6a9682eb4834665a2f2f648ee37/pa/BD67804_2511be3bbbbef85e14591741fa6d13d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fcdb2acd-7aec-5e5d-be0d-95159bae43f4/fcdb2acd-7aec-5e5d-be0d-95159bae43f4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50487,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/f5/09f5d6a9682eb4834665a2f2f648ee37/pa/BD67804_474b54d97534a76ca455c0ea16f1e8bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fcdb2acd-7aec-5e5d-be0d-95159bae43f4/fcdb2acd-7aec-5e5d-be0d-95159bae43f4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44974,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/f5/09f5d6a9682eb4834665a2f2f648ee37/pa/BD67804_9923096a67e7ead5644a5dfca5e13a8a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fcdb2acd-7aec-5e5d-be0d-95159bae43f4/fcdb2acd-7aec-5e5d-be0d-95159bae43f4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67533,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/f5/09f5d6a9682eb4834665a2f2f648ee37/pa/BD67804_d0851b749a9d80bf021636bd694915e9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fcdb2acd-7aec-5e5d-be0d-95159bae43f4/fcdb2acd-7aec-5e5d-be0d-95159bae43f4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72612,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/f5/09f5d6a9682eb4834665a2f2f648ee37/pa/BD67804_bd76996b2198f5fa85d3067ec7251be3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fcdb2acd-7aec-5e5d-be0d-95159bae43f4/fcdb2acd-7aec-5e5d-be0d-95159bae43f4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53208,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/f5/09f5d6a9682eb4834665a2f2f648ee37/pa/BD67804_ad8e6a79c98245d51e96a672a264f92e.jpg',
             'Width': 800}],
 'postal_code': '01360',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Ain',
 'province_code': 'FR-01',
 'region': 'Auvergne-Rhône-Alpes',
 'region_code': 'FR-84',
 'registration_date': '2013-01-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Touran 2.0 TDI Match',
 'transmission': 'manual',
 'trim': 'Match',
 'year': 2013}
2026-04-27 08:03:59 [auto1.fr] INFO: Saving data for BD67804: {'created_time': 1777277039.239175, 'last_price_update_time': 1777277039.239185, 'has_photos': True, 'auction_closing_time': 1777391637.0}
2026-04-27 08:03:59 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item fcdb2acd-7aec-5e5d-be0d-95159bae43f4 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:03:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 1083664b-56bc-56a3-b7ef-e7c78df0a6eb with identifier: RY45034
2026-04-27 08:03:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 1083664b-56bc-56a3-b7ef-e7c78df0a6eb with identifier: RY45034
2026-04-27 08:03:59 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:03:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 1083664b-56bc-56a3-b7ef-e7c78df0a6eb with identifier: RY45034 to the API
2026-04-27 08:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:03:59 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:03:59 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'category': None,
 'city': 'Chartres de Bretagne',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 160,
 'expiration_date': '2026-04-28T15:10:19Z',
 'fuel_type': 'diesel',
 'id': '1083664b-56bc-56a3-b7ef-e7c78df0a6eb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.0398,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RY45034',
 'listing': 'auction',
 'location': 'FR, Chartres de Bretagne',
 'location_confidence': 'geocoded',
 'longitude': -1.7054,
 'make': 'Renault',
 'model': 'Scenic',
 'odometer': 161798,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img53/aa/53aa5c1b62a399817eab232ec2d78861/pa/RY45034_7e6c14318baba812a8e3b116b9128b14.jpg',
                'https://img-pa.auto1.com/img53/aa/53aa5c1b62a399817eab232ec2d78861/pa/RY45034_14cce715185efa6a9a86cc4e4d28e0b9.jpg',
                'https://img-pa.auto1.com/img53/aa/53aa5c1b62a399817eab232ec2d78861/pa/RY45034_86e25bc53e2a84285d0f744a2382faef.jpg',
                'https://img-pa.auto1.com/img53/aa/53aa5c1b62a399817eab232ec2d78861/pa/RY45034_659dfd6b6075ac081f701cdccd20e014.jpg',
                'https://img-pa.auto1.com/img53/aa/53aa5c1b62a399817eab232ec2d78861/pa/RY45034_3842c22af9489db8179e341bcf685b62.jpg',
                'https://img-pa.auto1.com/img53/aa/53aa5c1b62a399817eab232ec2d78861/pa/RY45034_a14f8c015ef6212c977db84321fcea5e.jpg',
                'https://img-pa.auto1.com/img53/aa/53aa5c1b62a399817eab232ec2d78861/pa/RY45034_719ec3a400a4ba303e519e7e55b53786.jpg',
                'https://img-pa.auto1.com/img53/aa/53aa5c1b62a399817eab232ec2d78861/pa/RY45034_a725e6ab5e692c51303baae3d43895d0.jpg',
                'https://img-pa.auto1.com/img53/aa/53aa5c1b62a399817eab232ec2d78861/pa/RY45034_42212f2ddbf6eb90c406a6cc1d53098a.jpg',
                'https://img-pa.auto1.com/img53/aa/53aa5c1b62a399817eab232ec2d78861/pa/RY45034_ed6d2b2cfe0e3c6348225551e0bcfa42.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1083664b-56bc-56a3-b7ef-e7c78df0a6eb/1083664b-56bc-56a3-b7ef-e7c78df0a6eb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70762,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/aa/53aa5c1b62a399817eab232ec2d78861/pa/RY45034_7e6c14318baba812a8e3b116b9128b14.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1083664b-56bc-56a3-b7ef-e7c78df0a6eb/1083664b-56bc-56a3-b7ef-e7c78df0a6eb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56436,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/aa/53aa5c1b62a399817eab232ec2d78861/pa/RY45034_659dfd6b6075ac081f701cdccd20e014.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1083664b-56bc-56a3-b7ef-e7c78df0a6eb/1083664b-56bc-56a3-b7ef-e7c78df0a6eb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71015,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/aa/53aa5c1b62a399817eab232ec2d78861/pa/RY45034_42212f2ddbf6eb90c406a6cc1d53098a.jpg',
             'Width': 800}],
 'postal_code': '35131',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Ille-et-Vilaine',
 'province_code': 'FR-35',
 'region': 'Bretagne',
 'region_code': 'FR-53',
 'registration_date': '2017-05-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Scenic 1.6 dCi Energy Edition One',
 'transmission': 'automatic',
 'trim': 'Edition One',
 'year': 2017}
2026-04-27 08:03:59 [auto1.fr] INFO: Saving data for RY45034: {'created_time': 1777277039.65556, 'last_price_update_time': 1777277039.655569, 'has_photos': True, 'auction_closing_time': 1777389019.0}
2026-04-27 08:03:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142be0b450>
2026-04-27 08:03:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d807a8c-03ba-518f-8335-7f94119e6c2b/6d807a8c-03ba-518f-8335-7f94119e6c2b_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/02/5a0270c7e6143d6adfaea3279abe8998/pa/CM53599_2fc318ebdf795ea928bcd4b72606d8cb.jpg saved to cache
2026-04-27 08:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6d807a8c-03ba-518f-8335-7f94119e6c2b
2026-04-27 08:03:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6d807a8c-03ba-518f-8335-7f94119e6c2b, skipping ID generation
2026-04-27 08:03:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d807a8c-03ba-518f-8335-7f94119e6c2b with scrape type 1
2026-04-27 08:03:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6d807a8c-03ba-518f-8335-7f94119e6c2b sending to next pipeline
2026-04-27 08:03:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6d807a8c-03ba-518f-8335-7f94119e6c2b, identifier: CM53599
2026-04-27 08:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/54/2854ef87ea875d9327a5bdd1519cbbba/pa/KZ52464_53973d11c385238369f26b589ce994db.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:59 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 1083664b-56bc-56a3-b7ef-e7c78df0a6eb due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:03:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6d807a8c-03ba-518f-8335-7f94119e6c2b with identifier: CM53599
2026-04-27 08:03:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6d807a8c-03ba-518f-8335-7f94119e6c2b with identifier: CM53599
2026-04-27 08:03:59 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:03:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6d807a8c-03ba-518f-8335-7f94119e6c2b with identifier: CM53599 to the API
2026-04-27 08:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:00 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5a/02/5a0270c7e6143d6adfaea3279abe8998/pa/CM53599_2fc318ebdf795ea928bcd4b72606d8cb.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'city': 'Mougins',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 125,
 'expiration_date': '2026-04-28T15:14:34Z',
 'fuel_type': 'petrol',
 'id': '6d807a8c-03ba-518f-8335-7f94119e6c2b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 43.6007,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CM53599',
 'listing': 'auction',
 'location': 'FR, MOUGINS',
 'location_confidence': 'geocoded',
 'longitude': 6.9952,
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 38078,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 19,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6d807a8c-03ba-518f-8335-7f94119e6c2b/6d807a8c-03ba-518f-8335-7f94119e6c2b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51404,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/02/5a0270c7e6143d6adfaea3279abe8998/pa/CM53599_2fc318ebdf795ea928bcd4b72606d8cb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6d807a8c-03ba-518f-8335-7f94119e6c2b/6d807a8c-03ba-518f-8335-7f94119e6c2b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57465,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/02/5a0270c7e6143d6adfaea3279abe8998/pa/CM53599_81f7ae4c42ae7e2ac594368748ea96c7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6d807a8c-03ba-518f-8335-7f94119e6c2b/6d807a8c-03ba-518f-8335-7f94119e6c2b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49603,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/02/5a0270c7e6143d6adfaea3279abe8998/pa/CM53599_efa3ec4003f66ac60623e283b39fceea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6d807a8c-03ba-518f-8335-7f94119e6c2b/6d807a8c-03ba-518f-8335-7f94119e6c2b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54375,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/02/5a0270c7e6143d6adfaea3279abe8998/pa/CM53599_836868b2782c47bf2dd5a6dae1ebc562.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6d807a8c-03ba-518f-8335-7f94119e6c2b/6d807a8c-03ba-518f-8335-7f94119e6c2b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51668,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/02/5a0270c7e6143d6adfaea3279abe8998/pa/CM53599_bbe3eed944b0a23ea0c442836374549f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6d807a8c-03ba-518f-8335-7f94119e6c2b/6d807a8c-03ba-518f-8335-7f94119e6c2b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109735,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/02/5a0270c7e6143d6adfaea3279abe8998/pa/CM53599_5e5b81419417270b9a0b1a28fa991b10.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6d807a8c-03ba-518f-8335-7f94119e6c2b/6d807a8c-03ba-518f-8335-7f94119e6c2b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82209,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/02/5a0270c7e6143d6adfaea3279abe8998/pa/CM53599_992bd6a36b5bdcb583c717fb91865350.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6d807a8c-03ba-518f-8335-7f94119e6c2b/6d807a8c-03ba-518f-8335-7f94119e6c2b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73442,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/02/5a0270c7e6143d6adfaea3279abe8998/pa/CM53599_b8d72e2d45f5a6e1c9a02e1a27b02fb2.jpg',
             'Width': 800}],
 'postal_code': '06250',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Alpes-Maritimes',
 'province_code': 'FR-06',
 'region': "Provence-Alpes-Côte d'Azur",
 'region_code': 'FR-93',
 'registration_date': '2020-10-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 EcoBoost Mild-Hybrid Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2020}
2026-04-27 08:04:00 [auto1.fr] INFO: Saving data for CM53599: {'created_time': 1777277040.167286, 'last_price_update_time': 1777277040.167299, 'has_photos': True, 'auction_closing_time': 1777389274.0}
2026-04-27 08:04:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:04:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143803d890>
2026-04-27 08:04:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f91721f0-48b9-5dfb-9a19-70f67d1c033f/f91721f0-48b9-5dfb-9a19-70f67d1c033f_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/54/2854ef87ea875d9327a5bdd1519cbbba/pa/KZ52464_2ab6db7eb3d1ac969369652da18e1742.jpg saved to cache
2026-04-27 08:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f91721f0-48b9-5dfb-9a19-70f67d1c033f
2026-04-27 08:04:00 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item f91721f0-48b9-5dfb-9a19-70f67d1c033f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:04:00 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item f91721f0-48b9-5dfb-9a19-70f67d1c033f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:04:00 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item f91721f0-48b9-5dfb-9a19-70f67d1c033f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:04:00 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item c27dea38-70fc-5099-9cb2-ea154748f7ca due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:04:00 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item c27dea38-70fc-5099-9cb2-ea154748f7ca due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:04:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c27dea38-70fc-5099-9cb2-ea154748f7ca with identifier: SR11177
2026-04-27 08:04:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c27dea38-70fc-5099-9cb2-ea154748f7ca with identifier: SR11177
2026-04-27 08:04:00 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c27dea38-70fc-5099-9cb2-ea154748f7ca with identifier: SR11177 to the API
2026-04-27 08:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:00 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:00 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'category': None,
 'city': 'Saint-Saulve',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '0.9L',
 'engine_horse_power': 90,
 'expiration_date': '2026-04-28T15:20:12Z',
 'fuel_type': 'petrol',
 'id': 'c27dea38-70fc-5099-9cb2-ea154748f7ca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 50.3714,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR11177',
 'listing': 'auction',
 'location': 'FR, Saint-Saulve',
 'location_confidence': 'geocoded',
 'longitude': 3.5561,
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 23015,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img7f/e7/7fe78e860376592961bea2c7a563b62b/pa/SR11177_2e87a39065419939dca9b237a79e34cd.jpg',
                'https://img-pa.auto1.com/img7f/e7/7fe78e860376592961bea2c7a563b62b/pa/SR11177_56360fbcbcab2a82621a2d403e55266e.jpg',
                'https://img-pa.auto1.com/img7f/e7/7fe78e860376592961bea2c7a563b62b/pa/SR11177_9c0d0c6580c8d5bfe4168bdd2b3cbbd3.jpg',
                'https://img-pa.auto1.com/img7f/e7/7fe78e860376592961bea2c7a563b62b/pa/SR11177_63da92301785cbf64db876b179ed7263.jpg',
                'https://img-pa.auto1.com/img7f/e7/7fe78e860376592961bea2c7a563b62b/pa/SR11177_13235b774bd7416b91be51e52e7bc0c9.jpg',
                'https://img-pa.auto1.com/img7f/e7/7fe78e860376592961bea2c7a563b62b/pa/SR11177_7bd9e73eb10e7ccc762a63864b548b26.jpg',
                'https://img-pa.auto1.com/img7f/e7/7fe78e860376592961bea2c7a563b62b/pa/SR11177_4574518f0d23bf70fdc3e87fdb93e303.jpg',
                'https://img-pa.auto1.com/img7f/e7/7fe78e860376592961bea2c7a563b62b/pa/SR11177_d08c9825091ce6d6708cd130961360f2.jpg',
                'https://img-pa.auto1.com/img7f/e7/7fe78e860376592961bea2c7a563b62b/pa/SR11177_39deade5f3003c0f258c76847deb5e8d.jpg',
                'https://img-pa.auto1.com/img7f/e7/7fe78e860376592961bea2c7a563b62b/pa/SR11177_5090690fe7f252561c7142a32b87500c.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c27dea38-70fc-5099-9cb2-ea154748f7ca/c27dea38-70fc-5099-9cb2-ea154748f7ca_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79170,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/e7/7fe78e860376592961bea2c7a563b62b/pa/SR11177_63da92301785cbf64db876b179ed7263.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c27dea38-70fc-5099-9cb2-ea154748f7ca/c27dea38-70fc-5099-9cb2-ea154748f7ca_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89142,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/e7/7fe78e860376592961bea2c7a563b62b/pa/SR11177_4574518f0d23bf70fdc3e87fdb93e303.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c27dea38-70fc-5099-9cb2-ea154748f7ca/c27dea38-70fc-5099-9cb2-ea154748f7ca_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89901,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/e7/7fe78e860376592961bea2c7a563b62b/pa/SR11177_5090690fe7f252561c7142a32b87500c.jpg',
             'Width': 800}],
 'postal_code': '59880',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Nord',
 'province_code': 'FR-59',
 'region': 'Hauts-de-France',
 'region_code': 'FR-32',
 'registration_date': '2015-01-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Captur 0.9 Energy Intens',
 'transmission': 'manual',
 'trim': 'Intens',
 'year': 2015}
2026-04-27 08:04:00 [auto1.fr] INFO: Saving data for SR11177: {'created_time': 1777277040.530698, 'last_price_update_time': 1777277040.530708, 'has_photos': True, 'auction_closing_time': 1777389612.0}
2026-04-27 08:04:00 [scrapy.extensions.logstats] INFO: Crawled 361 pages (at 26 pages/min), scraped 343 items (at 11 items/min)
2026-04-27 08:04:00 [scrapy.extensions.memusage] INFO: Peak memory usage is 373MiB
2026-04-27 08:04:00 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item c27dea38-70fc-5099-9cb2-ea154748f7ca due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:04:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438056290>
2026-04-27 08:04:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f91721f0-48b9-5dfb-9a19-70f67d1c033f/f91721f0-48b9-5dfb-9a19-70f67d1c033f_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/54/2854ef87ea875d9327a5bdd1519cbbba/pa/KZ52464_53973d11c385238369f26b589ce994db.jpg saved to cache
2026-04-27 08:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f91721f0-48b9-5dfb-9a19-70f67d1c033f
2026-04-27 08:04:01 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item f91721f0-48b9-5dfb-9a19-70f67d1c033f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:04:01 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 8c4cb04e-fa69-5de2-b7e9-31be35d7f9d0 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:04:01 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item 8c4cb04e-fa69-5de2-b7e9-31be35d7f9d0 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:04:01 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item f91721f0-48b9-5dfb-9a19-70f67d1c033f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:04:01 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 8c4cb04e-fa69-5de2-b7e9-31be35d7f9d0 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:04:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f91721f0-48b9-5dfb-9a19-70f67d1c033f with identifier: KZ52464
2026-04-27 08:04:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f91721f0-48b9-5dfb-9a19-70f67d1c033f with identifier: KZ52464
2026-04-27 08:04:01 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f91721f0-48b9-5dfb-9a19-70f67d1c033f with identifier: KZ52464 to the API
2026-04-27 08:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:01 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:01 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'category': None,
 'city': 'Chantepie',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 116,
 'expiration_date': '2026-04-28T15:49:55Z',
 'fuel_type': 'petrol',
 'id': 'f91721f0-48b9-5dfb-9a19-70f67d1c033f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.0882,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KZ52464',
 'listing': 'auction',
 'location': 'FR, Chantepie',
 'location_confidence': 'geocoded',
 'longitude': -1.6169,
 'make': 'Nissan',
 'model': 'Juke',
 'odometer': 33499,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img28/54/2854ef87ea875d9327a5bdd1519cbbba/pa/KZ52464_b2977edf681343f0615f73bda770c337.jpg',
                'https://img-pa.auto1.com/img28/54/2854ef87ea875d9327a5bdd1519cbbba/pa/KZ52464_fdf666519ece9c4b99b05d1d71bdfc83.jpg',
                'https://img-pa.auto1.com/img28/54/2854ef87ea875d9327a5bdd1519cbbba/pa/KZ52464_a580050dc521eae9758ac97f8c407897.jpg',
                'https://img-pa.auto1.com/img28/54/2854ef87ea875d9327a5bdd1519cbbba/pa/KZ52464_53973d11c385238369f26b589ce994db.jpg',
                'https://img-pa.auto1.com/img28/54/2854ef87ea875d9327a5bdd1519cbbba/pa/KZ52464_2ab6db7eb3d1ac969369652da18e1742.jpg',
                'https://img-pa.auto1.com/img28/54/2854ef87ea875d9327a5bdd1519cbbba/pa/KZ52464_95b2e79c506bee3fdbd1f0b1233e106e.jpg',
                'https://img-pa.auto1.com/img28/54/2854ef87ea875d9327a5bdd1519cbbba/pa/KZ52464_29f469cba05f13edb585a162dbd8e6bf.jpg',
                'https://img-pa.auto1.com/img28/54/2854ef87ea875d9327a5bdd1519cbbba/pa/KZ52464_358c022fe820198c63103663ce661a74.jpg',
                'https://img-pa.auto1.com/img28/54/2854ef87ea875d9327a5bdd1519cbbba/pa/KZ52464_e7ede34fbaa7cb9c1973517ef29e56a8.jpg',
                'https://img-pa.auto1.com/img28/54/2854ef87ea875d9327a5bdd1519cbbba/pa/KZ52464_837e9528c7c4e9b2c931303dbdd87f13.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f91721f0-48b9-5dfb-9a19-70f67d1c033f/f91721f0-48b9-5dfb-9a19-70f67d1c033f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51350,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/54/2854ef87ea875d9327a5bdd1519cbbba/pa/KZ52464_53973d11c385238369f26b589ce994db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f91721f0-48b9-5dfb-9a19-70f67d1c033f/f91721f0-48b9-5dfb-9a19-70f67d1c033f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58636,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/54/2854ef87ea875d9327a5bdd1519cbbba/pa/KZ52464_2ab6db7eb3d1ac969369652da18e1742.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f91721f0-48b9-5dfb-9a19-70f67d1c033f/f91721f0-48b9-5dfb-9a19-70f67d1c033f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53143,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/54/2854ef87ea875d9327a5bdd1519cbbba/pa/KZ52464_29f469cba05f13edb585a162dbd8e6bf.jpg',
             'Width': 800}],
 'postal_code': '35135',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Ille-et-Vilaine',
 'province_code': 'FR-35',
 'region': 'Bretagne',
 'region_code': 'FR-53',
 'registration_date': '2018-03-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Juke 1.2 DIG-T Blacktop',
 'transmission': 'manual',
 'trim': 'Blacktop',
 'year': 2018}
2026-04-27 08:04:01 [auto1.fr] INFO: Saving data for KZ52464: {'created_time': 1777277041.659649, 'last_price_update_time': 1777277041.659662, 'has_photos': True, 'auction_closing_time': 1777391395.0}
2026-04-27 08:04:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8c4cb04e-fa69-5de2-b7e9-31be35d7f9d0 with identifier: EJ49197
2026-04-27 08:04:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8c4cb04e-fa69-5de2-b7e9-31be35d7f9d0 with identifier: EJ49197
2026-04-27 08:04:01 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 8c4cb04e-fa69-5de2-b7e9-31be35d7f9d0 with identifier: EJ49197 to the API
2026-04-27 08:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:01 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:01 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'category': None,
 'city': 'Pau',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 110,
 'expiration_date': '2026-04-28T15:27:30Z',
 'fuel_type': 'diesel',
 'id': '8c4cb04e-fa69-5de2-b7e9-31be35d7f9d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 43.3112,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EJ49197',
 'listing': 'auction',
 'location': 'Pau',
 'location_confidence': 'geocoded',
 'longitude': -0.3558,
 'make': 'Citroen',
 'model': 'C4',
 'odometer': 72752,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img3c/b6/3cb62a1e87add096b6810356c64d69be/pa/EJ49197_a0a803c9d747dde12f680d05371366df.jpg',
                'https://img-pa.auto1.com/img3c/b6/3cb62a1e87add096b6810356c64d69be/pa/EJ49197_ddc18633bbdcb569ad268a8e32c06ec7.jpg',
                'https://img-pa.auto1.com/img3c/b6/3cb62a1e87add096b6810356c64d69be/pa/EJ49197_aab0b7c0ff4569bb6b04b1418f1b617c.jpg',
                'https://img-pa.auto1.com/img3c/b6/3cb62a1e87add096b6810356c64d69be/pa/EJ49197_7ce19db607ae8cffd5917da52f2194fc.jpg',
                'https://img-pa.auto1.com/img3c/b6/3cb62a1e87add096b6810356c64d69be/pa/EJ49197_99f9f95f2a12d0961868cc01ae58607e.jpg',
                'https://img-pa.auto1.com/img3c/b6/3cb62a1e87add096b6810356c64d69be/pa/EJ49197_be6d9eb754b1073420a876ba621e32d4.jpg',
                'https://img-pa.auto1.com/img3c/b6/3cb62a1e87add096b6810356c64d69be/pa/EJ49197_4466f450c6ae48271df0b9fab7a9c63e.jpg',
                'https://img-pa.auto1.com/img3c/b6/3cb62a1e87add096b6810356c64d69be/pa/EJ49197_d3c523ac5359118eafde6c4a8f62d5ac.jpg',
                'https://img-pa.auto1.com/img3c/b6/3cb62a1e87add096b6810356c64d69be/pa/EJ49197_72fe04dab09493e39da443332a3e6002.jpg',
                'https://img-pa.auto1.com/img3c/b6/3cb62a1e87add096b6810356c64d69be/pa/EJ49197_bd10471e6a1c97d89d450460ac7daa4f.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8c4cb04e-fa69-5de2-b7e9-31be35d7f9d0/8c4cb04e-fa69-5de2-b7e9-31be35d7f9d0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66884,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/b6/3cb62a1e87add096b6810356c64d69be/pa/EJ49197_99f9f95f2a12d0961868cc01ae58607e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8c4cb04e-fa69-5de2-b7e9-31be35d7f9d0/8c4cb04e-fa69-5de2-b7e9-31be35d7f9d0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70623,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/b6/3cb62a1e87add096b6810356c64d69be/pa/EJ49197_be6d9eb754b1073420a876ba621e32d4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8c4cb04e-fa69-5de2-b7e9-31be35d7f9d0/8c4cb04e-fa69-5de2-b7e9-31be35d7f9d0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69779,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/b6/3cb62a1e87add096b6810356c64d69be/pa/EJ49197_4466f450c6ae48271df0b9fab7a9c63e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8c4cb04e-fa69-5de2-b7e9-31be35d7f9d0/8c4cb04e-fa69-5de2-b7e9-31be35d7f9d0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73582,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/b6/3cb62a1e87add096b6810356c64d69be/pa/EJ49197_d3c523ac5359118eafde6c4a8f62d5ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8c4cb04e-fa69-5de2-b7e9-31be35d7f9d0/8c4cb04e-fa69-5de2-b7e9-31be35d7f9d0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69525,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/b6/3cb62a1e87add096b6810356c64d69be/pa/EJ49197_72fe04dab09493e39da443332a3e6002.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8c4cb04e-fa69-5de2-b7e9-31be35d7f9d0/8c4cb04e-fa69-5de2-b7e9-31be35d7f9d0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2598161,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/b6/3cb62a1e87add096b6810356c64d69be/pa/EJ49197_bd10471e6a1c97d89d450460ac7daa4f.jpg',
             'Width': 2048}],
 'postal_code': '64000',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Pyrénées-Atlantiques',
 'province_code': 'FR-64',
 'region': 'Nouvelle-Aquitaine',
 'region_code': 'FR-75',
 'registration_date': '2012-07-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C4 1.6 HDi Confort',
 'transmission': 'automatic',
 'trim': 'Confort',
 'year': 2012}
2026-04-27 08:04:01 [auto1.fr] INFO: Saving data for EJ49197: {'created_time': 1777277041.981022, 'last_price_update_time': 1777277041.981035, 'has_photos': True, 'auction_closing_time': 1777390050.0}
2026-04-27 08:04:01 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item f91721f0-48b9-5dfb-9a19-70f67d1c033f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:04:02 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item 8c4cb04e-fa69-5de2-b7e9-31be35d7f9d0 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:04:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WA76064/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NL98546/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VK19723> (referer: https://www.auto1.com/v1/car-details-view/VK19723/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EE30564/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 614e029a-3393-5243-a34a-0698efb1a5a0 with identifier: VK19723
2026-04-27 08:04:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 614e029a-3393-5243-a34a-0698efb1a5a0 with scrape type 1
2026-04-27 08:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 614e029a-3393-5243-a34a-0698efb1a5a0
2026-04-27 08:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/f2/9df2109d091e802372d0ca3fc2666e62/pa/VK19723_859f34bdc2d9e497bc6bbd1a236e7154.jpg not downloaded yet
2026-04-27 08:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/f2/9df2109d091e802372d0ca3fc2666e62/pa/VK19723_d5485c9f47207b55a7a10d7c0255cef2.jpg not downloaded yet
2026-04-27 08:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/f2/9df2109d091e802372d0ca3fc2666e62/pa/VK19723_68b7505854d130a3b8383b171f641bf1.jpg not downloaded yet
2026-04-27 08:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/f2/9df2109d091e802372d0ca3fc2666e62/pa/VK19723_eda61597b0f048ac61cf537502182d77.jpg not downloaded yet
2026-04-27 08:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/f2/9df2109d091e802372d0ca3fc2666e62/pa/VK19723_65dcd20840758ddc382a59b64aabec72.jpg not downloaded yet
2026-04-27 08:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/f2/9df2109d091e802372d0ca3fc2666e62/pa/VK19723_fd46411f8004bd3e13867b6843508090.jpg not downloaded yet
2026-04-27 08:04:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AX86714> (referer: https://www.auto1.com/v1/car-details-view/AX86714/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b38e7e2-8ab8-5666-958c-2b6b5c2bef02 with identifier: AX86714
2026-04-27 08:04:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b38e7e2-8ab8-5666-958c-2b6b5c2bef02 with scrape type 1
2026-04-27 08:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 6b38e7e2-8ab8-5666-958c-2b6b5c2bef02
2026-04-27 08:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/47/0047ab8c46f42325d8406ad5606b6804/pa/AX86714_8061d0af57112bc28b7a5b16ecd1b74f.jpg not downloaded yet
2026-04-27 08:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/47/0047ab8c46f42325d8406ad5606b6804/pa/AX86714_81a0e5e00164ca13454c5fbcd09c53f0.jpg not downloaded yet
2026-04-27 08:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/47/0047ab8c46f42325d8406ad5606b6804/pa/AX86714_c88738e4838dec1744dc3168fc500dd1.jpg not downloaded yet
2026-04-27 08:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/47/0047ab8c46f42325d8406ad5606b6804/pa/AX86714_0896ea56c11150d8819c58f6756c91c0.jpg not downloaded yet
2026-04-27 08:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/47/0047ab8c46f42325d8406ad5606b6804/pa/AX86714_1aaf1b908b868b87d2d88b75705dd9a7.jpg not downloaded yet
2026-04-27 08:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/47/0047ab8c46f42325d8406ad5606b6804/pa/AX86714_cc972da0f02342bcaf4ee39dd8d302bc.jpg not downloaded yet
2026-04-27 08:04:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KV97324> (referer: https://www.auto1.com/v1/car-details-view/KV97324/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53793aa7-42ae-50b0-9503-2213190ad0ee with identifier: KV97324
2026-04-27 08:04:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53793aa7-42ae-50b0-9503-2213190ad0ee with scrape type 1
2026-04-27 08:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 53793aa7-42ae-50b0-9503-2213190ad0ee
2026-04-27 08:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/1e/261e305f8377a41547dd9d02116e0a6c/pa/KV97324_f4bf692acaf06313313c44866b9af4d3.jpg not downloaded yet
2026-04-27 08:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/1e/261e305f8377a41547dd9d02116e0a6c/pa/KV97324_e88ed0385c00a7aed3ff78b54c01dbcb.jpg not downloaded yet
2026-04-27 08:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/1e/261e305f8377a41547dd9d02116e0a6c/pa/KV97324_f685bf540305a9369eb7dec9c598d4a9.jpg not downloaded yet
2026-04-27 08:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/1e/261e305f8377a41547dd9d02116e0a6c/pa/KV97324_90e95d5757d8b5cad91fa90097a56833.jpg not downloaded yet
2026-04-27 08:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/1e/261e305f8377a41547dd9d02116e0a6c/pa/KV97324_b454fcd8fe891052cf131b750e4bc06a.jpg not downloaded yet
2026-04-27 08:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/1e/261e305f8377a41547dd9d02116e0a6c/pa/KV97324_70055a4c22c570306218158aeeff07cb.jpg not downloaded yet
2026-04-27 08:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/47/0047ab8c46f42325d8406ad5606b6804/pa/AX86714_cc972da0f02342bcaf4ee39dd8d302bc.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/1e/261e305f8377a41547dd9d02116e0a6c/pa/KV97324_7188a7650f4e1c7d80740003e7cb2fd1.jpg not downloaded yet
2026-04-27 08:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/1e/261e305f8377a41547dd9d02116e0a6c/pa/KV97324_ee002da804a51bc6d5308f3028cb9250.jpg not downloaded yet
2026-04-27 08:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/1e/261e305f8377a41547dd9d02116e0a6c/pa/KV97324_531c181d771217288ef75d9f8a5b6531.jpg not downloaded yet
2026-04-27 08:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/1e/261e305f8377a41547dd9d02116e0a6c/pa/KV97324_3aad73f0ada1727b4a0f5b39dedfd25d.jpg not downloaded yet
2026-04-27 08:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/1e/261e305f8377a41547dd9d02116e0a6c/pa/KV97324_70055a4c22c570306218158aeeff07cb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1439c77310>
2026-04-27 08:04:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b38e7e2-8ab8-5666-958c-2b6b5c2bef02/6b38e7e2-8ab8-5666-958c-2b6b5c2bef02_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/47/0047ab8c46f42325d8406ad5606b6804/pa/AX86714_cc972da0f02342bcaf4ee39dd8d302bc.jpg saved to cache
2026-04-27 08:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6b38e7e2-8ab8-5666-958c-2b6b5c2bef02
2026-04-27 08:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/1e/261e305f8377a41547dd9d02116e0a6c/pa/KV97324_3aad73f0ada1727b4a0f5b39dedfd25d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/1e/261e305f8377a41547dd9d02116e0a6c/pa/KV97324_531c181d771217288ef75d9f8a5b6531.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438cdf010>
2026-04-27 08:04:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53793aa7-42ae-50b0-9503-2213190ad0ee/53793aa7-42ae-50b0-9503-2213190ad0ee_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/1e/261e305f8377a41547dd9d02116e0a6c/pa/KV97324_70055a4c22c570306218158aeeff07cb.jpg saved to cache
2026-04-27 08:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 53793aa7-42ae-50b0-9503-2213190ad0ee
2026-04-27 08:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/1e/261e305f8377a41547dd9d02116e0a6c/pa/KV97324_ee002da804a51bc6d5308f3028cb9250.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1439c761d0>
2026-04-27 08:04:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53793aa7-42ae-50b0-9503-2213190ad0ee/53793aa7-42ae-50b0-9503-2213190ad0ee_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/1e/261e305f8377a41547dd9d02116e0a6c/pa/KV97324_3aad73f0ada1727b4a0f5b39dedfd25d.jpg saved to cache
2026-04-27 08:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 53793aa7-42ae-50b0-9503-2213190ad0ee
2026-04-27 08:04:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438e03bd0>
2026-04-27 08:04:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53793aa7-42ae-50b0-9503-2213190ad0ee/53793aa7-42ae-50b0-9503-2213190ad0ee_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/1e/261e305f8377a41547dd9d02116e0a6c/pa/KV97324_531c181d771217288ef75d9f8a5b6531.jpg saved to cache
2026-04-27 08:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 53793aa7-42ae-50b0-9503-2213190ad0ee
2026-04-27 08:04:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b37cd0>
2026-04-27 08:04:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53793aa7-42ae-50b0-9503-2213190ad0ee/53793aa7-42ae-50b0-9503-2213190ad0ee_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/1e/261e305f8377a41547dd9d02116e0a6c/pa/KV97324_ee002da804a51bc6d5308f3028cb9250.jpg saved to cache
2026-04-27 08:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 53793aa7-42ae-50b0-9503-2213190ad0ee
2026-04-27 08:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/1e/261e305f8377a41547dd9d02116e0a6c/pa/KV97324_7188a7650f4e1c7d80740003e7cb2fd1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143818a350>
2026-04-27 08:04:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53793aa7-42ae-50b0-9503-2213190ad0ee/53793aa7-42ae-50b0-9503-2213190ad0ee_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/1e/261e305f8377a41547dd9d02116e0a6c/pa/KV97324_7188a7650f4e1c7d80740003e7cb2fd1.jpg saved to cache
2026-04-27 08:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 53793aa7-42ae-50b0-9503-2213190ad0ee
2026-04-27 08:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/1e/261e305f8377a41547dd9d02116e0a6c/pa/KV97324_b454fcd8fe891052cf131b750e4bc06a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/1e/261e305f8377a41547dd9d02116e0a6c/pa/KV97324_90e95d5757d8b5cad91fa90097a56833.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/1e/261e305f8377a41547dd9d02116e0a6c/pa/KV97324_f685bf540305a9369eb7dec9c598d4a9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438055a50>
2026-04-27 08:04:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53793aa7-42ae-50b0-9503-2213190ad0ee/53793aa7-42ae-50b0-9503-2213190ad0ee_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/1e/261e305f8377a41547dd9d02116e0a6c/pa/KV97324_b454fcd8fe891052cf131b750e4bc06a.jpg saved to cache
2026-04-27 08:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 53793aa7-42ae-50b0-9503-2213190ad0ee
2026-04-27 08:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/1e/261e305f8377a41547dd9d02116e0a6c/pa/KV97324_e88ed0385c00a7aed3ff78b54c01dbcb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143820d9d0>
2026-04-27 08:04:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53793aa7-42ae-50b0-9503-2213190ad0ee/53793aa7-42ae-50b0-9503-2213190ad0ee_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/1e/261e305f8377a41547dd9d02116e0a6c/pa/KV97324_90e95d5757d8b5cad91fa90097a56833.jpg saved to cache
2026-04-27 08:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 53793aa7-42ae-50b0-9503-2213190ad0ee
2026-04-27 08:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/1e/261e305f8377a41547dd9d02116e0a6c/pa/KV97324_f4bf692acaf06313313c44866b9af4d3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380a4050>
2026-04-27 08:04:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53793aa7-42ae-50b0-9503-2213190ad0ee/53793aa7-42ae-50b0-9503-2213190ad0ee_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/1e/261e305f8377a41547dd9d02116e0a6c/pa/KV97324_f685bf540305a9369eb7dec9c598d4a9.jpg saved to cache
2026-04-27 08:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 53793aa7-42ae-50b0-9503-2213190ad0ee
2026-04-27 08:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380bb790>
2026-04-27 08:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53793aa7-42ae-50b0-9503-2213190ad0ee/53793aa7-42ae-50b0-9503-2213190ad0ee_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/1e/261e305f8377a41547dd9d02116e0a6c/pa/KV97324_e88ed0385c00a7aed3ff78b54c01dbcb.jpg saved to cache
2026-04-27 08:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 53793aa7-42ae-50b0-9503-2213190ad0ee
2026-04-27 08:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143ade4850>
2026-04-27 08:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53793aa7-42ae-50b0-9503-2213190ad0ee/53793aa7-42ae-50b0-9503-2213190ad0ee_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/1e/261e305f8377a41547dd9d02116e0a6c/pa/KV97324_f4bf692acaf06313313c44866b9af4d3.jpg saved to cache
2026-04-27 08:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 53793aa7-42ae-50b0-9503-2213190ad0ee
2026-04-27 08:04:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 53793aa7-42ae-50b0-9503-2213190ad0ee, skipping ID generation
2026-04-27 08:04:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53793aa7-42ae-50b0-9503-2213190ad0ee with scrape type 1
2026-04-27 08:04:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 53793aa7-42ae-50b0-9503-2213190ad0ee sending to next pipeline
2026-04-27 08:04:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 53793aa7-42ae-50b0-9503-2213190ad0ee, identifier: KV97324
2026-04-27 08:04:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 53793aa7-42ae-50b0-9503-2213190ad0ee with identifier: KV97324
2026-04-27 08:04:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 53793aa7-42ae-50b0-9503-2213190ad0ee with identifier: KV97324
2026-04-27 08:04:07 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 53793aa7-42ae-50b0-9503-2213190ad0ee with identifier: KV97324 to the API
2026-04-27 08:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:07 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img26/1e/261e305f8377a41547dd9d02116e0a6c/pa/KV97324_f4bf692acaf06313313c44866b9af4d3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'category': None,
 'city': 'Villenoy',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 125,
 'expiration_date': '2026-04-28T15:38:56Z',
 'fuel_type': 'petrol',
 'id': '53793aa7-42ae-50b0-9503-2213190ad0ee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.9411,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV97324',
 'listing': 'auction',
 'location': 'FR, Villenoy',
 'location_confidence': 'geocoded',
 'longitude': 2.8602,
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 39442,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_53793aa7-42ae-50b0-9503-2213190ad0ee/53793aa7-42ae-50b0-9503-2213190ad0ee_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71333,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/1e/261e305f8377a41547dd9d02116e0a6c/pa/KV97324_f4bf692acaf06313313c44866b9af4d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_53793aa7-42ae-50b0-9503-2213190ad0ee/53793aa7-42ae-50b0-9503-2213190ad0ee_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70299,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/1e/261e305f8377a41547dd9d02116e0a6c/pa/KV97324_e88ed0385c00a7aed3ff78b54c01dbcb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_53793aa7-42ae-50b0-9503-2213190ad0ee/53793aa7-42ae-50b0-9503-2213190ad0ee_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64076,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/1e/261e305f8377a41547dd9d02116e0a6c/pa/KV97324_f685bf540305a9369eb7dec9c598d4a9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_53793aa7-42ae-50b0-9503-2213190ad0ee/53793aa7-42ae-50b0-9503-2213190ad0ee_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64335,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/1e/261e305f8377a41547dd9d02116e0a6c/pa/KV97324_90e95d5757d8b5cad91fa90097a56833.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_53793aa7-42ae-50b0-9503-2213190ad0ee/53793aa7-42ae-50b0-9503-2213190ad0ee_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54466,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/1e/261e305f8377a41547dd9d02116e0a6c/pa/KV97324_b454fcd8fe891052cf131b750e4bc06a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_53793aa7-42ae-50b0-9503-2213190ad0ee/53793aa7-42ae-50b0-9503-2213190ad0ee_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68419,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/1e/261e305f8377a41547dd9d02116e0a6c/pa/KV97324_70055a4c22c570306218158aeeff07cb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_53793aa7-42ae-50b0-9503-2213190ad0ee/53793aa7-42ae-50b0-9503-2213190ad0ee_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62597,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/1e/261e305f8377a41547dd9d02116e0a6c/pa/KV97324_7188a7650f4e1c7d80740003e7cb2fd1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_53793aa7-42ae-50b0-9503-2213190ad0ee/53793aa7-42ae-50b0-9503-2213190ad0ee_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66604,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/1e/261e305f8377a41547dd9d02116e0a6c/pa/KV97324_ee002da804a51bc6d5308f3028cb9250.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_53793aa7-42ae-50b0-9503-2213190ad0ee/53793aa7-42ae-50b0-9503-2213190ad0ee_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63587,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/1e/261e305f8377a41547dd9d02116e0a6c/pa/KV97324_531c181d771217288ef75d9f8a5b6531.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_53793aa7-42ae-50b0-9503-2213190ad0ee/53793aa7-42ae-50b0-9503-2213190ad0ee_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59689,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/1e/261e305f8377a41547dd9d02116e0a6c/pa/KV97324_3aad73f0ada1727b4a0f5b39dedfd25d.jpg',
             'Width': 800}],
 'postal_code': '77124',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Seine-et-Marne',
 'province_code': 'FR-77',
 'region': 'Île-de-France',
 'region_code': 'FR-11',
 'registration_date': '2015-10-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A1 Sportback 1.4 TFSI Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2015}
2026-04-27 08:04:07 [auto1.fr] INFO: Saving data for KV97324: {'created_time': 1777277047.691448, 'last_price_update_time': 1777277047.691459, 'has_photos': True, 'auction_closing_time': 1777390736.0}
2026-04-27 08:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/47/0047ab8c46f42325d8406ad5606b6804/pa/AX86714_1aaf1b908b868b87d2d88b75705dd9a7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MS72274/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XD98518/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/47/0047ab8c46f42325d8406ad5606b6804/pa/AX86714_0896ea56c11150d8819c58f6756c91c0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/47/0047ab8c46f42325d8406ad5606b6804/pa/AX86714_8061d0af57112bc28b7a5b16ecd1b74f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b36c50>
2026-04-27 08:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b38e7e2-8ab8-5666-958c-2b6b5c2bef02/6b38e7e2-8ab8-5666-958c-2b6b5c2bef02_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/47/0047ab8c46f42325d8406ad5606b6804/pa/AX86714_1aaf1b908b868b87d2d88b75705dd9a7.jpg saved to cache
2026-04-27 08:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6b38e7e2-8ab8-5666-958c-2b6b5c2bef02
2026-04-27 08:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f144781cc10>
2026-04-27 08:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b38e7e2-8ab8-5666-958c-2b6b5c2bef02/6b38e7e2-8ab8-5666-958c-2b6b5c2bef02_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/47/0047ab8c46f42325d8406ad5606b6804/pa/AX86714_0896ea56c11150d8819c58f6756c91c0.jpg saved to cache
2026-04-27 08:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6b38e7e2-8ab8-5666-958c-2b6b5c2bef02
2026-04-27 08:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438fb6f10>
2026-04-27 08:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b38e7e2-8ab8-5666-958c-2b6b5c2bef02/6b38e7e2-8ab8-5666-958c-2b6b5c2bef02_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/47/0047ab8c46f42325d8406ad5606b6804/pa/AX86714_8061d0af57112bc28b7a5b16ecd1b74f.jpg saved to cache
2026-04-27 08:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6b38e7e2-8ab8-5666-958c-2b6b5c2bef02
2026-04-27 08:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/f2/9df2109d091e802372d0ca3fc2666e62/pa/VK19723_fd46411f8004bd3e13867b6843508090.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d36f10>
2026-04-27 08:04:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_614e029a-3393-5243-a34a-0698efb1a5a0/614e029a-3393-5243-a34a-0698efb1a5a0_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/f2/9df2109d091e802372d0ca3fc2666e62/pa/VK19723_fd46411f8004bd3e13867b6843508090.jpg saved to cache
2026-04-27 08:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 614e029a-3393-5243-a34a-0698efb1a5a0
2026-04-27 08:04:08 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item 6b38e7e2-8ab8-5666-958c-2b6b5c2bef02 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:04:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6b38e7e2-8ab8-5666-958c-2b6b5c2bef02 with identifier: AX86714
2026-04-27 08:04:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6b38e7e2-8ab8-5666-958c-2b6b5c2bef02 with identifier: AX86714
2026-04-27 08:04:08 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6b38e7e2-8ab8-5666-958c-2b6b5c2bef02 with identifier: AX86714 to the API
2026-04-27 08:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:09 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:09 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': 199,
 'category': None,
 'city': 'Beaucaire',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 4',
 'engine': '2.2L',
 'engine_horse_power': 170,
 'expiration_date': '2026-04-28T15:35:36Z',
 'fuel_type': 'diesel',
 'id': '6b38e7e2-8ab8-5666-958c-2b6b5c2bef02',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 43.8081,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AX86714',
 'listing': 'auction',
 'location': 'FR, Beaucaire',
 'location_confidence': 'geocoded',
 'longitude': 4.6442,
 'make': 'Citroen',
 'model': 'C6',
 'odometer': 271428,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/img00/47/0047ab8c46f42325d8406ad5606b6804/pa/AX86714_8061d0af57112bc28b7a5b16ecd1b74f.jpg',
                'https://img-pa.auto1.com/img00/47/0047ab8c46f42325d8406ad5606b6804/pa/AX86714_81a0e5e00164ca13454c5fbcd09c53f0.jpg',
                'https://img-pa.auto1.com/img00/47/0047ab8c46f42325d8406ad5606b6804/pa/AX86714_c88738e4838dec1744dc3168fc500dd1.jpg',
                'https://img-pa.auto1.com/img00/47/0047ab8c46f42325d8406ad5606b6804/pa/AX86714_0896ea56c11150d8819c58f6756c91c0.jpg',
                'https://img-pa.auto1.com/img00/47/0047ab8c46f42325d8406ad5606b6804/pa/AX86714_1aaf1b908b868b87d2d88b75705dd9a7.jpg',
                'https://img-pa.auto1.com/img00/47/0047ab8c46f42325d8406ad5606b6804/pa/AX86714_cc972da0f02342bcaf4ee39dd8d302bc.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6b38e7e2-8ab8-5666-958c-2b6b5c2bef02/6b38e7e2-8ab8-5666-958c-2b6b5c2bef02_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75371,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/47/0047ab8c46f42325d8406ad5606b6804/pa/AX86714_8061d0af57112bc28b7a5b16ecd1b74f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6b38e7e2-8ab8-5666-958c-2b6b5c2bef02/6b38e7e2-8ab8-5666-958c-2b6b5c2bef02_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55919,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/47/0047ab8c46f42325d8406ad5606b6804/pa/AX86714_0896ea56c11150d8819c58f6756c91c0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6b38e7e2-8ab8-5666-958c-2b6b5c2bef02/6b38e7e2-8ab8-5666-958c-2b6b5c2bef02_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62863,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/47/0047ab8c46f42325d8406ad5606b6804/pa/AX86714_1aaf1b908b868b87d2d88b75705dd9a7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6b38e7e2-8ab8-5666-958c-2b6b5c2bef02/6b38e7e2-8ab8-5666-958c-2b6b5c2bef02_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39310,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/47/0047ab8c46f42325d8406ad5606b6804/pa/AX86714_cc972da0f02342bcaf4ee39dd8d302bc.jpg',
             'Width': 800}],
 'postal_code': '30300',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Gard',
 'province_code': 'FR-30',
 'region': 'Occitanie',
 'region_code': 'FR-76',
 'registration_date': '2008-09-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C6 2.2 HDi BiTurbo',
 'transmission': 'automatic',
 'trim': '',
 'year': 2008}
2026-04-27 08:04:09 [auto1.fr] INFO: Saving data for AX86714: {'created_time': 1777277049.15166, 'last_price_update_time': 1777277049.15167, 'has_photos': True, 'auction_closing_time': 1777390536.0}
2026-04-27 08:04:09 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 6b38e7e2-8ab8-5666-958c-2b6b5c2bef02 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/f2/9df2109d091e802372d0ca3fc2666e62/pa/VK19723_65dcd20840758ddc382a59b64aabec72.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438bfd350>
2026-04-27 08:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_614e029a-3393-5243-a34a-0698efb1a5a0/614e029a-3393-5243-a34a-0698efb1a5a0_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/f2/9df2109d091e802372d0ca3fc2666e62/pa/VK19723_65dcd20840758ddc382a59b64aabec72.jpg saved to cache
2026-04-27 08:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 614e029a-3393-5243-a34a-0698efb1a5a0
2026-04-27 08:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/f2/9df2109d091e802372d0ca3fc2666e62/pa/VK19723_eda61597b0f048ac61cf537502182d77.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438cb9c50>
2026-04-27 08:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_614e029a-3393-5243-a34a-0698efb1a5a0/614e029a-3393-5243-a34a-0698efb1a5a0_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/f2/9df2109d091e802372d0ca3fc2666e62/pa/VK19723_eda61597b0f048ac61cf537502182d77.jpg saved to cache
2026-04-27 08:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 614e029a-3393-5243-a34a-0698efb1a5a0
2026-04-27 08:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/f2/9df2109d091e802372d0ca3fc2666e62/pa/VK19723_68b7505854d130a3b8383b171f641bf1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438cb82d0>
2026-04-27 08:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_614e029a-3393-5243-a34a-0698efb1a5a0/614e029a-3393-5243-a34a-0698efb1a5a0_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/f2/9df2109d091e802372d0ca3fc2666e62/pa/VK19723_68b7505854d130a3b8383b171f641bf1.jpg saved to cache
2026-04-27 08:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 614e029a-3393-5243-a34a-0698efb1a5a0
2026-04-27 08:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/f2/9df2109d091e802372d0ca3fc2666e62/pa/VK19723_d5485c9f47207b55a7a10d7c0255cef2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/f2/9df2109d091e802372d0ca3fc2666e62/pa/VK19723_859f34bdc2d9e497bc6bbd1a236e7154.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380bac10>
2026-04-27 08:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_614e029a-3393-5243-a34a-0698efb1a5a0/614e029a-3393-5243-a34a-0698efb1a5a0_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/f2/9df2109d091e802372d0ca3fc2666e62/pa/VK19723_d5485c9f47207b55a7a10d7c0255cef2.jpg saved to cache
2026-04-27 08:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 614e029a-3393-5243-a34a-0698efb1a5a0
2026-04-27 08:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438cba250>
2026-04-27 08:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_614e029a-3393-5243-a34a-0698efb1a5a0/614e029a-3393-5243-a34a-0698efb1a5a0_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/f2/9df2109d091e802372d0ca3fc2666e62/pa/VK19723_859f34bdc2d9e497bc6bbd1a236e7154.jpg saved to cache
2026-04-27 08:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 614e029a-3393-5243-a34a-0698efb1a5a0
2026-04-27 08:04:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 614e029a-3393-5243-a34a-0698efb1a5a0, skipping ID generation
2026-04-27 08:04:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 614e029a-3393-5243-a34a-0698efb1a5a0 with scrape type 1
2026-04-27 08:04:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 614e029a-3393-5243-a34a-0698efb1a5a0 sending to next pipeline
2026-04-27 08:04:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 614e029a-3393-5243-a34a-0698efb1a5a0, identifier: VK19723
2026-04-27 08:04:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 614e029a-3393-5243-a34a-0698efb1a5a0 with identifier: VK19723
2026-04-27 08:04:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 614e029a-3393-5243-a34a-0698efb1a5a0 with identifier: VK19723
2026-04-27 08:04:10 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 614e029a-3393-5243-a34a-0698efb1a5a0 with identifier: VK19723 to the API
2026-04-27 08:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:10 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img9d/f2/9df2109d091e802372d0ca3fc2666e62/pa/VK19723_859f34bdc2d9e497bc6bbd1a236e7154.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'category': None,
 'city': 'Beaucaire',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 68,
 'expiration_date': '2026-04-28T15:46:53Z',
 'fuel_type': 'diesel',
 'id': '614e029a-3393-5243-a34a-0698efb1a5a0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 43.8081,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VK19723',
 'listing': 'auction',
 'location': 'FR, Beaucaire',
 'location_confidence': 'geocoded',
 'longitude': 4.6442,
 'make': 'Peugeot',
 'model': '206+',
 'odometer': 165186,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_614e029a-3393-5243-a34a-0698efb1a5a0/614e029a-3393-5243-a34a-0698efb1a5a0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74429,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/f2/9df2109d091e802372d0ca3fc2666e62/pa/VK19723_859f34bdc2d9e497bc6bbd1a236e7154.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_614e029a-3393-5243-a34a-0698efb1a5a0/614e029a-3393-5243-a34a-0698efb1a5a0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68329,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/f2/9df2109d091e802372d0ca3fc2666e62/pa/VK19723_d5485c9f47207b55a7a10d7c0255cef2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_614e029a-3393-5243-a34a-0698efb1a5a0/614e029a-3393-5243-a34a-0698efb1a5a0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74497,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/f2/9df2109d091e802372d0ca3fc2666e62/pa/VK19723_68b7505854d130a3b8383b171f641bf1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_614e029a-3393-5243-a34a-0698efb1a5a0/614e029a-3393-5243-a34a-0698efb1a5a0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56662,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/f2/9df2109d091e802372d0ca3fc2666e62/pa/VK19723_eda61597b0f048ac61cf537502182d77.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_614e029a-3393-5243-a34a-0698efb1a5a0/614e029a-3393-5243-a34a-0698efb1a5a0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80151,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/f2/9df2109d091e802372d0ca3fc2666e62/pa/VK19723_65dcd20840758ddc382a59b64aabec72.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_614e029a-3393-5243-a34a-0698efb1a5a0/614e029a-3393-5243-a34a-0698efb1a5a0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41869,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/f2/9df2109d091e802372d0ca3fc2666e62/pa/VK19723_fd46411f8004bd3e13867b6843508090.jpg',
             'Width': 800}],
 'postal_code': '30300',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Gard',
 'province_code': 'FR-30',
 'region': 'Occitanie',
 'region_code': 'FR-76',
 'registration_date': '2011-01-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 206+ 1.4 HDi Trendy',
 'transmission': 'manual',
 'trim': 'Trendy',
 'year': 2011}
2026-04-27 08:04:10 [auto1.fr] INFO: Saving data for VK19723: {'created_time': 1777277050.266579, 'last_price_update_time': 1777277050.266589, 'has_photos': True, 'auction_closing_time': 1777391213.0}
2026-04-27 08:04:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MZ95816/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LP40212> (referer: https://www.auto1.com/v1/car-details-view/LP40212/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 244c45d6-1901-5f0a-9f33-8c40ffcd72cf with identifier: LP40212
2026-04-27 08:04:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 244c45d6-1901-5f0a-9f33-8c40ffcd72cf with scrape type 1
2026-04-27 08:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 244c45d6-1901-5f0a-9f33-8c40ffcd72cf
2026-04-27 08:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/89/338962503fc88955a51ffcf7fc66eafa/pa/LP40212_e0423ace02681b91c2d5bea1161a102f.jpg not downloaded yet
2026-04-27 08:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/89/338962503fc88955a51ffcf7fc66eafa/pa/LP40212_fc0349e6fb719312c88502b03968fb6f.jpg not downloaded yet
2026-04-27 08:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/89/338962503fc88955a51ffcf7fc66eafa/pa/LP40212_17b9406b7230f9d03ff59902277802ea.jpg not downloaded yet
2026-04-27 08:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/89/338962503fc88955a51ffcf7fc66eafa/pa/LP40212_a049cc4d724abceefe1df548116434bf.jpg not downloaded yet
2026-04-27 08:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/89/338962503fc88955a51ffcf7fc66eafa/pa/LP40212_ab534779328529a3452631645da1f11d.jpg not downloaded yet
2026-04-27 08:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/89/338962503fc88955a51ffcf7fc66eafa/pa/LP40212_b73c42d94074f460ef85ac630cba4ff6.jpg not downloaded yet
2026-04-27 08:04:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UM47720/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GT31591/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/89/338962503fc88955a51ffcf7fc66eafa/pa/LP40212_b73c42d94074f460ef85ac630cba4ff6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438171710>
2026-04-27 08:04:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_244c45d6-1901-5f0a-9f33-8c40ffcd72cf/244c45d6-1901-5f0a-9f33-8c40ffcd72cf_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/89/338962503fc88955a51ffcf7fc66eafa/pa/LP40212_b73c42d94074f460ef85ac630cba4ff6.jpg saved to cache
2026-04-27 08:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 244c45d6-1901-5f0a-9f33-8c40ffcd72cf
2026-04-27 08:04:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/89/338962503fc88955a51ffcf7fc66eafa/pa/LP40212_ab534779328529a3452631645da1f11d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c39690>
2026-04-27 08:04:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_244c45d6-1901-5f0a-9f33-8c40ffcd72cf/244c45d6-1901-5f0a-9f33-8c40ffcd72cf_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/89/338962503fc88955a51ffcf7fc66eafa/pa/LP40212_ab534779328529a3452631645da1f11d.jpg saved to cache
2026-04-27 08:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 244c45d6-1901-5f0a-9f33-8c40ffcd72cf
2026-04-27 08:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CZ28253/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/89/338962503fc88955a51ffcf7fc66eafa/pa/LP40212_a049cc4d724abceefe1df548116434bf.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438fb6590>
2026-04-27 08:04:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_244c45d6-1901-5f0a-9f33-8c40ffcd72cf/244c45d6-1901-5f0a-9f33-8c40ffcd72cf_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/89/338962503fc88955a51ffcf7fc66eafa/pa/LP40212_a049cc4d724abceefe1df548116434bf.jpg saved to cache
2026-04-27 08:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 244c45d6-1901-5f0a-9f33-8c40ffcd72cf
2026-04-27 08:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NL98546> (referer: https://www.auto1.com/v1/car-details-view/NL98546/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3d36fac-7e85-5b77-bc16-54c41706edca with identifier: NL98546
2026-04-27 08:04:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3d36fac-7e85-5b77-bc16-54c41706edca with scrape type 1
2026-04-27 08:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item d3d36fac-7e85-5b77-bc16-54c41706edca
2026-04-27 08:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/5b/105b5e79d3c00062c3b7a9bc7b01001f/pa/NL98546_48c4edb71ffdfca2b5a4f48a37fe1146.jpg not downloaded yet
2026-04-27 08:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/5b/105b5e79d3c00062c3b7a9bc7b01001f/pa/NL98546_af543ea29f80995a04dd5878f1ca0aad.jpg not downloaded yet
2026-04-27 08:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/5b/105b5e79d3c00062c3b7a9bc7b01001f/pa/NL98546_a2dacbfdb84991d4de03364ccd53afd1.jpg not downloaded yet
2026-04-27 08:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/5b/105b5e79d3c00062c3b7a9bc7b01001f/pa/NL98546_0425915b505977ff8b5ae7361f849fbc.jpg not downloaded yet
2026-04-27 08:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/89/338962503fc88955a51ffcf7fc66eafa/pa/LP40212_17b9406b7230f9d03ff59902277802ea.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/5b/105b5e79d3c00062c3b7a9bc7b01001f/pa/NL98546_a2d349c1e30c70e62769221098c1be74.jpg not downloaded yet
2026-04-27 08:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/5b/105b5e79d3c00062c3b7a9bc7b01001f/pa/NL98546_9280995e4f4cdfad63e9681c5042a65c.jpg not downloaded yet
2026-04-27 08:04:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438181390>
2026-04-27 08:04:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_244c45d6-1901-5f0a-9f33-8c40ffcd72cf/244c45d6-1901-5f0a-9f33-8c40ffcd72cf_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/89/338962503fc88955a51ffcf7fc66eafa/pa/LP40212_17b9406b7230f9d03ff59902277802ea.jpg saved to cache
2026-04-27 08:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 244c45d6-1901-5f0a-9f33-8c40ffcd72cf
2026-04-27 08:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WA76064> (referer: https://www.auto1.com/v1/car-details-view/WA76064/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/5b/105b5e79d3c00062c3b7a9bc7b01001f/pa/NL98546_a2dacbfdb84991d4de03364ccd53afd1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f908d25-8356-5799-89a1-a32c2e1515ab with identifier: WA76064
2026-04-27 08:04:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f908d25-8356-5799-89a1-a32c2e1515ab with scrape type 1
2026-04-27 08:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0f908d25-8356-5799-89a1-a32c2e1515ab
2026-04-27 08:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/16/5e163bd0a4e2ef7104490a3f3d63108d/pa/WA76064_ed7b37080a325f1b0b27686e6923be89.jpg not downloaded yet
2026-04-27 08:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/16/5e163bd0a4e2ef7104490a3f3d63108d/pa/WA76064_65166d55cb95b4d0511e3f02ebd25217.jpg not downloaded yet
2026-04-27 08:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/16/5e163bd0a4e2ef7104490a3f3d63108d/pa/WA76064_8246df51ceb48de88057d28de45e5902.jpg not downloaded yet
2026-04-27 08:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/16/5e163bd0a4e2ef7104490a3f3d63108d/pa/WA76064_6849a8ad9f642512eadb29b91e7485d1.jpg not downloaded yet
2026-04-27 08:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/16/5e163bd0a4e2ef7104490a3f3d63108d/pa/WA76064_4fcc49f051450157b6d6aa6e206e305d.jpg not downloaded yet
2026-04-27 08:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438fb75d0>
2026-04-27 08:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3d36fac-7e85-5b77-bc16-54c41706edca/d3d36fac-7e85-5b77-bc16-54c41706edca_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/5b/105b5e79d3c00062c3b7a9bc7b01001f/pa/NL98546_a2dacbfdb84991d4de03364ccd53afd1.jpg saved to cache
2026-04-27 08:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d3d36fac-7e85-5b77-bc16-54c41706edca
2026-04-27 08:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/16/5e163bd0a4e2ef7104490a3f3d63108d/pa/WA76064_c26690ec78ffa954be2f2402fb1af338.jpg not downloaded yet
2026-04-27 08:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/16/5e163bd0a4e2ef7104490a3f3d63108d/pa/WA76064_168c5a427a456263ba2ce0845abe22a0.jpg not downloaded yet
2026-04-27 08:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/16/5e163bd0a4e2ef7104490a3f3d63108d/pa/WA76064_3f13a8d7c01cd9271eac9769bfcbd415.jpg not downloaded yet
2026-04-27 08:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/16/5e163bd0a4e2ef7104490a3f3d63108d/pa/WA76064_9bf834a932b63bba1f849f8665ecc3b0.jpg not downloaded yet
2026-04-27 08:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/16/5e163bd0a4e2ef7104490a3f3d63108d/pa/WA76064_af6d02106fe42f65b20351193c19e848.jpg not downloaded yet
2026-04-27 08:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/5b/105b5e79d3c00062c3b7a9bc7b01001f/pa/NL98546_a2d349c1e30c70e62769221098c1be74.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/16/5e163bd0a4e2ef7104490a3f3d63108d/pa/WA76064_af6d02106fe42f65b20351193c19e848.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/16/5e163bd0a4e2ef7104490a3f3d63108d/pa/WA76064_9bf834a932b63bba1f849f8665ecc3b0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142be05710>
2026-04-27 08:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3d36fac-7e85-5b77-bc16-54c41706edca/d3d36fac-7e85-5b77-bc16-54c41706edca_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/5b/105b5e79d3c00062c3b7a9bc7b01001f/pa/NL98546_a2d349c1e30c70e62769221098c1be74.jpg saved to cache
2026-04-27 08:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d3d36fac-7e85-5b77-bc16-54c41706edca
2026-04-27 08:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/16/5e163bd0a4e2ef7104490a3f3d63108d/pa/WA76064_3f13a8d7c01cd9271eac9769bfcbd415.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c2ab50>
2026-04-27 08:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f908d25-8356-5799-89a1-a32c2e1515ab/0f908d25-8356-5799-89a1-a32c2e1515ab_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/16/5e163bd0a4e2ef7104490a3f3d63108d/pa/WA76064_af6d02106fe42f65b20351193c19e848.jpg saved to cache
2026-04-27 08:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0f908d25-8356-5799-89a1-a32c2e1515ab
2026-04-27 08:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d61b90>
2026-04-27 08:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f908d25-8356-5799-89a1-a32c2e1515ab/0f908d25-8356-5799-89a1-a32c2e1515ab_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/16/5e163bd0a4e2ef7104490a3f3d63108d/pa/WA76064_9bf834a932b63bba1f849f8665ecc3b0.jpg saved to cache
2026-04-27 08:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0f908d25-8356-5799-89a1-a32c2e1515ab
2026-04-27 08:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/16/5e163bd0a4e2ef7104490a3f3d63108d/pa/WA76064_168c5a427a456263ba2ce0845abe22a0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d348d0>
2026-04-27 08:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f908d25-8356-5799-89a1-a32c2e1515ab/0f908d25-8356-5799-89a1-a32c2e1515ab_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/16/5e163bd0a4e2ef7104490a3f3d63108d/pa/WA76064_3f13a8d7c01cd9271eac9769bfcbd415.jpg saved to cache
2026-04-27 08:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0f908d25-8356-5799-89a1-a32c2e1515ab
2026-04-27 08:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/16/5e163bd0a4e2ef7104490a3f3d63108d/pa/WA76064_c26690ec78ffa954be2f2402fb1af338.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438eb6cd0>
2026-04-27 08:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f908d25-8356-5799-89a1-a32c2e1515ab/0f908d25-8356-5799-89a1-a32c2e1515ab_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/16/5e163bd0a4e2ef7104490a3f3d63108d/pa/WA76064_168c5a427a456263ba2ce0845abe22a0.jpg saved to cache
2026-04-27 08:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0f908d25-8356-5799-89a1-a32c2e1515ab
2026-04-27 08:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/16/5e163bd0a4e2ef7104490a3f3d63108d/pa/WA76064_4fcc49f051450157b6d6aa6e206e305d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438eb5850>
2026-04-27 08:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f908d25-8356-5799-89a1-a32c2e1515ab/0f908d25-8356-5799-89a1-a32c2e1515ab_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/16/5e163bd0a4e2ef7104490a3f3d63108d/pa/WA76064_c26690ec78ffa954be2f2402fb1af338.jpg saved to cache
2026-04-27 08:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0f908d25-8356-5799-89a1-a32c2e1515ab
2026-04-27 08:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/16/5e163bd0a4e2ef7104490a3f3d63108d/pa/WA76064_6849a8ad9f642512eadb29b91e7485d1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/16/5e163bd0a4e2ef7104490a3f3d63108d/pa/WA76064_8246df51ceb48de88057d28de45e5902.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438180d10>
2026-04-27 08:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f908d25-8356-5799-89a1-a32c2e1515ab/0f908d25-8356-5799-89a1-a32c2e1515ab_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/16/5e163bd0a4e2ef7104490a3f3d63108d/pa/WA76064_4fcc49f051450157b6d6aa6e206e305d.jpg saved to cache
2026-04-27 08:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0f908d25-8356-5799-89a1-a32c2e1515ab
2026-04-27 08:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438eb5890>
2026-04-27 08:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f908d25-8356-5799-89a1-a32c2e1515ab/0f908d25-8356-5799-89a1-a32c2e1515ab_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/16/5e163bd0a4e2ef7104490a3f3d63108d/pa/WA76064_6849a8ad9f642512eadb29b91e7485d1.jpg saved to cache
2026-04-27 08:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0f908d25-8356-5799-89a1-a32c2e1515ab
2026-04-27 08:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142be0f710>
2026-04-27 08:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f908d25-8356-5799-89a1-a32c2e1515ab/0f908d25-8356-5799-89a1-a32c2e1515ab_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/16/5e163bd0a4e2ef7104490a3f3d63108d/pa/WA76064_8246df51ceb48de88057d28de45e5902.jpg saved to cache
2026-04-27 08:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0f908d25-8356-5799-89a1-a32c2e1515ab
2026-04-27 08:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/16/5e163bd0a4e2ef7104490a3f3d63108d/pa/WA76064_65166d55cb95b4d0511e3f02ebd25217.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/16/5e163bd0a4e2ef7104490a3f3d63108d/pa/WA76064_ed7b37080a325f1b0b27686e6923be89.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438addb90>
2026-04-27 08:04:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f908d25-8356-5799-89a1-a32c2e1515ab/0f908d25-8356-5799-89a1-a32c2e1515ab_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/16/5e163bd0a4e2ef7104490a3f3d63108d/pa/WA76064_65166d55cb95b4d0511e3f02ebd25217.jpg saved to cache
2026-04-27 08:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0f908d25-8356-5799-89a1-a32c2e1515ab
2026-04-27 08:04:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MS72274> (referer: https://www.auto1.com/v1/car-details-view/MS72274/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b35b10>
2026-04-27 08:04:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f908d25-8356-5799-89a1-a32c2e1515ab/0f908d25-8356-5799-89a1-a32c2e1515ab_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/16/5e163bd0a4e2ef7104490a3f3d63108d/pa/WA76064_ed7b37080a325f1b0b27686e6923be89.jpg saved to cache
2026-04-27 08:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0f908d25-8356-5799-89a1-a32c2e1515ab
2026-04-27 08:04:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0f908d25-8356-5799-89a1-a32c2e1515ab, skipping ID generation
2026-04-27 08:04:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f908d25-8356-5799-89a1-a32c2e1515ab with scrape type 1
2026-04-27 08:04:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0f908d25-8356-5799-89a1-a32c2e1515ab sending to next pipeline
2026-04-27 08:04:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0f908d25-8356-5799-89a1-a32c2e1515ab, identifier: WA76064
2026-04-27 08:04:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0f908d25-8356-5799-89a1-a32c2e1515ab with identifier: WA76064
2026-04-27 08:04:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0f908d25-8356-5799-89a1-a32c2e1515ab with identifier: WA76064
2026-04-27 08:04:19 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 0f908d25-8356-5799-89a1-a32c2e1515ab with identifier: WA76064 to the API
2026-04-27 08:04:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:19 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5e/16/5e163bd0a4e2ef7104490a3f3d63108d/pa/WA76064_ed7b37080a325f1b0b27686e6923be89.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 85,
 'category': None,
 'city': 'Martigues',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 92,
 'expiration_date': '2026-04-28T15:32:32Z',
 'fuel_type': 'diesel',
 'id': '0f908d25-8356-5799-89a1-a32c2e1515ab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 43.4074,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA76064',
 'listing': 'auction',
 'location': 'FR, Martigues',
 'location_confidence': 'geocoded',
 'longitude': 5.0553,
 'make': 'Peugeot',
 'model': '208',
 'odometer': 180450,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0f908d25-8356-5799-89a1-a32c2e1515ab/0f908d25-8356-5799-89a1-a32c2e1515ab_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81117,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/16/5e163bd0a4e2ef7104490a3f3d63108d/pa/WA76064_ed7b37080a325f1b0b27686e6923be89.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0f908d25-8356-5799-89a1-a32c2e1515ab/0f908d25-8356-5799-89a1-a32c2e1515ab_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81117,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/16/5e163bd0a4e2ef7104490a3f3d63108d/pa/WA76064_65166d55cb95b4d0511e3f02ebd25217.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0f908d25-8356-5799-89a1-a32c2e1515ab/0f908d25-8356-5799-89a1-a32c2e1515ab_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89544,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/16/5e163bd0a4e2ef7104490a3f3d63108d/pa/WA76064_8246df51ceb48de88057d28de45e5902.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0f908d25-8356-5799-89a1-a32c2e1515ab/0f908d25-8356-5799-89a1-a32c2e1515ab_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77509,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/16/5e163bd0a4e2ef7104490a3f3d63108d/pa/WA76064_6849a8ad9f642512eadb29b91e7485d1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0f908d25-8356-5799-89a1-a32c2e1515ab/0f908d25-8356-5799-89a1-a32c2e1515ab_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89360,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/16/5e163bd0a4e2ef7104490a3f3d63108d/pa/WA76064_4fcc49f051450157b6d6aa6e206e305d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0f908d25-8356-5799-89a1-a32c2e1515ab/0f908d25-8356-5799-89a1-a32c2e1515ab_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90482,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/16/5e163bd0a4e2ef7104490a3f3d63108d/pa/WA76064_c26690ec78ffa954be2f2402fb1af338.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0f908d25-8356-5799-89a1-a32c2e1515ab/0f908d25-8356-5799-89a1-a32c2e1515ab_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84073,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/16/5e163bd0a4e2ef7104490a3f3d63108d/pa/WA76064_168c5a427a456263ba2ce0845abe22a0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0f908d25-8356-5799-89a1-a32c2e1515ab/0f908d25-8356-5799-89a1-a32c2e1515ab_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80778,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/16/5e163bd0a4e2ef7104490a3f3d63108d/pa/WA76064_3f13a8d7c01cd9271eac9769bfcbd415.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0f908d25-8356-5799-89a1-a32c2e1515ab/0f908d25-8356-5799-89a1-a32c2e1515ab_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77525,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/16/5e163bd0a4e2ef7104490a3f3d63108d/pa/WA76064_9bf834a932b63bba1f849f8665ecc3b0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0f908d25-8356-5799-89a1-a32c2e1515ab/0f908d25-8356-5799-89a1-a32c2e1515ab_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82463,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/16/5e163bd0a4e2ef7104490a3f3d63108d/pa/WA76064_af6d02106fe42f65b20351193c19e848.jpg',
             'Width': 800}],
 'postal_code': '13117',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Bouches-du-Rhône',
 'province_code': 'FR-13',
 'region': "Provence-Alpes-Côte d'Azur",
 'region_code': 'FR-93',
 'registration_date': '2014-06-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 208 1.6 HDi Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2014}
2026-04-27 08:04:19 [auto1.fr] INFO: Saving data for WA76064: {'created_time': 1777277059.795903, 'last_price_update_time': 1777277059.795913, 'has_photos': True, 'auction_closing_time': 1777390352.0}
2026-04-27 08:04:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/5b/105b5e79d3c00062c3b7a9bc7b01001f/pa/NL98546_0425915b505977ff8b5ae7361f849fbc.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:19 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item d3d36fac-7e85-5b77-bc16-54c41706edca due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:04:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JN01057/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc2a4bd9-6d1b-5149-837b-bd1fc64acb2c with identifier: MS72274
2026-04-27 08:04:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc2a4bd9-6d1b-5149-837b-bd1fc64acb2c with scrape type 1
2026-04-27 08:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item cc2a4bd9-6d1b-5149-837b-bd1fc64acb2c
2026-04-27 08:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/97/189766134f514ff9ebcc72b18dd44a2d/pa/MS72274_e43637af836282dd5cc73bf060d4d15f.jpg not downloaded yet
2026-04-27 08:04:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/97/189766134f514ff9ebcc72b18dd44a2d/pa/MS72274_dd075939db4dd9b9661378f2814a9454.jpg not downloaded yet
2026-04-27 08:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/97/189766134f514ff9ebcc72b18dd44a2d/pa/MS72274_31698d57f907015911daee55959bc655.jpg not downloaded yet
2026-04-27 08:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/97/189766134f514ff9ebcc72b18dd44a2d/pa/MS72274_6f7ab67ee0043738fe532c4cee4bf1db.jpg not downloaded yet
2026-04-27 08:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/97/189766134f514ff9ebcc72b18dd44a2d/pa/MS72274_4af7452dba3ca743324fa224d1667008.jpg not downloaded yet
2026-04-27 08:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/97/189766134f514ff9ebcc72b18dd44a2d/pa/MS72274_416e800b16d939ba44cfc87d2dcef6d4.jpg not downloaded yet
2026-04-27 08:04:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438171110>
2026-04-27 08:04:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3d36fac-7e85-5b77-bc16-54c41706edca/d3d36fac-7e85-5b77-bc16-54c41706edca_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/5b/105b5e79d3c00062c3b7a9bc7b01001f/pa/NL98546_0425915b505977ff8b5ae7361f849fbc.jpg saved to cache
2026-04-27 08:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d3d36fac-7e85-5b77-bc16-54c41706edca
2026-04-27 08:04:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/89/338962503fc88955a51ffcf7fc66eafa/pa/LP40212_fc0349e6fb719312c88502b03968fb6f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/97/189766134f514ff9ebcc72b18dd44a2d/pa/MS72274_416e800b16d939ba44cfc87d2dcef6d4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143818ab90>
2026-04-27 08:04:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_244c45d6-1901-5f0a-9f33-8c40ffcd72cf/244c45d6-1901-5f0a-9f33-8c40ffcd72cf_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/89/338962503fc88955a51ffcf7fc66eafa/pa/LP40212_fc0349e6fb719312c88502b03968fb6f.jpg saved to cache
2026-04-27 08:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 244c45d6-1901-5f0a-9f33-8c40ffcd72cf
2026-04-27 08:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/97/189766134f514ff9ebcc72b18dd44a2d/pa/MS72274_4af7452dba3ca743324fa224d1667008.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142be0c410>
2026-04-27 08:04:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc2a4bd9-6d1b-5149-837b-bd1fc64acb2c/cc2a4bd9-6d1b-5149-837b-bd1fc64acb2c_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/97/189766134f514ff9ebcc72b18dd44a2d/pa/MS72274_416e800b16d939ba44cfc87d2dcef6d4.jpg saved to cache
2026-04-27 08:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cc2a4bd9-6d1b-5149-837b-bd1fc64acb2c
2026-04-27 08:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/97/189766134f514ff9ebcc72b18dd44a2d/pa/MS72274_6f7ab67ee0043738fe532c4cee4bf1db.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:20 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item d3d36fac-7e85-5b77-bc16-54c41706edca due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:04:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142be06290>
2026-04-27 08:04:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc2a4bd9-6d1b-5149-837b-bd1fc64acb2c/cc2a4bd9-6d1b-5149-837b-bd1fc64acb2c_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/97/189766134f514ff9ebcc72b18dd44a2d/pa/MS72274_4af7452dba3ca743324fa224d1667008.jpg saved to cache
2026-04-27 08:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cc2a4bd9-6d1b-5149-837b-bd1fc64acb2c
2026-04-27 08:04:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c9a350>
2026-04-27 08:04:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc2a4bd9-6d1b-5149-837b-bd1fc64acb2c/cc2a4bd9-6d1b-5149-837b-bd1fc64acb2c_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/97/189766134f514ff9ebcc72b18dd44a2d/pa/MS72274_6f7ab67ee0043738fe532c4cee4bf1db.jpg saved to cache
2026-04-27 08:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cc2a4bd9-6d1b-5149-837b-bd1fc64acb2c
2026-04-27 08:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/97/189766134f514ff9ebcc72b18dd44a2d/pa/MS72274_31698d57f907015911daee55959bc655.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/97/189766134f514ff9ebcc72b18dd44a2d/pa/MS72274_dd075939db4dd9b9661378f2814a9454.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/97/189766134f514ff9ebcc72b18dd44a2d/pa/MS72274_e43637af836282dd5cc73bf060d4d15f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142be05d10>
2026-04-27 08:04:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc2a4bd9-6d1b-5149-837b-bd1fc64acb2c/cc2a4bd9-6d1b-5149-837b-bd1fc64acb2c_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/97/189766134f514ff9ebcc72b18dd44a2d/pa/MS72274_31698d57f907015911daee55959bc655.jpg saved to cache
2026-04-27 08:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cc2a4bd9-6d1b-5149-837b-bd1fc64acb2c
2026-04-27 08:04:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142be0e350>
2026-04-27 08:04:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc2a4bd9-6d1b-5149-837b-bd1fc64acb2c/cc2a4bd9-6d1b-5149-837b-bd1fc64acb2c_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/97/189766134f514ff9ebcc72b18dd44a2d/pa/MS72274_dd075939db4dd9b9661378f2814a9454.jpg saved to cache
2026-04-27 08:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cc2a4bd9-6d1b-5149-837b-bd1fc64acb2c
2026-04-27 08:04:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bfb5410>
2026-04-27 08:04:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc2a4bd9-6d1b-5149-837b-bd1fc64acb2c/cc2a4bd9-6d1b-5149-837b-bd1fc64acb2c_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/97/189766134f514ff9ebcc72b18dd44a2d/pa/MS72274_e43637af836282dd5cc73bf060d4d15f.jpg saved to cache
2026-04-27 08:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cc2a4bd9-6d1b-5149-837b-bd1fc64acb2c
2026-04-27 08:04:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cc2a4bd9-6d1b-5149-837b-bd1fc64acb2c, skipping ID generation
2026-04-27 08:04:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc2a4bd9-6d1b-5149-837b-bd1fc64acb2c with scrape type 1
2026-04-27 08:04:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cc2a4bd9-6d1b-5149-837b-bd1fc64acb2c sending to next pipeline
2026-04-27 08:04:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: cc2a4bd9-6d1b-5149-837b-bd1fc64acb2c, identifier: MS72274
2026-04-27 08:04:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: cc2a4bd9-6d1b-5149-837b-bd1fc64acb2c with identifier: MS72274
2026-04-27 08:04:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: cc2a4bd9-6d1b-5149-837b-bd1fc64acb2c with identifier: MS72274
2026-04-27 08:04:20 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: cc2a4bd9-6d1b-5149-837b-bd1fc64acb2c with identifier: MS72274 to the API
2026-04-27 08:04:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:21 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img18/97/189766134f514ff9ebcc72b18dd44a2d/pa/MS72274_e43637af836282dd5cc73bf060d4d15f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 180,
 'category': None,
 'city': 'Grésy-sur-Aix',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 3',
 'engine': '1.6L',
 'engine_horse_power': 110,
 'expiration_date': '2026-04-28T15:31:00Z',
 'fuel_type': 'petrol',
 'id': 'cc2a4bd9-6d1b-5149-837b-bd1fc64acb2c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 45.7231,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MS72274',
 'listing': 'auction',
 'location': 'FR, Grésy-sur-Aix',
 'location_confidence': 'geocoded',
 'longitude': 5.9252,
 'make': 'Citroen',
 'model': 'C4',
 'odometer': 214208,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cc2a4bd9-6d1b-5149-837b-bd1fc64acb2c/cc2a4bd9-6d1b-5149-837b-bd1fc64acb2c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93028,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/97/189766134f514ff9ebcc72b18dd44a2d/pa/MS72274_e43637af836282dd5cc73bf060d4d15f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cc2a4bd9-6d1b-5149-837b-bd1fc64acb2c/cc2a4bd9-6d1b-5149-837b-bd1fc64acb2c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89218,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/97/189766134f514ff9ebcc72b18dd44a2d/pa/MS72274_dd075939db4dd9b9661378f2814a9454.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cc2a4bd9-6d1b-5149-837b-bd1fc64acb2c/cc2a4bd9-6d1b-5149-837b-bd1fc64acb2c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91351,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/97/189766134f514ff9ebcc72b18dd44a2d/pa/MS72274_31698d57f907015911daee55959bc655.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cc2a4bd9-6d1b-5149-837b-bd1fc64acb2c/cc2a4bd9-6d1b-5149-837b-bd1fc64acb2c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64069,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/97/189766134f514ff9ebcc72b18dd44a2d/pa/MS72274_6f7ab67ee0043738fe532c4cee4bf1db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cc2a4bd9-6d1b-5149-837b-bd1fc64acb2c/cc2a4bd9-6d1b-5149-837b-bd1fc64acb2c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98226,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/97/189766134f514ff9ebcc72b18dd44a2d/pa/MS72274_4af7452dba3ca743324fa224d1667008.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cc2a4bd9-6d1b-5149-837b-bd1fc64acb2c/cc2a4bd9-6d1b-5149-837b-bd1fc64acb2c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40567,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/97/189766134f514ff9ebcc72b18dd44a2d/pa/MS72274_416e800b16d939ba44cfc87d2dcef6d4.jpg',
             'Width': 800}],
 'postal_code': '73100',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Savoie',
 'province_code': 'FR-73',
 'region': 'Auvergne-Rhône-Alpes',
 'region_code': 'FR-84',
 'registration_date': '2005-02-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C4 1.6 Ambiance',
 'transmission': 'automatic',
 'trim': 'Ambiance',
 'year': 2005}
2026-04-27 08:04:21 [auto1.fr] INFO: Saving data for MS72274: {'created_time': 1777277061.139725, 'last_price_update_time': 1777277061.139735, 'has_photos': True, 'auction_closing_time': 1777390260.0}
2026-04-27 08:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TX81047/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CU45750/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d3d36fac-7e85-5b77-bc16-54c41706edca with identifier: NL98546
2026-04-27 08:04:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d3d36fac-7e85-5b77-bc16-54c41706edca with identifier: NL98546
2026-04-27 08:04:21 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: d3d36fac-7e85-5b77-bc16-54c41706edca with identifier: NL98546 to the API
2026-04-27 08:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:21 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:21 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'city': 'Marckolsheim',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO N\\/A',
 'engine': '1.4L',
 'engine_horse_power': 95,
 'expiration_date': '2026-04-28T15:46:15Z',
 'fuel_type': 'petrol',
 'id': 'd3d36fac-7e85-5b77-bc16-54c41706edca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.1647,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NL98546',
 'listing': 'auction',
 'location': 'FR, Marckolsheim',
 'location_confidence': 'geocoded',
 'longitude': 7.544,
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 195310,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/img10/5b/105b5e79d3c00062c3b7a9bc7b01001f/pa/NL98546_48c4edb71ffdfca2b5a4f48a37fe1146.jpg',
                'https://img-pa.auto1.com/img10/5b/105b5e79d3c00062c3b7a9bc7b01001f/pa/NL98546_af543ea29f80995a04dd5878f1ca0aad.jpg',
                'https://img-pa.auto1.com/img10/5b/105b5e79d3c00062c3b7a9bc7b01001f/pa/NL98546_a2dacbfdb84991d4de03364ccd53afd1.jpg',
                'https://img-pa.auto1.com/img10/5b/105b5e79d3c00062c3b7a9bc7b01001f/pa/NL98546_0425915b505977ff8b5ae7361f849fbc.jpg',
                'https://img-pa.auto1.com/img10/5b/105b5e79d3c00062c3b7a9bc7b01001f/pa/NL98546_a2d349c1e30c70e62769221098c1be74.jpg',
                'https://img-pa.auto1.com/img10/5b/105b5e79d3c00062c3b7a9bc7b01001f/pa/NL98546_9280995e4f4cdfad63e9681c5042a65c.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d3d36fac-7e85-5b77-bc16-54c41706edca/d3d36fac-7e85-5b77-bc16-54c41706edca_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79194,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/5b/105b5e79d3c00062c3b7a9bc7b01001f/pa/NL98546_a2dacbfdb84991d4de03364ccd53afd1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d3d36fac-7e85-5b77-bc16-54c41706edca/d3d36fac-7e85-5b77-bc16-54c41706edca_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71371,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/5b/105b5e79d3c00062c3b7a9bc7b01001f/pa/NL98546_0425915b505977ff8b5ae7361f849fbc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d3d36fac-7e85-5b77-bc16-54c41706edca/d3d36fac-7e85-5b77-bc16-54c41706edca_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 129002,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/5b/105b5e79d3c00062c3b7a9bc7b01001f/pa/NL98546_a2d349c1e30c70e62769221098c1be74.jpg',
             'Width': 800}],
 'postal_code': '67390',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Bas-Rhin',
 'province_code': 'FR-67',
 'region': 'Grand Est',
 'region_code': 'FR-44',
 'registration_date': '2002-02-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Megane 1.4 Authentique',
 'transmission': 'manual',
 'trim': 'Authentique',
 'year': 2002}
2026-04-27 08:04:21 [auto1.fr] INFO: Saving data for NL98546: {'created_time': 1777277061.571596, 'last_price_update_time': 1777277061.571606, 'has_photos': True, 'auction_closing_time': 1777391175.0}
2026-04-27 08:04:21 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item d3d36fac-7e85-5b77-bc16-54c41706edca due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:04:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 244c45d6-1901-5f0a-9f33-8c40ffcd72cf with identifier: LP40212
2026-04-27 08:04:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 244c45d6-1901-5f0a-9f33-8c40ffcd72cf with identifier: LP40212
2026-04-27 08:04:21 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 244c45d6-1901-5f0a-9f33-8c40ffcd72cf with identifier: LP40212 to the API
2026-04-27 08:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:21 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:21 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'city': 'Marseille',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 110,
 'expiration_date': '2026-04-28T15:24:49Z',
 'fuel_type': 'diesel',
 'id': '244c45d6-1901-5f0a-9f33-8c40ffcd72cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 43.2969,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LP40212',
 'listing': 'auction',
 'location': 'FR, Marseille',
 'location_confidence': 'geocoded',
 'longitude': 5.3811,
 'make': 'Peugeot',
 'model': '508',
 'odometer': 278396,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/img33/89/338962503fc88955a51ffcf7fc66eafa/pa/LP40212_e0423ace02681b91c2d5bea1161a102f.jpg',
                'https://img-pa.auto1.com/img33/89/338962503fc88955a51ffcf7fc66eafa/pa/LP40212_fc0349e6fb719312c88502b03968fb6f.jpg',
                'https://img-pa.auto1.com/img33/89/338962503fc88955a51ffcf7fc66eafa/pa/LP40212_17b9406b7230f9d03ff59902277802ea.jpg',
                'https://img-pa.auto1.com/img33/89/338962503fc88955a51ffcf7fc66eafa/pa/LP40212_a049cc4d724abceefe1df548116434bf.jpg',
                'https://img-pa.auto1.com/img33/89/338962503fc88955a51ffcf7fc66eafa/pa/LP40212_ab534779328529a3452631645da1f11d.jpg',
                'https://img-pa.auto1.com/img33/89/338962503fc88955a51ffcf7fc66eafa/pa/LP40212_b73c42d94074f460ef85ac630cba4ff6.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_244c45d6-1901-5f0a-9f33-8c40ffcd72cf/244c45d6-1901-5f0a-9f33-8c40ffcd72cf_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84268,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/89/338962503fc88955a51ffcf7fc66eafa/pa/LP40212_fc0349e6fb719312c88502b03968fb6f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_244c45d6-1901-5f0a-9f33-8c40ffcd72cf/244c45d6-1901-5f0a-9f33-8c40ffcd72cf_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78289,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/89/338962503fc88955a51ffcf7fc66eafa/pa/LP40212_17b9406b7230f9d03ff59902277802ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_244c45d6-1901-5f0a-9f33-8c40ffcd72cf/244c45d6-1901-5f0a-9f33-8c40ffcd72cf_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85730,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/89/338962503fc88955a51ffcf7fc66eafa/pa/LP40212_a049cc4d724abceefe1df548116434bf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_244c45d6-1901-5f0a-9f33-8c40ffcd72cf/244c45d6-1901-5f0a-9f33-8c40ffcd72cf_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91532,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/89/338962503fc88955a51ffcf7fc66eafa/pa/LP40212_ab534779328529a3452631645da1f11d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_244c45d6-1901-5f0a-9f33-8c40ffcd72cf/244c45d6-1901-5f0a-9f33-8c40ffcd72cf_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43543,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/89/338962503fc88955a51ffcf7fc66eafa/pa/LP40212_b73c42d94074f460ef85ac630cba4ff6.jpg',
             'Width': 800}],
 'postal_code': '13000',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Bouches-du-Rhône',
 'province_code': 'FR-13',
 'region': "Provence-Alpes-Côte d'Azur",
 'region_code': 'FR-93',
 'registration_date': '2012-02-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 508 1.6 HDi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2012}
2026-04-27 08:04:21 [auto1.fr] INFO: Saving data for LP40212: {'created_time': 1777277061.951533, 'last_price_update_time': 1777277061.951544, 'has_photos': True, 'auction_closing_time': 1777389889.0}
2026-04-27 08:04:21 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 244c45d6-1901-5f0a-9f33-8c40ffcd72cf due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EE30564> (referer: https://www.auto1.com/v1/car-details-view/EE30564/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PC47151> (referer: https://www.auto1.com/v1/car-details-view/PC47151/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/4c/e54c1895b9cbd3b0f8ec6d982c510e3c/pa/XP78105_48524bff1427010c887f1ba7f6d7fce6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d5136184-68f2-5086-ab51-eea548b7ee87 with identifier: EE30564
2026-04-27 08:04:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5136184-68f2-5086-ab51-eea548b7ee87 with scrape type 1
2026-04-27 08:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d5136184-68f2-5086-ab51-eea548b7ee87
2026-04-27 08:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/3c/493c1e5a5a12ca88cdaf88538dab7474/pa/EE30564_dbfcb01ea7443126a6773184cb407acc.jpg not downloaded yet
2026-04-27 08:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/3c/493c1e5a5a12ca88cdaf88538dab7474/pa/EE30564_8a83543c161dcff02170ef0831fd91f9.jpg not downloaded yet
2026-04-27 08:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/3c/493c1e5a5a12ca88cdaf88538dab7474/pa/EE30564_121cef13417a6be3a247848033cf8513.jpg not downloaded yet
2026-04-27 08:04:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5cd4e810-5454-52b3-a523-32a3f1a4c5b6 with identifier: PC47151
2026-04-27 08:04:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5cd4e810-5454-52b3-a523-32a3f1a4c5b6 with scrape type 1
2026-04-27 08:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 5cd4e810-5454-52b3-a523-32a3f1a4c5b6
2026-04-27 08:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/55/fd5506effb27161ff7ccff54733777de/pa/PC47151_466d5a82012b761828aec5422672245d.jpg not downloaded yet
2026-04-27 08:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/3c/493c1e5a5a12ca88cdaf88538dab7474/pa/EE30564_1632e4c5a31fc464282785c69799d2d9.jpg not downloaded yet
2026-04-27 08:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/55/fd5506effb27161ff7ccff54733777de/pa/PC47151_b32e674b3df466035b025aa0d8a5e573.jpg not downloaded yet
2026-04-27 08:04:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438086910>
2026-04-27 08:04:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77f790f4-3e0a-5702-98e2-d24f664e169f/77f790f4-3e0a-5702-98e2-d24f664e169f_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/4c/e54c1895b9cbd3b0f8ec6d982c510e3c/pa/XP78105_48524bff1427010c887f1ba7f6d7fce6.jpg saved to cache
2026-04-27 08:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 77f790f4-3e0a-5702-98e2-d24f664e169f
2026-04-27 08:04:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 77f790f4-3e0a-5702-98e2-d24f664e169f, skipping ID generation
2026-04-27 08:04:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77f790f4-3e0a-5702-98e2-d24f664e169f with scrape type 1
2026-04-27 08:04:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 77f790f4-3e0a-5702-98e2-d24f664e169f sending to next pipeline
2026-04-27 08:04:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 77f790f4-3e0a-5702-98e2-d24f664e169f, identifier: XP78105
2026-04-27 08:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/3c/493c1e5a5a12ca88cdaf88538dab7474/pa/EE30564_77dc6f70d08400a604d502871ccb22ac.jpg not downloaded yet
2026-04-27 08:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/55/fd5506effb27161ff7ccff54733777de/pa/PC47151_b0c6993bfb0497a33e11b7c543c3b5da.jpg not downloaded yet
2026-04-27 08:04:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 77f790f4-3e0a-5702-98e2-d24f664e169f with identifier: XP78105
2026-04-27 08:04:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 77f790f4-3e0a-5702-98e2-d24f664e169f with identifier: XP78105
2026-04-27 08:04:22 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 77f790f4-3e0a-5702-98e2-d24f664e169f with identifier: XP78105 to the API
2026-04-27 08:04:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:22 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge5/4c/e54c1895b9cbd3b0f8ec6d982c510e3c/pa/XP78105_48524bff1427010c887f1ba7f6d7fce6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'city': 'Ingrandes sur Vienne',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.5L',
 'engine_horse_power': 105,
 'expiration_date': '2026-04-28T15:06:48Z',
 'fuel_type': 'diesel',
 'id': '77f790f4-3e0a-5702-98e2-d24f664e169f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XP78105',
 'listing': 'auction',
 'location': 'FR, Ingrandes sur Vienne',
 'location_confidence': None,
 'longitude': None,
 'make': 'Renault',
 'model': 'Grand Scenic',
 'odometer': 234968,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_77f790f4-3e0a-5702-98e2-d24f664e169f/77f790f4-3e0a-5702-98e2-d24f664e169f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81437,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/4c/e54c1895b9cbd3b0f8ec6d982c510e3c/pa/XP78105_48524bff1427010c887f1ba7f6d7fce6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_77f790f4-3e0a-5702-98e2-d24f664e169f/77f790f4-3e0a-5702-98e2-d24f664e169f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84543,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/4c/e54c1895b9cbd3b0f8ec6d982c510e3c/pa/XP78105_dbac5f41d64502ed62291ae9b21069ce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_77f790f4-3e0a-5702-98e2-d24f664e169f/77f790f4-3e0a-5702-98e2-d24f664e169f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74762,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/4c/e54c1895b9cbd3b0f8ec6d982c510e3c/pa/XP78105_8bcb02351ad73cd7aadd78e9172edc3e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_77f790f4-3e0a-5702-98e2-d24f664e169f/77f790f4-3e0a-5702-98e2-d24f664e169f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55701,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/4c/e54c1895b9cbd3b0f8ec6d982c510e3c/pa/XP78105_3c673f181350f05ab29cb9f38a1ac592.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_77f790f4-3e0a-5702-98e2-d24f664e169f/77f790f4-3e0a-5702-98e2-d24f664e169f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99545,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/4c/e54c1895b9cbd3b0f8ec6d982c510e3c/pa/XP78105_ec1fd60399136242abf181b079202e51.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_77f790f4-3e0a-5702-98e2-d24f664e169f/77f790f4-3e0a-5702-98e2-d24f664e169f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44813,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/4c/e54c1895b9cbd3b0f8ec6d982c510e3c/pa/XP78105_c634a9eb6e2148882ae87b4dd7ccb1b6.jpg',
             'Width': 800}],
 'postal_code': None,
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2009-10-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Grand Scenic 1.5 dCi Carminat Tom-Tom',
 'transmission': 'manual',
 'trim': 'Carminat Tom-Tom',
 'year': 2009}
2026-04-27 08:04:22 [auto1.fr] INFO: Saving data for XP78105: {'created_time': 1777277062.78416, 'last_price_update_time': 1777277062.784169, 'has_photos': True, 'auction_closing_time': 1777388808.0}
2026-04-27 08:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/3c/493c1e5a5a12ca88cdaf88538dab7474/pa/EE30564_8295d20d76ded82b1cc6c7064186bf82.jpg not downloaded yet
2026-04-27 08:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/55/fd5506effb27161ff7ccff54733777de/pa/PC47151_e976f097599d7bdfec76159809d2fb48.jpg not downloaded yet
2026-04-27 08:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/3c/493c1e5a5a12ca88cdaf88538dab7474/pa/EE30564_82b906558ce7774e30e8df31877a8e46.jpg not downloaded yet
2026-04-27 08:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/55/fd5506effb27161ff7ccff54733777de/pa/PC47151_abf9796ff9fc0ff10ff3f02415861669.jpg not downloaded yet
2026-04-27 08:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/3c/493c1e5a5a12ca88cdaf88538dab7474/pa/EE30564_c5c5aee5b7ff59bb016e44423c8c5192.jpg not downloaded yet
2026-04-27 08:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/55/fd5506effb27161ff7ccff54733777de/pa/PC47151_12906010d682b5d38b1c2f6bdd73f72d.jpg not downloaded yet
2026-04-27 08:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/3c/493c1e5a5a12ca88cdaf88538dab7474/pa/EE30564_a9ed675baa88fa85dd779d1a12a0e54f.jpg not downloaded yet
2026-04-27 08:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/3c/493c1e5a5a12ca88cdaf88538dab7474/pa/EE30564_323ea7e73537c85707d9b6b21ae98329.jpg not downloaded yet
2026-04-27 08:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UM47720> (referer: https://www.auto1.com/v1/car-details-view/UM47720/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2b69601-177e-5b5e-b73d-5a6050fc4e1c with identifier: UM47720
2026-04-27 08:04:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2b69601-177e-5b5e-b73d-5a6050fc4e1c with scrape type 1
2026-04-27 08:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c2b69601-177e-5b5e-b73d-5a6050fc4e1c
2026-04-27 08:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/72/0072f38dca13c58757369e39ef06d0a4/pa/UM47720_baafa92aa26dcf91430138da9287e077.jpg not downloaded yet
2026-04-27 08:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/72/0072f38dca13c58757369e39ef06d0a4/pa/UM47720_1b44d2ef929534efb3ed16b80f51ac8a.jpg not downloaded yet
2026-04-27 08:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/72/0072f38dca13c58757369e39ef06d0a4/pa/UM47720_395a0624910098fed53274412b3a022e.jpg not downloaded yet
2026-04-27 08:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/72/0072f38dca13c58757369e39ef06d0a4/pa/UM47720_4593e430fb28074737a8fbb8d7b2b613.jpg not downloaded yet
2026-04-27 08:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/72/0072f38dca13c58757369e39ef06d0a4/pa/UM47720_ca3c6b4edea33158cd68bc441636f70e.jpg not downloaded yet
2026-04-27 08:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/72/0072f38dca13c58757369e39ef06d0a4/pa/UM47720_ee21365adf0c932cf3a0d16bfb409983.jpg not downloaded yet
2026-04-27 08:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/3c/493c1e5a5a12ca88cdaf88538dab7474/pa/EE30564_323ea7e73537c85707d9b6b21ae98329.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/72/0072f38dca13c58757369e39ef06d0a4/pa/UM47720_73e98a6874fe97c8ea0045a91855aee6.jpg not downloaded yet
2026-04-27 08:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/72/0072f38dca13c58757369e39ef06d0a4/pa/UM47720_87ebe7737b0a4e7339b05e424d73ef29.jpg not downloaded yet
2026-04-27 08:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/72/0072f38dca13c58757369e39ef06d0a4/pa/UM47720_17f906eb0224ce678a8fe5e40c00d10d.jpg not downloaded yet
2026-04-27 08:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/72/0072f38dca13c58757369e39ef06d0a4/pa/UM47720_fb94e4dc2784699e9c99aea9918d598b.jpg not downloaded yet
2026-04-27 08:04:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c9bd50>
2026-04-27 08:04:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5136184-68f2-5086-ab51-eea548b7ee87/d5136184-68f2-5086-ab51-eea548b7ee87_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/3c/493c1e5a5a12ca88cdaf88538dab7474/pa/EE30564_323ea7e73537c85707d9b6b21ae98329.jpg saved to cache
2026-04-27 08:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d5136184-68f2-5086-ab51-eea548b7ee87
2026-04-27 08:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/72/0072f38dca13c58757369e39ef06d0a4/pa/UM47720_ee21365adf0c932cf3a0d16bfb409983.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a1bd90>
2026-04-27 08:04:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2b69601-177e-5b5e-b73d-5a6050fc4e1c/c2b69601-177e-5b5e-b73d-5a6050fc4e1c_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/72/0072f38dca13c58757369e39ef06d0a4/pa/UM47720_ee21365adf0c932cf3a0d16bfb409983.jpg saved to cache
2026-04-27 08:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c2b69601-177e-5b5e-b73d-5a6050fc4e1c
2026-04-27 08:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/72/0072f38dca13c58757369e39ef06d0a4/pa/UM47720_fb94e4dc2784699e9c99aea9918d598b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/72/0072f38dca13c58757369e39ef06d0a4/pa/UM47720_17f906eb0224ce678a8fe5e40c00d10d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/72/0072f38dca13c58757369e39ef06d0a4/pa/UM47720_87ebe7737b0a4e7339b05e424d73ef29.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142be1b450>
2026-04-27 08:04:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2b69601-177e-5b5e-b73d-5a6050fc4e1c/c2b69601-177e-5b5e-b73d-5a6050fc4e1c_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/72/0072f38dca13c58757369e39ef06d0a4/pa/UM47720_fb94e4dc2784699e9c99aea9918d598b.jpg saved to cache
2026-04-27 08:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c2b69601-177e-5b5e-b73d-5a6050fc4e1c
2026-04-27 08:04:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a1b3d0>
2026-04-27 08:04:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2b69601-177e-5b5e-b73d-5a6050fc4e1c/c2b69601-177e-5b5e-b73d-5a6050fc4e1c_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/72/0072f38dca13c58757369e39ef06d0a4/pa/UM47720_17f906eb0224ce678a8fe5e40c00d10d.jpg saved to cache
2026-04-27 08:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c2b69601-177e-5b5e-b73d-5a6050fc4e1c
2026-04-27 08:04:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a5a150>
2026-04-27 08:04:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2b69601-177e-5b5e-b73d-5a6050fc4e1c/c2b69601-177e-5b5e-b73d-5a6050fc4e1c_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/72/0072f38dca13c58757369e39ef06d0a4/pa/UM47720_87ebe7737b0a4e7339b05e424d73ef29.jpg saved to cache
2026-04-27 08:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c2b69601-177e-5b5e-b73d-5a6050fc4e1c
2026-04-27 08:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/72/0072f38dca13c58757369e39ef06d0a4/pa/UM47720_73e98a6874fe97c8ea0045a91855aee6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b59310>
2026-04-27 08:04:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2b69601-177e-5b5e-b73d-5a6050fc4e1c/c2b69601-177e-5b5e-b73d-5a6050fc4e1c_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/72/0072f38dca13c58757369e39ef06d0a4/pa/UM47720_73e98a6874fe97c8ea0045a91855aee6.jpg saved to cache
2026-04-27 08:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c2b69601-177e-5b5e-b73d-5a6050fc4e1c
2026-04-27 08:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/72/0072f38dca13c58757369e39ef06d0a4/pa/UM47720_ca3c6b4edea33158cd68bc441636f70e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bfb6150>
2026-04-27 08:04:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2b69601-177e-5b5e-b73d-5a6050fc4e1c/c2b69601-177e-5b5e-b73d-5a6050fc4e1c_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/72/0072f38dca13c58757369e39ef06d0a4/pa/UM47720_ca3c6b4edea33158cd68bc441636f70e.jpg saved to cache
2026-04-27 08:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c2b69601-177e-5b5e-b73d-5a6050fc4e1c
2026-04-27 08:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/72/0072f38dca13c58757369e39ef06d0a4/pa/UM47720_4593e430fb28074737a8fbb8d7b2b613.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14381814d0>
2026-04-27 08:04:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2b69601-177e-5b5e-b73d-5a6050fc4e1c/c2b69601-177e-5b5e-b73d-5a6050fc4e1c_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/72/0072f38dca13c58757369e39ef06d0a4/pa/UM47720_4593e430fb28074737a8fbb8d7b2b613.jpg saved to cache
2026-04-27 08:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c2b69601-177e-5b5e-b73d-5a6050fc4e1c
2026-04-27 08:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/72/0072f38dca13c58757369e39ef06d0a4/pa/UM47720_395a0624910098fed53274412b3a022e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/72/0072f38dca13c58757369e39ef06d0a4/pa/UM47720_1b44d2ef929534efb3ed16b80f51ac8a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/72/0072f38dca13c58757369e39ef06d0a4/pa/UM47720_baafa92aa26dcf91430138da9287e077.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142be05250>
2026-04-27 08:04:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2b69601-177e-5b5e-b73d-5a6050fc4e1c/c2b69601-177e-5b5e-b73d-5a6050fc4e1c_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/72/0072f38dca13c58757369e39ef06d0a4/pa/UM47720_395a0624910098fed53274412b3a022e.jpg saved to cache
2026-04-27 08:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c2b69601-177e-5b5e-b73d-5a6050fc4e1c
2026-04-27 08:04:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b5bc10>
2026-04-27 08:04:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2b69601-177e-5b5e-b73d-5a6050fc4e1c/c2b69601-177e-5b5e-b73d-5a6050fc4e1c_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/72/0072f38dca13c58757369e39ef06d0a4/pa/UM47720_1b44d2ef929534efb3ed16b80f51ac8a.jpg saved to cache
2026-04-27 08:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c2b69601-177e-5b5e-b73d-5a6050fc4e1c
2026-04-27 08:04:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bfb4e10>
2026-04-27 08:04:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2b69601-177e-5b5e-b73d-5a6050fc4e1c/c2b69601-177e-5b5e-b73d-5a6050fc4e1c_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/72/0072f38dca13c58757369e39ef06d0a4/pa/UM47720_baafa92aa26dcf91430138da9287e077.jpg saved to cache
2026-04-27 08:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c2b69601-177e-5b5e-b73d-5a6050fc4e1c
2026-04-27 08:04:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c2b69601-177e-5b5e-b73d-5a6050fc4e1c, skipping ID generation
2026-04-27 08:04:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2b69601-177e-5b5e-b73d-5a6050fc4e1c with scrape type 1
2026-04-27 08:04:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c2b69601-177e-5b5e-b73d-5a6050fc4e1c sending to next pipeline
2026-04-27 08:04:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c2b69601-177e-5b5e-b73d-5a6050fc4e1c, identifier: UM47720
2026-04-27 08:04:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c2b69601-177e-5b5e-b73d-5a6050fc4e1c with identifier: UM47720
2026-04-27 08:04:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c2b69601-177e-5b5e-b73d-5a6050fc4e1c with identifier: UM47720
2026-04-27 08:04:25 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c2b69601-177e-5b5e-b73d-5a6050fc4e1c with identifier: UM47720 to the API
2026-04-27 08:04:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:25 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img00/72/0072f38dca13c58757369e39ef06d0a4/pa/UM47720_baafa92aa26dcf91430138da9287e077.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'city': 'Ingrandes sur Vienne',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 130,
 'expiration_date': '2026-04-28T15:51:01Z',
 'fuel_type': 'diesel',
 'id': 'c2b69601-177e-5b5e-b73d-5a6050fc4e1c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UM47720',
 'listing': 'auction',
 'location': 'FR, Ingrandes sur Vienne',
 'location_confidence': None,
 'longitude': None,
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 248012,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c2b69601-177e-5b5e-b73d-5a6050fc4e1c/c2b69601-177e-5b5e-b73d-5a6050fc4e1c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75936,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/72/0072f38dca13c58757369e39ef06d0a4/pa/UM47720_baafa92aa26dcf91430138da9287e077.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c2b69601-177e-5b5e-b73d-5a6050fc4e1c/c2b69601-177e-5b5e-b73d-5a6050fc4e1c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74123,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/72/0072f38dca13c58757369e39ef06d0a4/pa/UM47720_1b44d2ef929534efb3ed16b80f51ac8a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c2b69601-177e-5b5e-b73d-5a6050fc4e1c/c2b69601-177e-5b5e-b73d-5a6050fc4e1c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70384,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/72/0072f38dca13c58757369e39ef06d0a4/pa/UM47720_395a0624910098fed53274412b3a022e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c2b69601-177e-5b5e-b73d-5a6050fc4e1c/c2b69601-177e-5b5e-b73d-5a6050fc4e1c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65990,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/72/0072f38dca13c58757369e39ef06d0a4/pa/UM47720_4593e430fb28074737a8fbb8d7b2b613.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c2b69601-177e-5b5e-b73d-5a6050fc4e1c/c2b69601-177e-5b5e-b73d-5a6050fc4e1c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64703,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/72/0072f38dca13c58757369e39ef06d0a4/pa/UM47720_ca3c6b4edea33158cd68bc441636f70e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c2b69601-177e-5b5e-b73d-5a6050fc4e1c/c2b69601-177e-5b5e-b73d-5a6050fc4e1c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75563,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/72/0072f38dca13c58757369e39ef06d0a4/pa/UM47720_ee21365adf0c932cf3a0d16bfb409983.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c2b69601-177e-5b5e-b73d-5a6050fc4e1c/c2b69601-177e-5b5e-b73d-5a6050fc4e1c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66282,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/72/0072f38dca13c58757369e39ef06d0a4/pa/UM47720_73e98a6874fe97c8ea0045a91855aee6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c2b69601-177e-5b5e-b73d-5a6050fc4e1c/c2b69601-177e-5b5e-b73d-5a6050fc4e1c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77187,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/72/0072f38dca13c58757369e39ef06d0a4/pa/UM47720_87ebe7737b0a4e7339b05e424d73ef29.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c2b69601-177e-5b5e-b73d-5a6050fc4e1c/c2b69601-177e-5b5e-b73d-5a6050fc4e1c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72588,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/72/0072f38dca13c58757369e39ef06d0a4/pa/UM47720_17f906eb0224ce678a8fe5e40c00d10d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c2b69601-177e-5b5e-b73d-5a6050fc4e1c/c2b69601-177e-5b5e-b73d-5a6050fc4e1c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67823,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/72/0072f38dca13c58757369e39ef06d0a4/pa/UM47720_fb94e4dc2784699e9c99aea9918d598b.jpg',
             'Width': 800}],
 'postal_code': None,
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2014-06-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Qashqai 1.6 dCi Connect Edition',
 'transmission': 'manual',
 'trim': 'Connect Edition',
 'year': 2014}
2026-04-27 08:04:25 [auto1.fr] INFO: Saving data for UM47720: {'created_time': 1777277065.347486, 'last_price_update_time': 1777277065.347497, 'has_photos': True, 'auction_closing_time': 1777391461.0}
2026-04-27 08:04:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/3c/493c1e5a5a12ca88cdaf88538dab7474/pa/EE30564_a9ed675baa88fa85dd779d1a12a0e54f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZP81071> (referer: https://www.auto1.com/v1/car-details-view/ZP81071/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c29bd0>
2026-04-27 08:04:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5136184-68f2-5086-ab51-eea548b7ee87/d5136184-68f2-5086-ab51-eea548b7ee87_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/3c/493c1e5a5a12ca88cdaf88538dab7474/pa/EE30564_a9ed675baa88fa85dd779d1a12a0e54f.jpg saved to cache
2026-04-27 08:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d5136184-68f2-5086-ab51-eea548b7ee87
2026-04-27 08:04:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd2c4967-8f4d-5102-916a-6889198a6396 with identifier: ZP81071
2026-04-27 08:04:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd2c4967-8f4d-5102-916a-6889198a6396 with scrape type 1
2026-04-27 08:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dd2c4967-8f4d-5102-916a-6889198a6396
2026-04-27 08:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/09/aa0986dc2e2e3dd2078e1023244aa6f9/pa/ZP81071_5c8fbbe18eae87038a2f78ea16d2b44c.jpg not downloaded yet
2026-04-27 08:04:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/55/fd5506effb27161ff7ccff54733777de/pa/PC47151_12906010d682b5d38b1c2f6bdd73f72d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/09/aa0986dc2e2e3dd2078e1023244aa6f9/pa/ZP81071_7b4edc9ec95177d6831015c7025bb1fc.jpg not downloaded yet
2026-04-27 08:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/09/aa0986dc2e2e3dd2078e1023244aa6f9/pa/ZP81071_9199e9f2ba24bd18e8bb1de6e1f82fae.jpg not downloaded yet
2026-04-27 08:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/09/aa0986dc2e2e3dd2078e1023244aa6f9/pa/ZP81071_95be7f872b05ba481f8861a77a513750.jpg not downloaded yet
2026-04-27 08:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/09/aa0986dc2e2e3dd2078e1023244aa6f9/pa/ZP81071_e8697a9865b96292ac911badbbdad824.jpg not downloaded yet
2026-04-27 08:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/09/aa0986dc2e2e3dd2078e1023244aa6f9/pa/ZP81071_f3bd65d13cdb3bd77e1a16d4b112fd5a.jpg not downloaded yet
2026-04-27 08:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/09/aa0986dc2e2e3dd2078e1023244aa6f9/pa/ZP81071_9b6b4400c6971966b82ccbddad4daaea.jpg not downloaded yet
2026-04-27 08:04:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/09/aa0986dc2e2e3dd2078e1023244aa6f9/pa/ZP81071_5c8fbbe18eae87038a2f78ea16d2b44c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a1bf50>
2026-04-27 08:04:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cd4e810-5454-52b3-a523-32a3f1a4c5b6/5cd4e810-5454-52b3-a523-32a3f1a4c5b6_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/55/fd5506effb27161ff7ccff54733777de/pa/PC47151_12906010d682b5d38b1c2f6bdd73f72d.jpg saved to cache
2026-04-27 08:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5cd4e810-5454-52b3-a523-32a3f1a4c5b6
2026-04-27 08:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/09/aa0986dc2e2e3dd2078e1023244aa6f9/pa/ZP81071_840cc81533c1f1e34b50bffed863c8b1.jpg not downloaded yet
2026-04-27 08:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/09/aa0986dc2e2e3dd2078e1023244aa6f9/pa/ZP81071_1fc6ec4afc15d192b382c246d42de8cf.jpg not downloaded yet
2026-04-27 08:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/09/aa0986dc2e2e3dd2078e1023244aa6f9/pa/ZP81071_e7f2d7018b74e56a8c98649c6f1f14e7.jpg not downloaded yet
2026-04-27 08:04:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438171b90>
2026-04-27 08:04:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd2c4967-8f4d-5102-916a-6889198a6396/dd2c4967-8f4d-5102-916a-6889198a6396_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/09/aa0986dc2e2e3dd2078e1023244aa6f9/pa/ZP81071_5c8fbbe18eae87038a2f78ea16d2b44c.jpg saved to cache
2026-04-27 08:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dd2c4967-8f4d-5102-916a-6889198a6396
2026-04-27 08:04:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/09/aa0986dc2e2e3dd2078e1023244aa6f9/pa/ZP81071_f3bd65d13cdb3bd77e1a16d4b112fd5a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438086ad0>
2026-04-27 08:04:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd2c4967-8f4d-5102-916a-6889198a6396/dd2c4967-8f4d-5102-916a-6889198a6396_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/09/aa0986dc2e2e3dd2078e1023244aa6f9/pa/ZP81071_f3bd65d13cdb3bd77e1a16d4b112fd5a.jpg saved to cache
2026-04-27 08:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dd2c4967-8f4d-5102-916a-6889198a6396
2026-04-27 08:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/09/aa0986dc2e2e3dd2078e1023244aa6f9/pa/ZP81071_e7f2d7018b74e56a8c98649c6f1f14e7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/09/aa0986dc2e2e3dd2078e1023244aa6f9/pa/ZP81071_1fc6ec4afc15d192b382c246d42de8cf.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/09/aa0986dc2e2e3dd2078e1023244aa6f9/pa/ZP81071_840cc81533c1f1e34b50bffed863c8b1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438dd9750>
2026-04-27 08:04:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd2c4967-8f4d-5102-916a-6889198a6396/dd2c4967-8f4d-5102-916a-6889198a6396_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/09/aa0986dc2e2e3dd2078e1023244aa6f9/pa/ZP81071_e7f2d7018b74e56a8c98649c6f1f14e7.jpg saved to cache
2026-04-27 08:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item dd2c4967-8f4d-5102-916a-6889198a6396
2026-04-27 08:04:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438cce910>
2026-04-27 08:04:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd2c4967-8f4d-5102-916a-6889198a6396/dd2c4967-8f4d-5102-916a-6889198a6396_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/09/aa0986dc2e2e3dd2078e1023244aa6f9/pa/ZP81071_1fc6ec4afc15d192b382c246d42de8cf.jpg saved to cache
2026-04-27 08:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dd2c4967-8f4d-5102-916a-6889198a6396
2026-04-27 08:04:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142be04510>
2026-04-27 08:04:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd2c4967-8f4d-5102-916a-6889198a6396/dd2c4967-8f4d-5102-916a-6889198a6396_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/09/aa0986dc2e2e3dd2078e1023244aa6f9/pa/ZP81071_840cc81533c1f1e34b50bffed863c8b1.jpg saved to cache
2026-04-27 08:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dd2c4967-8f4d-5102-916a-6889198a6396
2026-04-27 08:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/09/aa0986dc2e2e3dd2078e1023244aa6f9/pa/ZP81071_9b6b4400c6971966b82ccbddad4daaea.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380b9490>
2026-04-27 08:04:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd2c4967-8f4d-5102-916a-6889198a6396/dd2c4967-8f4d-5102-916a-6889198a6396_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/09/aa0986dc2e2e3dd2078e1023244aa6f9/pa/ZP81071_9b6b4400c6971966b82ccbddad4daaea.jpg saved to cache
2026-04-27 08:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dd2c4967-8f4d-5102-916a-6889198a6396
2026-04-27 08:04:26 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item d5136184-68f2-5086-ab51-eea548b7ee87 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/09/aa0986dc2e2e3dd2078e1023244aa6f9/pa/ZP81071_e8697a9865b96292ac911badbbdad824.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438cccd50>
2026-04-27 08:04:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd2c4967-8f4d-5102-916a-6889198a6396/dd2c4967-8f4d-5102-916a-6889198a6396_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/09/aa0986dc2e2e3dd2078e1023244aa6f9/pa/ZP81071_e8697a9865b96292ac911badbbdad824.jpg saved to cache
2026-04-27 08:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dd2c4967-8f4d-5102-916a-6889198a6396
2026-04-27 08:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/09/aa0986dc2e2e3dd2078e1023244aa6f9/pa/ZP81071_9199e9f2ba24bd18e8bb1de6e1f82fae.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/09/aa0986dc2e2e3dd2078e1023244aa6f9/pa/ZP81071_7b4edc9ec95177d6831015c7025bb1fc.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ccda50>
2026-04-27 08:04:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd2c4967-8f4d-5102-916a-6889198a6396/dd2c4967-8f4d-5102-916a-6889198a6396_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/09/aa0986dc2e2e3dd2078e1023244aa6f9/pa/ZP81071_9199e9f2ba24bd18e8bb1de6e1f82fae.jpg saved to cache
2026-04-27 08:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dd2c4967-8f4d-5102-916a-6889198a6396
2026-04-27 08:04:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438cf9290>
2026-04-27 08:04:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd2c4967-8f4d-5102-916a-6889198a6396/dd2c4967-8f4d-5102-916a-6889198a6396_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/09/aa0986dc2e2e3dd2078e1023244aa6f9/pa/ZP81071_7b4edc9ec95177d6831015c7025bb1fc.jpg saved to cache
2026-04-27 08:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dd2c4967-8f4d-5102-916a-6889198a6396
2026-04-27 08:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/55/fd5506effb27161ff7ccff54733777de/pa/PC47151_abf9796ff9fc0ff10ff3f02415861669.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/3c/493c1e5a5a12ca88cdaf88538dab7474/pa/EE30564_82b906558ce7774e30e8df31877a8e46.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142be07150>
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cd4e810-5454-52b3-a523-32a3f1a4c5b6/5cd4e810-5454-52b3-a523-32a3f1a4c5b6_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/55/fd5506effb27161ff7ccff54733777de/pa/PC47151_abf9796ff9fc0ff10ff3f02415861669.jpg saved to cache
2026-04-27 08:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5cd4e810-5454-52b3-a523-32a3f1a4c5b6
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bf192d0>
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5136184-68f2-5086-ab51-eea548b7ee87/d5136184-68f2-5086-ab51-eea548b7ee87_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/3c/493c1e5a5a12ca88cdaf88538dab7474/pa/EE30564_82b906558ce7774e30e8df31877a8e46.jpg saved to cache
2026-04-27 08:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d5136184-68f2-5086-ab51-eea548b7ee87
2026-04-27 08:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/55/fd5506effb27161ff7ccff54733777de/pa/PC47151_e976f097599d7bdfec76159809d2fb48.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/3c/493c1e5a5a12ca88cdaf88538dab7474/pa/EE30564_8295d20d76ded82b1cc6c7064186bf82.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438075a90>
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cd4e810-5454-52b3-a523-32a3f1a4c5b6/5cd4e810-5454-52b3-a523-32a3f1a4c5b6_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/55/fd5506effb27161ff7ccff54733777de/pa/PC47151_e976f097599d7bdfec76159809d2fb48.jpg saved to cache
2026-04-27 08:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5cd4e810-5454-52b3-a523-32a3f1a4c5b6
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438fb7450>
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5136184-68f2-5086-ab51-eea548b7ee87/d5136184-68f2-5086-ab51-eea548b7ee87_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/3c/493c1e5a5a12ca88cdaf88538dab7474/pa/EE30564_8295d20d76ded82b1cc6c7064186bf82.jpg saved to cache
2026-04-27 08:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d5136184-68f2-5086-ab51-eea548b7ee87
2026-04-27 08:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/55/fd5506effb27161ff7ccff54733777de/pa/PC47151_b0c6993bfb0497a33e11b7c543c3b5da.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: dd2c4967-8f4d-5102-916a-6889198a6396 with identifier: ZP81071
2026-04-27 08:04:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: dd2c4967-8f4d-5102-916a-6889198a6396 with identifier: ZP81071
2026-04-27 08:04:27 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: dd2c4967-8f4d-5102-916a-6889198a6396 with identifier: ZP81071 to the API
2026-04-27 08:04:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:27 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:28 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'city': 'Saint Aignan de Grandlieu',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-04-28T15:43:25Z',
 'fuel_type': 'diesel',
 'id': 'dd2c4967-8f4d-5102-916a-6889198a6396',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 47.1237,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZP81071',
 'listing': 'auction',
 'location': 'FR, Saint Aignan de Grandlieu',
 'location_confidence': 'geocoded',
 'longitude': -1.6308,
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 250601,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgaa/09/aa0986dc2e2e3dd2078e1023244aa6f9/pa/ZP81071_5c8fbbe18eae87038a2f78ea16d2b44c.jpg',
                'https://img-pa.auto1.com/imgaa/09/aa0986dc2e2e3dd2078e1023244aa6f9/pa/ZP81071_7b4edc9ec95177d6831015c7025bb1fc.jpg',
                'https://img-pa.auto1.com/imgaa/09/aa0986dc2e2e3dd2078e1023244aa6f9/pa/ZP81071_9199e9f2ba24bd18e8bb1de6e1f82fae.jpg',
                'https://img-pa.auto1.com/imgaa/09/aa0986dc2e2e3dd2078e1023244aa6f9/pa/ZP81071_95be7f872b05ba481f8861a77a513750.jpg',
                'https://img-pa.auto1.com/imgaa/09/aa0986dc2e2e3dd2078e1023244aa6f9/pa/ZP81071_e8697a9865b96292ac911badbbdad824.jpg',
                'https://img-pa.auto1.com/imgaa/09/aa0986dc2e2e3dd2078e1023244aa6f9/pa/ZP81071_f3bd65d13cdb3bd77e1a16d4b112fd5a.jpg',
                'https://img-pa.auto1.com/imgaa/09/aa0986dc2e2e3dd2078e1023244aa6f9/pa/ZP81071_9b6b4400c6971966b82ccbddad4daaea.jpg',
                'https://img-pa.auto1.com/imgaa/09/aa0986dc2e2e3dd2078e1023244aa6f9/pa/ZP81071_840cc81533c1f1e34b50bffed863c8b1.jpg',
                'https://img-pa.auto1.com/imgaa/09/aa0986dc2e2e3dd2078e1023244aa6f9/pa/ZP81071_1fc6ec4afc15d192b382c246d42de8cf.jpg',
                'https://img-pa.auto1.com/imgaa/09/aa0986dc2e2e3dd2078e1023244aa6f9/pa/ZP81071_e7f2d7018b74e56a8c98649c6f1f14e7.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dd2c4967-8f4d-5102-916a-6889198a6396/dd2c4967-8f4d-5102-916a-6889198a6396_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69216,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/09/aa0986dc2e2e3dd2078e1023244aa6f9/pa/ZP81071_5c8fbbe18eae87038a2f78ea16d2b44c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dd2c4967-8f4d-5102-916a-6889198a6396/dd2c4967-8f4d-5102-916a-6889198a6396_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71876,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/09/aa0986dc2e2e3dd2078e1023244aa6f9/pa/ZP81071_7b4edc9ec95177d6831015c7025bb1fc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dd2c4967-8f4d-5102-916a-6889198a6396/dd2c4967-8f4d-5102-916a-6889198a6396_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61526,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/09/aa0986dc2e2e3dd2078e1023244aa6f9/pa/ZP81071_9199e9f2ba24bd18e8bb1de6e1f82fae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dd2c4967-8f4d-5102-916a-6889198a6396/dd2c4967-8f4d-5102-916a-6889198a6396_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58921,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/09/aa0986dc2e2e3dd2078e1023244aa6f9/pa/ZP81071_e8697a9865b96292ac911badbbdad824.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dd2c4967-8f4d-5102-916a-6889198a6396/dd2c4967-8f4d-5102-916a-6889198a6396_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59096,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/09/aa0986dc2e2e3dd2078e1023244aa6f9/pa/ZP81071_f3bd65d13cdb3bd77e1a16d4b112fd5a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dd2c4967-8f4d-5102-916a-6889198a6396/dd2c4967-8f4d-5102-916a-6889198a6396_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49762,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/09/aa0986dc2e2e3dd2078e1023244aa6f9/pa/ZP81071_9b6b4400c6971966b82ccbddad4daaea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dd2c4967-8f4d-5102-916a-6889198a6396/dd2c4967-8f4d-5102-916a-6889198a6396_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66741,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/09/aa0986dc2e2e3dd2078e1023244aa6f9/pa/ZP81071_840cc81533c1f1e34b50bffed863c8b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dd2c4967-8f4d-5102-916a-6889198a6396/dd2c4967-8f4d-5102-916a-6889198a6396_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65273,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/09/aa0986dc2e2e3dd2078e1023244aa6f9/pa/ZP81071_1fc6ec4afc15d192b382c246d42de8cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dd2c4967-8f4d-5102-916a-6889198a6396/dd2c4967-8f4d-5102-916a-6889198a6396_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59884,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/09/aa0986dc2e2e3dd2078e1023244aa6f9/pa/ZP81071_e7f2d7018b74e56a8c98649c6f1f14e7.jpg',
             'Width': 800}],
 'postal_code': '44860',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Loire-Atlantique',
 'province_code': 'FR-44',
 'region': 'Pays de la Loire',
 'region_code': 'FR-52',
 'registration_date': '2014-08-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI Confortline Business BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Confortline Business BlueMotion Tech',
 'year': 2014}
2026-04-27 08:04:28 [auto1.fr] INFO: Saving data for ZP81071: {'created_time': 1777277068.069791, 'last_price_update_time': 1777277068.069802, 'has_photos': True, 'auction_closing_time': 1777391005.0}
2026-04-27 08:04:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/3c/493c1e5a5a12ca88cdaf88538dab7474/pa/EE30564_77dc6f70d08400a604d502871ccb22ac.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:28 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item dd2c4967-8f4d-5102-916a-6889198a6396 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:04:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d2d8d0>
2026-04-27 08:04:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cd4e810-5454-52b3-a523-32a3f1a4c5b6/5cd4e810-5454-52b3-a523-32a3f1a4c5b6_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/55/fd5506effb27161ff7ccff54733777de/pa/PC47151_b0c6993bfb0497a33e11b7c543c3b5da.jpg saved to cache
2026-04-27 08:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5cd4e810-5454-52b3-a523-32a3f1a4c5b6
2026-04-27 08:04:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c8e650>
2026-04-27 08:04:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5136184-68f2-5086-ab51-eea548b7ee87/d5136184-68f2-5086-ab51-eea548b7ee87_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/3c/493c1e5a5a12ca88cdaf88538dab7474/pa/EE30564_77dc6f70d08400a604d502871ccb22ac.jpg saved to cache
2026-04-27 08:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d5136184-68f2-5086-ab51-eea548b7ee87
2026-04-27 08:04:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/3c/493c1e5a5a12ca88cdaf88538dab7474/pa/EE30564_1632e4c5a31fc464282785c69799d2d9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/55/fd5506effb27161ff7ccff54733777de/pa/PC47151_466d5a82012b761828aec5422672245d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bf18ed0>
2026-04-27 08:04:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5136184-68f2-5086-ab51-eea548b7ee87/d5136184-68f2-5086-ab51-eea548b7ee87_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/3c/493c1e5a5a12ca88cdaf88538dab7474/pa/EE30564_1632e4c5a31fc464282785c69799d2d9.jpg saved to cache
2026-04-27 08:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d5136184-68f2-5086-ab51-eea548b7ee87
2026-04-27 08:04:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a1a610>
2026-04-27 08:04:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cd4e810-5454-52b3-a523-32a3f1a4c5b6/5cd4e810-5454-52b3-a523-32a3f1a4c5b6_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/55/fd5506effb27161ff7ccff54733777de/pa/PC47151_466d5a82012b761828aec5422672245d.jpg saved to cache
2026-04-27 08:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5cd4e810-5454-52b3-a523-32a3f1a4c5b6
2026-04-27 08:04:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/3c/493c1e5a5a12ca88cdaf88538dab7474/pa/EE30564_121cef13417a6be3a247848033cf8513.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/3c/493c1e5a5a12ca88cdaf88538dab7474/pa/EE30564_8a83543c161dcff02170ef0831fd91f9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5cd4e810-5454-52b3-a523-32a3f1a4c5b6 with identifier: PC47151
2026-04-27 08:04:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5cd4e810-5454-52b3-a523-32a3f1a4c5b6 with identifier: PC47151
2026-04-27 08:04:28 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 5cd4e810-5454-52b3-a523-32a3f1a4c5b6 with identifier: PC47151 to the API
2026-04-27 08:04:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:28 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:28 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'category': None,
 'city': 'Gouesnou',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-04-28T15:28:29Z',
 'fuel_type': 'petrol',
 'id': '5cd4e810-5454-52b3-a523-32a3f1a4c5b6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.453,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PC47151',
 'listing': 'auction',
 'location': 'Gouesnou',
 'location_confidence': 'geocoded',
 'longitude': -4.465,
 'make': 'Peugeot',
 'model': '308',
 'odometer': 193727,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/imgfd/55/fd5506effb27161ff7ccff54733777de/pa/PC47151_466d5a82012b761828aec5422672245d.jpg',
                'https://img-pa.auto1.com/imgfd/55/fd5506effb27161ff7ccff54733777de/pa/PC47151_b32e674b3df466035b025aa0d8a5e573.jpg',
                'https://img-pa.auto1.com/imgfd/55/fd5506effb27161ff7ccff54733777de/pa/PC47151_b0c6993bfb0497a33e11b7c543c3b5da.jpg',
                'https://img-pa.auto1.com/imgfd/55/fd5506effb27161ff7ccff54733777de/pa/PC47151_e976f097599d7bdfec76159809d2fb48.jpg',
                'https://img-pa.auto1.com/imgfd/55/fd5506effb27161ff7ccff54733777de/pa/PC47151_abf9796ff9fc0ff10ff3f02415861669.jpg',
                'https://img-pa.auto1.com/imgfd/55/fd5506effb27161ff7ccff54733777de/pa/PC47151_12906010d682b5d38b1c2f6bdd73f72d.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5cd4e810-5454-52b3-a523-32a3f1a4c5b6/5cd4e810-5454-52b3-a523-32a3f1a4c5b6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85333,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/55/fd5506effb27161ff7ccff54733777de/pa/PC47151_466d5a82012b761828aec5422672245d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5cd4e810-5454-52b3-a523-32a3f1a4c5b6/5cd4e810-5454-52b3-a523-32a3f1a4c5b6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75492,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/55/fd5506effb27161ff7ccff54733777de/pa/PC47151_b0c6993bfb0497a33e11b7c543c3b5da.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5cd4e810-5454-52b3-a523-32a3f1a4c5b6/5cd4e810-5454-52b3-a523-32a3f1a4c5b6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78516,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/55/fd5506effb27161ff7ccff54733777de/pa/PC47151_e976f097599d7bdfec76159809d2fb48.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5cd4e810-5454-52b3-a523-32a3f1a4c5b6/5cd4e810-5454-52b3-a523-32a3f1a4c5b6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71152,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/55/fd5506effb27161ff7ccff54733777de/pa/PC47151_abf9796ff9fc0ff10ff3f02415861669.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5cd4e810-5454-52b3-a523-32a3f1a4c5b6/5cd4e810-5454-52b3-a523-32a3f1a4c5b6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63844,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/55/fd5506effb27161ff7ccff54733777de/pa/PC47151_12906010d682b5d38b1c2f6bdd73f72d.jpg',
             'Width': 800}],
 'postal_code': '29850',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Finistère',
 'province_code': 'FR-29',
 'region': 'Bretagne',
 'region_code': 'FR-53',
 'registration_date': '2008-11-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 308 1.6 Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2008}
2026-04-27 08:04:29 [auto1.fr] INFO: Saving data for PC47151: {'created_time': 1777277069.011477, 'last_price_update_time': 1777277069.011487, 'has_photos': True, 'auction_closing_time': 1777390109.0}
2026-04-27 08:04:29 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 5cd4e810-5454-52b3-a523-32a3f1a4c5b6 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142be0e8d0>
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5136184-68f2-5086-ab51-eea548b7ee87/d5136184-68f2-5086-ab51-eea548b7ee87_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/3c/493c1e5a5a12ca88cdaf88538dab7474/pa/EE30564_121cef13417a6be3a247848033cf8513.jpg saved to cache
2026-04-27 08:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d5136184-68f2-5086-ab51-eea548b7ee87
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438fbd910>
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5136184-68f2-5086-ab51-eea548b7ee87/d5136184-68f2-5086-ab51-eea548b7ee87_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/3c/493c1e5a5a12ca88cdaf88538dab7474/pa/EE30564_8a83543c161dcff02170ef0831fd91f9.jpg saved to cache
2026-04-27 08:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d5136184-68f2-5086-ab51-eea548b7ee87
2026-04-27 08:04:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d5136184-68f2-5086-ab51-eea548b7ee87 with identifier: EE30564
2026-04-27 08:04:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d5136184-68f2-5086-ab51-eea548b7ee87 with identifier: EE30564
2026-04-27 08:04:29 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: d5136184-68f2-5086-ab51-eea548b7ee87 with identifier: EE30564 to the API
2026-04-27 08:04:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:29 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:30 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'category': None,
 'city': 'Ingrandes sur Vienne',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 135,
 'expiration_date': '2026-04-28T15:42:19Z',
 'fuel_type': 'diesel',
 'id': 'd5136184-68f2-5086-ab51-eea548b7ee87',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EE30564',
 'listing': 'auction',
 'location': 'FR, Ingrandes sur Vienne',
 'location_confidence': None,
 'longitude': None,
 'make': 'Opel',
 'model': 'Mokka X',
 'odometer': 141093,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img49/3c/493c1e5a5a12ca88cdaf88538dab7474/pa/EE30564_dbfcb01ea7443126a6773184cb407acc.jpg',
                'https://img-pa.auto1.com/img49/3c/493c1e5a5a12ca88cdaf88538dab7474/pa/EE30564_8a83543c161dcff02170ef0831fd91f9.jpg',
                'https://img-pa.auto1.com/img49/3c/493c1e5a5a12ca88cdaf88538dab7474/pa/EE30564_121cef13417a6be3a247848033cf8513.jpg',
                'https://img-pa.auto1.com/img49/3c/493c1e5a5a12ca88cdaf88538dab7474/pa/EE30564_1632e4c5a31fc464282785c69799d2d9.jpg',
                'https://img-pa.auto1.com/img49/3c/493c1e5a5a12ca88cdaf88538dab7474/pa/EE30564_77dc6f70d08400a604d502871ccb22ac.jpg',
                'https://img-pa.auto1.com/img49/3c/493c1e5a5a12ca88cdaf88538dab7474/pa/EE30564_8295d20d76ded82b1cc6c7064186bf82.jpg',
                'https://img-pa.auto1.com/img49/3c/493c1e5a5a12ca88cdaf88538dab7474/pa/EE30564_82b906558ce7774e30e8df31877a8e46.jpg',
                'https://img-pa.auto1.com/img49/3c/493c1e5a5a12ca88cdaf88538dab7474/pa/EE30564_c5c5aee5b7ff59bb016e44423c8c5192.jpg',
                'https://img-pa.auto1.com/img49/3c/493c1e5a5a12ca88cdaf88538dab7474/pa/EE30564_a9ed675baa88fa85dd779d1a12a0e54f.jpg',
                'https://img-pa.auto1.com/img49/3c/493c1e5a5a12ca88cdaf88538dab7474/pa/EE30564_323ea7e73537c85707d9b6b21ae98329.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d5136184-68f2-5086-ab51-eea548b7ee87/d5136184-68f2-5086-ab51-eea548b7ee87_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66894,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/3c/493c1e5a5a12ca88cdaf88538dab7474/pa/EE30564_8a83543c161dcff02170ef0831fd91f9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d5136184-68f2-5086-ab51-eea548b7ee87/d5136184-68f2-5086-ab51-eea548b7ee87_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66939,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/3c/493c1e5a5a12ca88cdaf88538dab7474/pa/EE30564_121cef13417a6be3a247848033cf8513.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d5136184-68f2-5086-ab51-eea548b7ee87/d5136184-68f2-5086-ab51-eea548b7ee87_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56444,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/3c/493c1e5a5a12ca88cdaf88538dab7474/pa/EE30564_1632e4c5a31fc464282785c69799d2d9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d5136184-68f2-5086-ab51-eea548b7ee87/d5136184-68f2-5086-ab51-eea548b7ee87_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57871,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/3c/493c1e5a5a12ca88cdaf88538dab7474/pa/EE30564_77dc6f70d08400a604d502871ccb22ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d5136184-68f2-5086-ab51-eea548b7ee87/d5136184-68f2-5086-ab51-eea548b7ee87_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63194,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/3c/493c1e5a5a12ca88cdaf88538dab7474/pa/EE30564_8295d20d76ded82b1cc6c7064186bf82.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d5136184-68f2-5086-ab51-eea548b7ee87/d5136184-68f2-5086-ab51-eea548b7ee87_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57978,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/3c/493c1e5a5a12ca88cdaf88538dab7474/pa/EE30564_82b906558ce7774e30e8df31877a8e46.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d5136184-68f2-5086-ab51-eea548b7ee87/d5136184-68f2-5086-ab51-eea548b7ee87_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67831,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/3c/493c1e5a5a12ca88cdaf88538dab7474/pa/EE30564_a9ed675baa88fa85dd779d1a12a0e54f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d5136184-68f2-5086-ab51-eea548b7ee87/d5136184-68f2-5086-ab51-eea548b7ee87_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61202,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/3c/493c1e5a5a12ca88cdaf88538dab7474/pa/EE30564_323ea7e73537c85707d9b6b21ae98329.jpg',
             'Width': 800}],
 'postal_code': None,
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2018-05-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Mokka X 1.6 CDTI Elite',
 'transmission': 'automatic',
 'trim': 'Elite',
 'year': 2018}
2026-04-27 08:04:30 [auto1.fr] INFO: Saving data for EE30564: {'created_time': 1777277070.073216, 'last_price_update_time': 1777277070.073229, 'has_photos': True, 'auction_closing_time': 1777390939.0}
2026-04-27 08:04:30 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item d5136184-68f2-5086-ab51-eea548b7ee87 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/1c/7d1c93ca4bbe89621b8efcb6585e9b8c/pa/AC55074_85446462f10ecf2e1caec7eb2f8400f5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MZ95816> (referer: https://www.auto1.com/v1/car-details-view/MZ95816/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c99e10>
2026-04-27 08:04:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4693e5fd-40a8-5b79-a5c9-e14c3ec71fba/4693e5fd-40a8-5b79-a5c9-e14c3ec71fba_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/1c/7d1c93ca4bbe89621b8efcb6585e9b8c/pa/AC55074_85446462f10ecf2e1caec7eb2f8400f5.jpg saved to cache
2026-04-27 08:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4693e5fd-40a8-5b79-a5c9-e14c3ec71fba
2026-04-27 08:04:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4beede2-e56d-512d-bcd0-e42fcd81b3f7 with identifier: MZ95816
2026-04-27 08:04:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4beede2-e56d-512d-bcd0-e42fcd81b3f7 with scrape type 1
2026-04-27 08:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item a4beede2-e56d-512d-bcd0-e42fcd81b3f7
2026-04-27 08:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/7c/cc7c988db4e59294095475b7377015f8/pa/MZ95816_bee6f65691982cbd32d606b926b32a5b.jpg not downloaded yet
2026-04-27 08:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/7c/cc7c988db4e59294095475b7377015f8/pa/MZ95816_b7509a6c91b0b9f58987946b522d939d.jpg not downloaded yet
2026-04-27 08:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/7c/cc7c988db4e59294095475b7377015f8/pa/MZ95816_9e9aa005110c087a8abcec470f1b5c4d.jpg not downloaded yet
2026-04-27 08:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/7c/cc7c988db4e59294095475b7377015f8/pa/MZ95816_acd55ac57cc4cd273b91e212b5639126.jpg not downloaded yet
2026-04-27 08:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/7c/cc7c988db4e59294095475b7377015f8/pa/MZ95816_73912f5c4748c5bc2b8a77423b49c34a.jpg not downloaded yet
2026-04-27 08:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/7c/cc7c988db4e59294095475b7377015f8/pa/MZ95816_adbd02bb7ddfd523868823b4d47adc52.jpg not downloaded yet
2026-04-27 08:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/94/c394a6f2a84927e0e63ff4e532d9a6c0/pa/CS54070_98e34c5e8644a56121068573b278c867.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380bb290>
2026-04-27 08:04:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ad1fc8f-78a4-5e5c-b1e6-2588312b7847/2ad1fc8f-78a4-5e5c-b1e6-2588312b7847_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/94/c394a6f2a84927e0e63ff4e532d9a6c0/pa/CS54070_98e34c5e8644a56121068573b278c867.jpg saved to cache
2026-04-27 08:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2ad1fc8f-78a4-5e5c-b1e6-2588312b7847
2026-04-27 08:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/7c/cc7c988db4e59294095475b7377015f8/pa/MZ95816_adbd02bb7ddfd523868823b4d47adc52.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GT31591> (referer: https://www.auto1.com/v1/car-details-view/GT31591/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CZ28253> (referer: https://www.auto1.com/v1/car-details-view/CZ28253/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ae4090>
2026-04-27 08:04:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4beede2-e56d-512d-bcd0-e42fcd81b3f7/a4beede2-e56d-512d-bcd0-e42fcd81b3f7_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/7c/cc7c988db4e59294095475b7377015f8/pa/MZ95816_adbd02bb7ddfd523868823b4d47adc52.jpg saved to cache
2026-04-27 08:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a4beede2-e56d-512d-bcd0-e42fcd81b3f7
2026-04-27 08:04:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c1f4ceb-bc40-5514-8b22-fe3b4d4cbc6e with identifier: GT31591
2026-04-27 08:04:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c1f4ceb-bc40-5514-8b22-fe3b4d4cbc6e with scrape type 1
2026-04-27 08:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0c1f4ceb-bc40-5514-8b22-fe3b4d4cbc6e
2026-04-27 08:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/26/b1265df7e6bd24e0b6ffedd0f25486e5/pa/GT31591_3d2a56f5195b67d09a48950234c84d16.jpg not downloaded yet
2026-04-27 08:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/26/b1265df7e6bd24e0b6ffedd0f25486e5/pa/GT31591_995953f11a0a0a7a5cd4641e46431d79.jpg not downloaded yet
2026-04-27 08:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/7c/cc7c988db4e59294095475b7377015f8/pa/MZ95816_73912f5c4748c5bc2b8a77423b49c34a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/26/b1265df7e6bd24e0b6ffedd0f25486e5/pa/GT31591_d7210be945e0977eb870101904e34869.jpg not downloaded yet
2026-04-27 08:04:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9a41afe-c791-5641-b2e3-87dd47fcfcde with identifier: CZ28253
2026-04-27 08:04:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9a41afe-c791-5641-b2e3-87dd47fcfcde with scrape type 1
2026-04-27 08:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item d9a41afe-c791-5641-b2e3-87dd47fcfcde
2026-04-27 08:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/93/7d93688daf0c26191e254201cbf97adb/pa/CZ28253_e9904d09f11be26135af62c12b1648a3.jpg not downloaded yet
2026-04-27 08:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/26/b1265df7e6bd24e0b6ffedd0f25486e5/pa/GT31591_cf8f171a5feaefb397943eaac62e358c.jpg not downloaded yet
2026-04-27 08:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/93/7d93688daf0c26191e254201cbf97adb/pa/CZ28253_ac43bb90ff529fea3785ace971870d4b.jpg not downloaded yet
2026-04-27 08:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/26/b1265df7e6bd24e0b6ffedd0f25486e5/pa/GT31591_eb4566647ce35b5a93e77ac6866de810.jpg not downloaded yet
2026-04-27 08:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/93/7d93688daf0c26191e254201cbf97adb/pa/CZ28253_103a0f9a87506a868261c73ef871ab56.jpg not downloaded yet
2026-04-27 08:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/26/b1265df7e6bd24e0b6ffedd0f25486e5/pa/GT31591_d64cac44f6bede450cfe09af7df37a99.jpg not downloaded yet
2026-04-27 08:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/26/b1265df7e6bd24e0b6ffedd0f25486e5/pa/GT31591_995953f11a0a0a7a5cd4641e46431d79.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/93/7d93688daf0c26191e254201cbf97adb/pa/CZ28253_a6963e92c1b8a404ef93b12941e63b99.jpg not downloaded yet
2026-04-27 08:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/26/b1265df7e6bd24e0b6ffedd0f25486e5/pa/GT31591_c88a5188b0b09d1ae468096942f4ba14.jpg not downloaded yet
2026-04-27 08:04:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c2f8d0>
2026-04-27 08:04:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4beede2-e56d-512d-bcd0-e42fcd81b3f7/a4beede2-e56d-512d-bcd0-e42fcd81b3f7_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/7c/cc7c988db4e59294095475b7377015f8/pa/MZ95816_73912f5c4748c5bc2b8a77423b49c34a.jpg saved to cache
2026-04-27 08:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a4beede2-e56d-512d-bcd0-e42fcd81b3f7
2026-04-27 08:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/93/7d93688daf0c26191e254201cbf97adb/pa/CZ28253_9c233223fcc1f91d4a7f5ab85c9ff1e2.jpg not downloaded yet
2026-04-27 08:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/26/b1265df7e6bd24e0b6ffedd0f25486e5/pa/GT31591_e219223a0ef0e02d6b5c16edf5937759.jpg not downloaded yet
2026-04-27 08:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/93/7d93688daf0c26191e254201cbf97adb/pa/CZ28253_ec53096c0a0c8c69afc41e1218768aef.jpg not downloaded yet
2026-04-27 08:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/26/b1265df7e6bd24e0b6ffedd0f25486e5/pa/GT31591_69a4d0108d47cb465d5169c715b92cc9.jpg not downloaded yet
2026-04-27 08:04:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438cccb90>
2026-04-27 08:04:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c1f4ceb-bc40-5514-8b22-fe3b4d4cbc6e/0c1f4ceb-bc40-5514-8b22-fe3b4d4cbc6e_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/26/b1265df7e6bd24e0b6ffedd0f25486e5/pa/GT31591_995953f11a0a0a7a5cd4641e46431d79.jpg saved to cache
2026-04-27 08:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0c1f4ceb-bc40-5514-8b22-fe3b4d4cbc6e
2026-04-27 08:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/26/b1265df7e6bd24e0b6ffedd0f25486e5/pa/GT31591_c9541b8e74040e5fca758e7723e029eb.jpg not downloaded yet
2026-04-27 08:04:31 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 4693e5fd-40a8-5b79-a5c9-e14c3ec71fba due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/26/b1265df7e6bd24e0b6ffedd0f25486e5/pa/GT31591_d64cac44f6bede450cfe09af7df37a99.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438016f50>
2026-04-27 08:04:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c1f4ceb-bc40-5514-8b22-fe3b4d4cbc6e/0c1f4ceb-bc40-5514-8b22-fe3b4d4cbc6e_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/26/b1265df7e6bd24e0b6ffedd0f25486e5/pa/GT31591_d64cac44f6bede450cfe09af7df37a99.jpg saved to cache
2026-04-27 08:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0c1f4ceb-bc40-5514-8b22-fe3b4d4cbc6e
2026-04-27 08:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/26/b1265df7e6bd24e0b6ffedd0f25486e5/pa/GT31591_c9541b8e74040e5fca758e7723e029eb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZZ03906> (referer: https://www.auto1.com/v1/car-details-view/ZZ03906/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438cdcd10>
2026-04-27 08:04:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c1f4ceb-bc40-5514-8b22-fe3b4d4cbc6e/0c1f4ceb-bc40-5514-8b22-fe3b4d4cbc6e_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/26/b1265df7e6bd24e0b6ffedd0f25486e5/pa/GT31591_c9541b8e74040e5fca758e7723e029eb.jpg saved to cache
2026-04-27 08:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0c1f4ceb-bc40-5514-8b22-fe3b4d4cbc6e
2026-04-27 08:04:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2dcdff10-510b-51ca-9976-b8c074300a05 with identifier: ZZ03906
2026-04-27 08:04:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2dcdff10-510b-51ca-9976-b8c074300a05 with scrape type 1
2026-04-27 08:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2dcdff10-510b-51ca-9976-b8c074300a05
2026-04-27 08:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/02/380208bd04868badc9de90f75b58d3ee/pa/ZZ03906_0abc3c0ce3953960f364bd98589c8cb1.jpg not downloaded yet
2026-04-27 08:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/02/380208bd04868badc9de90f75b58d3ee/pa/ZZ03906_4891ea1edcad843594e25ba7d8448281.jpg not downloaded yet
2026-04-27 08:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/02/380208bd04868badc9de90f75b58d3ee/pa/ZZ03906_6cd4c60d374a149ff62f7a3c48feef61.jpg not downloaded yet
2026-04-27 08:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/02/380208bd04868badc9de90f75b58d3ee/pa/ZZ03906_5ac92411b2a6dee9ff1896e1bba7e02c.jpg not downloaded yet
2026-04-27 08:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/26/b1265df7e6bd24e0b6ffedd0f25486e5/pa/GT31591_69a4d0108d47cb465d5169c715b92cc9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:31 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item a4beede2-e56d-512d-bcd0-e42fcd81b3f7 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:04:31 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item a4beede2-e56d-512d-bcd0-e42fcd81b3f7 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/02/380208bd04868badc9de90f75b58d3ee/pa/ZZ03906_89da8bf98c59e66037b88017b19f0ed5.jpg not downloaded yet
2026-04-27 08:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/02/380208bd04868badc9de90f75b58d3ee/pa/ZZ03906_6c743829d8ec9032b9f121cbe98d9c93.jpg not downloaded yet
2026-04-27 08:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/02/380208bd04868badc9de90f75b58d3ee/pa/ZZ03906_9bf9c493e38576c98e6ad18feb9e3b27.jpg not downloaded yet
2026-04-27 08:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/02/380208bd04868badc9de90f75b58d3ee/pa/ZZ03906_f2bc9e8b7a40760e8546ad204e51abaa.jpg not downloaded yet
2026-04-27 08:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/02/380208bd04868badc9de90f75b58d3ee/pa/ZZ03906_e919484dd1c8855dde38ebc4651637f7.jpg not downloaded yet
2026-04-27 08:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/02/380208bd04868badc9de90f75b58d3ee/pa/ZZ03906_04fb27594926561e63e579e1b27791aa.jpg not downloaded yet
2026-04-27 08:04:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bfd1290>
2026-04-27 08:04:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c1f4ceb-bc40-5514-8b22-fe3b4d4cbc6e/0c1f4ceb-bc40-5514-8b22-fe3b4d4cbc6e_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/26/b1265df7e6bd24e0b6ffedd0f25486e5/pa/GT31591_69a4d0108d47cb465d5169c715b92cc9.jpg saved to cache
2026-04-27 08:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0c1f4ceb-bc40-5514-8b22-fe3b4d4cbc6e
2026-04-27 08:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/02/380208bd04868badc9de90f75b58d3ee/pa/ZZ03906_5ac92411b2a6dee9ff1896e1bba7e02c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ccc110>
2026-04-27 08:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dcdff10-510b-51ca-9976-b8c074300a05/2dcdff10-510b-51ca-9976-b8c074300a05_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/02/380208bd04868badc9de90f75b58d3ee/pa/ZZ03906_5ac92411b2a6dee9ff1896e1bba7e02c.jpg saved to cache
2026-04-27 08:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2dcdff10-510b-51ca-9976-b8c074300a05
2026-04-27 08:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/02/380208bd04868badc9de90f75b58d3ee/pa/ZZ03906_04fb27594926561e63e579e1b27791aa.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b34910>
2026-04-27 08:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dcdff10-510b-51ca-9976-b8c074300a05/2dcdff10-510b-51ca-9976-b8c074300a05_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/02/380208bd04868badc9de90f75b58d3ee/pa/ZZ03906_04fb27594926561e63e579e1b27791aa.jpg saved to cache
2026-04-27 08:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2dcdff10-510b-51ca-9976-b8c074300a05
2026-04-27 08:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/02/380208bd04868badc9de90f75b58d3ee/pa/ZZ03906_e919484dd1c8855dde38ebc4651637f7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:32 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 0c1f4ceb-bc40-5514-8b22-fe3b4d4cbc6e due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438e7c190>
2026-04-27 08:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dcdff10-510b-51ca-9976-b8c074300a05/2dcdff10-510b-51ca-9976-b8c074300a05_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/02/380208bd04868badc9de90f75b58d3ee/pa/ZZ03906_e919484dd1c8855dde38ebc4651637f7.jpg saved to cache
2026-04-27 08:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2dcdff10-510b-51ca-9976-b8c074300a05
2026-04-27 08:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/02/380208bd04868badc9de90f75b58d3ee/pa/ZZ03906_9bf9c493e38576c98e6ad18feb9e3b27.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:32 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item d9a41afe-c791-5641-b2e3-87dd47fcfcde due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438fbead0>
2026-04-27 08:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dcdff10-510b-51ca-9976-b8c074300a05/2dcdff10-510b-51ca-9976-b8c074300a05_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/02/380208bd04868badc9de90f75b58d3ee/pa/ZZ03906_9bf9c493e38576c98e6ad18feb9e3b27.jpg saved to cache
2026-04-27 08:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2dcdff10-510b-51ca-9976-b8c074300a05
2026-04-27 08:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SS62373> (referer: https://www.auto1.com/v1/car-details-view/SS62373/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/02/380208bd04868badc9de90f75b58d3ee/pa/ZZ03906_6c743829d8ec9032b9f121cbe98d9c93.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:32 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 0c1f4ceb-bc40-5514-8b22-fe3b4d4cbc6e due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:04:32 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item d9a41afe-c791-5641-b2e3-87dd47fcfcde due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:04:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b893ec9b-dfe4-5a85-b8d6-8f9d1e6538ee with identifier: SS62373
2026-04-27 08:04:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b893ec9b-dfe4-5a85-b8d6-8f9d1e6538ee with scrape type 1
2026-04-27 08:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item b893ec9b-dfe4-5a85-b8d6-8f9d1e6538ee
2026-04-27 08:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/65/a665d255241c45ba93c416de2545dc3d/pa/SS62373_06c3bb1f8e0b5511b4c2c9d21ce35499.jpg not downloaded yet
2026-04-27 08:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/65/a665d255241c45ba93c416de2545dc3d/pa/SS62373_db316dfd73b16f0a9ab8500bfddb231f.jpg not downloaded yet
2026-04-27 08:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/93/7d93688daf0c26191e254201cbf97adb/pa/CZ28253_a6963e92c1b8a404ef93b12941e63b99.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/65/a665d255241c45ba93c416de2545dc3d/pa/SS62373_f23e61379165a55a6628a04b720f5147.jpg not downloaded yet
2026-04-27 08:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c98e10>
2026-04-27 08:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dcdff10-510b-51ca-9976-b8c074300a05/2dcdff10-510b-51ca-9976-b8c074300a05_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/02/380208bd04868badc9de90f75b58d3ee/pa/ZZ03906_6c743829d8ec9032b9f121cbe98d9c93.jpg saved to cache
2026-04-27 08:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2dcdff10-510b-51ca-9976-b8c074300a05
2026-04-27 08:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/65/a665d255241c45ba93c416de2545dc3d/pa/SS62373_fe184cd00fadc5c63185b95ff805454a.jpg not downloaded yet
2026-04-27 08:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/65/a665d255241c45ba93c416de2545dc3d/pa/SS62373_3bd20c5e8ba289138419262f49876012.jpg not downloaded yet
2026-04-27 08:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/65/a665d255241c45ba93c416de2545dc3d/pa/SS62373_7649363eb6dba1683dec1cbe9bc09810.jpg not downloaded yet
2026-04-27 08:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d33790>
2026-04-27 08:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9a41afe-c791-5641-b2e3-87dd47fcfcde/d9a41afe-c791-5641-b2e3-87dd47fcfcde_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/93/7d93688daf0c26191e254201cbf97adb/pa/CZ28253_a6963e92c1b8a404ef93b12941e63b99.jpg saved to cache
2026-04-27 08:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d9a41afe-c791-5641-b2e3-87dd47fcfcde
2026-04-27 08:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/65/a665d255241c45ba93c416de2545dc3d/pa/SS62373_db316dfd73b16f0a9ab8500bfddb231f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14381890d0>
2026-04-27 08:04:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b893ec9b-dfe4-5a85-b8d6-8f9d1e6538ee/b893ec9b-dfe4-5a85-b8d6-8f9d1e6538ee_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/65/a665d255241c45ba93c416de2545dc3d/pa/SS62373_db316dfd73b16f0a9ab8500bfddb231f.jpg saved to cache
2026-04-27 08:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b893ec9b-dfe4-5a85-b8d6-8f9d1e6538ee
2026-04-27 08:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/65/a665d255241c45ba93c416de2545dc3d/pa/SS62373_7649363eb6dba1683dec1cbe9bc09810.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:33 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 2dcdff10-510b-51ca-9976-b8c074300a05 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:04:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438087a50>
2026-04-27 08:04:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b893ec9b-dfe4-5a85-b8d6-8f9d1e6538ee/b893ec9b-dfe4-5a85-b8d6-8f9d1e6538ee_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/65/a665d255241c45ba93c416de2545dc3d/pa/SS62373_7649363eb6dba1683dec1cbe9bc09810.jpg saved to cache
2026-04-27 08:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b893ec9b-dfe4-5a85-b8d6-8f9d1e6538ee
2026-04-27 08:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/65/a665d255241c45ba93c416de2545dc3d/pa/SS62373_fe184cd00fadc5c63185b95ff805454a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:33 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 2dcdff10-510b-51ca-9976-b8c074300a05 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/65/a665d255241c45ba93c416de2545dc3d/pa/SS62373_06c3bb1f8e0b5511b4c2c9d21ce35499.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d32650>
2026-04-27 08:04:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b893ec9b-dfe4-5a85-b8d6-8f9d1e6538ee/b893ec9b-dfe4-5a85-b8d6-8f9d1e6538ee_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/65/a665d255241c45ba93c416de2545dc3d/pa/SS62373_fe184cd00fadc5c63185b95ff805454a.jpg saved to cache
2026-04-27 08:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b893ec9b-dfe4-5a85-b8d6-8f9d1e6538ee
2026-04-27 08:04:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438cb8e10>
2026-04-27 08:04:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b893ec9b-dfe4-5a85-b8d6-8f9d1e6538ee/b893ec9b-dfe4-5a85-b8d6-8f9d1e6538ee_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/65/a665d255241c45ba93c416de2545dc3d/pa/SS62373_06c3bb1f8e0b5511b4c2c9d21ce35499.jpg saved to cache
2026-04-27 08:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b893ec9b-dfe4-5a85-b8d6-8f9d1e6538ee
2026-04-27 08:04:33 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 2dcdff10-510b-51ca-9976-b8c074300a05 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:04:33 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item 2dcdff10-510b-51ca-9976-b8c074300a05 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/93/7d93688daf0c26191e254201cbf97adb/pa/CZ28253_103a0f9a87506a868261c73ef871ab56.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2dcdff10-510b-51ca-9976-b8c074300a05 with identifier: ZZ03906
2026-04-27 08:04:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2dcdff10-510b-51ca-9976-b8c074300a05 with identifier: ZZ03906
2026-04-27 08:04:34 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2dcdff10-510b-51ca-9976-b8c074300a05 with identifier: ZZ03906 to the API
2026-04-27 08:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:34 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:34 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'city': 'Tarnos',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 130,
 'expiration_date': '2026-04-28T15:58:56Z',
 'fuel_type': 'petrol',
 'id': '2dcdff10-510b-51ca-9976-b8c074300a05',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 43.5417,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ03906',
 'listing': 'auction',
 'location': 'FR, Tarnos',
 'location_confidence': 'geocoded',
 'longitude': -1.4628,
 'make': 'Renault',
 'model': 'Kadjar',
 'odometer': 135406,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img38/02/380208bd04868badc9de90f75b58d3ee/pa/ZZ03906_0abc3c0ce3953960f364bd98589c8cb1.jpg',
                'https://img-pa.auto1.com/img38/02/380208bd04868badc9de90f75b58d3ee/pa/ZZ03906_4891ea1edcad843594e25ba7d8448281.jpg',
                'https://img-pa.auto1.com/img38/02/380208bd04868badc9de90f75b58d3ee/pa/ZZ03906_6cd4c60d374a149ff62f7a3c48feef61.jpg',
                'https://img-pa.auto1.com/img38/02/380208bd04868badc9de90f75b58d3ee/pa/ZZ03906_5ac92411b2a6dee9ff1896e1bba7e02c.jpg',
                'https://img-pa.auto1.com/img38/02/380208bd04868badc9de90f75b58d3ee/pa/ZZ03906_89da8bf98c59e66037b88017b19f0ed5.jpg',
                'https://img-pa.auto1.com/img38/02/380208bd04868badc9de90f75b58d3ee/pa/ZZ03906_6c743829d8ec9032b9f121cbe98d9c93.jpg',
                'https://img-pa.auto1.com/img38/02/380208bd04868badc9de90f75b58d3ee/pa/ZZ03906_9bf9c493e38576c98e6ad18feb9e3b27.jpg',
                'https://img-pa.auto1.com/img38/02/380208bd04868badc9de90f75b58d3ee/pa/ZZ03906_f2bc9e8b7a40760e8546ad204e51abaa.jpg',
                'https://img-pa.auto1.com/img38/02/380208bd04868badc9de90f75b58d3ee/pa/ZZ03906_e919484dd1c8855dde38ebc4651637f7.jpg',
                'https://img-pa.auto1.com/img38/02/380208bd04868badc9de90f75b58d3ee/pa/ZZ03906_04fb27594926561e63e579e1b27791aa.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2dcdff10-510b-51ca-9976-b8c074300a05/2dcdff10-510b-51ca-9976-b8c074300a05_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59600,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/02/380208bd04868badc9de90f75b58d3ee/pa/ZZ03906_5ac92411b2a6dee9ff1896e1bba7e02c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2dcdff10-510b-51ca-9976-b8c074300a05/2dcdff10-510b-51ca-9976-b8c074300a05_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69911,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/02/380208bd04868badc9de90f75b58d3ee/pa/ZZ03906_6c743829d8ec9032b9f121cbe98d9c93.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2dcdff10-510b-51ca-9976-b8c074300a05/2dcdff10-510b-51ca-9976-b8c074300a05_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54111,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/02/380208bd04868badc9de90f75b58d3ee/pa/ZZ03906_9bf9c493e38576c98e6ad18feb9e3b27.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2dcdff10-510b-51ca-9976-b8c074300a05/2dcdff10-510b-51ca-9976-b8c074300a05_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60573,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/02/380208bd04868badc9de90f75b58d3ee/pa/ZZ03906_e919484dd1c8855dde38ebc4651637f7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2dcdff10-510b-51ca-9976-b8c074300a05/2dcdff10-510b-51ca-9976-b8c074300a05_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53983,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/02/380208bd04868badc9de90f75b58d3ee/pa/ZZ03906_04fb27594926561e63e579e1b27791aa.jpg',
             'Width': 800}],
 'postal_code': '40220',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Landes',
 'province_code': 'FR-40',
 'region': 'Nouvelle-Aquitaine',
 'region_code': 'FR-75',
 'registration_date': '2018-01-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Kadjar 1.2 TCe Energy Intens',
 'transmission': 'automatic',
 'trim': 'Intens',
 'year': 2018}
2026-04-27 08:04:34 [auto1.fr] INFO: Saving data for ZZ03906: {'created_time': 1777277074.487011, 'last_price_update_time': 1777277074.487022, 'has_photos': True, 'auction_closing_time': 1777391936.0}
2026-04-27 08:04:34 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 2dcdff10-510b-51ca-9976-b8c074300a05 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/93/7d93688daf0c26191e254201cbf97adb/pa/CZ28253_e9904d09f11be26135af62c12b1648a3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JN01057> (referer: https://www.auto1.com/v1/car-details-view/JN01057/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bffe1d0>
2026-04-27 08:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9a41afe-c791-5641-b2e3-87dd47fcfcde/d9a41afe-c791-5641-b2e3-87dd47fcfcde_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/93/7d93688daf0c26191e254201cbf97adb/pa/CZ28253_103a0f9a87506a868261c73ef871ab56.jpg saved to cache
2026-04-27 08:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d9a41afe-c791-5641-b2e3-87dd47fcfcde
2026-04-27 08:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/26/b1265df7e6bd24e0b6ffedd0f25486e5/pa/GT31591_3d2a56f5195b67d09a48950234c84d16.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:34 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item b893ec9b-dfe4-5a85-b8d6-8f9d1e6538ee due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d45490>
2026-04-27 08:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9a41afe-c791-5641-b2e3-87dd47fcfcde/d9a41afe-c791-5641-b2e3-87dd47fcfcde_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/93/7d93688daf0c26191e254201cbf97adb/pa/CZ28253_e9904d09f11be26135af62c12b1648a3.jpg saved to cache
2026-04-27 08:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d9a41afe-c791-5641-b2e3-87dd47fcfcde
2026-04-27 08:04:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25f94154-d3cf-5def-adbd-e3e2ca881d4c with identifier: JN01057
2026-04-27 08:04:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25f94154-d3cf-5def-adbd-e3e2ca881d4c with scrape type 1
2026-04-27 08:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 25f94154-d3cf-5def-adbd-e3e2ca881d4c
2026-04-27 08:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/49/ec49d627b47c7c82dcd648c62fbfbb8d/pa/JN01057_28039814027869b8ab5c9c44c75e78a7.jpg not downloaded yet
2026-04-27 08:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/49/ec49d627b47c7c82dcd648c62fbfbb8d/pa/JN01057_3e0df03a3818996f6cd5ce49eaac4a7f.jpg not downloaded yet
2026-04-27 08:04:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b893ec9b-dfe4-5a85-b8d6-8f9d1e6538ee with identifier: SS62373
2026-04-27 08:04:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b893ec9b-dfe4-5a85-b8d6-8f9d1e6538ee with identifier: SS62373
2026-04-27 08:04:34 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b893ec9b-dfe4-5a85-b8d6-8f9d1e6538ee with identifier: SS62373 to the API
2026-04-27 08:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:34 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:35 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': 145,
 'category': None,
 'city': 'Saint Aignan de Grandlieu',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.9L',
 'engine_horse_power': 130,
 'expiration_date': '2026-04-28T15:44:12Z',
 'fuel_type': 'diesel',
 'id': 'b893ec9b-dfe4-5a85-b8d6-8f9d1e6538ee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 47.1237,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SS62373',
 'listing': 'auction',
 'location': 'FR, Saint Aignan de Grandlieu',
 'location_confidence': 'geocoded',
 'longitude': -1.6308,
 'make': 'Renault',
 'model': 'Scenic',
 'odometer': 209195,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/imga6/65/a665d255241c45ba93c416de2545dc3d/pa/SS62373_06c3bb1f8e0b5511b4c2c9d21ce35499.jpg',
                'https://img-pa.auto1.com/imga6/65/a665d255241c45ba93c416de2545dc3d/pa/SS62373_db316dfd73b16f0a9ab8500bfddb231f.jpg',
                'https://img-pa.auto1.com/imga6/65/a665d255241c45ba93c416de2545dc3d/pa/SS62373_f23e61379165a55a6628a04b720f5147.jpg',
                'https://img-pa.auto1.com/imga6/65/a665d255241c45ba93c416de2545dc3d/pa/SS62373_fe184cd00fadc5c63185b95ff805454a.jpg',
                'https://img-pa.auto1.com/imga6/65/a665d255241c45ba93c416de2545dc3d/pa/SS62373_3bd20c5e8ba289138419262f49876012.jpg',
                'https://img-pa.auto1.com/imga6/65/a665d255241c45ba93c416de2545dc3d/pa/SS62373_7649363eb6dba1683dec1cbe9bc09810.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b893ec9b-dfe4-5a85-b8d6-8f9d1e6538ee/b893ec9b-dfe4-5a85-b8d6-8f9d1e6538ee_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75830,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/65/a665d255241c45ba93c416de2545dc3d/pa/SS62373_06c3bb1f8e0b5511b4c2c9d21ce35499.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b893ec9b-dfe4-5a85-b8d6-8f9d1e6538ee/b893ec9b-dfe4-5a85-b8d6-8f9d1e6538ee_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78161,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/65/a665d255241c45ba93c416de2545dc3d/pa/SS62373_db316dfd73b16f0a9ab8500bfddb231f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b893ec9b-dfe4-5a85-b8d6-8f9d1e6538ee/b893ec9b-dfe4-5a85-b8d6-8f9d1e6538ee_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75328,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/65/a665d255241c45ba93c416de2545dc3d/pa/SS62373_fe184cd00fadc5c63185b95ff805454a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b893ec9b-dfe4-5a85-b8d6-8f9d1e6538ee/b893ec9b-dfe4-5a85-b8d6-8f9d1e6538ee_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63782,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/65/a665d255241c45ba93c416de2545dc3d/pa/SS62373_7649363eb6dba1683dec1cbe9bc09810.jpg',
             'Width': 800}],
 'postal_code': '44860',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Loire-Atlantique',
 'province_code': 'FR-44',
 'region': 'Pays de la Loire',
 'region_code': 'FR-52',
 'registration_date': '2010-12-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Scenic 1.9 dCi Privilege',
 'transmission': 'manual',
 'trim': 'Privilege',
 'year': 2010}
2026-04-27 08:04:35 [auto1.fr] INFO: Saving data for SS62373: {'created_time': 1777277075.078711, 'last_price_update_time': 1777277075.078721, 'has_photos': True, 'auction_closing_time': 1777391052.0}
2026-04-27 08:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/49/ec49d627b47c7c82dcd648c62fbfbb8d/pa/JN01057_f61cf34a5b022e830fb23f73a7e75539.jpg not downloaded yet
2026-04-27 08:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/94/c394a6f2a84927e0e63ff4e532d9a6c0/pa/CS54070_9c5fc469e3cb0e140ecb59ea7201b8dc.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:35 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item b893ec9b-dfe4-5a85-b8d6-8f9d1e6538ee due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EF60252/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438fb7e10>
2026-04-27 08:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c1f4ceb-bc40-5514-8b22-fe3b4d4cbc6e/0c1f4ceb-bc40-5514-8b22-fe3b4d4cbc6e_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/26/b1265df7e6bd24e0b6ffedd0f25486e5/pa/GT31591_3d2a56f5195b67d09a48950234c84d16.jpg saved to cache
2026-04-27 08:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0c1f4ceb-bc40-5514-8b22-fe3b4d4cbc6e
2026-04-27 08:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/49/ec49d627b47c7c82dcd648c62fbfbb8d/pa/JN01057_e04dc5b3914df1653bf84ff5618e7923.jpg not downloaded yet
2026-04-27 08:04:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/49/ec49d627b47c7c82dcd648c62fbfbb8d/pa/JN01057_cbbb1e90e3e36c112a0e48bc4a469c63.jpg not downloaded yet
2026-04-27 08:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/49/ec49d627b47c7c82dcd648c62fbfbb8d/pa/JN01057_3bafed436350a340091339b00075d3ad.jpg not downloaded yet
2026-04-27 08:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/49/ec49d627b47c7c82dcd648c62fbfbb8d/pa/JN01057_bbd9e157c67c1fccaacc0c6561768bb5.jpg not downloaded yet
2026-04-27 08:04:35 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 0c1f4ceb-bc40-5514-8b22-fe3b4d4cbc6e due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:04:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d9a41afe-c791-5641-b2e3-87dd47fcfcde with identifier: CZ28253
2026-04-27 08:04:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d9a41afe-c791-5641-b2e3-87dd47fcfcde with identifier: CZ28253
2026-04-27 08:04:35 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: d9a41afe-c791-5641-b2e3-87dd47fcfcde with identifier: CZ28253 to the API
2026-04-27 08:04:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:35 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:35 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'category': None,
 'city': 'Marseille',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 95,
 'expiration_date': '2026-04-28T15:39:03Z',
 'fuel_type': 'petrol',
 'id': 'd9a41afe-c791-5641-b2e3-87dd47fcfcde',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 43.2969,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CZ28253',
 'listing': 'auction',
 'location': 'FR, Marseille',
 'location_confidence': 'geocoded',
 'longitude': 5.3811,
 'make': 'Peugeot',
 'model': '207',
 'odometer': 159552,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/img7d/93/7d93688daf0c26191e254201cbf97adb/pa/CZ28253_e9904d09f11be26135af62c12b1648a3.jpg',
                'https://img-pa.auto1.com/img7d/93/7d93688daf0c26191e254201cbf97adb/pa/CZ28253_ac43bb90ff529fea3785ace971870d4b.jpg',
                'https://img-pa.auto1.com/img7d/93/7d93688daf0c26191e254201cbf97adb/pa/CZ28253_103a0f9a87506a868261c73ef871ab56.jpg',
                'https://img-pa.auto1.com/img7d/93/7d93688daf0c26191e254201cbf97adb/pa/CZ28253_a6963e92c1b8a404ef93b12941e63b99.jpg',
                'https://img-pa.auto1.com/img7d/93/7d93688daf0c26191e254201cbf97adb/pa/CZ28253_9c233223fcc1f91d4a7f5ab85c9ff1e2.jpg',
                'https://img-pa.auto1.com/img7d/93/7d93688daf0c26191e254201cbf97adb/pa/CZ28253_ec53096c0a0c8c69afc41e1218768aef.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d9a41afe-c791-5641-b2e3-87dd47fcfcde/d9a41afe-c791-5641-b2e3-87dd47fcfcde_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72220,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/93/7d93688daf0c26191e254201cbf97adb/pa/CZ28253_e9904d09f11be26135af62c12b1648a3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d9a41afe-c791-5641-b2e3-87dd47fcfcde/d9a41afe-c791-5641-b2e3-87dd47fcfcde_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71547,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/93/7d93688daf0c26191e254201cbf97adb/pa/CZ28253_103a0f9a87506a868261c73ef871ab56.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d9a41afe-c791-5641-b2e3-87dd47fcfcde/d9a41afe-c791-5641-b2e3-87dd47fcfcde_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60774,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/93/7d93688daf0c26191e254201cbf97adb/pa/CZ28253_a6963e92c1b8a404ef93b12941e63b99.jpg',
             'Width': 800}],
 'postal_code': '13000',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Bouches-du-Rhône',
 'province_code': 'FR-13',
 'region': "Provence-Alpes-Côte d'Azur",
 'region_code': 'FR-93',
 'registration_date': '2009-04-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 207 1.4 VTi Trendy',
 'transmission': 'manual',
 'trim': 'Trendy',
 'year': 2009}
2026-04-27 08:04:35 [auto1.fr] INFO: Saving data for CZ28253: {'created_time': 1777277075.643756, 'last_price_update_time': 1777277075.643775, 'has_photos': True, 'auction_closing_time': 1777390743.0}
2026-04-27 08:04:35 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item 0c1f4ceb-bc40-5514-8b22-fe3b4d4cbc6e due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/49/ec49d627b47c7c82dcd648c62fbfbb8d/pa/JN01057_a18ebb182237ee08670a7ff9dc37b7e0.jpg not downloaded yet
2026-04-27 08:04:35 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item d9a41afe-c791-5641-b2e3-87dd47fcfcde due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143817e110>
2026-04-27 08:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ad1fc8f-78a4-5e5c-b1e6-2588312b7847/2ad1fc8f-78a4-5e5c-b1e6-2588312b7847_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/94/c394a6f2a84927e0e63ff4e532d9a6c0/pa/CS54070_9c5fc469e3cb0e140ecb59ea7201b8dc.jpg saved to cache
2026-04-27 08:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2ad1fc8f-78a4-5e5c-b1e6-2588312b7847
2026-04-27 08:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/49/ec49d627b47c7c82dcd648c62fbfbb8d/pa/JN01057_3e0df03a3818996f6cd5ce49eaac4a7f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/49/ec49d627b47c7c82dcd648c62fbfbb8d/pa/JN01057_de4f51b2758a6737f8d8f183d398ab1e.jpg not downloaded yet
2026-04-27 08:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/49/ec49d627b47c7c82dcd648c62fbfbb8d/pa/JN01057_ae26b55111cf3d695bbca660de5361cb.jpg not downloaded yet
2026-04-27 08:04:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0c1f4ceb-bc40-5514-8b22-fe3b4d4cbc6e with identifier: GT31591
2026-04-27 08:04:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0c1f4ceb-bc40-5514-8b22-fe3b4d4cbc6e with identifier: GT31591
2026-04-27 08:04:35 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 0c1f4ceb-bc40-5514-8b22-fe3b4d4cbc6e with identifier: GT31591 to the API
2026-04-27 08:04:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:35 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:36 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'city': 'Houécourt',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-04-28T15:17:00Z',
 'fuel_type': 'diesel',
 'id': '0c1f4ceb-bc40-5514-8b22-fe3b4d4cbc6e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.2985,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GT31591',
 'listing': 'auction',
 'location': 'FR, Houecourt',
 'location_confidence': 'geocoded',
 'longitude': 5.8931,
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 221290,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 20,
 'photo_urls': ['https://img-pa.auto1.com/imgb1/26/b1265df7e6bd24e0b6ffedd0f25486e5/pa/GT31591_3d2a56f5195b67d09a48950234c84d16.jpg',
                'https://img-pa.auto1.com/imgb1/26/b1265df7e6bd24e0b6ffedd0f25486e5/pa/GT31591_995953f11a0a0a7a5cd4641e46431d79.jpg',
                'https://img-pa.auto1.com/imgb1/26/b1265df7e6bd24e0b6ffedd0f25486e5/pa/GT31591_d7210be945e0977eb870101904e34869.jpg',
                'https://img-pa.auto1.com/imgb1/26/b1265df7e6bd24e0b6ffedd0f25486e5/pa/GT31591_cf8f171a5feaefb397943eaac62e358c.jpg',
                'https://img-pa.auto1.com/imgb1/26/b1265df7e6bd24e0b6ffedd0f25486e5/pa/GT31591_eb4566647ce35b5a93e77ac6866de810.jpg',
                'https://img-pa.auto1.com/imgb1/26/b1265df7e6bd24e0b6ffedd0f25486e5/pa/GT31591_d64cac44f6bede450cfe09af7df37a99.jpg',
                'https://img-pa.auto1.com/imgb1/26/b1265df7e6bd24e0b6ffedd0f25486e5/pa/GT31591_c88a5188b0b09d1ae468096942f4ba14.jpg',
                'https://img-pa.auto1.com/imgb1/26/b1265df7e6bd24e0b6ffedd0f25486e5/pa/GT31591_e219223a0ef0e02d6b5c16edf5937759.jpg',
                'https://img-pa.auto1.com/imgb1/26/b1265df7e6bd24e0b6ffedd0f25486e5/pa/GT31591_69a4d0108d47cb465d5169c715b92cc9.jpg',
                'https://img-pa.auto1.com/imgb1/26/b1265df7e6bd24e0b6ffedd0f25486e5/pa/GT31591_c9541b8e74040e5fca758e7723e029eb.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0c1f4ceb-bc40-5514-8b22-fe3b4d4cbc6e/0c1f4ceb-bc40-5514-8b22-fe3b4d4cbc6e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55781,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/26/b1265df7e6bd24e0b6ffedd0f25486e5/pa/GT31591_3d2a56f5195b67d09a48950234c84d16.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0c1f4ceb-bc40-5514-8b22-fe3b4d4cbc6e/0c1f4ceb-bc40-5514-8b22-fe3b4d4cbc6e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56390,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/26/b1265df7e6bd24e0b6ffedd0f25486e5/pa/GT31591_995953f11a0a0a7a5cd4641e46431d79.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0c1f4ceb-bc40-5514-8b22-fe3b4d4cbc6e/0c1f4ceb-bc40-5514-8b22-fe3b4d4cbc6e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42758,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/26/b1265df7e6bd24e0b6ffedd0f25486e5/pa/GT31591_d64cac44f6bede450cfe09af7df37a99.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0c1f4ceb-bc40-5514-8b22-fe3b4d4cbc6e/0c1f4ceb-bc40-5514-8b22-fe3b4d4cbc6e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80422,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/26/b1265df7e6bd24e0b6ffedd0f25486e5/pa/GT31591_69a4d0108d47cb465d5169c715b92cc9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0c1f4ceb-bc40-5514-8b22-fe3b4d4cbc6e/0c1f4ceb-bc40-5514-8b22-fe3b4d4cbc6e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62076,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/26/b1265df7e6bd24e0b6ffedd0f25486e5/pa/GT31591_c9541b8e74040e5fca758e7723e029eb.jpg',
             'Width': 800}],
 'postal_code': '88170',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Vosges',
 'province_code': 'FR-88',
 'region': 'Grand Est',
 'region_code': 'FR-44',
 'registration_date': '2015-05-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Comfortline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion',
 'year': 2015}
2026-04-27 08:04:36 [auto1.fr] INFO: Saving data for GT31591: {'created_time': 1777277076.128964, 'last_price_update_time': 1777277076.128974, 'has_photos': True, 'auction_closing_time': 1777389420.0}
2026-04-27 08:04:36 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item a4beede2-e56d-512d-bcd0-e42fcd81b3f7 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/49/ec49d627b47c7c82dcd648c62fbfbb8d/pa/JN01057_a18ebb182237ee08670a7ff9dc37b7e0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:36 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item 0c1f4ceb-bc40-5514-8b22-fe3b4d4cbc6e due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:04:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a4beede2-e56d-512d-bcd0-e42fcd81b3f7 with identifier: MZ95816
2026-04-27 08:04:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-27 08:04:36 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=violet HTTP/1.1" 200 None
2026-04-27 08:04:36 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-27 08:04:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a4beede2-e56d-512d-bcd0-e42fcd81b3f7 with identifier: MZ95816
2026-04-27 08:04:36 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a4beede2-e56d-512d-bcd0-e42fcd81b3f7 with identifier: MZ95816 to the API
2026-04-27 08:04:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:36 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:36 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'category': None,
 'city': 'Beaucaire',
 'color': 'violet',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.0L',
 'engine_horse_power': 68,
 'expiration_date': '2026-04-28T15:06:01Z',
 'fuel_type': 'petrol',
 'id': 'a4beede2-e56d-512d-bcd0-e42fcd81b3f7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 43.8081,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MZ95816',
 'listing': 'auction',
 'location': 'FR, Beaucaire',
 'location_confidence': 'geocoded',
 'longitude': 4.6442,
 'make': 'Nissan',
 'model': 'Pixo',
 'odometer': 79710,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/imgcc/7c/cc7c988db4e59294095475b7377015f8/pa/MZ95816_bee6f65691982cbd32d606b926b32a5b.jpg',
                'https://img-pa.auto1.com/imgcc/7c/cc7c988db4e59294095475b7377015f8/pa/MZ95816_b7509a6c91b0b9f58987946b522d939d.jpg',
                'https://img-pa.auto1.com/imgcc/7c/cc7c988db4e59294095475b7377015f8/pa/MZ95816_9e9aa005110c087a8abcec470f1b5c4d.jpg',
                'https://img-pa.auto1.com/imgcc/7c/cc7c988db4e59294095475b7377015f8/pa/MZ95816_acd55ac57cc4cd273b91e212b5639126.jpg',
                'https://img-pa.auto1.com/imgcc/7c/cc7c988db4e59294095475b7377015f8/pa/MZ95816_73912f5c4748c5bc2b8a77423b49c34a.jpg',
                'https://img-pa.auto1.com/imgcc/7c/cc7c988db4e59294095475b7377015f8/pa/MZ95816_adbd02bb7ddfd523868823b4d47adc52.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a4beede2-e56d-512d-bcd0-e42fcd81b3f7/a4beede2-e56d-512d-bcd0-e42fcd81b3f7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105543,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/7c/cc7c988db4e59294095475b7377015f8/pa/MZ95816_73912f5c4748c5bc2b8a77423b49c34a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a4beede2-e56d-512d-bcd0-e42fcd81b3f7/a4beede2-e56d-512d-bcd0-e42fcd81b3f7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41843,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/7c/cc7c988db4e59294095475b7377015f8/pa/MZ95816_adbd02bb7ddfd523868823b4d47adc52.jpg',
             'Width': 800}],
 'postal_code': '30300',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Gard',
 'province_code': 'FR-30',
 'region': 'Occitanie',
 'region_code': 'FR-76',
 'registration_date': '2009-08-03',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Nissan Pixo 1.0 Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2009}
2026-04-27 08:04:36 [auto1.fr] INFO: Saving data for MZ95816: {'created_time': 1777277076.763132, 'last_price_update_time': 1777277076.763144, 'has_photos': True, 'auction_closing_time': 1777388761.0}
2026-04-27 08:04:36 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item a4beede2-e56d-512d-bcd0-e42fcd81b3f7 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:04:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438fbc190>
2026-04-27 08:04:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25f94154-d3cf-5def-adbd-e3e2ca881d4c/25f94154-d3cf-5def-adbd-e3e2ca881d4c_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/49/ec49d627b47c7c82dcd648c62fbfbb8d/pa/JN01057_3e0df03a3818996f6cd5ce49eaac4a7f.jpg saved to cache
2026-04-27 08:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 25f94154-d3cf-5def-adbd-e3e2ca881d4c
2026-04-27 08:04:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438bfe290>
2026-04-27 08:04:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25f94154-d3cf-5def-adbd-e3e2ca881d4c/25f94154-d3cf-5def-adbd-e3e2ca881d4c_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/49/ec49d627b47c7c82dcd648c62fbfbb8d/pa/JN01057_a18ebb182237ee08670a7ff9dc37b7e0.jpg saved to cache
2026-04-27 08:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 25f94154-d3cf-5def-adbd-e3e2ca881d4c
2026-04-27 08:04:36 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item 4693e5fd-40a8-5b79-a5c9-e14c3ec71fba due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:04:36 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 25f94154-d3cf-5def-adbd-e3e2ca881d4c due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:04:36 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item 25f94154-d3cf-5def-adbd-e3e2ca881d4c due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:04:36 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 25f94154-d3cf-5def-adbd-e3e2ca881d4c due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:04:36 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item 25f94154-d3cf-5def-adbd-e3e2ca881d4c due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:04:36 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 25f94154-d3cf-5def-adbd-e3e2ca881d4c due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:04:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/49/ec49d627b47c7c82dcd648c62fbfbb8d/pa/JN01057_ae26b55111cf3d695bbca660de5361cb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d2f950>
2026-04-27 08:04:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25f94154-d3cf-5def-adbd-e3e2ca881d4c/25f94154-d3cf-5def-adbd-e3e2ca881d4c_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/49/ec49d627b47c7c82dcd648c62fbfbb8d/pa/JN01057_ae26b55111cf3d695bbca660de5361cb.jpg saved to cache
2026-04-27 08:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 25f94154-d3cf-5def-adbd-e3e2ca881d4c
2026-04-27 08:04:37 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 89cd1d2d-ac08-5559-b4ed-73373e2aebfd due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:04:37 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item 2ad1fc8f-78a4-5e5c-b1e6-2588312b7847 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:04:37 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item e19fdb36-92fd-577b-aaba-b8f0b4b67f7c due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:04:37 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item 25f94154-d3cf-5def-adbd-e3e2ca881d4c due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:04:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 25f94154-d3cf-5def-adbd-e3e2ca881d4c with identifier: JN01057
2026-04-27 08:04:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 25f94154-d3cf-5def-adbd-e3e2ca881d4c with identifier: JN01057
2026-04-27 08:04:38 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 25f94154-d3cf-5def-adbd-e3e2ca881d4c with identifier: JN01057 to the API
2026-04-27 08:04:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:38 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:38 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'category': None,
 'city': 'Marseille',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-04-28T15:20:43Z',
 'fuel_type': 'petrol',
 'id': '25f94154-d3cf-5def-adbd-e3e2ca881d4c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 43.2969,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JN01057',
 'listing': 'auction',
 'location': 'FR, Marseille',
 'location_confidence': 'geocoded',
 'longitude': 5.3811,
 'make': 'Peugeot',
 'model': '208',
 'odometer': 118379,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgec/49/ec49d627b47c7c82dcd648c62fbfbb8d/pa/JN01057_28039814027869b8ab5c9c44c75e78a7.jpg',
                'https://img-pa.auto1.com/imgec/49/ec49d627b47c7c82dcd648c62fbfbb8d/pa/JN01057_3e0df03a3818996f6cd5ce49eaac4a7f.jpg',
                'https://img-pa.auto1.com/imgec/49/ec49d627b47c7c82dcd648c62fbfbb8d/pa/JN01057_f61cf34a5b022e830fb23f73a7e75539.jpg',
                'https://img-pa.auto1.com/imgec/49/ec49d627b47c7c82dcd648c62fbfbb8d/pa/JN01057_e04dc5b3914df1653bf84ff5618e7923.jpg',
                'https://img-pa.auto1.com/imgec/49/ec49d627b47c7c82dcd648c62fbfbb8d/pa/JN01057_cbbb1e90e3e36c112a0e48bc4a469c63.jpg',
                'https://img-pa.auto1.com/imgec/49/ec49d627b47c7c82dcd648c62fbfbb8d/pa/JN01057_3bafed436350a340091339b00075d3ad.jpg',
                'https://img-pa.auto1.com/imgec/49/ec49d627b47c7c82dcd648c62fbfbb8d/pa/JN01057_bbd9e157c67c1fccaacc0c6561768bb5.jpg',
                'https://img-pa.auto1.com/imgec/49/ec49d627b47c7c82dcd648c62fbfbb8d/pa/JN01057_a18ebb182237ee08670a7ff9dc37b7e0.jpg',
                'https://img-pa.auto1.com/imgec/49/ec49d627b47c7c82dcd648c62fbfbb8d/pa/JN01057_de4f51b2758a6737f8d8f183d398ab1e.jpg',
                'https://img-pa.auto1.com/imgec/49/ec49d627b47c7c82dcd648c62fbfbb8d/pa/JN01057_ae26b55111cf3d695bbca660de5361cb.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_25f94154-d3cf-5def-adbd-e3e2ca881d4c/25f94154-d3cf-5def-adbd-e3e2ca881d4c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69745,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/49/ec49d627b47c7c82dcd648c62fbfbb8d/pa/JN01057_3e0df03a3818996f6cd5ce49eaac4a7f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_25f94154-d3cf-5def-adbd-e3e2ca881d4c/25f94154-d3cf-5def-adbd-e3e2ca881d4c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63105,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/49/ec49d627b47c7c82dcd648c62fbfbb8d/pa/JN01057_a18ebb182237ee08670a7ff9dc37b7e0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_25f94154-d3cf-5def-adbd-e3e2ca881d4c/25f94154-d3cf-5def-adbd-e3e2ca881d4c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52322,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/49/ec49d627b47c7c82dcd648c62fbfbb8d/pa/JN01057_ae26b55111cf3d695bbca660de5361cb.jpg',
             'Width': 800}],
 'postal_code': '13000',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Bouches-du-Rhône',
 'province_code': 'FR-13',
 'region': "Provence-Alpes-Côte d'Azur",
 'region_code': 'FR-93',
 'registration_date': '2015-02-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 208 1.2 VTi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2015}
2026-04-27 08:04:38 [auto1.fr] INFO: Saving data for JN01057: {'created_time': 1777277078.461087, 'last_price_update_time': 1777277078.4611, 'has_photos': True, 'auction_closing_time': 1777389643.0}
2026-04-27 08:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/1c/7d1c93ca4bbe89621b8efcb6585e9b8c/pa/AC55074_f1a5a8e6f0ab6c65a29482da5cb62fd2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:38 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 25f94154-d3cf-5def-adbd-e3e2ca881d4c due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RH90545/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/f9/e8f96765af5dffa9d81d57865e986165/pa/WP26002_1569715bd973639489ef03155222f96e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ae7790>
2026-04-27 08:04:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4693e5fd-40a8-5b79-a5c9-e14c3ec71fba/4693e5fd-40a8-5b79-a5c9-e14c3ec71fba_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/1c/7d1c93ca4bbe89621b8efcb6585e9b8c/pa/AC55074_f1a5a8e6f0ab6c65a29482da5cb62fd2.jpg saved to cache
2026-04-27 08:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4693e5fd-40a8-5b79-a5c9-e14c3ec71fba
2026-04-27 08:04:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438fccb90>
2026-04-27 08:04:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e19fdb36-92fd-577b-aaba-b8f0b4b67f7c/e19fdb36-92fd-577b-aaba-b8f0b4b67f7c_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/f9/e8f96765af5dffa9d81d57865e986165/pa/WP26002_1569715bd973639489ef03155222f96e.jpg saved to cache
2026-04-27 08:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e19fdb36-92fd-577b-aaba-b8f0b4b67f7c
2026-04-27 08:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CU45750> (referer: https://www.auto1.com/v1/car-details-view/CU45750/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/94/c394a6f2a84927e0e63ff4e532d9a6c0/pa/CS54070_c9e983fa37da0177a4f8c209b26ce11b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NK06658/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24b67b4d-806d-5830-b6ee-1c2ce8e0e172 with identifier: CU45750
2026-04-27 08:04:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24b67b4d-806d-5830-b6ee-1c2ce8e0e172 with scrape type 1
2026-04-27 08:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 24b67b4d-806d-5830-b6ee-1c2ce8e0e172
2026-04-27 08:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/3f/363fd25cdc002b01f1a45adc490a3bc9/pa/CU45750_bd89355f9943be89aa0da60ef5dcfb5f.jpg not downloaded yet
2026-04-27 08:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/3f/363fd25cdc002b01f1a45adc490a3bc9/pa/CU45750_ab1a03c8b1787c21bd62aa0c0d34b625.jpg not downloaded yet
2026-04-27 08:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/3f/363fd25cdc002b01f1a45adc490a3bc9/pa/CU45750_08614881f3dd74e577d0e739161bf3fd.jpg not downloaded yet
2026-04-27 08:04:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438dd8d90>
2026-04-27 08:04:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ad1fc8f-78a4-5e5c-b1e6-2588312b7847/2ad1fc8f-78a4-5e5c-b1e6-2588312b7847_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/94/c394a6f2a84927e0e63ff4e532d9a6c0/pa/CS54070_c9e983fa37da0177a4f8c209b26ce11b.jpg saved to cache
2026-04-27 08:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2ad1fc8f-78a4-5e5c-b1e6-2588312b7847
2026-04-27 08:04:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/a6/65a6d69b2a238978c0e72cffed4a27aa/pa/LG63023_e7ea8172caaca8c106dda897b884892f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/3f/363fd25cdc002b01f1a45adc490a3bc9/pa/CU45750_c2e236cd9fd55966a77faa67f9ba8cc0.jpg not downloaded yet
2026-04-27 08:04:39 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item e19fdb36-92fd-577b-aaba-b8f0b4b67f7c due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:04:39 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item 2ad1fc8f-78a4-5e5c-b1e6-2588312b7847 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:04:39 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 89cd1d2d-ac08-5559-b4ed-73373e2aebfd due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/3f/363fd25cdc002b01f1a45adc490a3bc9/pa/CU45750_f5f87a2653d0e423cf88dd573ff8f9b8.jpg not downloaded yet
2026-04-27 08:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/3f/363fd25cdc002b01f1a45adc490a3bc9/pa/CU45750_7f7acccb008d13185234a498eb14fe86.jpg not downloaded yet
2026-04-27 08:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/3f/363fd25cdc002b01f1a45adc490a3bc9/pa/CU45750_431bc8c0b03161e42cba8250ee25d810.jpg not downloaded yet
2026-04-27 08:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/3f/363fd25cdc002b01f1a45adc490a3bc9/pa/CU45750_c63236d09a1f1675ad34141912de03ec.jpg not downloaded yet
2026-04-27 08:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/3f/363fd25cdc002b01f1a45adc490a3bc9/pa/CU45750_1b5118349e3888388ee1ea05f26e3e54.jpg not downloaded yet
2026-04-27 08:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/3f/363fd25cdc002b01f1a45adc490a3bc9/pa/CU45750_32e4de9aae60309dc50e932c78a68783.jpg not downloaded yet
2026-04-27 08:04:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438bfd410>
2026-04-27 08:04:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89cd1d2d-ac08-5559-b4ed-73373e2aebfd/89cd1d2d-ac08-5559-b4ed-73373e2aebfd_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/a6/65a6d69b2a238978c0e72cffed4a27aa/pa/LG63023_e7ea8172caaca8c106dda897b884892f.jpg saved to cache
2026-04-27 08:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 89cd1d2d-ac08-5559-b4ed-73373e2aebfd
2026-04-27 08:04:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/3f/363fd25cdc002b01f1a45adc490a3bc9/pa/CU45750_08614881f3dd74e577d0e739161bf3fd.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438dfa850>
2026-04-27 08:04:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24b67b4d-806d-5830-b6ee-1c2ce8e0e172/24b67b4d-806d-5830-b6ee-1c2ce8e0e172_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/3f/363fd25cdc002b01f1a45adc490a3bc9/pa/CU45750_08614881f3dd74e577d0e739161bf3fd.jpg saved to cache
2026-04-27 08:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 24b67b4d-806d-5830-b6ee-1c2ce8e0e172
2026-04-27 08:04:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/3f/363fd25cdc002b01f1a45adc490a3bc9/pa/CU45750_32e4de9aae60309dc50e932c78a68783.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/3f/363fd25cdc002b01f1a45adc490a3bc9/pa/CU45750_1b5118349e3888388ee1ea05f26e3e54.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/3f/363fd25cdc002b01f1a45adc490a3bc9/pa/CU45750_c63236d09a1f1675ad34141912de03ec.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d26d10>
2026-04-27 08:04:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24b67b4d-806d-5830-b6ee-1c2ce8e0e172/24b67b4d-806d-5830-b6ee-1c2ce8e0e172_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/3f/363fd25cdc002b01f1a45adc490a3bc9/pa/CU45750_32e4de9aae60309dc50e932c78a68783.jpg saved to cache
2026-04-27 08:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 24b67b4d-806d-5830-b6ee-1c2ce8e0e172
2026-04-27 08:04:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438cb9110>
2026-04-27 08:04:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24b67b4d-806d-5830-b6ee-1c2ce8e0e172/24b67b4d-806d-5830-b6ee-1c2ce8e0e172_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/3f/363fd25cdc002b01f1a45adc490a3bc9/pa/CU45750_1b5118349e3888388ee1ea05f26e3e54.jpg saved to cache
2026-04-27 08:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 24b67b4d-806d-5830-b6ee-1c2ce8e0e172
2026-04-27 08:04:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LN71029/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d90810>
2026-04-27 08:04:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24b67b4d-806d-5830-b6ee-1c2ce8e0e172/24b67b4d-806d-5830-b6ee-1c2ce8e0e172_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/3f/363fd25cdc002b01f1a45adc490a3bc9/pa/CU45750_c63236d09a1f1675ad34141912de03ec.jpg saved to cache
2026-04-27 08:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 24b67b4d-806d-5830-b6ee-1c2ce8e0e172
2026-04-27 08:04:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/3f/363fd25cdc002b01f1a45adc490a3bc9/pa/CU45750_431bc8c0b03161e42cba8250ee25d810.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14381de790>
2026-04-27 08:04:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24b67b4d-806d-5830-b6ee-1c2ce8e0e172/24b67b4d-806d-5830-b6ee-1c2ce8e0e172_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/3f/363fd25cdc002b01f1a45adc490a3bc9/pa/CU45750_431bc8c0b03161e42cba8250ee25d810.jpg saved to cache
2026-04-27 08:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 24b67b4d-806d-5830-b6ee-1c2ce8e0e172
2026-04-27 08:04:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/3f/363fd25cdc002b01f1a45adc490a3bc9/pa/CU45750_f5f87a2653d0e423cf88dd573ff8f9b8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/3f/363fd25cdc002b01f1a45adc490a3bc9/pa/CU45750_c2e236cd9fd55966a77faa67f9ba8cc0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142be07350>
2026-04-27 08:04:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24b67b4d-806d-5830-b6ee-1c2ce8e0e172/24b67b4d-806d-5830-b6ee-1c2ce8e0e172_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/3f/363fd25cdc002b01f1a45adc490a3bc9/pa/CU45750_f5f87a2653d0e423cf88dd573ff8f9b8.jpg saved to cache
2026-04-27 08:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 24b67b4d-806d-5830-b6ee-1c2ce8e0e172
2026-04-27 08:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/3f/363fd25cdc002b01f1a45adc490a3bc9/pa/CU45750_bd89355f9943be89aa0da60ef5dcfb5f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GV65376> (referer: https://www.auto1.com/v1/car-details-view/GV65376/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:40 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 4693e5fd-40a8-5b79-a5c9-e14c3ec71fba due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:04:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:40 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item e19fdb36-92fd-577b-aaba-b8f0b4b67f7c due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:04:40 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 2ad1fc8f-78a4-5e5c-b1e6-2588312b7847 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:04:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438016c10>
2026-04-27 08:04:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24b67b4d-806d-5830-b6ee-1c2ce8e0e172/24b67b4d-806d-5830-b6ee-1c2ce8e0e172_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/3f/363fd25cdc002b01f1a45adc490a3bc9/pa/CU45750_c2e236cd9fd55966a77faa67f9ba8cc0.jpg saved to cache
2026-04-27 08:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 24b67b4d-806d-5830-b6ee-1c2ce8e0e172
2026-04-27 08:04:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d25f10>
2026-04-27 08:04:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24b67b4d-806d-5830-b6ee-1c2ce8e0e172/24b67b4d-806d-5830-b6ee-1c2ce8e0e172_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/3f/363fd25cdc002b01f1a45adc490a3bc9/pa/CU45750_bd89355f9943be89aa0da60ef5dcfb5f.jpg saved to cache
2026-04-27 08:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 24b67b4d-806d-5830-b6ee-1c2ce8e0e172
2026-04-27 08:04:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21c5e18f-e26b-5c06-9300-e825cccc2b27 with identifier: GV65376
2026-04-27 08:04:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21c5e18f-e26b-5c06-9300-e825cccc2b27 with scrape type 1
2026-04-27 08:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 21c5e18f-e26b-5c06-9300-e825cccc2b27
2026-04-27 08:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/7d/b97d16b9e88e45e3fc01d3ae2729cb39/pa/GV65376_c96950e1ce3008b1b22e56c8e9407288.jpg not downloaded yet
2026-04-27 08:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/7d/b97d16b9e88e45e3fc01d3ae2729cb39/pa/GV65376_0a21466df4aaa42e588e06196811d103.jpg not downloaded yet
2026-04-27 08:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/a6/65a6d69b2a238978c0e72cffed4a27aa/pa/LG63023_a3b47e838821215f1cdda3a9f6cb0df2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/7d/b97d16b9e88e45e3fc01d3ae2729cb39/pa/GV65376_1a574c0bc6a0f540dd4aa979fb6bec94.jpg not downloaded yet
2026-04-27 08:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/7d/b97d16b9e88e45e3fc01d3ae2729cb39/pa/GV65376_ebebc473bfdd661136c379eea4a9c6ae.jpg not downloaded yet
2026-04-27 08:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/7d/b97d16b9e88e45e3fc01d3ae2729cb39/pa/GV65376_d4f180ffe32e27322377931b967c6ab2.jpg not downloaded yet
2026-04-27 08:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/7d/b97d16b9e88e45e3fc01d3ae2729cb39/pa/GV65376_97da07e796e80aaf5a346da3636b0278.jpg not downloaded yet
2026-04-27 08:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/7d/b97d16b9e88e45e3fc01d3ae2729cb39/pa/GV65376_746fa84322b43819c2a15824e40eae1b.jpg not downloaded yet
2026-04-27 08:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/7d/b97d16b9e88e45e3fc01d3ae2729cb39/pa/GV65376_d1d3ec04184ba0501e61400760c1ecdc.jpg not downloaded yet
2026-04-27 08:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/7d/b97d16b9e88e45e3fc01d3ae2729cb39/pa/GV65376_0a21466df4aaa42e588e06196811d103.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/7d/b97d16b9e88e45e3fc01d3ae2729cb39/pa/GV65376_89fb5eabe983bf3b55b2a53938b721c0.jpg not downloaded yet
2026-04-27 08:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/7d/b97d16b9e88e45e3fc01d3ae2729cb39/pa/GV65376_f59e1ebef7f6c09b7a8822551d54a6b7.jpg not downloaded yet
2026-04-27 08:04:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d30fd0>
2026-04-27 08:04:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89cd1d2d-ac08-5559-b4ed-73373e2aebfd/89cd1d2d-ac08-5559-b4ed-73373e2aebfd_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/a6/65a6d69b2a238978c0e72cffed4a27aa/pa/LG63023_a3b47e838821215f1cdda3a9f6cb0df2.jpg saved to cache
2026-04-27 08:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 89cd1d2d-ac08-5559-b4ed-73373e2aebfd
2026-04-27 08:04:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143809ef50>
2026-04-27 08:04:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21c5e18f-e26b-5c06-9300-e825cccc2b27/21c5e18f-e26b-5c06-9300-e825cccc2b27_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/7d/b97d16b9e88e45e3fc01d3ae2729cb39/pa/GV65376_0a21466df4aaa42e588e06196811d103.jpg saved to cache
2026-04-27 08:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 21c5e18f-e26b-5c06-9300-e825cccc2b27
2026-04-27 08:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/7d/b97d16b9e88e45e3fc01d3ae2729cb39/pa/GV65376_746fa84322b43819c2a15824e40eae1b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KJ24442/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d32d90>
2026-04-27 08:04:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21c5e18f-e26b-5c06-9300-e825cccc2b27/21c5e18f-e26b-5c06-9300-e825cccc2b27_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/7d/b97d16b9e88e45e3fc01d3ae2729cb39/pa/GV65376_746fa84322b43819c2a15824e40eae1b.jpg saved to cache
2026-04-27 08:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 21c5e18f-e26b-5c06-9300-e825cccc2b27
2026-04-27 08:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/7d/b97d16b9e88e45e3fc01d3ae2729cb39/pa/GV65376_f59e1ebef7f6c09b7a8822551d54a6b7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/7d/b97d16b9e88e45e3fc01d3ae2729cb39/pa/GV65376_d1d3ec04184ba0501e61400760c1ecdc.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142be05950>
2026-04-27 08:04:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21c5e18f-e26b-5c06-9300-e825cccc2b27/21c5e18f-e26b-5c06-9300-e825cccc2b27_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/7d/b97d16b9e88e45e3fc01d3ae2729cb39/pa/GV65376_f59e1ebef7f6c09b7a8822551d54a6b7.jpg saved to cache
2026-04-27 08:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 21c5e18f-e26b-5c06-9300-e825cccc2b27
2026-04-27 08:04:40 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item 24b67b4d-806d-5830-b6ee-1c2ce8e0e172 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:04:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c2e390>
2026-04-27 08:04:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21c5e18f-e26b-5c06-9300-e825cccc2b27/21c5e18f-e26b-5c06-9300-e825cccc2b27_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/7d/b97d16b9e88e45e3fc01d3ae2729cb39/pa/GV65376_d1d3ec04184ba0501e61400760c1ecdc.jpg saved to cache
2026-04-27 08:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 21c5e18f-e26b-5c06-9300-e825cccc2b27
2026-04-27 08:04:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 24b67b4d-806d-5830-b6ee-1c2ce8e0e172 with identifier: CU45750
2026-04-27 08:04:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 24b67b4d-806d-5830-b6ee-1c2ce8e0e172 with identifier: CU45750
2026-04-27 08:04:41 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 24b67b4d-806d-5830-b6ee-1c2ce8e0e172 with identifier: CU45750 to the API
2026-04-27 08:04:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:41 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:41 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'city': 'Saint-Saulve',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.9L',
 'engine_horse_power': 90,
 'expiration_date': '2026-04-28T15:28:56Z',
 'fuel_type': 'diesel',
 'id': '24b67b4d-806d-5830-b6ee-1c2ce8e0e172',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 50.3714,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CU45750',
 'listing': 'auction',
 'location': 'FR, Saint-Saulve',
 'location_confidence': 'geocoded',
 'longitude': 3.5561,
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 285224,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img36/3f/363fd25cdc002b01f1a45adc490a3bc9/pa/CU45750_bd89355f9943be89aa0da60ef5dcfb5f.jpg',
                'https://img-pa.auto1.com/img36/3f/363fd25cdc002b01f1a45adc490a3bc9/pa/CU45750_ab1a03c8b1787c21bd62aa0c0d34b625.jpg',
                'https://img-pa.auto1.com/img36/3f/363fd25cdc002b01f1a45adc490a3bc9/pa/CU45750_08614881f3dd74e577d0e739161bf3fd.jpg',
                'https://img-pa.auto1.com/img36/3f/363fd25cdc002b01f1a45adc490a3bc9/pa/CU45750_c2e236cd9fd55966a77faa67f9ba8cc0.jpg',
                'https://img-pa.auto1.com/img36/3f/363fd25cdc002b01f1a45adc490a3bc9/pa/CU45750_f5f87a2653d0e423cf88dd573ff8f9b8.jpg',
                'https://img-pa.auto1.com/img36/3f/363fd25cdc002b01f1a45adc490a3bc9/pa/CU45750_7f7acccb008d13185234a498eb14fe86.jpg',
                'https://img-pa.auto1.com/img36/3f/363fd25cdc002b01f1a45adc490a3bc9/pa/CU45750_431bc8c0b03161e42cba8250ee25d810.jpg',
                'https://img-pa.auto1.com/img36/3f/363fd25cdc002b01f1a45adc490a3bc9/pa/CU45750_c63236d09a1f1675ad34141912de03ec.jpg',
                'https://img-pa.auto1.com/img36/3f/363fd25cdc002b01f1a45adc490a3bc9/pa/CU45750_1b5118349e3888388ee1ea05f26e3e54.jpg',
                'https://img-pa.auto1.com/img36/3f/363fd25cdc002b01f1a45adc490a3bc9/pa/CU45750_32e4de9aae60309dc50e932c78a68783.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_24b67b4d-806d-5830-b6ee-1c2ce8e0e172/24b67b4d-806d-5830-b6ee-1c2ce8e0e172_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76110,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/3f/363fd25cdc002b01f1a45adc490a3bc9/pa/CU45750_bd89355f9943be89aa0da60ef5dcfb5f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_24b67b4d-806d-5830-b6ee-1c2ce8e0e172/24b67b4d-806d-5830-b6ee-1c2ce8e0e172_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70968,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/3f/363fd25cdc002b01f1a45adc490a3bc9/pa/CU45750_08614881f3dd74e577d0e739161bf3fd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_24b67b4d-806d-5830-b6ee-1c2ce8e0e172/24b67b4d-806d-5830-b6ee-1c2ce8e0e172_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62766,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/3f/363fd25cdc002b01f1a45adc490a3bc9/pa/CU45750_c2e236cd9fd55966a77faa67f9ba8cc0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_24b67b4d-806d-5830-b6ee-1c2ce8e0e172/24b67b4d-806d-5830-b6ee-1c2ce8e0e172_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68833,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/3f/363fd25cdc002b01f1a45adc490a3bc9/pa/CU45750_f5f87a2653d0e423cf88dd573ff8f9b8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_24b67b4d-806d-5830-b6ee-1c2ce8e0e172/24b67b4d-806d-5830-b6ee-1c2ce8e0e172_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64961,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/3f/363fd25cdc002b01f1a45adc490a3bc9/pa/CU45750_431bc8c0b03161e42cba8250ee25d810.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_24b67b4d-806d-5830-b6ee-1c2ce8e0e172/24b67b4d-806d-5830-b6ee-1c2ce8e0e172_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78875,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/3f/363fd25cdc002b01f1a45adc490a3bc9/pa/CU45750_c63236d09a1f1675ad34141912de03ec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_24b67b4d-806d-5830-b6ee-1c2ce8e0e172/24b67b4d-806d-5830-b6ee-1c2ce8e0e172_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75746,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/3f/363fd25cdc002b01f1a45adc490a3bc9/pa/CU45750_1b5118349e3888388ee1ea05f26e3e54.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_24b67b4d-806d-5830-b6ee-1c2ce8e0e172/24b67b4d-806d-5830-b6ee-1c2ce8e0e172_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52276,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/3f/363fd25cdc002b01f1a45adc490a3bc9/pa/CU45750_32e4de9aae60309dc50e932c78a68783.jpg',
             'Width': 800}],
 'postal_code': '59880',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Nord',
 'province_code': 'FR-59',
 'region': 'Hauts-de-France',
 'region_code': 'FR-32',
 'registration_date': '2008-10-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Ibiza 1.9 TDI Stylance Style',
 'transmission': 'manual',
 'trim': 'Stylance Style',
 'year': 2008}
2026-04-27 08:04:41 [auto1.fr] INFO: Saving data for CU45750: {'created_time': 1777277081.573687, 'last_price_update_time': 1777277081.573699, 'has_photos': True, 'auction_closing_time': 1777390136.0}
2026-04-27 08:04:41 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 24b67b4d-806d-5830-b6ee-1c2ce8e0e172 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:04:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/7d/b97d16b9e88e45e3fc01d3ae2729cb39/pa/GV65376_d4f180ffe32e27322377931b967c6ab2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/7d/b97d16b9e88e45e3fc01d3ae2729cb39/pa/GV65376_ebebc473bfdd661136c379eea4a9c6ae.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RH90545> (referer: https://www.auto1.com/v1/car-details-view/RH90545/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438e174d0>
2026-04-27 08:04:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21c5e18f-e26b-5c06-9300-e825cccc2b27/21c5e18f-e26b-5c06-9300-e825cccc2b27_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/7d/b97d16b9e88e45e3fc01d3ae2729cb39/pa/GV65376_d4f180ffe32e27322377931b967c6ab2.jpg saved to cache
2026-04-27 08:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 21c5e18f-e26b-5c06-9300-e825cccc2b27
2026-04-27 08:04:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438e00410>
2026-04-27 08:04:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21c5e18f-e26b-5c06-9300-e825cccc2b27/21c5e18f-e26b-5c06-9300-e825cccc2b27_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/7d/b97d16b9e88e45e3fc01d3ae2729cb39/pa/GV65376_ebebc473bfdd661136c379eea4a9c6ae.jpg saved to cache
2026-04-27 08:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 21c5e18f-e26b-5c06-9300-e825cccc2b27
2026-04-27 08:04:41 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 21c5e18f-e26b-5c06-9300-e825cccc2b27 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:04:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9c77e8f-db0f-517c-aab3-d3736b4537f4 with identifier: RH90545
2026-04-27 08:04:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9c77e8f-db0f-517c-aab3-d3736b4537f4 with scrape type 1
2026-04-27 08:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f9c77e8f-db0f-517c-aab3-d3736b4537f4
2026-04-27 08:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/ae/7eae148e43533499749dceb1ea5234af/pa/RH90545_72fe336ffa200ce495c00cb5e5a89e6d.jpg not downloaded yet
2026-04-27 08:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/ae/7eae148e43533499749dceb1ea5234af/pa/RH90545_879f430896c79a360c762a464c802421.jpg not downloaded yet
2026-04-27 08:04:41 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item 21c5e18f-e26b-5c06-9300-e825cccc2b27 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/ae/7eae148e43533499749dceb1ea5234af/pa/RH90545_c9d5aef180300e2debb3fba964e4ae84.jpg not downloaded yet
2026-04-27 08:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/ae/7eae148e43533499749dceb1ea5234af/pa/RH90545_a4aac42778adb38ca383e09ddb4c96bb.jpg not downloaded yet
2026-04-27 08:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/ae/7eae148e43533499749dceb1ea5234af/pa/RH90545_1c4456756ea6a2ab2053c40c9d555edd.jpg not downloaded yet
2026-04-27 08:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/ae/7eae148e43533499749dceb1ea5234af/pa/RH90545_337ba9e7426f0f2864eb843649879b01.jpg not downloaded yet
2026-04-27 08:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/ae/7eae148e43533499749dceb1ea5234af/pa/RH90545_3aec12a5bdc27ab1c8978742dd1fe2b5.jpg not downloaded yet
2026-04-27 08:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/ae/7eae148e43533499749dceb1ea5234af/pa/RH90545_91e7082b4f893102bff57d360bdd2dce.jpg not downloaded yet
2026-04-27 08:04:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/7d/b97d16b9e88e45e3fc01d3ae2729cb39/pa/GV65376_1a574c0bc6a0f540dd4aa979fb6bec94.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/ae/7eae148e43533499749dceb1ea5234af/pa/RH90545_8bbebd05fa8275c02342542ad220ed0d.jpg not downloaded yet
2026-04-27 08:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/ae/7eae148e43533499749dceb1ea5234af/pa/RH90545_0c80deff011b0e5597b4ded00ac8b101.jpg not downloaded yet
2026-04-27 08:04:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bfb8610>
2026-04-27 08:04:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21c5e18f-e26b-5c06-9300-e825cccc2b27/21c5e18f-e26b-5c06-9300-e825cccc2b27_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/7d/b97d16b9e88e45e3fc01d3ae2729cb39/pa/GV65376_1a574c0bc6a0f540dd4aa979fb6bec94.jpg saved to cache
2026-04-27 08:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 21c5e18f-e26b-5c06-9300-e825cccc2b27
2026-04-27 08:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/ae/7eae148e43533499749dceb1ea5234af/pa/RH90545_91e7082b4f893102bff57d360bdd2dce.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438134ed0>
2026-04-27 08:04:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9c77e8f-db0f-517c-aab3-d3736b4537f4/f9c77e8f-db0f-517c-aab3-d3736b4537f4_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/ae/7eae148e43533499749dceb1ea5234af/pa/RH90545_91e7082b4f893102bff57d360bdd2dce.jpg saved to cache
2026-04-27 08:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f9c77e8f-db0f-517c-aab3-d3736b4537f4
2026-04-27 08:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/ae/7eae148e43533499749dceb1ea5234af/pa/RH90545_0c80deff011b0e5597b4ded00ac8b101.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d93ed0>
2026-04-27 08:04:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9c77e8f-db0f-517c-aab3-d3736b4537f4/f9c77e8f-db0f-517c-aab3-d3736b4537f4_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/ae/7eae148e43533499749dceb1ea5234af/pa/RH90545_0c80deff011b0e5597b4ded00ac8b101.jpg saved to cache
2026-04-27 08:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f9c77e8f-db0f-517c-aab3-d3736b4537f4
2026-04-27 08:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/ae/7eae148e43533499749dceb1ea5234af/pa/RH90545_8bbebd05fa8275c02342542ad220ed0d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438135690>
2026-04-27 08:04:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9c77e8f-db0f-517c-aab3-d3736b4537f4/f9c77e8f-db0f-517c-aab3-d3736b4537f4_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/ae/7eae148e43533499749dceb1ea5234af/pa/RH90545_8bbebd05fa8275c02342542ad220ed0d.jpg saved to cache
2026-04-27 08:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f9c77e8f-db0f-517c-aab3-d3736b4537f4
2026-04-27 08:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/ae/7eae148e43533499749dceb1ea5234af/pa/RH90545_3aec12a5bdc27ab1c8978742dd1fe2b5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 21c5e18f-e26b-5c06-9300-e825cccc2b27 with identifier: GV65376
2026-04-27 08:04:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 21c5e18f-e26b-5c06-9300-e825cccc2b27 with identifier: GV65376
2026-04-27 08:04:42 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 21c5e18f-e26b-5c06-9300-e825cccc2b27 with identifier: GV65376 to the API
2026-04-27 08:04:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:43 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:43 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'city': 'Houécourt',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-04-28T15:14:40Z',
 'fuel_type': 'petrol',
 'id': '21c5e18f-e26b-5c06-9300-e825cccc2b27',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.2985,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GV65376',
 'listing': 'auction',
 'location': 'FR, Houecourt',
 'location_confidence': 'geocoded',
 'longitude': 5.8931,
 'make': 'Fiat',
 'model': '500',
 'odometer': 88624,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgb9/7d/b97d16b9e88e45e3fc01d3ae2729cb39/pa/GV65376_c96950e1ce3008b1b22e56c8e9407288.jpg',
                'https://img-pa.auto1.com/imgb9/7d/b97d16b9e88e45e3fc01d3ae2729cb39/pa/GV65376_0a21466df4aaa42e588e06196811d103.jpg',
                'https://img-pa.auto1.com/imgb9/7d/b97d16b9e88e45e3fc01d3ae2729cb39/pa/GV65376_1a574c0bc6a0f540dd4aa979fb6bec94.jpg',
                'https://img-pa.auto1.com/imgb9/7d/b97d16b9e88e45e3fc01d3ae2729cb39/pa/GV65376_ebebc473bfdd661136c379eea4a9c6ae.jpg',
                'https://img-pa.auto1.com/imgb9/7d/b97d16b9e88e45e3fc01d3ae2729cb39/pa/GV65376_d4f180ffe32e27322377931b967c6ab2.jpg',
                'https://img-pa.auto1.com/imgb9/7d/b97d16b9e88e45e3fc01d3ae2729cb39/pa/GV65376_97da07e796e80aaf5a346da3636b0278.jpg',
                'https://img-pa.auto1.com/imgb9/7d/b97d16b9e88e45e3fc01d3ae2729cb39/pa/GV65376_746fa84322b43819c2a15824e40eae1b.jpg',
                'https://img-pa.auto1.com/imgb9/7d/b97d16b9e88e45e3fc01d3ae2729cb39/pa/GV65376_d1d3ec04184ba0501e61400760c1ecdc.jpg',
                'https://img-pa.auto1.com/imgb9/7d/b97d16b9e88e45e3fc01d3ae2729cb39/pa/GV65376_89fb5eabe983bf3b55b2a53938b721c0.jpg',
                'https://img-pa.auto1.com/imgb9/7d/b97d16b9e88e45e3fc01d3ae2729cb39/pa/GV65376_f59e1ebef7f6c09b7a8822551d54a6b7.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_21c5e18f-e26b-5c06-9300-e825cccc2b27/21c5e18f-e26b-5c06-9300-e825cccc2b27_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81861,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/7d/b97d16b9e88e45e3fc01d3ae2729cb39/pa/GV65376_0a21466df4aaa42e588e06196811d103.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_21c5e18f-e26b-5c06-9300-e825cccc2b27/21c5e18f-e26b-5c06-9300-e825cccc2b27_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74892,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/7d/b97d16b9e88e45e3fc01d3ae2729cb39/pa/GV65376_1a574c0bc6a0f540dd4aa979fb6bec94.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_21c5e18f-e26b-5c06-9300-e825cccc2b27/21c5e18f-e26b-5c06-9300-e825cccc2b27_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66634,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/7d/b97d16b9e88e45e3fc01d3ae2729cb39/pa/GV65376_ebebc473bfdd661136c379eea4a9c6ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_21c5e18f-e26b-5c06-9300-e825cccc2b27/21c5e18f-e26b-5c06-9300-e825cccc2b27_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70027,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/7d/b97d16b9e88e45e3fc01d3ae2729cb39/pa/GV65376_d4f180ffe32e27322377931b967c6ab2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_21c5e18f-e26b-5c06-9300-e825cccc2b27/21c5e18f-e26b-5c06-9300-e825cccc2b27_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59357,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/7d/b97d16b9e88e45e3fc01d3ae2729cb39/pa/GV65376_746fa84322b43819c2a15824e40eae1b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_21c5e18f-e26b-5c06-9300-e825cccc2b27/21c5e18f-e26b-5c06-9300-e825cccc2b27_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81063,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/7d/b97d16b9e88e45e3fc01d3ae2729cb39/pa/GV65376_d1d3ec04184ba0501e61400760c1ecdc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_21c5e18f-e26b-5c06-9300-e825cccc2b27/21c5e18f-e26b-5c06-9300-e825cccc2b27_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69542,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/7d/b97d16b9e88e45e3fc01d3ae2729cb39/pa/GV65376_f59e1ebef7f6c09b7a8822551d54a6b7.jpg',
             'Width': 800}],
 'postal_code': '88170',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Vosges',
 'province_code': 'FR-88',
 'region': 'Grand Est',
 'region_code': 'FR-44',
 'registration_date': '2012-10-10',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat 500 1.2 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2012}
2026-04-27 08:04:43 [auto1.fr] INFO: Saving data for GV65376: {'created_time': 1777277083.183708, 'last_price_update_time': 1777277083.183716, 'has_photos': True, 'auction_closing_time': 1777389280.0}
2026-04-27 08:04:43 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 21c5e18f-e26b-5c06-9300-e825cccc2b27 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:04:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/ae/7eae148e43533499749dceb1ea5234af/pa/RH90545_a4aac42778adb38ca383e09ddb4c96bb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4693e5fd-40a8-5b79-a5c9-e14c3ec71fba with identifier: AC55074
2026-04-27 08:04:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4693e5fd-40a8-5b79-a5c9-e14c3ec71fba with identifier: AC55074
2026-04-27 08:04:43 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 4693e5fd-40a8-5b79-a5c9-e14c3ec71fba with identifier: AC55074 to the API
2026-04-27 08:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:43 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:43 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': None,
 'city': 'Bussy-Lettrée',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 180,
 'expiration_date': '2026-04-28T15:38:52Z',
 'fuel_type': 'diesel',
 'id': '4693e5fd-40a8-5b79-a5c9-e14c3ec71fba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.8052,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AC55074',
 'listing': 'auction',
 'location': 'FR, Bussy-Lettrée',
 'location_confidence': 'geocoded',
 'longitude': 4.2592,
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 112237,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img7d/1c/7d1c93ca4bbe89621b8efcb6585e9b8c/pa/AC55074_b1a3e55d6e7a131b35d2eef500fee8b0.jpg',
                'https://img-pa.auto1.com/img7d/1c/7d1c93ca4bbe89621b8efcb6585e9b8c/pa/AC55074_70211e4675816e3d169120bacbfb34e0.jpg',
                'https://img-pa.auto1.com/img7d/1c/7d1c93ca4bbe89621b8efcb6585e9b8c/pa/AC55074_6c2f4550f3ff8eca6da3658284f114f4.jpg',
                'https://img-pa.auto1.com/img7d/1c/7d1c93ca4bbe89621b8efcb6585e9b8c/pa/AC55074_f1a5a8e6f0ab6c65a29482da5cb62fd2.jpg',
                'https://img-pa.auto1.com/img7d/1c/7d1c93ca4bbe89621b8efcb6585e9b8c/pa/AC55074_4227f0e85005263c34210dc2d3fbfd31.jpg',
                'https://img-pa.auto1.com/img7d/1c/7d1c93ca4bbe89621b8efcb6585e9b8c/pa/AC55074_688f2282e8c9c5739f688246336c2597.jpg',
                'https://img-pa.auto1.com/img7d/1c/7d1c93ca4bbe89621b8efcb6585e9b8c/pa/AC55074_16bd4d5fffaedfbf2e0509811380ee74.jpg',
                'https://img-pa.auto1.com/img7d/1c/7d1c93ca4bbe89621b8efcb6585e9b8c/pa/AC55074_85446462f10ecf2e1caec7eb2f8400f5.jpg',
                'https://img-pa.auto1.com/img7d/1c/7d1c93ca4bbe89621b8efcb6585e9b8c/pa/AC55074_bd3b91309540c66ffe16f9d1204b5f6c.jpg',
                'https://img-pa.auto1.com/img7d/1c/7d1c93ca4bbe89621b8efcb6585e9b8c/pa/AC55074_528e971c4d9c7880158f9fa7e41e399b.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4693e5fd-40a8-5b79-a5c9-e14c3ec71fba/4693e5fd-40a8-5b79-a5c9-e14c3ec71fba_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77479,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/1c/7d1c93ca4bbe89621b8efcb6585e9b8c/pa/AC55074_6c2f4550f3ff8eca6da3658284f114f4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4693e5fd-40a8-5b79-a5c9-e14c3ec71fba/4693e5fd-40a8-5b79-a5c9-e14c3ec71fba_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73140,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/1c/7d1c93ca4bbe89621b8efcb6585e9b8c/pa/AC55074_f1a5a8e6f0ab6c65a29482da5cb62fd2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4693e5fd-40a8-5b79-a5c9-e14c3ec71fba/4693e5fd-40a8-5b79-a5c9-e14c3ec71fba_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70695,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/1c/7d1c93ca4bbe89621b8efcb6585e9b8c/pa/AC55074_4227f0e85005263c34210dc2d3fbfd31.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4693e5fd-40a8-5b79-a5c9-e14c3ec71fba/4693e5fd-40a8-5b79-a5c9-e14c3ec71fba_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69935,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/1c/7d1c93ca4bbe89621b8efcb6585e9b8c/pa/AC55074_85446462f10ecf2e1caec7eb2f8400f5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4693e5fd-40a8-5b79-a5c9-e14c3ec71fba/4693e5fd-40a8-5b79-a5c9-e14c3ec71fba_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67410,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/1c/7d1c93ca4bbe89621b8efcb6585e9b8c/pa/AC55074_bd3b91309540c66ffe16f9d1204b5f6c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4693e5fd-40a8-5b79-a5c9-e14c3ec71fba/4693e5fd-40a8-5b79-a5c9-e14c3ec71fba_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81201,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/1c/7d1c93ca4bbe89621b8efcb6585e9b8c/pa/AC55074_528e971c4d9c7880158f9fa7e41e399b.jpg',
             'Width': 800}],
 'postal_code': '51320',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Marne',
 'province_code': 'FR-51',
 'region': 'Grand Est',
 'region_code': 'FR-44',
 'registration_date': '2019-10-30',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Peugeot 5008 2.0 Blue-HDi GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2019}
2026-04-27 08:04:43 [auto1.fr] INFO: Saving data for AC55074: {'created_time': 1777277083.560799, 'last_price_update_time': 1777277083.560809, 'has_photos': True, 'auction_closing_time': 1777390732.0}
2026-04-27 08:04:43 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 4693e5fd-40a8-5b79-a5c9-e14c3ec71fba due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:04:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438f82990>
2026-04-27 08:04:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9c77e8f-db0f-517c-aab3-d3736b4537f4/f9c77e8f-db0f-517c-aab3-d3736b4537f4_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/ae/7eae148e43533499749dceb1ea5234af/pa/RH90545_3aec12a5bdc27ab1c8978742dd1fe2b5.jpg saved to cache
2026-04-27 08:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f9c77e8f-db0f-517c-aab3-d3736b4537f4
2026-04-27 08:04:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143ade7310>
2026-04-27 08:04:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9c77e8f-db0f-517c-aab3-d3736b4537f4/f9c77e8f-db0f-517c-aab3-d3736b4537f4_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/ae/7eae148e43533499749dceb1ea5234af/pa/RH90545_a4aac42778adb38ca383e09ddb4c96bb.jpg saved to cache
2026-04-27 08:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f9c77e8f-db0f-517c-aab3-d3736b4537f4
2026-04-27 08:04:43 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item f9c77e8f-db0f-517c-aab3-d3736b4537f4 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:04:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/ae/7eae148e43533499749dceb1ea5234af/pa/RH90545_c9d5aef180300e2debb3fba964e4ae84.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:43 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item f9c77e8f-db0f-517c-aab3-d3736b4537f4 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:04:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/f9/e8f96765af5dffa9d81d57865e986165/pa/WP26002_a18afe5e437e6cdbe92a9dfb4e0476f0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/94/c394a6f2a84927e0e63ff4e532d9a6c0/pa/CS54070_3531135aa4f964c2683f3361bb4aea45.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143801ea90>
2026-04-27 08:04:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9c77e8f-db0f-517c-aab3-d3736b4537f4/f9c77e8f-db0f-517c-aab3-d3736b4537f4_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/ae/7eae148e43533499749dceb1ea5234af/pa/RH90545_c9d5aef180300e2debb3fba964e4ae84.jpg saved to cache
2026-04-27 08:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f9c77e8f-db0f-517c-aab3-d3736b4537f4
2026-04-27 08:04:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bfb9c50>
2026-04-27 08:04:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e19fdb36-92fd-577b-aaba-b8f0b4b67f7c/e19fdb36-92fd-577b-aaba-b8f0b4b67f7c_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/f9/e8f96765af5dffa9d81d57865e986165/pa/WP26002_a18afe5e437e6cdbe92a9dfb4e0476f0.jpg saved to cache
2026-04-27 08:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e19fdb36-92fd-577b-aaba-b8f0b4b67f7c
2026-04-27 08:04:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e19fdb36-92fd-577b-aaba-b8f0b4b67f7c, skipping ID generation
2026-04-27 08:04:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e19fdb36-92fd-577b-aaba-b8f0b4b67f7c with scrape type 1
2026-04-27 08:04:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e19fdb36-92fd-577b-aaba-b8f0b4b67f7c sending to next pipeline
2026-04-27 08:04:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e19fdb36-92fd-577b-aaba-b8f0b4b67f7c, identifier: WP26002
2026-04-27 08:04:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e19fdb36-92fd-577b-aaba-b8f0b4b67f7c with identifier: WP26002
2026-04-27 08:04:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e19fdb36-92fd-577b-aaba-b8f0b4b67f7c with identifier: WP26002
2026-04-27 08:04:44 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e19fdb36-92fd-577b-aaba-b8f0b4b67f7c with identifier: WP26002 to the API
2026-04-27 08:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:44 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge8/f9/e8f96765af5dffa9d81d57865e986165/pa/WP26002_a18afe5e437e6cdbe92a9dfb4e0476f0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 243,
 'category': None,
 'city': 'Marly-la-Ville',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 3',
 'engine': '3.0L',
 'engine_horse_power': 205,
 'expiration_date': '2026-04-28T15:33:29Z',
 'fuel_type': 'diesel',
 'id': 'e19fdb36-92fd-577b-aaba-b8f0b4b67f7c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 49.082,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP26002',
 'listing': 'auction',
 'location': 'FR, Marly-la-ville',
 'location_confidence': 'geocoded',
 'longitude': 2.5035,
 'make': 'BMW',
 'model': 'X3',
 'odometer': 304938,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e19fdb36-92fd-577b-aaba-b8f0b4b67f7c/e19fdb36-92fd-577b-aaba-b8f0b4b67f7c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118926,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/f9/e8f96765af5dffa9d81d57865e986165/pa/WP26002_a18afe5e437e6cdbe92a9dfb4e0476f0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e19fdb36-92fd-577b-aaba-b8f0b4b67f7c/e19fdb36-92fd-577b-aaba-b8f0b4b67f7c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90141,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/f9/e8f96765af5dffa9d81d57865e986165/pa/WP26002_1569715bd973639489ef03155222f96e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e19fdb36-92fd-577b-aaba-b8f0b4b67f7c/e19fdb36-92fd-577b-aaba-b8f0b4b67f7c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88277,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/f9/e8f96765af5dffa9d81d57865e986165/pa/WP26002_5fbd02df05f1084f87f5bb7a1d937188.jpg',
             'Width': 800}],
 'postal_code': '95670',
 'price': 0,
 'price_includes_vat': True,
 'province': "Val-d'Oise",
 'province_code': 'FR-95',
 'region': 'Île-de-France',
 'region_code': 'FR-11',
 'registration_date': '2004-03-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 3.0d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2004}
2026-04-27 08:04:44 [auto1.fr] INFO: Saving data for WP26002: {'created_time': 1777277084.464328, 'last_price_update_time': 1777277084.464345, 'has_photos': True, 'auction_closing_time': 1777390409.0}
2026-04-27 08:04:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438024f10>
2026-04-27 08:04:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ad1fc8f-78a4-5e5c-b1e6-2588312b7847/2ad1fc8f-78a4-5e5c-b1e6-2588312b7847_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/94/c394a6f2a84927e0e63ff4e532d9a6c0/pa/CS54070_3531135aa4f964c2683f3361bb4aea45.jpg saved to cache
2026-04-27 08:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2ad1fc8f-78a4-5e5c-b1e6-2588312b7847
2026-04-27 08:04:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2ad1fc8f-78a4-5e5c-b1e6-2588312b7847, skipping ID generation
2026-04-27 08:04:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ad1fc8f-78a4-5e5c-b1e6-2588312b7847 with scrape type 1
2026-04-27 08:04:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2ad1fc8f-78a4-5e5c-b1e6-2588312b7847 sending to next pipeline
2026-04-27 08:04:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2ad1fc8f-78a4-5e5c-b1e6-2588312b7847, identifier: CS54070
2026-04-27 08:04:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2ad1fc8f-78a4-5e5c-b1e6-2588312b7847 with identifier: CS54070
2026-04-27 08:04:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2ad1fc8f-78a4-5e5c-b1e6-2588312b7847 with identifier: CS54070
2026-04-27 08:04:44 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2ad1fc8f-78a4-5e5c-b1e6-2588312b7847 with identifier: CS54070 to the API
2026-04-27 08:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:44 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc3/94/c394a6f2a84927e0e63ff4e532d9a6c0/pa/CS54070_3531135aa4f964c2683f3361bb4aea45.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'category': None,
 'city': 'Beaucaire',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-04-28T15:41:17Z',
 'fuel_type': 'diesel',
 'id': '2ad1fc8f-78a4-5e5c-b1e6-2588312b7847',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 43.8081,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CS54070',
 'listing': 'auction',
 'location': 'FR, Beaucaire',
 'location_confidence': 'geocoded',
 'longitude': 4.6442,
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 82075,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2ad1fc8f-78a4-5e5c-b1e6-2588312b7847/2ad1fc8f-78a4-5e5c-b1e6-2588312b7847_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68143,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/94/c394a6f2a84927e0e63ff4e532d9a6c0/pa/CS54070_3531135aa4f964c2683f3361bb4aea45.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2ad1fc8f-78a4-5e5c-b1e6-2588312b7847/2ad1fc8f-78a4-5e5c-b1e6-2588312b7847_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70943,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/94/c394a6f2a84927e0e63ff4e532d9a6c0/pa/CS54070_c9e983fa37da0177a4f8c209b26ce11b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2ad1fc8f-78a4-5e5c-b1e6-2588312b7847/2ad1fc8f-78a4-5e5c-b1e6-2588312b7847_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70053,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/94/c394a6f2a84927e0e63ff4e532d9a6c0/pa/CS54070_cb52d22086a3a07fd458b597145cfb13.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2ad1fc8f-78a4-5e5c-b1e6-2588312b7847/2ad1fc8f-78a4-5e5c-b1e6-2588312b7847_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50441,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/94/c394a6f2a84927e0e63ff4e532d9a6c0/pa/CS54070_9c5fc469e3cb0e140ecb59ea7201b8dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2ad1fc8f-78a4-5e5c-b1e6-2588312b7847/2ad1fc8f-78a4-5e5c-b1e6-2588312b7847_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84716,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/94/c394a6f2a84927e0e63ff4e532d9a6c0/pa/CS54070_98e34c5e8644a56121068573b278c867.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2ad1fc8f-78a4-5e5c-b1e6-2588312b7847/2ad1fc8f-78a4-5e5c-b1e6-2588312b7847_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68069,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/94/c394a6f2a84927e0e63ff4e532d9a6c0/pa/CS54070_f55e68dc391ca4982e863a4ca681c732.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2ad1fc8f-78a4-5e5c-b1e6-2588312b7847/2ad1fc8f-78a4-5e5c-b1e6-2588312b7847_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66210,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/94/c394a6f2a84927e0e63ff4e532d9a6c0/pa/CS54070_011de4a681ca8c407b36794940979349.jpg',
             'Width': 800}],
 'postal_code': '30300',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Gard',
 'province_code': 'FR-30',
 'region': 'Occitanie',
 'region_code': 'FR-76',
 'registration_date': '2019-09-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2019}
2026-04-27 08:04:45 [auto1.fr] INFO: Saving data for CS54070: {'created_time': 1777277085.007089, 'last_price_update_time': 1777277085.007104, 'has_photos': True, 'auction_closing_time': 1777390877.0}
2026-04-27 08:04:45 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item f9c77e8f-db0f-517c-aab3-d3736b4537f4 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:04:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f9c77e8f-db0f-517c-aab3-d3736b4537f4 with identifier: RH90545
2026-04-27 08:04:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f9c77e8f-db0f-517c-aab3-d3736b4537f4 with identifier: RH90545
2026-04-27 08:04:45 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f9c77e8f-db0f-517c-aab3-d3736b4537f4 with identifier: RH90545 to the API
2026-04-27 08:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:45 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:45 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'category': None,
 'city': 'Ambarès-et-Lagrave',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 92,
 'expiration_date': '2026-04-28T15:40:54Z',
 'fuel_type': 'diesel',
 'id': 'f9c77e8f-db0f-517c-aab3-d3736b4537f4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 44.9274,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RH90545',
 'listing': 'auction',
 'location': 'FR, Ambarès-et-Lagrave',
 'location_confidence': 'geocoded',
 'longitude': -0.4914,
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 184213,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img7e/ae/7eae148e43533499749dceb1ea5234af/pa/RH90545_72fe336ffa200ce495c00cb5e5a89e6d.jpg',
                'https://img-pa.auto1.com/img7e/ae/7eae148e43533499749dceb1ea5234af/pa/RH90545_879f430896c79a360c762a464c802421.jpg',
                'https://img-pa.auto1.com/img7e/ae/7eae148e43533499749dceb1ea5234af/pa/RH90545_c9d5aef180300e2debb3fba964e4ae84.jpg',
                'https://img-pa.auto1.com/img7e/ae/7eae148e43533499749dceb1ea5234af/pa/RH90545_a4aac42778adb38ca383e09ddb4c96bb.jpg',
                'https://img-pa.auto1.com/img7e/ae/7eae148e43533499749dceb1ea5234af/pa/RH90545_1c4456756ea6a2ab2053c40c9d555edd.jpg',
                'https://img-pa.auto1.com/img7e/ae/7eae148e43533499749dceb1ea5234af/pa/RH90545_337ba9e7426f0f2864eb843649879b01.jpg',
                'https://img-pa.auto1.com/img7e/ae/7eae148e43533499749dceb1ea5234af/pa/RH90545_3aec12a5bdc27ab1c8978742dd1fe2b5.jpg',
                'https://img-pa.auto1.com/img7e/ae/7eae148e43533499749dceb1ea5234af/pa/RH90545_91e7082b4f893102bff57d360bdd2dce.jpg',
                'https://img-pa.auto1.com/img7e/ae/7eae148e43533499749dceb1ea5234af/pa/RH90545_8bbebd05fa8275c02342542ad220ed0d.jpg',
                'https://img-pa.auto1.com/img7e/ae/7eae148e43533499749dceb1ea5234af/pa/RH90545_0c80deff011b0e5597b4ded00ac8b101.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f9c77e8f-db0f-517c-aab3-d3736b4537f4/f9c77e8f-db0f-517c-aab3-d3736b4537f4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74656,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/ae/7eae148e43533499749dceb1ea5234af/pa/RH90545_c9d5aef180300e2debb3fba964e4ae84.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f9c77e8f-db0f-517c-aab3-d3736b4537f4/f9c77e8f-db0f-517c-aab3-d3736b4537f4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65326,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/ae/7eae148e43533499749dceb1ea5234af/pa/RH90545_a4aac42778adb38ca383e09ddb4c96bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f9c77e8f-db0f-517c-aab3-d3736b4537f4/f9c77e8f-db0f-517c-aab3-d3736b4537f4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81334,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/ae/7eae148e43533499749dceb1ea5234af/pa/RH90545_3aec12a5bdc27ab1c8978742dd1fe2b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f9c77e8f-db0f-517c-aab3-d3736b4537f4/f9c77e8f-db0f-517c-aab3-d3736b4537f4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85859,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/ae/7eae148e43533499749dceb1ea5234af/pa/RH90545_91e7082b4f893102bff57d360bdd2dce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f9c77e8f-db0f-517c-aab3-d3736b4537f4/f9c77e8f-db0f-517c-aab3-d3736b4537f4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77195,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/ae/7eae148e43533499749dceb1ea5234af/pa/RH90545_8bbebd05fa8275c02342542ad220ed0d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f9c77e8f-db0f-517c-aab3-d3736b4537f4/f9c77e8f-db0f-517c-aab3-d3736b4537f4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71903,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/ae/7eae148e43533499749dceb1ea5234af/pa/RH90545_0c80deff011b0e5597b4ded00ac8b101.jpg',
             'Width': 800}],
 'postal_code': '33440',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Gironde',
 'province_code': 'FR-33',
 'region': 'Nouvelle-Aquitaine',
 'region_code': 'FR-75',
 'registration_date': '2013-11-18',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Peugeot 2008 1.6 e-HDi Business Pack',
 'transmission': 'manual',
 'trim': 'Business Pack',
 'year': 2013}
2026-04-27 08:04:45 [auto1.fr] INFO: Saving data for RH90545: {'created_time': 1777277085.442391, 'last_price_update_time': 1777277085.442403, 'has_photos': True, 'auction_closing_time': 1777390854.0}
2026-04-27 08:04:45 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item f9c77e8f-db0f-517c-aab3-d3736b4537f4 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/a6/65a6d69b2a238978c0e72cffed4a27aa/pa/LG63023_76015bd5bfc1d6accb575a0bf1d689bc.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438126450>
2026-04-27 08:04:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89cd1d2d-ac08-5559-b4ed-73373e2aebfd/89cd1d2d-ac08-5559-b4ed-73373e2aebfd_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/a6/65a6d69b2a238978c0e72cffed4a27aa/pa/LG63023_76015bd5bfc1d6accb575a0bf1d689bc.jpg saved to cache
2026-04-27 08:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 89cd1d2d-ac08-5559-b4ed-73373e2aebfd
2026-04-27 08:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TX81047> (referer: https://www.auto1.com/v1/car-details-view/TX81047/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 617e7a62-8dab-50af-9d01-1df7ef48ca49 with identifier: TX81047
2026-04-27 08:04:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 617e7a62-8dab-50af-9d01-1df7ef48ca49 with scrape type 1
2026-04-27 08:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 617e7a62-8dab-50af-9d01-1df7ef48ca49
2026-04-27 08:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/de/abdea0a7bfed781d985f215a5668c771/pa/TX81047_ac1ce2deac637cafb4b7e64011925704.jpg not downloaded yet
2026-04-27 08:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/de/abdea0a7bfed781d985f215a5668c771/pa/TX81047_bc1fd91228a4a1dc35b96f6c0b952c3c.jpg not downloaded yet
2026-04-27 08:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/de/abdea0a7bfed781d985f215a5668c771/pa/TX81047_bac7327ef04abeaf422c22ed68bf6d88.jpg not downloaded yet
2026-04-27 08:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/de/abdea0a7bfed781d985f215a5668c771/pa/TX81047_9a0ddd49a6faf247cc3c35f786346652.jpg not downloaded yet
2026-04-27 08:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/de/abdea0a7bfed781d985f215a5668c771/pa/TX81047_00538480dbb55f0aeaac5cc01b2e0abd.jpg not downloaded yet
2026-04-27 08:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/de/abdea0a7bfed781d985f215a5668c771/pa/TX81047_6e7386d629290f415c6b35193df8d258.jpg not downloaded yet
2026-04-27 08:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/de/abdea0a7bfed781d985f215a5668c771/pa/TX81047_95918e7fe3c97a91905248fbc43222f7.jpg not downloaded yet
2026-04-27 08:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/a6/65a6d69b2a238978c0e72cffed4a27aa/pa/LG63023_5d8a6c1421589963bd191176da77913f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/de/abdea0a7bfed781d985f215a5668c771/pa/TX81047_c260bd9107a5ecc0cafe2b6b29d01015.jpg not downloaded yet
2026-04-27 08:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/de/abdea0a7bfed781d985f215a5668c771/pa/TX81047_d6068983dc477231dc00867c27c26066.jpg not downloaded yet
2026-04-27 08:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/de/abdea0a7bfed781d985f215a5668c771/pa/TX81047_c8a9fe766bc18c9362f0840c007a92b1.jpg not downloaded yet
2026-04-27 08:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438be9690>
2026-04-27 08:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89cd1d2d-ac08-5559-b4ed-73373e2aebfd/89cd1d2d-ac08-5559-b4ed-73373e2aebfd_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/a6/65a6d69b2a238978c0e72cffed4a27aa/pa/LG63023_5d8a6c1421589963bd191176da77913f.jpg saved to cache
2026-04-27 08:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 89cd1d2d-ac08-5559-b4ed-73373e2aebfd
2026-04-27 08:04:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 89cd1d2d-ac08-5559-b4ed-73373e2aebfd, skipping ID generation
2026-04-27 08:04:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89cd1d2d-ac08-5559-b4ed-73373e2aebfd with scrape type 1
2026-04-27 08:04:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 89cd1d2d-ac08-5559-b4ed-73373e2aebfd sending to next pipeline
2026-04-27 08:04:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 89cd1d2d-ac08-5559-b4ed-73373e2aebfd, identifier: LG63023
2026-04-27 08:04:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 89cd1d2d-ac08-5559-b4ed-73373e2aebfd with identifier: LG63023
2026-04-27 08:04:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 89cd1d2d-ac08-5559-b4ed-73373e2aebfd with identifier: LG63023
2026-04-27 08:04:47 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 89cd1d2d-ac08-5559-b4ed-73373e2aebfd with identifier: LG63023 to the API
2026-04-27 08:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:47 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img65/a6/65a6d69b2a238978c0e72cffed4a27aa/pa/LG63023_5d8a6c1421589963bd191176da77913f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'category': None,
 'city': 'LA CHAPELLE LONGUEVILLE',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 143,
 'expiration_date': '2026-04-28T15:27:34Z',
 'fuel_type': 'diesel',
 'id': '89cd1d2d-ac08-5559-b4ed-73373e2aebfd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LG63023',
 'listing': 'auction',
 'location': 'FR, LA CHAPELLE LONGUEVILLE',
 'location_confidence': None,
 'longitude': None,
 'make': 'BMW',
 'model': 'X3',
 'odometer': 256622,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_89cd1d2d-ac08-5559-b4ed-73373e2aebfd/89cd1d2d-ac08-5559-b4ed-73373e2aebfd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67121,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/a6/65a6d69b2a238978c0e72cffed4a27aa/pa/LG63023_a79110b4d9c17b789744e944b9e7b890.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_89cd1d2d-ac08-5559-b4ed-73373e2aebfd/89cd1d2d-ac08-5559-b4ed-73373e2aebfd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70900,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/a6/65a6d69b2a238978c0e72cffed4a27aa/pa/LG63023_55631285080c6f4c8ffb6bbbe193f2ca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_89cd1d2d-ac08-5559-b4ed-73373e2aebfd/89cd1d2d-ac08-5559-b4ed-73373e2aebfd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70710,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/a6/65a6d69b2a238978c0e72cffed4a27aa/pa/LG63023_5d8a6c1421589963bd191176da77913f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_89cd1d2d-ac08-5559-b4ed-73373e2aebfd/89cd1d2d-ac08-5559-b4ed-73373e2aebfd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65489,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/a6/65a6d69b2a238978c0e72cffed4a27aa/pa/LG63023_983317a2d76e9f6a9d898ddecc970ffb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_89cd1d2d-ac08-5559-b4ed-73373e2aebfd/89cd1d2d-ac08-5559-b4ed-73373e2aebfd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66904,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/a6/65a6d69b2a238978c0e72cffed4a27aa/pa/LG63023_76015bd5bfc1d6accb575a0bf1d689bc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_89cd1d2d-ac08-5559-b4ed-73373e2aebfd/89cd1d2d-ac08-5559-b4ed-73373e2aebfd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67491,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/a6/65a6d69b2a238978c0e72cffed4a27aa/pa/LG63023_a3b47e838821215f1cdda3a9f6cb0df2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_89cd1d2d-ac08-5559-b4ed-73373e2aebfd/89cd1d2d-ac08-5559-b4ed-73373e2aebfd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54872,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/a6/65a6d69b2a238978c0e72cffed4a27aa/pa/LG63023_e7ea8172caaca8c106dda897b884892f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_89cd1d2d-ac08-5559-b4ed-73373e2aebfd/89cd1d2d-ac08-5559-b4ed-73373e2aebfd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58901,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/a6/65a6d69b2a238978c0e72cffed4a27aa/pa/LG63023_83747aad1880cc742840e303327901d7.jpg',
             'Width': 800}],
 'postal_code': None,
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2013-03-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 sDrive 18d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-04-27 08:04:47 [auto1.fr] INFO: Saving data for LG63023: {'created_time': 1777277087.421013, 'last_price_update_time': 1777277087.421027, 'has_photos': True, 'auction_closing_time': 1777390054.0}
2026-04-27 08:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/de/abdea0a7bfed781d985f215a5668c771/pa/TX81047_95918e7fe3c97a91905248fbc43222f7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HS91891/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LN71029> (referer: https://www.auto1.com/v1/car-details-view/LN71029/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438134b50>
2026-04-27 08:04:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_617e7a62-8dab-50af-9d01-1df7ef48ca49/617e7a62-8dab-50af-9d01-1df7ef48ca49_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/de/abdea0a7bfed781d985f215a5668c771/pa/TX81047_95918e7fe3c97a91905248fbc43222f7.jpg saved to cache
2026-04-27 08:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 617e7a62-8dab-50af-9d01-1df7ef48ca49
2026-04-27 08:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/de/abdea0a7bfed781d985f215a5668c771/pa/TX81047_c8a9fe766bc18c9362f0840c007a92b1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8f9e007-c3cb-54d3-912c-e9bf386dacce with identifier: LN71029
2026-04-27 08:04:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8f9e007-c3cb-54d3-912c-e9bf386dacce with scrape type 1
2026-04-27 08:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item f8f9e007-c3cb-54d3-912c-e9bf386dacce
2026-04-27 08:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/5b/d65be62c60ba25d00d25d92beeddaa5f/pa/LN71029_3b568fee3a3da2757b9be7731d97ec76.jpg not downloaded yet
2026-04-27 08:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/5b/d65be62c60ba25d00d25d92beeddaa5f/pa/LN71029_9c277c7e86eb379b1cdf279b448c179c.jpg not downloaded yet
2026-04-27 08:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/5b/d65be62c60ba25d00d25d92beeddaa5f/pa/LN71029_5304d6b7d0d2d99cf7a474495cb7170f.jpg not downloaded yet
2026-04-27 08:04:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d25610>
2026-04-27 08:04:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_617e7a62-8dab-50af-9d01-1df7ef48ca49/617e7a62-8dab-50af-9d01-1df7ef48ca49_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/de/abdea0a7bfed781d985f215a5668c771/pa/TX81047_c8a9fe766bc18c9362f0840c007a92b1.jpg saved to cache
2026-04-27 08:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 617e7a62-8dab-50af-9d01-1df7ef48ca49
2026-04-27 08:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/5b/d65be62c60ba25d00d25d92beeddaa5f/pa/LN71029_38ee30914b6d358d6fb47ecb36bebb4e.jpg not downloaded yet
2026-04-27 08:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/5b/d65be62c60ba25d00d25d92beeddaa5f/pa/LN71029_14f3cf6b202a0d188d0b9b4d4e71714b.jpg not downloaded yet
2026-04-27 08:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/5b/d65be62c60ba25d00d25d92beeddaa5f/pa/LN71029_fc6771c53d8bd09d9864d0c73a5f46ac.jpg not downloaded yet
2026-04-27 08:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/5b/d65be62c60ba25d00d25d92beeddaa5f/pa/LN71029_fc6771c53d8bd09d9864d0c73a5f46ac.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:48 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 617e7a62-8dab-50af-9d01-1df7ef48ca49 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/5b/d65be62c60ba25d00d25d92beeddaa5f/pa/LN71029_14f3cf6b202a0d188d0b9b4d4e71714b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/5b/d65be62c60ba25d00d25d92beeddaa5f/pa/LN71029_38ee30914b6d358d6fb47ecb36bebb4e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d92690>
2026-04-27 08:04:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8f9e007-c3cb-54d3-912c-e9bf386dacce/f8f9e007-c3cb-54d3-912c-e9bf386dacce_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/5b/d65be62c60ba25d00d25d92beeddaa5f/pa/LN71029_fc6771c53d8bd09d9864d0c73a5f46ac.jpg saved to cache
2026-04-27 08:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f8f9e007-c3cb-54d3-912c-e9bf386dacce
2026-04-27 08:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/5b/d65be62c60ba25d00d25d92beeddaa5f/pa/LN71029_9c277c7e86eb379b1cdf279b448c179c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c2e750>
2026-04-27 08:04:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8f9e007-c3cb-54d3-912c-e9bf386dacce/f8f9e007-c3cb-54d3-912c-e9bf386dacce_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/5b/d65be62c60ba25d00d25d92beeddaa5f/pa/LN71029_14f3cf6b202a0d188d0b9b4d4e71714b.jpg saved to cache
2026-04-27 08:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f8f9e007-c3cb-54d3-912c-e9bf386dacce
2026-04-27 08:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/5b/d65be62c60ba25d00d25d92beeddaa5f/pa/LN71029_3b568fee3a3da2757b9be7731d97ec76.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:48 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 617e7a62-8dab-50af-9d01-1df7ef48ca49 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:04:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438fb42d0>
2026-04-27 08:04:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8f9e007-c3cb-54d3-912c-e9bf386dacce/f8f9e007-c3cb-54d3-912c-e9bf386dacce_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/5b/d65be62c60ba25d00d25d92beeddaa5f/pa/LN71029_38ee30914b6d358d6fb47ecb36bebb4e.jpg saved to cache
2026-04-27 08:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f8f9e007-c3cb-54d3-912c-e9bf386dacce
2026-04-27 08:04:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d31ad0>
2026-04-27 08:04:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8f9e007-c3cb-54d3-912c-e9bf386dacce/f8f9e007-c3cb-54d3-912c-e9bf386dacce_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/5b/d65be62c60ba25d00d25d92beeddaa5f/pa/LN71029_9c277c7e86eb379b1cdf279b448c179c.jpg saved to cache
2026-04-27 08:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f8f9e007-c3cb-54d3-912c-e9bf386dacce
2026-04-27 08:04:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380a7a50>
2026-04-27 08:04:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8f9e007-c3cb-54d3-912c-e9bf386dacce/f8f9e007-c3cb-54d3-912c-e9bf386dacce_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/5b/d65be62c60ba25d00d25d92beeddaa5f/pa/LN71029_3b568fee3a3da2757b9be7731d97ec76.jpg saved to cache
2026-04-27 08:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f8f9e007-c3cb-54d3-912c-e9bf386dacce
2026-04-27 08:04:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/de/abdea0a7bfed781d985f215a5668c771/pa/TX81047_6e7386d629290f415c6b35193df8d258.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/de/abdea0a7bfed781d985f215a5668c771/pa/TX81047_00538480dbb55f0aeaac5cc01b2e0abd.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/de/abdea0a7bfed781d985f215a5668c771/pa/TX81047_9a0ddd49a6faf247cc3c35f786346652.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438cb4f90>
2026-04-27 08:04:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_617e7a62-8dab-50af-9d01-1df7ef48ca49/617e7a62-8dab-50af-9d01-1df7ef48ca49_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/de/abdea0a7bfed781d985f215a5668c771/pa/TX81047_6e7386d629290f415c6b35193df8d258.jpg saved to cache
2026-04-27 08:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 617e7a62-8dab-50af-9d01-1df7ef48ca49
2026-04-27 08:04:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1439c743d0>
2026-04-27 08:04:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_617e7a62-8dab-50af-9d01-1df7ef48ca49/617e7a62-8dab-50af-9d01-1df7ef48ca49_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/de/abdea0a7bfed781d985f215a5668c771/pa/TX81047_00538480dbb55f0aeaac5cc01b2e0abd.jpg saved to cache
2026-04-27 08:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 617e7a62-8dab-50af-9d01-1df7ef48ca49
2026-04-27 08:04:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ce9bd0>
2026-04-27 08:04:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_617e7a62-8dab-50af-9d01-1df7ef48ca49/617e7a62-8dab-50af-9d01-1df7ef48ca49_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/de/abdea0a7bfed781d985f215a5668c771/pa/TX81047_9a0ddd49a6faf247cc3c35f786346652.jpg saved to cache
2026-04-27 08:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 617e7a62-8dab-50af-9d01-1df7ef48ca49
2026-04-27 08:04:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/de/abdea0a7bfed781d985f215a5668c771/pa/TX81047_bac7327ef04abeaf422c22ed68bf6d88.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/de/abdea0a7bfed781d985f215a5668c771/pa/TX81047_bc1fd91228a4a1dc35b96f6c0b952c3c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/de/abdea0a7bfed781d985f215a5668c771/pa/TX81047_ac1ce2deac637cafb4b7e64011925704.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438adc3d0>
2026-04-27 08:04:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_617e7a62-8dab-50af-9d01-1df7ef48ca49/617e7a62-8dab-50af-9d01-1df7ef48ca49_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/de/abdea0a7bfed781d985f215a5668c771/pa/TX81047_bac7327ef04abeaf422c22ed68bf6d88.jpg saved to cache
2026-04-27 08:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 617e7a62-8dab-50af-9d01-1df7ef48ca49
2026-04-27 08:04:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d30c50>
2026-04-27 08:04:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_617e7a62-8dab-50af-9d01-1df7ef48ca49/617e7a62-8dab-50af-9d01-1df7ef48ca49_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/de/abdea0a7bfed781d985f215a5668c771/pa/TX81047_bc1fd91228a4a1dc35b96f6c0b952c3c.jpg saved to cache
2026-04-27 08:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 617e7a62-8dab-50af-9d01-1df7ef48ca49
2026-04-27 08:04:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bf1aa90>
2026-04-27 08:04:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_617e7a62-8dab-50af-9d01-1df7ef48ca49/617e7a62-8dab-50af-9d01-1df7ef48ca49_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/de/abdea0a7bfed781d985f215a5668c771/pa/TX81047_ac1ce2deac637cafb4b7e64011925704.jpg saved to cache
2026-04-27 08:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 617e7a62-8dab-50af-9d01-1df7ef48ca49
2026-04-27 08:04:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 617e7a62-8dab-50af-9d01-1df7ef48ca49, skipping ID generation
2026-04-27 08:04:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 617e7a62-8dab-50af-9d01-1df7ef48ca49 with scrape type 1
2026-04-27 08:04:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 617e7a62-8dab-50af-9d01-1df7ef48ca49 sending to next pipeline
2026-04-27 08:04:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 617e7a62-8dab-50af-9d01-1df7ef48ca49, identifier: TX81047
2026-04-27 08:04:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 617e7a62-8dab-50af-9d01-1df7ef48ca49 with identifier: TX81047
2026-04-27 08:04:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 617e7a62-8dab-50af-9d01-1df7ef48ca49 with identifier: TX81047
2026-04-27 08:04:49 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 617e7a62-8dab-50af-9d01-1df7ef48ca49 with identifier: TX81047 to the API
2026-04-27 08:04:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:49 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgab/de/abdea0a7bfed781d985f215a5668c771/pa/TX81047_ac1ce2deac637cafb4b7e64011925704.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'category': None,
 'city': 'Beaucaire',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-04-28T15:15:38Z',
 'fuel_type': 'diesel',
 'id': '617e7a62-8dab-50af-9d01-1df7ef48ca49',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 43.8081,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TX81047',
 'listing': 'auction',
 'location': 'FR, Beaucaire',
 'location_confidence': 'geocoded',
 'longitude': 4.6442,
 'make': 'BMW',
 'model': '1er',
 'odometer': 161802,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_617e7a62-8dab-50af-9d01-1df7ef48ca49/617e7a62-8dab-50af-9d01-1df7ef48ca49_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74599,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/de/abdea0a7bfed781d985f215a5668c771/pa/TX81047_ac1ce2deac637cafb4b7e64011925704.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_617e7a62-8dab-50af-9d01-1df7ef48ca49/617e7a62-8dab-50af-9d01-1df7ef48ca49_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75272,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/de/abdea0a7bfed781d985f215a5668c771/pa/TX81047_bc1fd91228a4a1dc35b96f6c0b952c3c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_617e7a62-8dab-50af-9d01-1df7ef48ca49/617e7a62-8dab-50af-9d01-1df7ef48ca49_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78180,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/de/abdea0a7bfed781d985f215a5668c771/pa/TX81047_bac7327ef04abeaf422c22ed68bf6d88.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_617e7a62-8dab-50af-9d01-1df7ef48ca49/617e7a62-8dab-50af-9d01-1df7ef48ca49_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74789,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/de/abdea0a7bfed781d985f215a5668c771/pa/TX81047_9a0ddd49a6faf247cc3c35f786346652.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_617e7a62-8dab-50af-9d01-1df7ef48ca49/617e7a62-8dab-50af-9d01-1df7ef48ca49_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65553,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/de/abdea0a7bfed781d985f215a5668c771/pa/TX81047_00538480dbb55f0aeaac5cc01b2e0abd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_617e7a62-8dab-50af-9d01-1df7ef48ca49/617e7a62-8dab-50af-9d01-1df7ef48ca49_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73062,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/de/abdea0a7bfed781d985f215a5668c771/pa/TX81047_6e7386d629290f415c6b35193df8d258.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_617e7a62-8dab-50af-9d01-1df7ef48ca49/617e7a62-8dab-50af-9d01-1df7ef48ca49_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72387,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/de/abdea0a7bfed781d985f215a5668c771/pa/TX81047_95918e7fe3c97a91905248fbc43222f7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_617e7a62-8dab-50af-9d01-1df7ef48ca49/617e7a62-8dab-50af-9d01-1df7ef48ca49_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76303,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/de/abdea0a7bfed781d985f215a5668c771/pa/TX81047_c8a9fe766bc18c9362f0840c007a92b1.jpg',
             'Width': 800}],
 'postal_code': '30300',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Gard',
 'province_code': 'FR-30',
 'region': 'Occitanie',
 'region_code': 'FR-76',
 'registration_date': '2017-10-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 118d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2017}
2026-04-27 08:04:50 [auto1.fr] INFO: Saving data for TX81047: {'created_time': 1777277090.048291, 'last_price_update_time': 1777277090.048302, 'has_photos': True, 'auction_closing_time': 1777389338.0}
2026-04-27 08:04:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f8f9e007-c3cb-54d3-912c-e9bf386dacce with identifier: LN71029
2026-04-27 08:04:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f8f9e007-c3cb-54d3-912c-e9bf386dacce with identifier: LN71029
2026-04-27 08:04:50 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f8f9e007-c3cb-54d3-912c-e9bf386dacce with identifier: LN71029 to the API
2026-04-27 08:04:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:50 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:50 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': 145,
 'category': None,
 'city': 'Quincieux',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 110,
 'expiration_date': '2026-04-28T15:03:23Z',
 'fuel_type': 'diesel',
 'id': 'f8f9e007-c3cb-54d3-912c-e9bf386dacce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 45.9137,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LN71029',
 'listing': 'auction',
 'location': 'FR, Quincieux',
 'location_confidence': 'geocoded',
 'longitude': 4.777,
 'make': 'Citroen',
 'model': 'C4 Picasso',
 'odometer': 192532,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/imgd6/5b/d65be62c60ba25d00d25d92beeddaa5f/pa/LN71029_3b568fee3a3da2757b9be7731d97ec76.jpg',
                'https://img-pa.auto1.com/imgd6/5b/d65be62c60ba25d00d25d92beeddaa5f/pa/LN71029_9c277c7e86eb379b1cdf279b448c179c.jpg',
                'https://img-pa.auto1.com/imgd6/5b/d65be62c60ba25d00d25d92beeddaa5f/pa/LN71029_5304d6b7d0d2d99cf7a474495cb7170f.jpg',
                'https://img-pa.auto1.com/imgd6/5b/d65be62c60ba25d00d25d92beeddaa5f/pa/LN71029_38ee30914b6d358d6fb47ecb36bebb4e.jpg',
                'https://img-pa.auto1.com/imgd6/5b/d65be62c60ba25d00d25d92beeddaa5f/pa/LN71029_14f3cf6b202a0d188d0b9b4d4e71714b.jpg',
                'https://img-pa.auto1.com/imgd6/5b/d65be62c60ba25d00d25d92beeddaa5f/pa/LN71029_fc6771c53d8bd09d9864d0c73a5f46ac.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f8f9e007-c3cb-54d3-912c-e9bf386dacce/f8f9e007-c3cb-54d3-912c-e9bf386dacce_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71537,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/5b/d65be62c60ba25d00d25d92beeddaa5f/pa/LN71029_3b568fee3a3da2757b9be7731d97ec76.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f8f9e007-c3cb-54d3-912c-e9bf386dacce/f8f9e007-c3cb-54d3-912c-e9bf386dacce_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72097,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/5b/d65be62c60ba25d00d25d92beeddaa5f/pa/LN71029_9c277c7e86eb379b1cdf279b448c179c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f8f9e007-c3cb-54d3-912c-e9bf386dacce/f8f9e007-c3cb-54d3-912c-e9bf386dacce_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47571,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/5b/d65be62c60ba25d00d25d92beeddaa5f/pa/LN71029_38ee30914b6d358d6fb47ecb36bebb4e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f8f9e007-c3cb-54d3-912c-e9bf386dacce/f8f9e007-c3cb-54d3-912c-e9bf386dacce_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77413,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/5b/d65be62c60ba25d00d25d92beeddaa5f/pa/LN71029_14f3cf6b202a0d188d0b9b4d4e71714b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f8f9e007-c3cb-54d3-912c-e9bf386dacce/f8f9e007-c3cb-54d3-912c-e9bf386dacce_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45603,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/5b/d65be62c60ba25d00d25d92beeddaa5f/pa/LN71029_fc6771c53d8bd09d9864d0c73a5f46ac.jpg',
             'Width': 800}],
 'postal_code': '69650',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Rhône',
 'province_code': 'FR-69',
 'region': 'Auvergne-Rhône-Alpes',
 'region_code': 'FR-84',
 'registration_date': '2010-05-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C4 Picasso 1.6 HDi Dynamique',
 'transmission': 'manual',
 'trim': 'Dynamique',
 'year': 2010}
2026-04-27 08:04:50 [auto1.fr] INFO: Saving data for LN71029: {'created_time': 1777277090.460735, 'last_price_update_time': 1777277090.460747, 'has_photos': True, 'auction_closing_time': 1777388603.0}
2026-04-27 08:04:50 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item f8f9e007-c3cb-54d3-912c-e9bf386dacce due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:04:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TJ12777/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EJ46418/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WC58866/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZX13537> (referer: https://www.auto1.com/v1/car-details-view/ZX13537/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90f0b20c-124e-55ca-a766-5bb7c71114b8 with identifier: ZX13537
2026-04-27 08:04:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90f0b20c-124e-55ca-a766-5bb7c71114b8 with scrape type 1
2026-04-27 08:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 90f0b20c-124e-55ca-a766-5bb7c71114b8
2026-04-27 08:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/f8/faf8a8a9386fbfc846fddbc2159b1541/pa/ZX13537_42a2525687b04073176127eb07b08f24.jpg not downloaded yet
2026-04-27 08:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/f8/faf8a8a9386fbfc846fddbc2159b1541/pa/ZX13537_7ca23ab83d3cfb4bde6832d4b719448e.jpg not downloaded yet
2026-04-27 08:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/f8/faf8a8a9386fbfc846fddbc2159b1541/pa/ZX13537_70aaa78c1c2f45681cfd53ea43ea7504.jpg not downloaded yet
2026-04-27 08:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/f8/faf8a8a9386fbfc846fddbc2159b1541/pa/ZX13537_2d2a8661267e328217e9c73025e5dcfb.jpg not downloaded yet
2026-04-27 08:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/f8/faf8a8a9386fbfc846fddbc2159b1541/pa/ZX13537_2e95416a92f85c5f9526a450f95be300.jpg not downloaded yet
2026-04-27 08:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/f8/faf8a8a9386fbfc846fddbc2159b1541/pa/ZX13537_9a2e9c0195053532b2efdb375ca16f02.jpg not downloaded yet
2026-04-27 08:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/f8/faf8a8a9386fbfc846fddbc2159b1541/pa/ZX13537_b2a280d0c64f8fb78a0807ae4db408bd.jpg not downloaded yet
2026-04-27 08:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/f8/faf8a8a9386fbfc846fddbc2159b1541/pa/ZX13537_13f60f5e84c41b3e62f59dc96779c7c6.jpg not downloaded yet
2026-04-27 08:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/f8/faf8a8a9386fbfc846fddbc2159b1541/pa/ZX13537_b8fa6d647da0f16700a0d905122c34a4.jpg not downloaded yet
2026-04-27 08:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/f8/faf8a8a9386fbfc846fddbc2159b1541/pa/ZX13537_570f92f7b2b72a362aa824601f9ce23f.jpg not downloaded yet
2026-04-27 08:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KJ24442> (referer: https://www.auto1.com/v1/car-details-view/KJ24442/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/f8/faf8a8a9386fbfc846fddbc2159b1541/pa/ZX13537_570f92f7b2b72a362aa824601f9ce23f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98017000-7f94-5b07-b86c-e1b841719af9 with identifier: KJ24442
2026-04-27 08:04:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98017000-7f94-5b07-b86c-e1b841719af9 with scrape type 1
2026-04-27 08:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 98017000-7f94-5b07-b86c-e1b841719af9
2026-04-27 08:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/39/2d39dd3cc55a850edbf254cb27ee36dd/pa/KJ24442_bdcfb7dc1a3f6773a399810cc56cf465.jpg not downloaded yet
2026-04-27 08:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/39/2d39dd3cc55a850edbf254cb27ee36dd/pa/KJ24442_985eb6ca50ccfcce35bcec1f9153cd10.jpg not downloaded yet
2026-04-27 08:04:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/f8/faf8a8a9386fbfc846fddbc2159b1541/pa/ZX13537_b8fa6d647da0f16700a0d905122c34a4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/39/2d39dd3cc55a850edbf254cb27ee36dd/pa/KJ24442_8004c3598f845b1ed82180051dbb5c04.jpg not downloaded yet
2026-04-27 08:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/39/2d39dd3cc55a850edbf254cb27ee36dd/pa/KJ24442_b04893be72ec649a396ebb113f466ee9.jpg not downloaded yet
2026-04-27 08:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/39/2d39dd3cc55a850edbf254cb27ee36dd/pa/KJ24442_585aee4b50e78d36620679f23e895739.jpg not downloaded yet
2026-04-27 08:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/39/2d39dd3cc55a850edbf254cb27ee36dd/pa/KJ24442_9c0fbab9135480a3ee548a2096fce4cc.jpg not downloaded yet
2026-04-27 08:04:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a60490>
2026-04-27 08:04:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90f0b20c-124e-55ca-a766-5bb7c71114b8/90f0b20c-124e-55ca-a766-5bb7c71114b8_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/f8/faf8a8a9386fbfc846fddbc2159b1541/pa/ZX13537_570f92f7b2b72a362aa824601f9ce23f.jpg saved to cache
2026-04-27 08:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 90f0b20c-124e-55ca-a766-5bb7c71114b8
2026-04-27 08:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/39/2d39dd3cc55a850edbf254cb27ee36dd/pa/KJ24442_8f2a2d01cecf23844aea0901c92a43e4.jpg not downloaded yet
2026-04-27 08:04:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b28b10>
2026-04-27 08:04:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90f0b20c-124e-55ca-a766-5bb7c71114b8/90f0b20c-124e-55ca-a766-5bb7c71114b8_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/f8/faf8a8a9386fbfc846fddbc2159b1541/pa/ZX13537_b8fa6d647da0f16700a0d905122c34a4.jpg saved to cache
2026-04-27 08:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 90f0b20c-124e-55ca-a766-5bb7c71114b8
2026-04-27 08:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/39/2d39dd3cc55a850edbf254cb27ee36dd/pa/KJ24442_024bd74e472257b3d61dc09506b94681.jpg not downloaded yet
2026-04-27 08:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/39/2d39dd3cc55a850edbf254cb27ee36dd/pa/KJ24442_f6f1e1282cf288515936c5b4d3b06a97.jpg not downloaded yet
2026-04-27 08:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/39/2d39dd3cc55a850edbf254cb27ee36dd/pa/KJ24442_bbae2ee340aad87814545c79773f9849.jpg not downloaded yet
2026-04-27 08:04:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/39/2d39dd3cc55a850edbf254cb27ee36dd/pa/KJ24442_985eb6ca50ccfcce35bcec1f9153cd10.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438135ad0>
2026-04-27 08:04:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98017000-7f94-5b07-b86c-e1b841719af9/98017000-7f94-5b07-b86c-e1b841719af9_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/39/2d39dd3cc55a850edbf254cb27ee36dd/pa/KJ24442_985eb6ca50ccfcce35bcec1f9153cd10.jpg saved to cache
2026-04-27 08:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 98017000-7f94-5b07-b86c-e1b841719af9
2026-04-27 08:04:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/39/2d39dd3cc55a850edbf254cb27ee36dd/pa/KJ24442_bbae2ee340aad87814545c79773f9849.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bf1b510>
2026-04-27 08:04:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98017000-7f94-5b07-b86c-e1b841719af9/98017000-7f94-5b07-b86c-e1b841719af9_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/39/2d39dd3cc55a850edbf254cb27ee36dd/pa/KJ24442_bbae2ee340aad87814545c79773f9849.jpg saved to cache
2026-04-27 08:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 98017000-7f94-5b07-b86c-e1b841719af9
2026-04-27 08:04:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/39/2d39dd3cc55a850edbf254cb27ee36dd/pa/KJ24442_f6f1e1282cf288515936c5b4d3b06a97.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14381ca390>
2026-04-27 08:04:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98017000-7f94-5b07-b86c-e1b841719af9/98017000-7f94-5b07-b86c-e1b841719af9_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/39/2d39dd3cc55a850edbf254cb27ee36dd/pa/KJ24442_f6f1e1282cf288515936c5b4d3b06a97.jpg saved to cache
2026-04-27 08:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 98017000-7f94-5b07-b86c-e1b841719af9
2026-04-27 08:04:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/39/2d39dd3cc55a850edbf254cb27ee36dd/pa/KJ24442_024bd74e472257b3d61dc09506b94681.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bf1a250>
2026-04-27 08:04:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98017000-7f94-5b07-b86c-e1b841719af9/98017000-7f94-5b07-b86c-e1b841719af9_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/39/2d39dd3cc55a850edbf254cb27ee36dd/pa/KJ24442_024bd74e472257b3d61dc09506b94681.jpg saved to cache
2026-04-27 08:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 98017000-7f94-5b07-b86c-e1b841719af9
2026-04-27 08:04:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/39/2d39dd3cc55a850edbf254cb27ee36dd/pa/KJ24442_8f2a2d01cecf23844aea0901c92a43e4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438add850>
2026-04-27 08:04:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98017000-7f94-5b07-b86c-e1b841719af9/98017000-7f94-5b07-b86c-e1b841719af9_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/39/2d39dd3cc55a850edbf254cb27ee36dd/pa/KJ24442_8f2a2d01cecf23844aea0901c92a43e4.jpg saved to cache
2026-04-27 08:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 98017000-7f94-5b07-b86c-e1b841719af9
2026-04-27 08:04:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/39/2d39dd3cc55a850edbf254cb27ee36dd/pa/KJ24442_9c0fbab9135480a3ee548a2096fce4cc.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438bfddd0>
2026-04-27 08:04:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98017000-7f94-5b07-b86c-e1b841719af9/98017000-7f94-5b07-b86c-e1b841719af9_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/39/2d39dd3cc55a850edbf254cb27ee36dd/pa/KJ24442_9c0fbab9135480a3ee548a2096fce4cc.jpg saved to cache
2026-04-27 08:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 98017000-7f94-5b07-b86c-e1b841719af9
2026-04-27 08:04:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/39/2d39dd3cc55a850edbf254cb27ee36dd/pa/KJ24442_585aee4b50e78d36620679f23e895739.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d32f10>
2026-04-27 08:04:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98017000-7f94-5b07-b86c-e1b841719af9/98017000-7f94-5b07-b86c-e1b841719af9_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/39/2d39dd3cc55a850edbf254cb27ee36dd/pa/KJ24442_585aee4b50e78d36620679f23e895739.jpg saved to cache
2026-04-27 08:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 98017000-7f94-5b07-b86c-e1b841719af9
2026-04-27 08:04:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EF60252> (referer: https://www.auto1.com/v1/car-details-view/EF60252/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:59 [scrapy.extensions.logstats] INFO: Crawled 406 pages (at 45 pages/min), scraped 372 items (at 29 items/min)
2026-04-27 08:04:59 [scrapy.extensions.memusage] INFO: Peak memory usage is 373MiB
2026-04-27 08:04:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/39/2d39dd3cc55a850edbf254cb27ee36dd/pa/KJ24442_b04893be72ec649a396ebb113f466ee9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/39/2d39dd3cc55a850edbf254cb27ee36dd/pa/KJ24442_bdcfb7dc1a3f6773a399810cc56cf465.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea2a190f-1d6d-566b-9ce8-eee8a012b000 with identifier: EF60252
2026-04-27 08:05:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea2a190f-1d6d-566b-9ce8-eee8a012b000 with scrape type 1
2026-04-27 08:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item ea2a190f-1d6d-566b-9ce8-eee8a012b000
2026-04-27 08:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/81/8381fe4276625a55dfe485d4e8a318c6/pa/EF60252_404d3b0ffe73b3bc0efd24cf8383f687.jpg not downloaded yet
2026-04-27 08:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/81/8381fe4276625a55dfe485d4e8a318c6/pa/EF60252_6e67b4ed740bd56131648735745c09cf.jpg not downloaded yet
2026-04-27 08:05:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/f8/faf8a8a9386fbfc846fddbc2159b1541/pa/ZX13537_13f60f5e84c41b3e62f59dc96779c7c6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/81/8381fe4276625a55dfe485d4e8a318c6/pa/EF60252_c813740ccfc452f249b8c4398d2dd507.jpg not downloaded yet
2026-04-27 08:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/81/8381fe4276625a55dfe485d4e8a318c6/pa/EF60252_a9fb52c974ce526fbf8347d58b98c851.jpg not downloaded yet
2026-04-27 08:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/81/8381fe4276625a55dfe485d4e8a318c6/pa/EF60252_2214036d82a78b5c2e771daabfae9f36.jpg not downloaded yet
2026-04-27 08:05:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438e015d0>
2026-04-27 08:05:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98017000-7f94-5b07-b86c-e1b841719af9/98017000-7f94-5b07-b86c-e1b841719af9_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/39/2d39dd3cc55a850edbf254cb27ee36dd/pa/KJ24442_b04893be72ec649a396ebb113f466ee9.jpg saved to cache
2026-04-27 08:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 98017000-7f94-5b07-b86c-e1b841719af9
2026-04-27 08:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/81/8381fe4276625a55dfe485d4e8a318c6/pa/EF60252_86e6e933dbe86b715025e4d77ae54c1b.jpg not downloaded yet
2026-04-27 08:05:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a1ae90>
2026-04-27 08:05:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98017000-7f94-5b07-b86c-e1b841719af9/98017000-7f94-5b07-b86c-e1b841719af9_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/39/2d39dd3cc55a850edbf254cb27ee36dd/pa/KJ24442_bdcfb7dc1a3f6773a399810cc56cf465.jpg saved to cache
2026-04-27 08:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 98017000-7f94-5b07-b86c-e1b841719af9
2026-04-27 08:05:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d7cb50>
2026-04-27 08:05:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90f0b20c-124e-55ca-a766-5bb7c71114b8/90f0b20c-124e-55ca-a766-5bb7c71114b8_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/f8/faf8a8a9386fbfc846fddbc2159b1541/pa/ZX13537_13f60f5e84c41b3e62f59dc96779c7c6.jpg saved to cache
2026-04-27 08:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 90f0b20c-124e-55ca-a766-5bb7c71114b8
2026-04-27 08:05:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/39/2d39dd3cc55a850edbf254cb27ee36dd/pa/KJ24442_8004c3598f845b1ed82180051dbb5c04.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/81/8381fe4276625a55dfe485d4e8a318c6/pa/EF60252_6e67b4ed740bd56131648735745c09cf.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/81/8381fe4276625a55dfe485d4e8a318c6/pa/EF60252_86e6e933dbe86b715025e4d77ae54c1b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c38c10>
2026-04-27 08:05:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98017000-7f94-5b07-b86c-e1b841719af9/98017000-7f94-5b07-b86c-e1b841719af9_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/39/2d39dd3cc55a850edbf254cb27ee36dd/pa/KJ24442_8004c3598f845b1ed82180051dbb5c04.jpg saved to cache
2026-04-27 08:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 98017000-7f94-5b07-b86c-e1b841719af9
2026-04-27 08:05:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 98017000-7f94-5b07-b86c-e1b841719af9, skipping ID generation
2026-04-27 08:05:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98017000-7f94-5b07-b86c-e1b841719af9 with scrape type 1
2026-04-27 08:05:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 98017000-7f94-5b07-b86c-e1b841719af9 sending to next pipeline
2026-04-27 08:05:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 98017000-7f94-5b07-b86c-e1b841719af9, identifier: KJ24442
2026-04-27 08:05:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/81/8381fe4276625a55dfe485d4e8a318c6/pa/EF60252_2214036d82a78b5c2e771daabfae9f36.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SG66178/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 98017000-7f94-5b07-b86c-e1b841719af9 with identifier: KJ24442
2026-04-27 08:05:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 98017000-7f94-5b07-b86c-e1b841719af9 with identifier: KJ24442
2026-04-27 08:05:01 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:05:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 98017000-7f94-5b07-b86c-e1b841719af9 with identifier: KJ24442 to the API
2026-04-27 08:05:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:05:01 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:05:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2d/39/2d39dd3cc55a850edbf254cb27ee36dd/pa/KJ24442_8004c3598f845b1ed82180051dbb5c04.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'city': 'Allennes-les-Marais',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 91,
 'expiration_date': '2026-04-28T15:11:43Z',
 'fuel_type': 'petrol',
 'id': '98017000-7f94-5b07-b86c-e1b841719af9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 50.5375,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KJ24442',
 'listing': 'auction',
 'location': 'FR, Allennes-les-Marais',
 'location_confidence': 'geocoded',
 'longitude': 2.9536,
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 39588,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_98017000-7f94-5b07-b86c-e1b841719af9/98017000-7f94-5b07-b86c-e1b841719af9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75929,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/39/2d39dd3cc55a850edbf254cb27ee36dd/pa/KJ24442_bdcfb7dc1a3f6773a399810cc56cf465.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_98017000-7f94-5b07-b86c-e1b841719af9/98017000-7f94-5b07-b86c-e1b841719af9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75331,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/39/2d39dd3cc55a850edbf254cb27ee36dd/pa/KJ24442_985eb6ca50ccfcce35bcec1f9153cd10.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_98017000-7f94-5b07-b86c-e1b841719af9/98017000-7f94-5b07-b86c-e1b841719af9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73382,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/39/2d39dd3cc55a850edbf254cb27ee36dd/pa/KJ24442_8004c3598f845b1ed82180051dbb5c04.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_98017000-7f94-5b07-b86c-e1b841719af9/98017000-7f94-5b07-b86c-e1b841719af9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59970,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/39/2d39dd3cc55a850edbf254cb27ee36dd/pa/KJ24442_b04893be72ec649a396ebb113f466ee9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_98017000-7f94-5b07-b86c-e1b841719af9/98017000-7f94-5b07-b86c-e1b841719af9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64544,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/39/2d39dd3cc55a850edbf254cb27ee36dd/pa/KJ24442_585aee4b50e78d36620679f23e895739.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_98017000-7f94-5b07-b86c-e1b841719af9/98017000-7f94-5b07-b86c-e1b841719af9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75529,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/39/2d39dd3cc55a850edbf254cb27ee36dd/pa/KJ24442_9c0fbab9135480a3ee548a2096fce4cc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_98017000-7f94-5b07-b86c-e1b841719af9/98017000-7f94-5b07-b86c-e1b841719af9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70697,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/39/2d39dd3cc55a850edbf254cb27ee36dd/pa/KJ24442_8f2a2d01cecf23844aea0901c92a43e4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_98017000-7f94-5b07-b86c-e1b841719af9/98017000-7f94-5b07-b86c-e1b841719af9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75056,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/39/2d39dd3cc55a850edbf254cb27ee36dd/pa/KJ24442_024bd74e472257b3d61dc09506b94681.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_98017000-7f94-5b07-b86c-e1b841719af9/98017000-7f94-5b07-b86c-e1b841719af9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75713,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/39/2d39dd3cc55a850edbf254cb27ee36dd/pa/KJ24442_f6f1e1282cf288515936c5b4d3b06a97.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_98017000-7f94-5b07-b86c-e1b841719af9/98017000-7f94-5b07-b86c-e1b841719af9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48130,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/39/2d39dd3cc55a850edbf254cb27ee36dd/pa/KJ24442_bbae2ee340aad87814545c79773f9849.jpg',
             'Width': 800}],
 'postal_code': '59251',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Nord',
 'province_code': 'FR-59',
 'region': 'Hauts-de-France',
 'region_code': 'FR-32',
 'registration_date': '2022-09-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Sandero 1.0 TCe Stepway Essential',
 'transmission': 'manual',
 'trim': 'Stepway Essential',
 'year': 2022}
2026-04-27 08:05:01 [auto1.fr] INFO: Saving data for KJ24442: {'created_time': 1777277101.277335, 'last_price_update_time': 1777277101.277344, 'has_photos': True, 'auction_closing_time': 1777389103.0}
2026-04-27 08:05:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143812f2d0>
2026-04-27 08:05:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea2a190f-1d6d-566b-9ce8-eee8a012b000/ea2a190f-1d6d-566b-9ce8-eee8a012b000_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/81/8381fe4276625a55dfe485d4e8a318c6/pa/EF60252_6e67b4ed740bd56131648735745c09cf.jpg saved to cache
2026-04-27 08:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ea2a190f-1d6d-566b-9ce8-eee8a012b000
2026-04-27 08:05:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143805db50>
2026-04-27 08:05:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea2a190f-1d6d-566b-9ce8-eee8a012b000/ea2a190f-1d6d-566b-9ce8-eee8a012b000_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/81/8381fe4276625a55dfe485d4e8a318c6/pa/EF60252_86e6e933dbe86b715025e4d77ae54c1b.jpg saved to cache
2026-04-27 08:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ea2a190f-1d6d-566b-9ce8-eee8a012b000
2026-04-27 08:05:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bfb8810>
2026-04-27 08:05:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea2a190f-1d6d-566b-9ce8-eee8a012b000/ea2a190f-1d6d-566b-9ce8-eee8a012b000_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/81/8381fe4276625a55dfe485d4e8a318c6/pa/EF60252_2214036d82a78b5c2e771daabfae9f36.jpg saved to cache
2026-04-27 08:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ea2a190f-1d6d-566b-9ce8-eee8a012b000
2026-04-27 08:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/81/8381fe4276625a55dfe485d4e8a318c6/pa/EF60252_404d3b0ffe73b3bc0efd24cf8383f687.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/81/8381fe4276625a55dfe485d4e8a318c6/pa/EF60252_c813740ccfc452f249b8c4398d2dd507.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/81/8381fe4276625a55dfe485d4e8a318c6/pa/EF60252_a9fb52c974ce526fbf8347d58b98c851.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438cab290>
2026-04-27 08:05:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea2a190f-1d6d-566b-9ce8-eee8a012b000/ea2a190f-1d6d-566b-9ce8-eee8a012b000_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/81/8381fe4276625a55dfe485d4e8a318c6/pa/EF60252_404d3b0ffe73b3bc0efd24cf8383f687.jpg saved to cache
2026-04-27 08:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ea2a190f-1d6d-566b-9ce8-eee8a012b000
2026-04-27 08:05:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438fbfad0>
2026-04-27 08:05:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea2a190f-1d6d-566b-9ce8-eee8a012b000/ea2a190f-1d6d-566b-9ce8-eee8a012b000_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/81/8381fe4276625a55dfe485d4e8a318c6/pa/EF60252_c813740ccfc452f249b8c4398d2dd507.jpg saved to cache
2026-04-27 08:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ea2a190f-1d6d-566b-9ce8-eee8a012b000
2026-04-27 08:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/f8/faf8a8a9386fbfc846fddbc2159b1541/pa/ZX13537_b2a280d0c64f8fb78a0807ae4db408bd.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ca8b10>
2026-04-27 08:05:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea2a190f-1d6d-566b-9ce8-eee8a012b000/ea2a190f-1d6d-566b-9ce8-eee8a012b000_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/81/8381fe4276625a55dfe485d4e8a318c6/pa/EF60252_a9fb52c974ce526fbf8347d58b98c851.jpg saved to cache
2026-04-27 08:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ea2a190f-1d6d-566b-9ce8-eee8a012b000
2026-04-27 08:05:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ea2a190f-1d6d-566b-9ce8-eee8a012b000, skipping ID generation
2026-04-27 08:05:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea2a190f-1d6d-566b-9ce8-eee8a012b000 with scrape type 1
2026-04-27 08:05:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ea2a190f-1d6d-566b-9ce8-eee8a012b000 sending to next pipeline
2026-04-27 08:05:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ea2a190f-1d6d-566b-9ce8-eee8a012b000, identifier: EF60252
2026-04-27 08:05:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ea2a190f-1d6d-566b-9ce8-eee8a012b000 with identifier: EF60252
2026-04-27 08:05:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ea2a190f-1d6d-566b-9ce8-eee8a012b000 with identifier: EF60252
2026-04-27 08:05:02 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:05:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ea2a190f-1d6d-566b-9ce8-eee8a012b000 with identifier: EF60252 to the API
2026-04-27 08:05:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:05:02 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:05:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img83/81/8381fe4276625a55dfe485d4e8a318c6/pa/EF60252_a9fb52c974ce526fbf8347d58b98c851.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'city': 'Marckolsheim',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.0L',
 'engine_horse_power': 65,
 'expiration_date': '2026-04-28T15:12:24Z',
 'fuel_type': 'petrol',
 'id': 'ea2a190f-1d6d-566b-9ce8-eee8a012b000',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.1647,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EF60252',
 'listing': 'auction',
 'location': 'FR, Marckolsheim',
 'location_confidence': 'geocoded',
 'longitude': 7.544,
 'make': 'Suzuki',
 'model': 'Splash',
 'odometer': 191477,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ea2a190f-1d6d-566b-9ce8-eee8a012b000/ea2a190f-1d6d-566b-9ce8-eee8a012b000_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84281,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/81/8381fe4276625a55dfe485d4e8a318c6/pa/EF60252_404d3b0ffe73b3bc0efd24cf8383f687.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ea2a190f-1d6d-566b-9ce8-eee8a012b000/ea2a190f-1d6d-566b-9ce8-eee8a012b000_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79758,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/81/8381fe4276625a55dfe485d4e8a318c6/pa/EF60252_6e67b4ed740bd56131648735745c09cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ea2a190f-1d6d-566b-9ce8-eee8a012b000/ea2a190f-1d6d-566b-9ce8-eee8a012b000_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77028,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/81/8381fe4276625a55dfe485d4e8a318c6/pa/EF60252_c813740ccfc452f249b8c4398d2dd507.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ea2a190f-1d6d-566b-9ce8-eee8a012b000/ea2a190f-1d6d-566b-9ce8-eee8a012b000_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70695,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/81/8381fe4276625a55dfe485d4e8a318c6/pa/EF60252_a9fb52c974ce526fbf8347d58b98c851.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ea2a190f-1d6d-566b-9ce8-eee8a012b000/ea2a190f-1d6d-566b-9ce8-eee8a012b000_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73885,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/81/8381fe4276625a55dfe485d4e8a318c6/pa/EF60252_2214036d82a78b5c2e771daabfae9f36.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ea2a190f-1d6d-566b-9ce8-eee8a012b000/ea2a190f-1d6d-566b-9ce8-eee8a012b000_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41623,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/81/8381fe4276625a55dfe485d4e8a318c6/pa/EF60252_86e6e933dbe86b715025e4d77ae54c1b.jpg',
             'Width': 800}],
 'postal_code': '67390',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Bas-Rhin',
 'province_code': 'FR-67',
 'region': 'Grand Est',
 'region_code': 'FR-44',
 'registration_date': '2009-06-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Suzuki Splash 1.0 GL',
 'transmission': 'manual',
 'trim': 'GL',
 'year': 2009}
2026-04-27 08:05:02 [auto1.fr] INFO: Saving data for EF60252: {'created_time': 1777277102.286879, 'last_price_update_time': 1777277102.286891, 'has_photos': True, 'auction_closing_time': 1777389144.0}
2026-04-27 08:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/f8/faf8a8a9386fbfc846fddbc2159b1541/pa/ZX13537_2e95416a92f85c5f9526a450f95be300.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/f8/faf8a8a9386fbfc846fddbc2159b1541/pa/ZX13537_9a2e9c0195053532b2efdb375ca16f02.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143805e5d0>
2026-04-27 08:05:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90f0b20c-124e-55ca-a766-5bb7c71114b8/90f0b20c-124e-55ca-a766-5bb7c71114b8_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/f8/faf8a8a9386fbfc846fddbc2159b1541/pa/ZX13537_b2a280d0c64f8fb78a0807ae4db408bd.jpg saved to cache
2026-04-27 08:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 90f0b20c-124e-55ca-a766-5bb7c71114b8
2026-04-27 08:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/f8/faf8a8a9386fbfc846fddbc2159b1541/pa/ZX13537_2d2a8661267e328217e9c73025e5dcfb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a19950>
2026-04-27 08:05:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90f0b20c-124e-55ca-a766-5bb7c71114b8/90f0b20c-124e-55ca-a766-5bb7c71114b8_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/f8/faf8a8a9386fbfc846fddbc2159b1541/pa/ZX13537_2e95416a92f85c5f9526a450f95be300.jpg saved to cache
2026-04-27 08:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 90f0b20c-124e-55ca-a766-5bb7c71114b8
2026-04-27 08:05:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b5bc10>
2026-04-27 08:05:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90f0b20c-124e-55ca-a766-5bb7c71114b8/90f0b20c-124e-55ca-a766-5bb7c71114b8_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/f8/faf8a8a9386fbfc846fddbc2159b1541/pa/ZX13537_9a2e9c0195053532b2efdb375ca16f02.jpg saved to cache
2026-04-27 08:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 90f0b20c-124e-55ca-a766-5bb7c71114b8
2026-04-27 08:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/f8/faf8a8a9386fbfc846fddbc2159b1541/pa/ZX13537_7ca23ab83d3cfb4bde6832d4b719448e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380443d0>
2026-04-27 08:05:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90f0b20c-124e-55ca-a766-5bb7c71114b8/90f0b20c-124e-55ca-a766-5bb7c71114b8_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/f8/faf8a8a9386fbfc846fddbc2159b1541/pa/ZX13537_2d2a8661267e328217e9c73025e5dcfb.jpg saved to cache
2026-04-27 08:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 90f0b20c-124e-55ca-a766-5bb7c71114b8
2026-04-27 08:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/f8/faf8a8a9386fbfc846fddbc2159b1541/pa/ZX13537_70aaa78c1c2f45681cfd53ea43ea7504.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/f8/faf8a8a9386fbfc846fddbc2159b1541/pa/ZX13537_42a2525687b04073176127eb07b08f24.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a1b550>
2026-04-27 08:05:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90f0b20c-124e-55ca-a766-5bb7c71114b8/90f0b20c-124e-55ca-a766-5bb7c71114b8_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/f8/faf8a8a9386fbfc846fddbc2159b1541/pa/ZX13537_7ca23ab83d3cfb4bde6832d4b719448e.jpg saved to cache
2026-04-27 08:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 90f0b20c-124e-55ca-a766-5bb7c71114b8
2026-04-27 08:05:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bfd3e50>
2026-04-27 08:05:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90f0b20c-124e-55ca-a766-5bb7c71114b8/90f0b20c-124e-55ca-a766-5bb7c71114b8_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/f8/faf8a8a9386fbfc846fddbc2159b1541/pa/ZX13537_70aaa78c1c2f45681cfd53ea43ea7504.jpg saved to cache
2026-04-27 08:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 90f0b20c-124e-55ca-a766-5bb7c71114b8
2026-04-27 08:05:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ccd250>
2026-04-27 08:05:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90f0b20c-124e-55ca-a766-5bb7c71114b8/90f0b20c-124e-55ca-a766-5bb7c71114b8_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/f8/faf8a8a9386fbfc846fddbc2159b1541/pa/ZX13537_42a2525687b04073176127eb07b08f24.jpg saved to cache
2026-04-27 08:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 90f0b20c-124e-55ca-a766-5bb7c71114b8
2026-04-27 08:05:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 90f0b20c-124e-55ca-a766-5bb7c71114b8, skipping ID generation
2026-04-27 08:05:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90f0b20c-124e-55ca-a766-5bb7c71114b8 with scrape type 1
2026-04-27 08:05:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 90f0b20c-124e-55ca-a766-5bb7c71114b8 sending to next pipeline
2026-04-27 08:05:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 90f0b20c-124e-55ca-a766-5bb7c71114b8, identifier: ZX13537
2026-04-27 08:05:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 90f0b20c-124e-55ca-a766-5bb7c71114b8 with identifier: ZX13537
2026-04-27 08:05:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 90f0b20c-124e-55ca-a766-5bb7c71114b8 with identifier: ZX13537
2026-04-27 08:05:02 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:05:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 90f0b20c-124e-55ca-a766-5bb7c71114b8 with identifier: ZX13537 to the API
2026-04-27 08:05:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:05:03 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:05:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgfa/f8/faf8a8a9386fbfc846fddbc2159b1541/pa/ZX13537_42a2525687b04073176127eb07b08f24.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'city': 'Loyettes',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.5L',
 'engine_horse_power': 110,
 'expiration_date': '2026-04-28T15:35:41Z',
 'fuel_type': 'diesel',
 'id': '90f0b20c-124e-55ca-a766-5bb7c71114b8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 45.7766,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZX13537',
 'listing': 'auction',
 'location': 'FR, Loyettes',
 'location_confidence': 'geocoded',
 'longitude': 5.2069,
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 198981,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_90f0b20c-124e-55ca-a766-5bb7c71114b8/90f0b20c-124e-55ca-a766-5bb7c71114b8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70374,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/f8/faf8a8a9386fbfc846fddbc2159b1541/pa/ZX13537_42a2525687b04073176127eb07b08f24.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_90f0b20c-124e-55ca-a766-5bb7c71114b8/90f0b20c-124e-55ca-a766-5bb7c71114b8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68005,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/f8/faf8a8a9386fbfc846fddbc2159b1541/pa/ZX13537_7ca23ab83d3cfb4bde6832d4b719448e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_90f0b20c-124e-55ca-a766-5bb7c71114b8/90f0b20c-124e-55ca-a766-5bb7c71114b8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66128,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/f8/faf8a8a9386fbfc846fddbc2159b1541/pa/ZX13537_70aaa78c1c2f45681cfd53ea43ea7504.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_90f0b20c-124e-55ca-a766-5bb7c71114b8/90f0b20c-124e-55ca-a766-5bb7c71114b8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63765,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/f8/faf8a8a9386fbfc846fddbc2159b1541/pa/ZX13537_2d2a8661267e328217e9c73025e5dcfb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_90f0b20c-124e-55ca-a766-5bb7c71114b8/90f0b20c-124e-55ca-a766-5bb7c71114b8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60483,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/f8/faf8a8a9386fbfc846fddbc2159b1541/pa/ZX13537_2e95416a92f85c5f9526a450f95be300.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_90f0b20c-124e-55ca-a766-5bb7c71114b8/90f0b20c-124e-55ca-a766-5bb7c71114b8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65933,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/f8/faf8a8a9386fbfc846fddbc2159b1541/pa/ZX13537_9a2e9c0195053532b2efdb375ca16f02.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_90f0b20c-124e-55ca-a766-5bb7c71114b8/90f0b20c-124e-55ca-a766-5bb7c71114b8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61462,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/f8/faf8a8a9386fbfc846fddbc2159b1541/pa/ZX13537_b2a280d0c64f8fb78a0807ae4db408bd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_90f0b20c-124e-55ca-a766-5bb7c71114b8/90f0b20c-124e-55ca-a766-5bb7c71114b8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61546,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/f8/faf8a8a9386fbfc846fddbc2159b1541/pa/ZX13537_13f60f5e84c41b3e62f59dc96779c7c6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_90f0b20c-124e-55ca-a766-5bb7c71114b8/90f0b20c-124e-55ca-a766-5bb7c71114b8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63858,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/f8/faf8a8a9386fbfc846fddbc2159b1541/pa/ZX13537_b8fa6d647da0f16700a0d905122c34a4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_90f0b20c-124e-55ca-a766-5bb7c71114b8/90f0b20c-124e-55ca-a766-5bb7c71114b8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50521,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/f8/faf8a8a9386fbfc846fddbc2159b1541/pa/ZX13537_570f92f7b2b72a362aa824601f9ce23f.jpg',
             'Width': 800}],
 'postal_code': '01360',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Ain',
 'province_code': 'FR-01',
 'region': 'Auvergne-Rhône-Alpes',
 'region_code': 'FR-84',
 'registration_date': '2014-04-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Duster 1.5 dCi Laureate 4x2',
 'transmission': 'manual',
 'trim': 'Laureate 4x2',
 'year': 2014}
2026-04-27 08:05:03 [auto1.fr] INFO: Saving data for ZX13537: {'created_time': 1777277103.178691, 'last_price_update_time': 1777277103.178701, 'has_photos': True, 'auction_closing_time': 1777390541.0}
2026-04-27 08:05:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CS24682> (referer: https://www.auto1.com/v1/car-details-view/CS24682/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HS91891> (referer: https://www.auto1.com/v1/car-details-view/HS91891/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12e696c1-5fad-566b-9cb8-f92093b883e8 with identifier: CS24682
2026-04-27 08:05:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12e696c1-5fad-566b-9cb8-f92093b883e8 with scrape type 1
2026-04-27 08:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 12e696c1-5fad-566b-9cb8-f92093b883e8
2026-04-27 08:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/a2/bca20f2e27b72ab1bfb06ecbfb2658af/pa/CS24682_672ce31db9f566469636101ce1b42a42.jpg not downloaded yet
2026-04-27 08:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/a2/bca20f2e27b72ab1bfb06ecbfb2658af/pa/CS24682_4c02c7be67bbf3cfe780a17df6f16668.jpg not downloaded yet
2026-04-27 08:05:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7a0f8ff-a25f-51b3-ba91-c646355df459 with identifier: HS91891
2026-04-27 08:05:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7a0f8ff-a25f-51b3-ba91-c646355df459 with scrape type 1
2026-04-27 08:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b7a0f8ff-a25f-51b3-ba91-c646355df459
2026-04-27 08:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/50/c3505c20f8b6ce30341d5135641c4ce9/pa/HS91891_20d6a9c283b88247109ce89b8cc30412.jpg not downloaded yet
2026-04-27 08:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/a2/bca20f2e27b72ab1bfb06ecbfb2658af/pa/CS24682_37a245fb4199448d5db22f53e70cf300.jpg not downloaded yet
2026-04-27 08:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/50/c3505c20f8b6ce30341d5135641c4ce9/pa/HS91891_355fa0346bbfc4b336b166d5d2c8410e.jpg not downloaded yet
2026-04-27 08:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/a2/bca20f2e27b72ab1bfb06ecbfb2658af/pa/CS24682_68312b85ffd91f262fe1dfbdc6a7237f.jpg not downloaded yet
2026-04-27 08:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/50/c3505c20f8b6ce30341d5135641c4ce9/pa/HS91891_e27a277cf0d27bdcdd546a8f27b18322.jpg not downloaded yet
2026-04-27 08:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/a2/bca20f2e27b72ab1bfb06ecbfb2658af/pa/CS24682_d26932f7dee8dabb3d1e3ca1208dcd61.jpg not downloaded yet
2026-04-27 08:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/50/c3505c20f8b6ce30341d5135641c4ce9/pa/HS91891_04484f9d8aeea3f1ccfec42de9c938d6.jpg not downloaded yet
2026-04-27 08:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/a2/bca20f2e27b72ab1bfb06ecbfb2658af/pa/CS24682_c799c1883e1904042fc30f3bd7ef59b6.jpg not downloaded yet
2026-04-27 08:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/50/c3505c20f8b6ce30341d5135641c4ce9/pa/HS91891_af0df5f75e698549646b58419a548bb8.jpg not downloaded yet
2026-04-27 08:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/a2/bca20f2e27b72ab1bfb06ecbfb2658af/pa/CS24682_ab69d331065aa6352edc47fec17bc055.jpg not downloaded yet
2026-04-27 08:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/50/c3505c20f8b6ce30341d5135641c4ce9/pa/HS91891_23ae2b1ff6f90d0faf2edfa4be3bbbd5.jpg not downloaded yet
2026-04-27 08:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/a2/bca20f2e27b72ab1bfb06ecbfb2658af/pa/CS24682_6dbf8c8187c1fef67ac56850be1a9e45.jpg not downloaded yet
2026-04-27 08:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/50/c3505c20f8b6ce30341d5135641c4ce9/pa/HS91891_3b26541a3a9aa1e1ddd25a37f7e0afa3.jpg not downloaded yet
2026-04-27 08:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/a2/bca20f2e27b72ab1bfb06ecbfb2658af/pa/CS24682_b97f43985a0535fd53e8bc07c47cdf8e.jpg not downloaded yet
2026-04-27 08:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/50/c3505c20f8b6ce30341d5135641c4ce9/pa/HS91891_0f5be8d3785f88e40b738b5b26cbb5fb.jpg not downloaded yet
2026-04-27 08:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/a2/bca20f2e27b72ab1bfb06ecbfb2658af/pa/CS24682_1d95458d1d7fd89cf8b47069a0276374.jpg not downloaded yet
2026-04-27 08:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/50/c3505c20f8b6ce30341d5135641c4ce9/pa/HS91891_8b89ca80138d3df769c224818032d53c.jpg not downloaded yet
2026-04-27 08:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/50/c3505c20f8b6ce30341d5135641c4ce9/pa/HS91891_6f2e9f39d372d90464cb93fb4a7ba5ef.jpg not downloaded yet
2026-04-27 08:05:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NK06658> (referer: https://www.auto1.com/v1/car-details-view/NK06658/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80bf6820-4a84-582b-b4ef-82508f7a3425 with identifier: NK06658
2026-04-27 08:05:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80bf6820-4a84-582b-b4ef-82508f7a3425 with scrape type 1
2026-04-27 08:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 80bf6820-4a84-582b-b4ef-82508f7a3425
2026-04-27 08:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/45/d4453b10cb557c86c4b3e92ef65a3500/pa/NK06658_b35a54705637a47313f7a1daad6cc9ac.jpg not downloaded yet
2026-04-27 08:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/45/d4453b10cb557c86c4b3e92ef65a3500/pa/NK06658_da4f7957ed2a5e45d8d6c302f2c694c1.jpg not downloaded yet
2026-04-27 08:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/45/d4453b10cb557c86c4b3e92ef65a3500/pa/NK06658_78c2a999808b94ae0d507912214d7af7.jpg not downloaded yet
2026-04-27 08:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/45/d4453b10cb557c86c4b3e92ef65a3500/pa/NK06658_4fc81dbb042737576ba7040c492ccde5.jpg not downloaded yet
2026-04-27 08:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/45/d4453b10cb557c86c4b3e92ef65a3500/pa/NK06658_8f36a9cff0200e15f21d6ad969fd9b94.jpg not downloaded yet
2026-04-27 08:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/45/d4453b10cb557c86c4b3e92ef65a3500/pa/NK06658_13f96d0aecb3203209fb62cace36aa7c.jpg not downloaded yet
2026-04-27 08:05:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CB45480/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/45/d4453b10cb557c86c4b3e92ef65a3500/pa/NK06658_9add99b61fc5cb6dd43f62e85737e022.jpg not downloaded yet
2026-04-27 08:05:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/45/d4453b10cb557c86c4b3e92ef65a3500/pa/NK06658_9da763c2bd5d3cb29ca1773dfc105163.jpg not downloaded yet
2026-04-27 08:05:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/50/c3505c20f8b6ce30341d5135641c4ce9/pa/HS91891_6f2e9f39d372d90464cb93fb4a7ba5ef.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/45/d4453b10cb557c86c4b3e92ef65a3500/pa/NK06658_0c636cb70319f5171959c2ce8feadc3a.jpg not downloaded yet
2026-04-27 08:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/45/d4453b10cb557c86c4b3e92ef65a3500/pa/NK06658_953eea05af2798c3b162739c0c9f4094.jpg not downloaded yet
2026-04-27 08:05:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/45/d4453b10cb557c86c4b3e92ef65a3500/pa/NK06658_13f96d0aecb3203209fb62cace36aa7c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438086c90>
2026-04-27 08:05:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7a0f8ff-a25f-51b3-ba91-c646355df459/b7a0f8ff-a25f-51b3-ba91-c646355df459_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/50/c3505c20f8b6ce30341d5135641c4ce9/pa/HS91891_6f2e9f39d372d90464cb93fb4a7ba5ef.jpg saved to cache
2026-04-27 08:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b7a0f8ff-a25f-51b3-ba91-c646355df459
2026-04-27 08:05:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bfd2250>
2026-04-27 08:05:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80bf6820-4a84-582b-b4ef-82508f7a3425/80bf6820-4a84-582b-b4ef-82508f7a3425_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/45/d4453b10cb557c86c4b3e92ef65a3500/pa/NK06658_13f96d0aecb3203209fb62cace36aa7c.jpg saved to cache
2026-04-27 08:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 80bf6820-4a84-582b-b4ef-82508f7a3425
2026-04-27 08:05:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UL64685/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/45/d4453b10cb557c86c4b3e92ef65a3500/pa/NK06658_9da763c2bd5d3cb29ca1773dfc105163.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/45/d4453b10cb557c86c4b3e92ef65a3500/pa/NK06658_953eea05af2798c3b162739c0c9f4094.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/45/d4453b10cb557c86c4b3e92ef65a3500/pa/NK06658_0c636cb70319f5171959c2ce8feadc3a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/45/d4453b10cb557c86c4b3e92ef65a3500/pa/NK06658_9add99b61fc5cb6dd43f62e85737e022.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/45/d4453b10cb557c86c4b3e92ef65a3500/pa/NK06658_8f36a9cff0200e15f21d6ad969fd9b94.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438adfa50>
2026-04-27 08:05:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80bf6820-4a84-582b-b4ef-82508f7a3425/80bf6820-4a84-582b-b4ef-82508f7a3425_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/45/d4453b10cb557c86c4b3e92ef65a3500/pa/NK06658_9da763c2bd5d3cb29ca1773dfc105163.jpg saved to cache
2026-04-27 08:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 80bf6820-4a84-582b-b4ef-82508f7a3425
2026-04-27 08:05:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/45/d4453b10cb557c86c4b3e92ef65a3500/pa/NK06658_4fc81dbb042737576ba7040c492ccde5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c994d0>
2026-04-27 08:05:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80bf6820-4a84-582b-b4ef-82508f7a3425/80bf6820-4a84-582b-b4ef-82508f7a3425_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/45/d4453b10cb557c86c4b3e92ef65a3500/pa/NK06658_953eea05af2798c3b162739c0c9f4094.jpg saved to cache
2026-04-27 08:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 80bf6820-4a84-582b-b4ef-82508f7a3425
2026-04-27 08:05:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438026dd0>
2026-04-27 08:05:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80bf6820-4a84-582b-b4ef-82508f7a3425/80bf6820-4a84-582b-b4ef-82508f7a3425_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/45/d4453b10cb557c86c4b3e92ef65a3500/pa/NK06658_0c636cb70319f5171959c2ce8feadc3a.jpg saved to cache
2026-04-27 08:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 80bf6820-4a84-582b-b4ef-82508f7a3425
2026-04-27 08:05:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380747d0>
2026-04-27 08:05:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80bf6820-4a84-582b-b4ef-82508f7a3425/80bf6820-4a84-582b-b4ef-82508f7a3425_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/45/d4453b10cb557c86c4b3e92ef65a3500/pa/NK06658_9add99b61fc5cb6dd43f62e85737e022.jpg saved to cache
2026-04-27 08:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 80bf6820-4a84-582b-b4ef-82508f7a3425
2026-04-27 08:05:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/45/d4453b10cb557c86c4b3e92ef65a3500/pa/NK06658_78c2a999808b94ae0d507912214d7af7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14381dc810>
2026-04-27 08:05:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80bf6820-4a84-582b-b4ef-82508f7a3425/80bf6820-4a84-582b-b4ef-82508f7a3425_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/45/d4453b10cb557c86c4b3e92ef65a3500/pa/NK06658_8f36a9cff0200e15f21d6ad969fd9b94.jpg saved to cache
2026-04-27 08:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 80bf6820-4a84-582b-b4ef-82508f7a3425
2026-04-27 08:05:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bf193d0>
2026-04-27 08:05:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80bf6820-4a84-582b-b4ef-82508f7a3425/80bf6820-4a84-582b-b4ef-82508f7a3425_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/45/d4453b10cb557c86c4b3e92ef65a3500/pa/NK06658_4fc81dbb042737576ba7040c492ccde5.jpg saved to cache
2026-04-27 08:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 80bf6820-4a84-582b-b4ef-82508f7a3425
2026-04-27 08:05:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ca9cd0>
2026-04-27 08:05:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80bf6820-4a84-582b-b4ef-82508f7a3425/80bf6820-4a84-582b-b4ef-82508f7a3425_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/45/d4453b10cb557c86c4b3e92ef65a3500/pa/NK06658_78c2a999808b94ae0d507912214d7af7.jpg saved to cache
2026-04-27 08:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 80bf6820-4a84-582b-b4ef-82508f7a3425
2026-04-27 08:05:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/45/d4453b10cb557c86c4b3e92ef65a3500/pa/NK06658_da4f7957ed2a5e45d8d6c302f2c694c1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/45/d4453b10cb557c86c4b3e92ef65a3500/pa/NK06658_b35a54705637a47313f7a1daad6cc9ac.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c28710>
2026-04-27 08:05:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80bf6820-4a84-582b-b4ef-82508f7a3425/80bf6820-4a84-582b-b4ef-82508f7a3425_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/45/d4453b10cb557c86c4b3e92ef65a3500/pa/NK06658_da4f7957ed2a5e45d8d6c302f2c694c1.jpg saved to cache
2026-04-27 08:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 80bf6820-4a84-582b-b4ef-82508f7a3425
2026-04-27 08:05:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438df8e90>
2026-04-27 08:05:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80bf6820-4a84-582b-b4ef-82508f7a3425/80bf6820-4a84-582b-b4ef-82508f7a3425_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/45/d4453b10cb557c86c4b3e92ef65a3500/pa/NK06658_b35a54705637a47313f7a1daad6cc9ac.jpg saved to cache
2026-04-27 08:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 80bf6820-4a84-582b-b4ef-82508f7a3425
2026-04-27 08:05:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 80bf6820-4a84-582b-b4ef-82508f7a3425, skipping ID generation
2026-04-27 08:05:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80bf6820-4a84-582b-b4ef-82508f7a3425 with scrape type 1
2026-04-27 08:05:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 80bf6820-4a84-582b-b4ef-82508f7a3425 sending to next pipeline
2026-04-27 08:05:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 80bf6820-4a84-582b-b4ef-82508f7a3425, identifier: NK06658
2026-04-27 08:05:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 80bf6820-4a84-582b-b4ef-82508f7a3425 with identifier: NK06658
2026-04-27 08:05:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 80bf6820-4a84-582b-b4ef-82508f7a3425 with identifier: NK06658
2026-04-27 08:05:06 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:05:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 80bf6820-4a84-582b-b4ef-82508f7a3425 with identifier: NK06658 to the API
2026-04-27 08:05:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:05:06 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:05:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd4/45/d4453b10cb557c86c4b3e92ef65a3500/pa/NK06658_b35a54705637a47313f7a1daad6cc9ac.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 93,
 'category': None,
 'city': 'Allennes-les-Marais',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-04-28T15:43:57Z',
 'fuel_type': 'diesel',
 'id': '80bf6820-4a84-582b-b4ef-82508f7a3425',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 50.5375,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NK06658',
 'listing': 'auction',
 'location': 'FR, Allennes-les-Marais',
 'location_confidence': 'geocoded',
 'longitude': 2.9536,
 'make': 'Honda',
 'model': 'Civic',
 'odometer': 237419,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_80bf6820-4a84-582b-b4ef-82508f7a3425/80bf6820-4a84-582b-b4ef-82508f7a3425_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82998,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/45/d4453b10cb557c86c4b3e92ef65a3500/pa/NK06658_b35a54705637a47313f7a1daad6cc9ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_80bf6820-4a84-582b-b4ef-82508f7a3425/80bf6820-4a84-582b-b4ef-82508f7a3425_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80288,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/45/d4453b10cb557c86c4b3e92ef65a3500/pa/NK06658_da4f7957ed2a5e45d8d6c302f2c694c1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_80bf6820-4a84-582b-b4ef-82508f7a3425/80bf6820-4a84-582b-b4ef-82508f7a3425_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83559,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/45/d4453b10cb557c86c4b3e92ef65a3500/pa/NK06658_78c2a999808b94ae0d507912214d7af7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_80bf6820-4a84-582b-b4ef-82508f7a3425/80bf6820-4a84-582b-b4ef-82508f7a3425_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71152,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/45/d4453b10cb557c86c4b3e92ef65a3500/pa/NK06658_4fc81dbb042737576ba7040c492ccde5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_80bf6820-4a84-582b-b4ef-82508f7a3425/80bf6820-4a84-582b-b4ef-82508f7a3425_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77131,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/45/d4453b10cb557c86c4b3e92ef65a3500/pa/NK06658_8f36a9cff0200e15f21d6ad969fd9b94.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_80bf6820-4a84-582b-b4ef-82508f7a3425/80bf6820-4a84-582b-b4ef-82508f7a3425_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82594,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/45/d4453b10cb557c86c4b3e92ef65a3500/pa/NK06658_13f96d0aecb3203209fb62cace36aa7c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_80bf6820-4a84-582b-b4ef-82508f7a3425/80bf6820-4a84-582b-b4ef-82508f7a3425_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64669,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/45/d4453b10cb557c86c4b3e92ef65a3500/pa/NK06658_9add99b61fc5cb6dd43f62e85737e022.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_80bf6820-4a84-582b-b4ef-82508f7a3425/80bf6820-4a84-582b-b4ef-82508f7a3425_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76644,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/45/d4453b10cb557c86c4b3e92ef65a3500/pa/NK06658_9da763c2bd5d3cb29ca1773dfc105163.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_80bf6820-4a84-582b-b4ef-82508f7a3425/80bf6820-4a84-582b-b4ef-82508f7a3425_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81157,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/45/d4453b10cb557c86c4b3e92ef65a3500/pa/NK06658_0c636cb70319f5171959c2ce8feadc3a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_80bf6820-4a84-582b-b4ef-82508f7a3425/80bf6820-4a84-582b-b4ef-82508f7a3425_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73324,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/45/d4453b10cb557c86c4b3e92ef65a3500/pa/NK06658_953eea05af2798c3b162739c0c9f4094.jpg',
             'Width': 800}],
 'postal_code': '59251',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Nord',
 'province_code': 'FR-59',
 'region': 'Hauts-de-France',
 'region_code': 'FR-32',
 'registration_date': '2019-09-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Honda Civic 1.6 DTEC Executive',
 'transmission': 'manual',
 'trim': 'Executive',
 'year': 2019}
2026-04-27 08:05:06 [auto1.fr] INFO: Saving data for NK06658: {'created_time': 1777277106.275561, 'last_price_update_time': 1777277106.275569, 'has_photos': True, 'auction_closing_time': 1777391037.0}
2026-04-27 08:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/50/c3505c20f8b6ce30341d5135641c4ce9/pa/HS91891_8b89ca80138d3df769c224818032d53c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d617d0>
2026-04-27 08:05:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7a0f8ff-a25f-51b3-ba91-c646355df459/b7a0f8ff-a25f-51b3-ba91-c646355df459_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/50/c3505c20f8b6ce30341d5135641c4ce9/pa/HS91891_8b89ca80138d3df769c224818032d53c.jpg saved to cache
2026-04-27 08:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b7a0f8ff-a25f-51b3-ba91-c646355df459
2026-04-27 08:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/a2/bca20f2e27b72ab1bfb06ecbfb2658af/pa/CS24682_1d95458d1d7fd89cf8b47069a0276374.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bffc550>
2026-04-27 08:05:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12e696c1-5fad-566b-9cb8-f92093b883e8/12e696c1-5fad-566b-9cb8-f92093b883e8_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/a2/bca20f2e27b72ab1bfb06ecbfb2658af/pa/CS24682_1d95458d1d7fd89cf8b47069a0276374.jpg saved to cache
2026-04-27 08:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 12e696c1-5fad-566b-9cb8-f92093b883e8
2026-04-27 08:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/50/c3505c20f8b6ce30341d5135641c4ce9/pa/HS91891_0f5be8d3785f88e40b738b5b26cbb5fb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438027690>
2026-04-27 08:05:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7a0f8ff-a25f-51b3-ba91-c646355df459/b7a0f8ff-a25f-51b3-ba91-c646355df459_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/50/c3505c20f8b6ce30341d5135641c4ce9/pa/HS91891_0f5be8d3785f88e40b738b5b26cbb5fb.jpg saved to cache
2026-04-27 08:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b7a0f8ff-a25f-51b3-ba91-c646355df459
2026-04-27 08:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/a2/bca20f2e27b72ab1bfb06ecbfb2658af/pa/CS24682_b97f43985a0535fd53e8bc07c47cdf8e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143805e210>
2026-04-27 08:05:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12e696c1-5fad-566b-9cb8-f92093b883e8/12e696c1-5fad-566b-9cb8-f92093b883e8_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/a2/bca20f2e27b72ab1bfb06ecbfb2658af/pa/CS24682_b97f43985a0535fd53e8bc07c47cdf8e.jpg saved to cache
2026-04-27 08:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 12e696c1-5fad-566b-9cb8-f92093b883e8
2026-04-27 08:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/50/c3505c20f8b6ce30341d5135641c4ce9/pa/HS91891_3b26541a3a9aa1e1ddd25a37f7e0afa3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438024710>
2026-04-27 08:05:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7a0f8ff-a25f-51b3-ba91-c646355df459/b7a0f8ff-a25f-51b3-ba91-c646355df459_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/50/c3505c20f8b6ce30341d5135641c4ce9/pa/HS91891_3b26541a3a9aa1e1ddd25a37f7e0afa3.jpg saved to cache
2026-04-27 08:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b7a0f8ff-a25f-51b3-ba91-c646355df459
2026-04-27 08:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/a2/bca20f2e27b72ab1bfb06ecbfb2658af/pa/CS24682_6dbf8c8187c1fef67ac56850be1a9e45.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14381364d0>
2026-04-27 08:05:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12e696c1-5fad-566b-9cb8-f92093b883e8/12e696c1-5fad-566b-9cb8-f92093b883e8_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/a2/bca20f2e27b72ab1bfb06ecbfb2658af/pa/CS24682_6dbf8c8187c1fef67ac56850be1a9e45.jpg saved to cache
2026-04-27 08:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 12e696c1-5fad-566b-9cb8-f92093b883e8
2026-04-27 08:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/50/c3505c20f8b6ce30341d5135641c4ce9/pa/HS91891_23ae2b1ff6f90d0faf2edfa4be3bbbd5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438027e90>
2026-04-27 08:05:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7a0f8ff-a25f-51b3-ba91-c646355df459/b7a0f8ff-a25f-51b3-ba91-c646355df459_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/50/c3505c20f8b6ce30341d5135641c4ce9/pa/HS91891_23ae2b1ff6f90d0faf2edfa4be3bbbd5.jpg saved to cache
2026-04-27 08:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b7a0f8ff-a25f-51b3-ba91-c646355df459
2026-04-27 08:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/a2/bca20f2e27b72ab1bfb06ecbfb2658af/pa/CS24682_ab69d331065aa6352edc47fec17bc055.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d61410>
2026-04-27 08:05:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12e696c1-5fad-566b-9cb8-f92093b883e8/12e696c1-5fad-566b-9cb8-f92093b883e8_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/a2/bca20f2e27b72ab1bfb06ecbfb2658af/pa/CS24682_ab69d331065aa6352edc47fec17bc055.jpg saved to cache
2026-04-27 08:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 12e696c1-5fad-566b-9cb8-f92093b883e8
2026-04-27 08:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/50/c3505c20f8b6ce30341d5135641c4ce9/pa/HS91891_af0df5f75e698549646b58419a548bb8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/a2/bca20f2e27b72ab1bfb06ecbfb2658af/pa/CS24682_c799c1883e1904042fc30f3bd7ef59b6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ae58d0>
2026-04-27 08:05:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7a0f8ff-a25f-51b3-ba91-c646355df459/b7a0f8ff-a25f-51b3-ba91-c646355df459_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/50/c3505c20f8b6ce30341d5135641c4ce9/pa/HS91891_af0df5f75e698549646b58419a548bb8.jpg saved to cache
2026-04-27 08:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b7a0f8ff-a25f-51b3-ba91-c646355df459
2026-04-27 08:05:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438fbf650>
2026-04-27 08:05:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12e696c1-5fad-566b-9cb8-f92093b883e8/12e696c1-5fad-566b-9cb8-f92093b883e8_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/a2/bca20f2e27b72ab1bfb06ecbfb2658af/pa/CS24682_c799c1883e1904042fc30f3bd7ef59b6.jpg saved to cache
2026-04-27 08:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 12e696c1-5fad-566b-9cb8-f92093b883e8
2026-04-27 08:05:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/50/c3505c20f8b6ce30341d5135641c4ce9/pa/HS91891_04484f9d8aeea3f1ccfec42de9c938d6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14381dd650>
2026-04-27 08:05:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7a0f8ff-a25f-51b3-ba91-c646355df459/b7a0f8ff-a25f-51b3-ba91-c646355df459_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/50/c3505c20f8b6ce30341d5135641c4ce9/pa/HS91891_04484f9d8aeea3f1ccfec42de9c938d6.jpg saved to cache
2026-04-27 08:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b7a0f8ff-a25f-51b3-ba91-c646355df459
2026-04-27 08:05:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/a2/bca20f2e27b72ab1bfb06ecbfb2658af/pa/CS24682_d26932f7dee8dabb3d1e3ca1208dcd61.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380866d0>
2026-04-27 08:05:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12e696c1-5fad-566b-9cb8-f92093b883e8/12e696c1-5fad-566b-9cb8-f92093b883e8_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/a2/bca20f2e27b72ab1bfb06ecbfb2658af/pa/CS24682_d26932f7dee8dabb3d1e3ca1208dcd61.jpg saved to cache
2026-04-27 08:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 12e696c1-5fad-566b-9cb8-f92093b883e8
2026-04-27 08:05:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DY47155/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/50/c3505c20f8b6ce30341d5135641c4ce9/pa/HS91891_e27a277cf0d27bdcdd546a8f27b18322.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/a2/bca20f2e27b72ab1bfb06ecbfb2658af/pa/CS24682_68312b85ffd91f262fe1dfbdc6a7237f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438fbd1d0>
2026-04-27 08:05:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7a0f8ff-a25f-51b3-ba91-c646355df459/b7a0f8ff-a25f-51b3-ba91-c646355df459_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/50/c3505c20f8b6ce30341d5135641c4ce9/pa/HS91891_e27a277cf0d27bdcdd546a8f27b18322.jpg saved to cache
2026-04-27 08:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b7a0f8ff-a25f-51b3-ba91-c646355df459
2026-04-27 08:05:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380483d0>
2026-04-27 08:05:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12e696c1-5fad-566b-9cb8-f92093b883e8/12e696c1-5fad-566b-9cb8-f92093b883e8_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/a2/bca20f2e27b72ab1bfb06ecbfb2658af/pa/CS24682_68312b85ffd91f262fe1dfbdc6a7237f.jpg saved to cache
2026-04-27 08:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 12e696c1-5fad-566b-9cb8-f92093b883e8
2026-04-27 08:05:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/a2/bca20f2e27b72ab1bfb06ecbfb2658af/pa/CS24682_37a245fb4199448d5db22f53e70cf300.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d62150>
2026-04-27 08:05:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12e696c1-5fad-566b-9cb8-f92093b883e8/12e696c1-5fad-566b-9cb8-f92093b883e8_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/a2/bca20f2e27b72ab1bfb06ecbfb2658af/pa/CS24682_37a245fb4199448d5db22f53e70cf300.jpg saved to cache
2026-04-27 08:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 12e696c1-5fad-566b-9cb8-f92093b883e8
2026-04-27 08:05:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/50/c3505c20f8b6ce30341d5135641c4ce9/pa/HS91891_355fa0346bbfc4b336b166d5d2c8410e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/50/c3505c20f8b6ce30341d5135641c4ce9/pa/HS91891_20d6a9c283b88247109ce89b8cc30412.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ae7b10>
2026-04-27 08:05:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7a0f8ff-a25f-51b3-ba91-c646355df459/b7a0f8ff-a25f-51b3-ba91-c646355df459_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/50/c3505c20f8b6ce30341d5135641c4ce9/pa/HS91891_355fa0346bbfc4b336b166d5d2c8410e.jpg saved to cache
2026-04-27 08:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b7a0f8ff-a25f-51b3-ba91-c646355df459
2026-04-27 08:05:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438eb4e90>
2026-04-27 08:05:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7a0f8ff-a25f-51b3-ba91-c646355df459/b7a0f8ff-a25f-51b3-ba91-c646355df459_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/50/c3505c20f8b6ce30341d5135641c4ce9/pa/HS91891_20d6a9c283b88247109ce89b8cc30412.jpg saved to cache
2026-04-27 08:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b7a0f8ff-a25f-51b3-ba91-c646355df459
2026-04-27 08:05:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b7a0f8ff-a25f-51b3-ba91-c646355df459, skipping ID generation
2026-04-27 08:05:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7a0f8ff-a25f-51b3-ba91-c646355df459 with scrape type 1
2026-04-27 08:05:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b7a0f8ff-a25f-51b3-ba91-c646355df459 sending to next pipeline
2026-04-27 08:05:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b7a0f8ff-a25f-51b3-ba91-c646355df459, identifier: HS91891
2026-04-27 08:05:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b7a0f8ff-a25f-51b3-ba91-c646355df459 with identifier: HS91891
2026-04-27 08:05:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b7a0f8ff-a25f-51b3-ba91-c646355df459 with identifier: HS91891
2026-04-27 08:05:09 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:05:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b7a0f8ff-a25f-51b3-ba91-c646355df459 with identifier: HS91891 to the API
2026-04-27 08:05:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:05:09 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:05:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc3/50/c3505c20f8b6ce30341d5135641c4ce9/pa/HS91891_20d6a9c283b88247109ce89b8cc30412.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'category': None,
 'city': 'Beaucaire',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'engine_horse_power': 158,
 'expiration_date': '2026-04-28T15:33:33Z',
 'fuel_type': 'petrol',
 'id': 'b7a0f8ff-a25f-51b3-ba91-c646355df459',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'latitude': 43.8081,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HS91891',
 'listing': 'auction',
 'location': 'FR, Beaucaire',
 'location_confidence': 'geocoded',
 'longitude': 4.6442,
 'make': 'Renault',
 'model': 'Arkana',
 'odometer': 31393,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b7a0f8ff-a25f-51b3-ba91-c646355df459/b7a0f8ff-a25f-51b3-ba91-c646355df459_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52321,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/50/c3505c20f8b6ce30341d5135641c4ce9/pa/HS91891_20d6a9c283b88247109ce89b8cc30412.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b7a0f8ff-a25f-51b3-ba91-c646355df459/b7a0f8ff-a25f-51b3-ba91-c646355df459_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52321,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/50/c3505c20f8b6ce30341d5135641c4ce9/pa/HS91891_355fa0346bbfc4b336b166d5d2c8410e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b7a0f8ff-a25f-51b3-ba91-c646355df459/b7a0f8ff-a25f-51b3-ba91-c646355df459_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53836,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/50/c3505c20f8b6ce30341d5135641c4ce9/pa/HS91891_e27a277cf0d27bdcdd546a8f27b18322.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b7a0f8ff-a25f-51b3-ba91-c646355df459/b7a0f8ff-a25f-51b3-ba91-c646355df459_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53145,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/50/c3505c20f8b6ce30341d5135641c4ce9/pa/HS91891_04484f9d8aeea3f1ccfec42de9c938d6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b7a0f8ff-a25f-51b3-ba91-c646355df459/b7a0f8ff-a25f-51b3-ba91-c646355df459_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54704,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/50/c3505c20f8b6ce30341d5135641c4ce9/pa/HS91891_af0df5f75e698549646b58419a548bb8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b7a0f8ff-a25f-51b3-ba91-c646355df459/b7a0f8ff-a25f-51b3-ba91-c646355df459_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59028,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/50/c3505c20f8b6ce30341d5135641c4ce9/pa/HS91891_23ae2b1ff6f90d0faf2edfa4be3bbbd5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b7a0f8ff-a25f-51b3-ba91-c646355df459/b7a0f8ff-a25f-51b3-ba91-c646355df459_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52480,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/50/c3505c20f8b6ce30341d5135641c4ce9/pa/HS91891_3b26541a3a9aa1e1ddd25a37f7e0afa3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b7a0f8ff-a25f-51b3-ba91-c646355df459/b7a0f8ff-a25f-51b3-ba91-c646355df459_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 122701,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/50/c3505c20f8b6ce30341d5135641c4ce9/pa/HS91891_0f5be8d3785f88e40b738b5b26cbb5fb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b7a0f8ff-a25f-51b3-ba91-c646355df459/b7a0f8ff-a25f-51b3-ba91-c646355df459_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56060,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/50/c3505c20f8b6ce30341d5135641c4ce9/pa/HS91891_8b89ca80138d3df769c224818032d53c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b7a0f8ff-a25f-51b3-ba91-c646355df459/b7a0f8ff-a25f-51b3-ba91-c646355df459_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92261,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/50/c3505c20f8b6ce30341d5135641c4ce9/pa/HS91891_6f2e9f39d372d90464cb93fb4a7ba5ef.jpg',
             'Width': 800}],
 'postal_code': '30300',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Gard',
 'province_code': 'FR-30',
 'region': 'Occitanie',
 'region_code': 'FR-76',
 'registration_date': '2023-05-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Arkana 1.3 TCe Mild-Hybrid R.S. Line',
 'transmission': 'automatic',
 'trim': 'R.S. Line',
 'year': 2023}
2026-04-27 08:05:09 [auto1.fr] INFO: Saving data for HS91891: {'created_time': 1777277109.706169, 'last_price_update_time': 1777277109.706186, 'has_photos': True, 'auction_closing_time': 1777390413.0}
2026-04-27 08:05:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/a2/bca20f2e27b72ab1bfb06ecbfb2658af/pa/CS24682_4c02c7be67bbf3cfe780a17df6f16668.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/a2/bca20f2e27b72ab1bfb06ecbfb2658af/pa/CS24682_672ce31db9f566469636101ce1b42a42.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438075650>
2026-04-27 08:05:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12e696c1-5fad-566b-9cb8-f92093b883e8/12e696c1-5fad-566b-9cb8-f92093b883e8_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/a2/bca20f2e27b72ab1bfb06ecbfb2658af/pa/CS24682_4c02c7be67bbf3cfe780a17df6f16668.jpg saved to cache
2026-04-27 08:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 12e696c1-5fad-566b-9cb8-f92093b883e8
2026-04-27 08:05:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438075390>
2026-04-27 08:05:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12e696c1-5fad-566b-9cb8-f92093b883e8/12e696c1-5fad-566b-9cb8-f92093b883e8_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/a2/bca20f2e27b72ab1bfb06ecbfb2658af/pa/CS24682_672ce31db9f566469636101ce1b42a42.jpg saved to cache
2026-04-27 08:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 12e696c1-5fad-566b-9cb8-f92093b883e8
2026-04-27 08:05:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 12e696c1-5fad-566b-9cb8-f92093b883e8, skipping ID generation
2026-04-27 08:05:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12e696c1-5fad-566b-9cb8-f92093b883e8 with scrape type 1
2026-04-27 08:05:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 12e696c1-5fad-566b-9cb8-f92093b883e8 sending to next pipeline
2026-04-27 08:05:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 12e696c1-5fad-566b-9cb8-f92093b883e8, identifier: CS24682
2026-04-27 08:05:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 12e696c1-5fad-566b-9cb8-f92093b883e8 with identifier: CS24682
2026-04-27 08:05:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 12e696c1-5fad-566b-9cb8-f92093b883e8 with identifier: CS24682
2026-04-27 08:05:10 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:05:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 12e696c1-5fad-566b-9cb8-f92093b883e8 with identifier: CS24682 to the API
2026-04-27 08:05:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:05:10 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:05:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgbc/a2/bca20f2e27b72ab1bfb06ecbfb2658af/pa/CS24682_672ce31db9f566469636101ce1b42a42.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 223,
 'category': None,
 'city': 'Loyettes',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.2L',
 'engine_horse_power': 120,
 'expiration_date': '2026-04-28T15:15:24Z',
 'fuel_type': 'diesel',
 'id': '12e696c1-5fad-566b-9cb8-f92093b883e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'latitude': 45.7766,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CS24682',
 'listing': 'auction',
 'location': 'FR, Loyettes',
 'location_confidence': 'geocoded',
 'longitude': 5.2069,
 'make': 'Peugeot',
 'model': 'Boxer',
 'odometer': 60913,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_12e696c1-5fad-566b-9cb8-f92093b883e8/12e696c1-5fad-566b-9cb8-f92093b883e8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49671,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/a2/bca20f2e27b72ab1bfb06ecbfb2658af/pa/CS24682_672ce31db9f566469636101ce1b42a42.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_12e696c1-5fad-566b-9cb8-f92093b883e8/12e696c1-5fad-566b-9cb8-f92093b883e8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52057,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/a2/bca20f2e27b72ab1bfb06ecbfb2658af/pa/CS24682_4c02c7be67bbf3cfe780a17df6f16668.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_12e696c1-5fad-566b-9cb8-f92093b883e8/12e696c1-5fad-566b-9cb8-f92093b883e8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46305,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/a2/bca20f2e27b72ab1bfb06ecbfb2658af/pa/CS24682_37a245fb4199448d5db22f53e70cf300.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_12e696c1-5fad-566b-9cb8-f92093b883e8/12e696c1-5fad-566b-9cb8-f92093b883e8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40534,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/a2/bca20f2e27b72ab1bfb06ecbfb2658af/pa/CS24682_68312b85ffd91f262fe1dfbdc6a7237f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_12e696c1-5fad-566b-9cb8-f92093b883e8/12e696c1-5fad-566b-9cb8-f92093b883e8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44894,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/a2/bca20f2e27b72ab1bfb06ecbfb2658af/pa/CS24682_d26932f7dee8dabb3d1e3ca1208dcd61.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_12e696c1-5fad-566b-9cb8-f92093b883e8/12e696c1-5fad-566b-9cb8-f92093b883e8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51087,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/a2/bca20f2e27b72ab1bfb06ecbfb2658af/pa/CS24682_c799c1883e1904042fc30f3bd7ef59b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_12e696c1-5fad-566b-9cb8-f92093b883e8/12e696c1-5fad-566b-9cb8-f92093b883e8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47831,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/a2/bca20f2e27b72ab1bfb06ecbfb2658af/pa/CS24682_ab69d331065aa6352edc47fec17bc055.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_12e696c1-5fad-566b-9cb8-f92093b883e8/12e696c1-5fad-566b-9cb8-f92093b883e8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95778,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/a2/bca20f2e27b72ab1bfb06ecbfb2658af/pa/CS24682_6dbf8c8187c1fef67ac56850be1a9e45.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_12e696c1-5fad-566b-9cb8-f92093b883e8/12e696c1-5fad-566b-9cb8-f92093b883e8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70016,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/a2/bca20f2e27b72ab1bfb06ecbfb2658af/pa/CS24682_b97f43985a0535fd53e8bc07c47cdf8e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_12e696c1-5fad-566b-9cb8-f92093b883e8/12e696c1-5fad-566b-9cb8-f92093b883e8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67663,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/a2/bca20f2e27b72ab1bfb06ecbfb2658af/pa/CS24682_1d95458d1d7fd89cf8b47069a0276374.jpg',
             'Width': 800}],
 'postal_code': '01360',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Ain',
 'province_code': 'FR-01',
 'region': 'Auvergne-Rhône-Alpes',
 'region_code': 'FR-84',
 'registration_date': '2020-12-29',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Peugeot Boxer 2.2 Blue-HDi 330 L1H1 Premium verglast Stop&Start',
 'transmission': 'manual',
 'trim': '330 L1H1 Premium verglast Stop&Start',
 'year': 2020}
2026-04-27 08:05:10 [auto1.fr] INFO: Saving data for CS24682: {'created_time': 1777277110.457218, 'last_price_update_time': 1777277110.457229, 'has_photos': True, 'auction_closing_time': 1777389324.0}
2026-04-27 08:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TJ12777> (referer: https://www.auto1.com/v1/car-details-view/TJ12777/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f91c2d9-cef2-55bb-8489-cb880b294f1f with identifier: TJ12777
2026-04-27 08:05:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f91c2d9-cef2-55bb-8489-cb880b294f1f with scrape type 1
2026-04-27 08:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7f91c2d9-cef2-55bb-8489-cb880b294f1f
2026-04-27 08:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/33/21336787bf44c5f6164d60107a61a884/pa/TJ12777_2c1e1ad775b89183096936873e753dd7.jpg not downloaded yet
2026-04-27 08:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/33/21336787bf44c5f6164d60107a61a884/pa/TJ12777_774cd23c05a369332ea16400ec2761d1.jpg not downloaded yet
2026-04-27 08:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/33/21336787bf44c5f6164d60107a61a884/pa/TJ12777_fa24e3435c8bf44e78b15984340cc81d.jpg not downloaded yet
2026-04-27 08:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EJ46418> (referer: https://www.auto1.com/v1/car-details-view/EJ46418/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/33/21336787bf44c5f6164d60107a61a884/pa/TJ12777_4f0969cf69c323618639f615902ae7d0.jpg not downloaded yet
2026-04-27 08:05:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/33/21336787bf44c5f6164d60107a61a884/pa/TJ12777_942f8ee3b37fa2ceafde1bb8d7b5afb9.jpg not downloaded yet
2026-04-27 08:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/33/21336787bf44c5f6164d60107a61a884/pa/TJ12777_f6eac1d3ac39776038e9ecc23f80690a.jpg not downloaded yet
2026-04-27 08:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/33/21336787bf44c5f6164d60107a61a884/pa/TJ12777_56d8793e66bc9fadb011777d5c761044.jpg not downloaded yet
2026-04-27 08:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/33/21336787bf44c5f6164d60107a61a884/pa/TJ12777_89fb456180a287b4231aae50b78faff6.jpg not downloaded yet
2026-04-27 08:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/33/21336787bf44c5f6164d60107a61a884/pa/TJ12777_736781d59e17c4373d96bdb6f56006ae.jpg not downloaded yet
2026-04-27 08:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/33/21336787bf44c5f6164d60107a61a884/pa/TJ12777_480613e3ff867f19957ee823023bd403.jpg not downloaded yet
2026-04-27 08:05:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8119e1b8-2787-54af-9f5a-803f87735db5 with identifier: EJ46418
2026-04-27 08:05:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8119e1b8-2787-54af-9f5a-803f87735db5 with scrape type 1
2026-04-27 08:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8119e1b8-2787-54af-9f5a-803f87735db5
2026-04-27 08:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/84/8384aef255e381a1161ca61be170a825/pa/EJ46418_72d090703c1610e6f8b2a2819a36cd3e.jpg not downloaded yet
2026-04-27 08:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/84/8384aef255e381a1161ca61be170a825/pa/EJ46418_89460a9ebfa9e09e748fc58d8f944024.jpg not downloaded yet
2026-04-27 08:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/84/8384aef255e381a1161ca61be170a825/pa/EJ46418_ffca1501e7aadca2257f41921df3da3d.jpg not downloaded yet
2026-04-27 08:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/84/8384aef255e381a1161ca61be170a825/pa/EJ46418_685d944ee3b664beda0848700a574599.jpg not downloaded yet
2026-04-27 08:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/84/8384aef255e381a1161ca61be170a825/pa/EJ46418_0d6f25f5447c914c2fc61d9c37763345.jpg not downloaded yet
2026-04-27 08:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/84/8384aef255e381a1161ca61be170a825/pa/EJ46418_705b43d2639c76d96c8b128005d74c0b.jpg not downloaded yet
2026-04-27 08:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/84/8384aef255e381a1161ca61be170a825/pa/EJ46418_f3eab793997b9394d4854138de9614b1.jpg not downloaded yet
2026-04-27 08:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/84/8384aef255e381a1161ca61be170a825/pa/EJ46418_5413f3dd78be3e877839d07e58a792ff.jpg not downloaded yet
2026-04-27 08:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/84/8384aef255e381a1161ca61be170a825/pa/EJ46418_170faab631b75cbaeffd286b06330515.jpg not downloaded yet
2026-04-27 08:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/84/8384aef255e381a1161ca61be170a825/pa/EJ46418_579e507ac006eeb2f75ec640969dc0ef.jpg not downloaded yet
2026-04-27 08:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/33/21336787bf44c5f6164d60107a61a884/pa/TJ12777_fa24e3435c8bf44e78b15984340cc81d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SG66178> (referer: https://www.auto1.com/v1/car-details-view/SG66178/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380863d0>
2026-04-27 08:05:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f91c2d9-cef2-55bb-8489-cb880b294f1f/7f91c2d9-cef2-55bb-8489-cb880b294f1f_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/33/21336787bf44c5f6164d60107a61a884/pa/TJ12777_fa24e3435c8bf44e78b15984340cc81d.jpg saved to cache
2026-04-27 08:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7f91c2d9-cef2-55bb-8489-cb880b294f1f
2026-04-27 08:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/84/8384aef255e381a1161ca61be170a825/pa/EJ46418_170faab631b75cbaeffd286b06330515.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ca78153-8fbd-5463-8c17-b29178727986 with identifier: SG66178
2026-04-27 08:05:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ca78153-8fbd-5463-8c17-b29178727986 with scrape type 1
2026-04-27 08:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3ca78153-8fbd-5463-8c17-b29178727986
2026-04-27 08:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/31/b03172b6f73c1af95297dc4f25122ec3/pa/SG66178_6c45952c2c3888785df0c3c920a3e43b.jpg not downloaded yet
2026-04-27 08:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/31/b03172b6f73c1af95297dc4f25122ec3/pa/SG66178_511e522b6456f138a67c10dcec560b30.jpg not downloaded yet
2026-04-27 08:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/31/b03172b6f73c1af95297dc4f25122ec3/pa/SG66178_a5e36e4503e889197d6934e4c50c8ea8.jpg not downloaded yet
2026-04-27 08:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/84/8384aef255e381a1161ca61be170a825/pa/EJ46418_5413f3dd78be3e877839d07e58a792ff.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/31/b03172b6f73c1af95297dc4f25122ec3/pa/SG66178_7da70d285f00503d25a8b5a7361d0d73.jpg not downloaded yet
2026-04-27 08:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/31/b03172b6f73c1af95297dc4f25122ec3/pa/SG66178_5211632d49ddb61323142177e4665be3.jpg not downloaded yet
2026-04-27 08:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/84/8384aef255e381a1161ca61be170a825/pa/EJ46418_579e507ac006eeb2f75ec640969dc0ef.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/31/b03172b6f73c1af95297dc4f25122ec3/pa/SG66178_a4d5d29b0cc26f0129da4058671a5a91.jpg not downloaded yet
2026-04-27 08:05:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438057b90>
2026-04-27 08:05:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8119e1b8-2787-54af-9f5a-803f87735db5/8119e1b8-2787-54af-9f5a-803f87735db5_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/84/8384aef255e381a1161ca61be170a825/pa/EJ46418_170faab631b75cbaeffd286b06330515.jpg saved to cache
2026-04-27 08:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8119e1b8-2787-54af-9f5a-803f87735db5
2026-04-27 08:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/31/b03172b6f73c1af95297dc4f25122ec3/pa/SG66178_0bfeb9cbc9cdc8856c49ed23152d946d.jpg not downloaded yet
2026-04-27 08:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/31/b03172b6f73c1af95297dc4f25122ec3/pa/SG66178_c0229530a711bfd3f3c4e83a6502f8e8.jpg not downloaded yet
2026-04-27 08:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/31/b03172b6f73c1af95297dc4f25122ec3/pa/SG66178_2abcc842c6c7059bd86a2a1ee4c5c15c.jpg not downloaded yet
2026-04-27 08:05:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438cebd50>
2026-04-27 08:05:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8119e1b8-2787-54af-9f5a-803f87735db5/8119e1b8-2787-54af-9f5a-803f87735db5_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/84/8384aef255e381a1161ca61be170a825/pa/EJ46418_5413f3dd78be3e877839d07e58a792ff.jpg saved to cache
2026-04-27 08:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8119e1b8-2787-54af-9f5a-803f87735db5
2026-04-27 08:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/31/b03172b6f73c1af95297dc4f25122ec3/pa/SG66178_511e522b6456f138a67c10dcec560b30.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/31/b03172b6f73c1af95297dc4f25122ec3/pa/SG66178_b6ee0e510847b49cef1f49a8f586fc0e.jpg not downloaded yet
2026-04-27 08:05:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438dfaf90>
2026-04-27 08:05:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8119e1b8-2787-54af-9f5a-803f87735db5/8119e1b8-2787-54af-9f5a-803f87735db5_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/84/8384aef255e381a1161ca61be170a825/pa/EJ46418_579e507ac006eeb2f75ec640969dc0ef.jpg saved to cache
2026-04-27 08:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8119e1b8-2787-54af-9f5a-803f87735db5
2026-04-27 08:05:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380a6890>
2026-04-27 08:05:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ca78153-8fbd-5463-8c17-b29178727986/3ca78153-8fbd-5463-8c17-b29178727986_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/31/b03172b6f73c1af95297dc4f25122ec3/pa/SG66178_511e522b6456f138a67c10dcec560b30.jpg saved to cache
2026-04-27 08:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3ca78153-8fbd-5463-8c17-b29178727986
2026-04-27 08:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AV65681/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/31/b03172b6f73c1af95297dc4f25122ec3/pa/SG66178_5211632d49ddb61323142177e4665be3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WC58866> (referer: https://www.auto1.com/v1/car-details-view/WC58866/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/31/b03172b6f73c1af95297dc4f25122ec3/pa/SG66178_c0229530a711bfd3f3c4e83a6502f8e8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438df9550>
2026-04-27 08:05:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ca78153-8fbd-5463-8c17-b29178727986/3ca78153-8fbd-5463-8c17-b29178727986_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/31/b03172b6f73c1af95297dc4f25122ec3/pa/SG66178_5211632d49ddb61323142177e4665be3.jpg saved to cache
2026-04-27 08:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3ca78153-8fbd-5463-8c17-b29178727986
2026-04-27 08:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/31/b03172b6f73c1af95297dc4f25122ec3/pa/SG66178_2abcc842c6c7059bd86a2a1ee4c5c15c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98b3d389-2d07-5272-bc98-eff0825fd20a with identifier: WC58866
2026-04-27 08:05:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98b3d389-2d07-5272-bc98-eff0825fd20a with scrape type 1
2026-04-27 08:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 98b3d389-2d07-5272-bc98-eff0825fd20a
2026-04-27 08:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/a4/17a481835e1a80095ecb0250cbd36521/pa/WC58866_ca680ce93574f091b9c8919eecc57af2.jpg not downloaded yet
2026-04-27 08:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/a4/17a481835e1a80095ecb0250cbd36521/pa/WC58866_7ae43482e550d7b4498cca6dbba6db1c.jpg not downloaded yet
2026-04-27 08:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/a4/17a481835e1a80095ecb0250cbd36521/pa/WC58866_2cd7db80d2df49aa55bfbf09942640c1.jpg not downloaded yet
2026-04-27 08:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/31/b03172b6f73c1af95297dc4f25122ec3/pa/SG66178_b6ee0e510847b49cef1f49a8f586fc0e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438e02190>
2026-04-27 08:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ca78153-8fbd-5463-8c17-b29178727986/3ca78153-8fbd-5463-8c17-b29178727986_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/31/b03172b6f73c1af95297dc4f25122ec3/pa/SG66178_c0229530a711bfd3f3c4e83a6502f8e8.jpg saved to cache
2026-04-27 08:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3ca78153-8fbd-5463-8c17-b29178727986
2026-04-27 08:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/31/b03172b6f73c1af95297dc4f25122ec3/pa/SG66178_a4d5d29b0cc26f0129da4058671a5a91.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/a4/17a481835e1a80095ecb0250cbd36521/pa/WC58866_5dd3d925fffce1d9598490f1f12a1974.jpg not downloaded yet
2026-04-27 08:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/a4/17a481835e1a80095ecb0250cbd36521/pa/WC58866_2735f03b01f499cbcb86069d80b45d18.jpg not downloaded yet
2026-04-27 08:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d63510>
2026-04-27 08:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ca78153-8fbd-5463-8c17-b29178727986/3ca78153-8fbd-5463-8c17-b29178727986_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/31/b03172b6f73c1af95297dc4f25122ec3/pa/SG66178_2abcc842c6c7059bd86a2a1ee4c5c15c.jpg saved to cache
2026-04-27 08:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3ca78153-8fbd-5463-8c17-b29178727986
2026-04-27 08:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/a4/17a481835e1a80095ecb0250cbd36521/pa/WC58866_b5509a00f93128e3958e3391f2c5a952.jpg not downloaded yet
2026-04-27 08:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/a4/17a481835e1a80095ecb0250cbd36521/pa/WC58866_7ae43482e550d7b4498cca6dbba6db1c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/a4/17a481835e1a80095ecb0250cbd36521/pa/WC58866_2cd7db80d2df49aa55bfbf09942640c1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/a4/17a481835e1a80095ecb0250cbd36521/pa/WC58866_4075e670aa70ab77454f569cab2e0e4d.jpg not downloaded yet
2026-04-27 08:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438cfa890>
2026-04-27 08:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ca78153-8fbd-5463-8c17-b29178727986/3ca78153-8fbd-5463-8c17-b29178727986_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/31/b03172b6f73c1af95297dc4f25122ec3/pa/SG66178_b6ee0e510847b49cef1f49a8f586fc0e.jpg saved to cache
2026-04-27 08:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3ca78153-8fbd-5463-8c17-b29178727986
2026-04-27 08:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/a4/17a481835e1a80095ecb0250cbd36521/pa/WC58866_07f1b82025f7af274bbdd68f5c2cfd60.jpg not downloaded yet
2026-04-27 08:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438f81f10>
2026-04-27 08:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ca78153-8fbd-5463-8c17-b29178727986/3ca78153-8fbd-5463-8c17-b29178727986_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/31/b03172b6f73c1af95297dc4f25122ec3/pa/SG66178_a4d5d29b0cc26f0129da4058671a5a91.jpg saved to cache
2026-04-27 08:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3ca78153-8fbd-5463-8c17-b29178727986
2026-04-27 08:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/a4/17a481835e1a80095ecb0250cbd36521/pa/WC58866_5dd3d925fffce1d9598490f1f12a1974.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/a4/17a481835e1a80095ecb0250cbd36521/pa/WC58866_7f804d852c749525b9452544cb8a8adb.jpg not downloaded yet
2026-04-27 08:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/a4/17a481835e1a80095ecb0250cbd36521/pa/WC58866_2735f03b01f499cbcb86069d80b45d18.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a61ed0>
2026-04-27 08:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98b3d389-2d07-5272-bc98-eff0825fd20a/98b3d389-2d07-5272-bc98-eff0825fd20a_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/a4/17a481835e1a80095ecb0250cbd36521/pa/WC58866_7ae43482e550d7b4498cca6dbba6db1c.jpg saved to cache
2026-04-27 08:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 98b3d389-2d07-5272-bc98-eff0825fd20a
2026-04-27 08:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b2ba10>
2026-04-27 08:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98b3d389-2d07-5272-bc98-eff0825fd20a/98b3d389-2d07-5272-bc98-eff0825fd20a_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/a4/17a481835e1a80095ecb0250cbd36521/pa/WC58866_2cd7db80d2df49aa55bfbf09942640c1.jpg saved to cache
2026-04-27 08:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 98b3d389-2d07-5272-bc98-eff0825fd20a
2026-04-27 08:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/a4/17a481835e1a80095ecb0250cbd36521/pa/WC58866_15370b5274fc03b25468015b3e48bf9d.jpg not downloaded yet
2026-04-27 08:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14381364d0>
2026-04-27 08:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98b3d389-2d07-5272-bc98-eff0825fd20a/98b3d389-2d07-5272-bc98-eff0825fd20a_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/a4/17a481835e1a80095ecb0250cbd36521/pa/WC58866_5dd3d925fffce1d9598490f1f12a1974.jpg saved to cache
2026-04-27 08:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 98b3d389-2d07-5272-bc98-eff0825fd20a
2026-04-27 08:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/a4/17a481835e1a80095ecb0250cbd36521/pa/WC58866_4075e670aa70ab77454f569cab2e0e4d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/a4/17a481835e1a80095ecb0250cbd36521/pa/WC58866_07f1b82025f7af274bbdd68f5c2cfd60.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438136c90>
2026-04-27 08:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98b3d389-2d07-5272-bc98-eff0825fd20a/98b3d389-2d07-5272-bc98-eff0825fd20a_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/a4/17a481835e1a80095ecb0250cbd36521/pa/WC58866_2735f03b01f499cbcb86069d80b45d18.jpg saved to cache
2026-04-27 08:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 98b3d389-2d07-5272-bc98-eff0825fd20a
2026-04-27 08:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/a4/17a481835e1a80095ecb0250cbd36521/pa/WC58866_7f804d852c749525b9452544cb8a8adb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/a4/17a481835e1a80095ecb0250cbd36521/pa/WC58866_15370b5274fc03b25468015b3e48bf9d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143812f9d0>
2026-04-27 08:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98b3d389-2d07-5272-bc98-eff0825fd20a/98b3d389-2d07-5272-bc98-eff0825fd20a_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/a4/17a481835e1a80095ecb0250cbd36521/pa/WC58866_4075e670aa70ab77454f569cab2e0e4d.jpg saved to cache
2026-04-27 08:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 98b3d389-2d07-5272-bc98-eff0825fd20a
2026-04-27 08:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/a4/17a481835e1a80095ecb0250cbd36521/pa/WC58866_b5509a00f93128e3958e3391f2c5a952.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/a4/17a481835e1a80095ecb0250cbd36521/pa/WC58866_ca680ce93574f091b9c8919eecc57af2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438079390>
2026-04-27 08:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98b3d389-2d07-5272-bc98-eff0825fd20a/98b3d389-2d07-5272-bc98-eff0825fd20a_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/a4/17a481835e1a80095ecb0250cbd36521/pa/WC58866_07f1b82025f7af274bbdd68f5c2cfd60.jpg saved to cache
2026-04-27 08:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 98b3d389-2d07-5272-bc98-eff0825fd20a
2026-04-27 08:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380457d0>
2026-04-27 08:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98b3d389-2d07-5272-bc98-eff0825fd20a/98b3d389-2d07-5272-bc98-eff0825fd20a_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/a4/17a481835e1a80095ecb0250cbd36521/pa/WC58866_7f804d852c749525b9452544cb8a8adb.jpg saved to cache
2026-04-27 08:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 98b3d389-2d07-5272-bc98-eff0825fd20a
2026-04-27 08:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b2a010>
2026-04-27 08:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98b3d389-2d07-5272-bc98-eff0825fd20a/98b3d389-2d07-5272-bc98-eff0825fd20a_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/a4/17a481835e1a80095ecb0250cbd36521/pa/WC58866_15370b5274fc03b25468015b3e48bf9d.jpg saved to cache
2026-04-27 08:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 98b3d389-2d07-5272-bc98-eff0825fd20a
2026-04-27 08:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b58b50>
2026-04-27 08:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98b3d389-2d07-5272-bc98-eff0825fd20a/98b3d389-2d07-5272-bc98-eff0825fd20a_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/a4/17a481835e1a80095ecb0250cbd36521/pa/WC58866_b5509a00f93128e3958e3391f2c5a952.jpg saved to cache
2026-04-27 08:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 98b3d389-2d07-5272-bc98-eff0825fd20a
2026-04-27 08:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142be057d0>
2026-04-27 08:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98b3d389-2d07-5272-bc98-eff0825fd20a/98b3d389-2d07-5272-bc98-eff0825fd20a_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/a4/17a481835e1a80095ecb0250cbd36521/pa/WC58866_ca680ce93574f091b9c8919eecc57af2.jpg saved to cache
2026-04-27 08:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 98b3d389-2d07-5272-bc98-eff0825fd20a
2026-04-27 08:05:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 98b3d389-2d07-5272-bc98-eff0825fd20a, skipping ID generation
2026-04-27 08:05:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98b3d389-2d07-5272-bc98-eff0825fd20a with scrape type 1
2026-04-27 08:05:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 98b3d389-2d07-5272-bc98-eff0825fd20a sending to next pipeline
2026-04-27 08:05:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 98b3d389-2d07-5272-bc98-eff0825fd20a, identifier: WC58866
2026-04-27 08:05:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 98b3d389-2d07-5272-bc98-eff0825fd20a with identifier: WC58866
2026-04-27 08:05:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 98b3d389-2d07-5272-bc98-eff0825fd20a with identifier: WC58866
2026-04-27 08:05:27 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:05:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 98b3d389-2d07-5272-bc98-eff0825fd20a with identifier: WC58866 to the API
2026-04-27 08:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:05:27 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:05:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img17/a4/17a481835e1a80095ecb0250cbd36521/pa/WC58866_ca680ce93574f091b9c8919eecc57af2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'category': None,
 'city': 'Saint Aignan de Grandlieu',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.5L',
 'engine_horse_power': 110,
 'expiration_date': '2026-04-28T15:27:42Z',
 'fuel_type': 'diesel',
 'id': '98b3d389-2d07-5272-bc98-eff0825fd20a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 47.1237,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC58866',
 'listing': 'auction',
 'location': 'FR, Saint Aignan de Grandlieu',
 'location_confidence': 'geocoded',
 'longitude': -1.6308,
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 218195,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_98b3d389-2d07-5272-bc98-eff0825fd20a/98b3d389-2d07-5272-bc98-eff0825fd20a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75439,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/a4/17a481835e1a80095ecb0250cbd36521/pa/WC58866_ca680ce93574f091b9c8919eecc57af2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_98b3d389-2d07-5272-bc98-eff0825fd20a/98b3d389-2d07-5272-bc98-eff0825fd20a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73861,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/a4/17a481835e1a80095ecb0250cbd36521/pa/WC58866_7ae43482e550d7b4498cca6dbba6db1c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_98b3d389-2d07-5272-bc98-eff0825fd20a/98b3d389-2d07-5272-bc98-eff0825fd20a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81458,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/a4/17a481835e1a80095ecb0250cbd36521/pa/WC58866_2cd7db80d2df49aa55bfbf09942640c1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_98b3d389-2d07-5272-bc98-eff0825fd20a/98b3d389-2d07-5272-bc98-eff0825fd20a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41080,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/a4/17a481835e1a80095ecb0250cbd36521/pa/WC58866_5dd3d925fffce1d9598490f1f12a1974.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_98b3d389-2d07-5272-bc98-eff0825fd20a/98b3d389-2d07-5272-bc98-eff0825fd20a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75626,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/a4/17a481835e1a80095ecb0250cbd36521/pa/WC58866_2735f03b01f499cbcb86069d80b45d18.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_98b3d389-2d07-5272-bc98-eff0825fd20a/98b3d389-2d07-5272-bc98-eff0825fd20a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85808,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/a4/17a481835e1a80095ecb0250cbd36521/pa/WC58866_b5509a00f93128e3958e3391f2c5a952.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_98b3d389-2d07-5272-bc98-eff0825fd20a/98b3d389-2d07-5272-bc98-eff0825fd20a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63820,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/a4/17a481835e1a80095ecb0250cbd36521/pa/WC58866_4075e670aa70ab77454f569cab2e0e4d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_98b3d389-2d07-5272-bc98-eff0825fd20a/98b3d389-2d07-5272-bc98-eff0825fd20a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77933,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/a4/17a481835e1a80095ecb0250cbd36521/pa/WC58866_07f1b82025f7af274bbdd68f5c2cfd60.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_98b3d389-2d07-5272-bc98-eff0825fd20a/98b3d389-2d07-5272-bc98-eff0825fd20a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78140,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/a4/17a481835e1a80095ecb0250cbd36521/pa/WC58866_7f804d852c749525b9452544cb8a8adb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_98b3d389-2d07-5272-bc98-eff0825fd20a/98b3d389-2d07-5272-bc98-eff0825fd20a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86463,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/a4/17a481835e1a80095ecb0250cbd36521/pa/WC58866_15370b5274fc03b25468015b3e48bf9d.jpg',
             'Width': 800}],
 'postal_code': '44860',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Loire-Atlantique',
 'province_code': 'FR-44',
 'region': 'Pays de la Loire',
 'region_code': 'FR-52',
 'registration_date': '2013-03-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Qashqai 1.5 Turbodiesel Tekna',
 'transmission': 'manual',
 'trim': 'Tekna',
 'year': 2013}
2026-04-27 08:05:27 [auto1.fr] INFO: Saving data for WC58866: {'created_time': 1777277127.658697, 'last_price_update_time': 1777277127.658709, 'has_photos': True, 'auction_closing_time': 1777390062.0}
2026-04-27 08:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/31/b03172b6f73c1af95297dc4f25122ec3/pa/SG66178_a5e36e4503e889197d6934e4c50c8ea8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/31/b03172b6f73c1af95297dc4f25122ec3/pa/SG66178_7da70d285f00503d25a8b5a7361d0d73.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/31/b03172b6f73c1af95297dc4f25122ec3/pa/SG66178_6c45952c2c3888785df0c3c920a3e43b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438016510>
2026-04-27 08:05:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ca78153-8fbd-5463-8c17-b29178727986/3ca78153-8fbd-5463-8c17-b29178727986_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/31/b03172b6f73c1af95297dc4f25122ec3/pa/SG66178_a5e36e4503e889197d6934e4c50c8ea8.jpg saved to cache
2026-04-27 08:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3ca78153-8fbd-5463-8c17-b29178727986
2026-04-27 08:05:27 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 3ca78153-8fbd-5463-8c17-b29178727986 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:05:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438188f10>
2026-04-27 08:05:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ca78153-8fbd-5463-8c17-b29178727986/3ca78153-8fbd-5463-8c17-b29178727986_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/31/b03172b6f73c1af95297dc4f25122ec3/pa/SG66178_7da70d285f00503d25a8b5a7361d0d73.jpg saved to cache
2026-04-27 08:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3ca78153-8fbd-5463-8c17-b29178727986
2026-04-27 08:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/84/8384aef255e381a1161ca61be170a825/pa/EJ46418_0d6f25f5447c914c2fc61d9c37763345.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f144781cf50>
2026-04-27 08:05:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ca78153-8fbd-5463-8c17-b29178727986/3ca78153-8fbd-5463-8c17-b29178727986_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/31/b03172b6f73c1af95297dc4f25122ec3/pa/SG66178_6c45952c2c3888785df0c3c920a3e43b.jpg saved to cache
2026-04-27 08:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3ca78153-8fbd-5463-8c17-b29178727986
2026-04-27 08:05:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3ca78153-8fbd-5463-8c17-b29178727986, skipping ID generation
2026-04-27 08:05:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ca78153-8fbd-5463-8c17-b29178727986 with scrape type 1
2026-04-27 08:05:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3ca78153-8fbd-5463-8c17-b29178727986 sending to next pipeline
2026-04-27 08:05:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3ca78153-8fbd-5463-8c17-b29178727986, identifier: SG66178
2026-04-27 08:05:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3ca78153-8fbd-5463-8c17-b29178727986 with identifier: SG66178
2026-04-27 08:05:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3ca78153-8fbd-5463-8c17-b29178727986 with identifier: SG66178
2026-04-27 08:05:28 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:05:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 3ca78153-8fbd-5463-8c17-b29178727986 with identifier: SG66178 to the API
2026-04-27 08:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:05:28 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:05:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb0/31/b03172b6f73c1af95297dc4f25122ec3/pa/SG66178_6c45952c2c3888785df0c3c920a3e43b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'category': None,
 'city': 'Marseille',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 185,
 'expiration_date': '2026-04-28T15:12:37Z',
 'fuel_type': 'diesel',
 'id': '3ca78153-8fbd-5463-8c17-b29178727986',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'latitude': 43.2969,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG66178',
 'listing': 'auction',
 'location': 'FR, Marseille',
 'location_confidence': 'geocoded',
 'longitude': 5.3811,
 'make': 'Ford',
 'model': 'Transit Custom',
 'odometer': 119438,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3ca78153-8fbd-5463-8c17-b29178727986/3ca78153-8fbd-5463-8c17-b29178727986_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62076,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/31/b03172b6f73c1af95297dc4f25122ec3/pa/SG66178_6c45952c2c3888785df0c3c920a3e43b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3ca78153-8fbd-5463-8c17-b29178727986/3ca78153-8fbd-5463-8c17-b29178727986_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63734,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/31/b03172b6f73c1af95297dc4f25122ec3/pa/SG66178_511e522b6456f138a67c10dcec560b30.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3ca78153-8fbd-5463-8c17-b29178727986/3ca78153-8fbd-5463-8c17-b29178727986_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48216,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/31/b03172b6f73c1af95297dc4f25122ec3/pa/SG66178_a5e36e4503e889197d6934e4c50c8ea8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3ca78153-8fbd-5463-8c17-b29178727986/3ca78153-8fbd-5463-8c17-b29178727986_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44643,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/31/b03172b6f73c1af95297dc4f25122ec3/pa/SG66178_7da70d285f00503d25a8b5a7361d0d73.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3ca78153-8fbd-5463-8c17-b29178727986/3ca78153-8fbd-5463-8c17-b29178727986_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55557,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/31/b03172b6f73c1af95297dc4f25122ec3/pa/SG66178_5211632d49ddb61323142177e4665be3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3ca78153-8fbd-5463-8c17-b29178727986/3ca78153-8fbd-5463-8c17-b29178727986_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60702,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/31/b03172b6f73c1af95297dc4f25122ec3/pa/SG66178_a4d5d29b0cc26f0129da4058671a5a91.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3ca78153-8fbd-5463-8c17-b29178727986/3ca78153-8fbd-5463-8c17-b29178727986_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94526,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/31/b03172b6f73c1af95297dc4f25122ec3/pa/SG66178_c0229530a711bfd3f3c4e83a6502f8e8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3ca78153-8fbd-5463-8c17-b29178727986/3ca78153-8fbd-5463-8c17-b29178727986_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72798,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/31/b03172b6f73c1af95297dc4f25122ec3/pa/SG66178_2abcc842c6c7059bd86a2a1ee4c5c15c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3ca78153-8fbd-5463-8c17-b29178727986/3ca78153-8fbd-5463-8c17-b29178727986_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67020,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/31/b03172b6f73c1af95297dc4f25122ec3/pa/SG66178_b6ee0e510847b49cef1f49a8f586fc0e.jpg',
             'Width': 800}],
 'postal_code': '13000',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Bouches-du-Rhône',
 'province_code': 'FR-13',
 'region': "Provence-Alpes-Côte d'Azur",
 'region_code': 'FR-93',
 'registration_date': '2020-02-27',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Ford Transit Custom 2.0 TDCi 290 L1 Sport',
 'transmission': 'manual',
 'trim': '290 L1 Sport',
 'year': 2020}
2026-04-27 08:05:28 [auto1.fr] INFO: Saving data for SG66178: {'created_time': 1777277128.367554, 'last_price_update_time': 1777277128.367564, 'has_photos': True, 'auction_closing_time': 1777389157.0}
2026-04-27 08:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/84/8384aef255e381a1161ca61be170a825/pa/EJ46418_f3eab793997b9394d4854138de9614b1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/84/8384aef255e381a1161ca61be170a825/pa/EJ46418_705b43d2639c76d96c8b128005d74c0b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438189ed0>
2026-04-27 08:05:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8119e1b8-2787-54af-9f5a-803f87735db5/8119e1b8-2787-54af-9f5a-803f87735db5_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/84/8384aef255e381a1161ca61be170a825/pa/EJ46418_0d6f25f5447c914c2fc61d9c37763345.jpg saved to cache
2026-04-27 08:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8119e1b8-2787-54af-9f5a-803f87735db5
2026-04-27 08:05:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143812d490>
2026-04-27 08:05:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8119e1b8-2787-54af-9f5a-803f87735db5/8119e1b8-2787-54af-9f5a-803f87735db5_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/84/8384aef255e381a1161ca61be170a825/pa/EJ46418_f3eab793997b9394d4854138de9614b1.jpg saved to cache
2026-04-27 08:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8119e1b8-2787-54af-9f5a-803f87735db5
2026-04-27 08:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/84/8384aef255e381a1161ca61be170a825/pa/EJ46418_89460a9ebfa9e09e748fc58d8f944024.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ed9090>
2026-04-27 08:05:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8119e1b8-2787-54af-9f5a-803f87735db5/8119e1b8-2787-54af-9f5a-803f87735db5_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/84/8384aef255e381a1161ca61be170a825/pa/EJ46418_705b43d2639c76d96c8b128005d74c0b.jpg saved to cache
2026-04-27 08:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8119e1b8-2787-54af-9f5a-803f87735db5
2026-04-27 08:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FX33595/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/84/8384aef255e381a1161ca61be170a825/pa/EJ46418_685d944ee3b664beda0848700a574599.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/84/8384aef255e381a1161ca61be170a825/pa/EJ46418_72d090703c1610e6f8b2a2819a36cd3e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/84/8384aef255e381a1161ca61be170a825/pa/EJ46418_ffca1501e7aadca2257f41921df3da3d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f144750fa10>
2026-04-27 08:05:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8119e1b8-2787-54af-9f5a-803f87735db5/8119e1b8-2787-54af-9f5a-803f87735db5_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/84/8384aef255e381a1161ca61be170a825/pa/EJ46418_89460a9ebfa9e09e748fc58d8f944024.jpg saved to cache
2026-04-27 08:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8119e1b8-2787-54af-9f5a-803f87735db5
2026-04-27 08:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/33/21336787bf44c5f6164d60107a61a884/pa/TJ12777_736781d59e17c4373d96bdb6f56006ae.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/33/21336787bf44c5f6164d60107a61a884/pa/TJ12777_89fb456180a287b4231aae50b78faff6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a62c90>
2026-04-27 08:05:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8119e1b8-2787-54af-9f5a-803f87735db5/8119e1b8-2787-54af-9f5a-803f87735db5_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/84/8384aef255e381a1161ca61be170a825/pa/EJ46418_685d944ee3b664beda0848700a574599.jpg saved to cache
2026-04-27 08:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8119e1b8-2787-54af-9f5a-803f87735db5
2026-04-27 08:05:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438fbe2d0>
2026-04-27 08:05:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8119e1b8-2787-54af-9f5a-803f87735db5/8119e1b8-2787-54af-9f5a-803f87735db5_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/84/8384aef255e381a1161ca61be170a825/pa/EJ46418_72d090703c1610e6f8b2a2819a36cd3e.jpg saved to cache
2026-04-27 08:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8119e1b8-2787-54af-9f5a-803f87735db5
2026-04-27 08:05:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438077650>
2026-04-27 08:05:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8119e1b8-2787-54af-9f5a-803f87735db5/8119e1b8-2787-54af-9f5a-803f87735db5_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/84/8384aef255e381a1161ca61be170a825/pa/EJ46418_ffca1501e7aadca2257f41921df3da3d.jpg saved to cache
2026-04-27 08:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8119e1b8-2787-54af-9f5a-803f87735db5
2026-04-27 08:05:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8119e1b8-2787-54af-9f5a-803f87735db5, skipping ID generation
2026-04-27 08:05:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8119e1b8-2787-54af-9f5a-803f87735db5 with scrape type 1
2026-04-27 08:05:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8119e1b8-2787-54af-9f5a-803f87735db5 sending to next pipeline
2026-04-27 08:05:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8119e1b8-2787-54af-9f5a-803f87735db5, identifier: EJ46418
2026-04-27 08:05:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8119e1b8-2787-54af-9f5a-803f87735db5 with identifier: EJ46418
2026-04-27 08:05:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8119e1b8-2787-54af-9f5a-803f87735db5 with identifier: EJ46418
2026-04-27 08:05:29 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:05:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 8119e1b8-2787-54af-9f5a-803f87735db5 with identifier: EJ46418 to the API
2026-04-27 08:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:05:29 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:05:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img83/84/8384aef255e381a1161ca61be170a825/pa/EJ46418_ffca1501e7aadca2257f41921df3da3d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'category': None,
 'city': 'Tarnos',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 130,
 'expiration_date': '2026-04-28T15:55:29Z',
 'fuel_type': 'diesel',
 'id': '8119e1b8-2787-54af-9f5a-803f87735db5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 43.5417,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EJ46418',
 'listing': 'auction',
 'location': 'FR, Tarnos',
 'location_confidence': 'geocoded',
 'longitude': -1.4628,
 'make': 'Renault',
 'model': 'Scenic',
 'odometer': 125557,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8119e1b8-2787-54af-9f5a-803f87735db5/8119e1b8-2787-54af-9f5a-803f87735db5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73985,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/84/8384aef255e381a1161ca61be170a825/pa/EJ46418_72d090703c1610e6f8b2a2819a36cd3e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8119e1b8-2787-54af-9f5a-803f87735db5/8119e1b8-2787-54af-9f5a-803f87735db5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66137,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/84/8384aef255e381a1161ca61be170a825/pa/EJ46418_89460a9ebfa9e09e748fc58d8f944024.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8119e1b8-2787-54af-9f5a-803f87735db5/8119e1b8-2787-54af-9f5a-803f87735db5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67036,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/84/8384aef255e381a1161ca61be170a825/pa/EJ46418_ffca1501e7aadca2257f41921df3da3d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8119e1b8-2787-54af-9f5a-803f87735db5/8119e1b8-2787-54af-9f5a-803f87735db5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50603,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/84/8384aef255e381a1161ca61be170a825/pa/EJ46418_685d944ee3b664beda0848700a574599.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8119e1b8-2787-54af-9f5a-803f87735db5/8119e1b8-2787-54af-9f5a-803f87735db5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61503,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/84/8384aef255e381a1161ca61be170a825/pa/EJ46418_0d6f25f5447c914c2fc61d9c37763345.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8119e1b8-2787-54af-9f5a-803f87735db5/8119e1b8-2787-54af-9f5a-803f87735db5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63591,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/84/8384aef255e381a1161ca61be170a825/pa/EJ46418_705b43d2639c76d96c8b128005d74c0b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8119e1b8-2787-54af-9f5a-803f87735db5/8119e1b8-2787-54af-9f5a-803f87735db5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53012,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/84/8384aef255e381a1161ca61be170a825/pa/EJ46418_f3eab793997b9394d4854138de9614b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8119e1b8-2787-54af-9f5a-803f87735db5/8119e1b8-2787-54af-9f5a-803f87735db5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72694,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/84/8384aef255e381a1161ca61be170a825/pa/EJ46418_5413f3dd78be3e877839d07e58a792ff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8119e1b8-2787-54af-9f5a-803f87735db5/8119e1b8-2787-54af-9f5a-803f87735db5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70552,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/84/8384aef255e381a1161ca61be170a825/pa/EJ46418_170faab631b75cbaeffd286b06330515.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8119e1b8-2787-54af-9f5a-803f87735db5/8119e1b8-2787-54af-9f5a-803f87735db5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72791,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/84/8384aef255e381a1161ca61be170a825/pa/EJ46418_579e507ac006eeb2f75ec640969dc0ef.jpg',
             'Width': 800}],
 'postal_code': '40220',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Landes',
 'province_code': 'FR-40',
 'region': 'Nouvelle-Aquitaine',
 'region_code': 'FR-75',
 'registration_date': '2017-05-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Scenic 1.6 dCi Energy Business Edition',
 'transmission': 'manual',
 'trim': 'Business Edition',
 'year': 2017}
2026-04-27 08:05:29 [auto1.fr] INFO: Saving data for EJ46418: {'created_time': 1777277129.271461, 'last_price_update_time': 1777277129.271471, 'has_photos': True, 'auction_closing_time': 1777391729.0}
2026-04-27 08:05:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/33/21336787bf44c5f6164d60107a61a884/pa/TJ12777_56d8793e66bc9fadb011777d5c761044.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/33/21336787bf44c5f6164d60107a61a884/pa/TJ12777_942f8ee3b37fa2ceafde1bb8d7b5afb9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/33/21336787bf44c5f6164d60107a61a884/pa/TJ12777_f6eac1d3ac39776038e9ecc23f80690a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XZ61201/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143812e410>
2026-04-27 08:05:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f91c2d9-cef2-55bb-8489-cb880b294f1f/7f91c2d9-cef2-55bb-8489-cb880b294f1f_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/33/21336787bf44c5f6164d60107a61a884/pa/TJ12777_736781d59e17c4373d96bdb6f56006ae.jpg saved to cache
2026-04-27 08:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7f91c2d9-cef2-55bb-8489-cb880b294f1f
2026-04-27 08:05:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438cfa110>
2026-04-27 08:05:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f91c2d9-cef2-55bb-8489-cb880b294f1f/7f91c2d9-cef2-55bb-8489-cb880b294f1f_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/33/21336787bf44c5f6164d60107a61a884/pa/TJ12777_89fb456180a287b4231aae50b78faff6.jpg saved to cache
2026-04-27 08:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7f91c2d9-cef2-55bb-8489-cb880b294f1f
2026-04-27 08:05:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14381c9c10>
2026-04-27 08:05:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f91c2d9-cef2-55bb-8489-cb880b294f1f/7f91c2d9-cef2-55bb-8489-cb880b294f1f_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/33/21336787bf44c5f6164d60107a61a884/pa/TJ12777_56d8793e66bc9fadb011777d5c761044.jpg saved to cache
2026-04-27 08:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7f91c2d9-cef2-55bb-8489-cb880b294f1f
2026-04-27 08:05:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bfbaa10>
2026-04-27 08:05:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f91c2d9-cef2-55bb-8489-cb880b294f1f/7f91c2d9-cef2-55bb-8489-cb880b294f1f_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/33/21336787bf44c5f6164d60107a61a884/pa/TJ12777_942f8ee3b37fa2ceafde1bb8d7b5afb9.jpg saved to cache
2026-04-27 08:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7f91c2d9-cef2-55bb-8489-cb880b294f1f
2026-04-27 08:05:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c28fd0>
2026-04-27 08:05:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f91c2d9-cef2-55bb-8489-cb880b294f1f/7f91c2d9-cef2-55bb-8489-cb880b294f1f_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/33/21336787bf44c5f6164d60107a61a884/pa/TJ12777_f6eac1d3ac39776038e9ecc23f80690a.jpg saved to cache
2026-04-27 08:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7f91c2d9-cef2-55bb-8489-cb880b294f1f
2026-04-27 08:05:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/33/21336787bf44c5f6164d60107a61a884/pa/TJ12777_2c1e1ad775b89183096936873e753dd7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/33/21336787bf44c5f6164d60107a61a884/pa/TJ12777_774cd23c05a369332ea16400ec2761d1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/33/21336787bf44c5f6164d60107a61a884/pa/TJ12777_4f0969cf69c323618639f615902ae7d0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d83750>
2026-04-27 08:05:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f91c2d9-cef2-55bb-8489-cb880b294f1f/7f91c2d9-cef2-55bb-8489-cb880b294f1f_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/33/21336787bf44c5f6164d60107a61a884/pa/TJ12777_2c1e1ad775b89183096936873e753dd7.jpg saved to cache
2026-04-27 08:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7f91c2d9-cef2-55bb-8489-cb880b294f1f
2026-04-27 08:05:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438eb5950>
2026-04-27 08:05:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f91c2d9-cef2-55bb-8489-cb880b294f1f/7f91c2d9-cef2-55bb-8489-cb880b294f1f_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/33/21336787bf44c5f6164d60107a61a884/pa/TJ12777_774cd23c05a369332ea16400ec2761d1.jpg saved to cache
2026-04-27 08:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7f91c2d9-cef2-55bb-8489-cb880b294f1f
2026-04-27 08:05:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b37e50>
2026-04-27 08:05:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f91c2d9-cef2-55bb-8489-cb880b294f1f/7f91c2d9-cef2-55bb-8489-cb880b294f1f_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/33/21336787bf44c5f6164d60107a61a884/pa/TJ12777_4f0969cf69c323618639f615902ae7d0.jpg saved to cache
2026-04-27 08:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7f91c2d9-cef2-55bb-8489-cb880b294f1f
2026-04-27 08:05:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7f91c2d9-cef2-55bb-8489-cb880b294f1f with identifier: TJ12777
2026-04-27 08:05:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7f91c2d9-cef2-55bb-8489-cb880b294f1f with identifier: TJ12777
2026-04-27 08:05:29 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:05:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 7f91c2d9-cef2-55bb-8489-cb880b294f1f with identifier: TJ12777 to the API
2026-04-27 08:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:05:30 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:05:30 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': 191,
 'category': None,
 'city': 'Loyettes',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 240,
 'expiration_date': '2026-04-28T15:09:25Z',
 'fuel_type': 'diesel',
 'id': '7f91c2d9-cef2-55bb-8489-cb880b294f1f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 45.7766,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TJ12777',
 'listing': 'auction',
 'location': 'FR, Loyettes',
 'location_confidence': 'geocoded',
 'longitude': 5.2069,
 'make': 'Land Rover',
 'model': 'Discovery 5',
 'odometer': 97348,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img21/33/21336787bf44c5f6164d60107a61a884/pa/TJ12777_2c1e1ad775b89183096936873e753dd7.jpg',
                'https://img-pa.auto1.com/img21/33/21336787bf44c5f6164d60107a61a884/pa/TJ12777_774cd23c05a369332ea16400ec2761d1.jpg',
                'https://img-pa.auto1.com/img21/33/21336787bf44c5f6164d60107a61a884/pa/TJ12777_fa24e3435c8bf44e78b15984340cc81d.jpg',
                'https://img-pa.auto1.com/img21/33/21336787bf44c5f6164d60107a61a884/pa/TJ12777_4f0969cf69c323618639f615902ae7d0.jpg',
                'https://img-pa.auto1.com/img21/33/21336787bf44c5f6164d60107a61a884/pa/TJ12777_942f8ee3b37fa2ceafde1bb8d7b5afb9.jpg',
                'https://img-pa.auto1.com/img21/33/21336787bf44c5f6164d60107a61a884/pa/TJ12777_f6eac1d3ac39776038e9ecc23f80690a.jpg',
                'https://img-pa.auto1.com/img21/33/21336787bf44c5f6164d60107a61a884/pa/TJ12777_56d8793e66bc9fadb011777d5c761044.jpg',
                'https://img-pa.auto1.com/img21/33/21336787bf44c5f6164d60107a61a884/pa/TJ12777_89fb456180a287b4231aae50b78faff6.jpg',
                'https://img-pa.auto1.com/img21/33/21336787bf44c5f6164d60107a61a884/pa/TJ12777_736781d59e17c4373d96bdb6f56006ae.jpg',
                'https://img-pa.auto1.com/img21/33/21336787bf44c5f6164d60107a61a884/pa/TJ12777_480613e3ff867f19957ee823023bd403.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7f91c2d9-cef2-55bb-8489-cb880b294f1f/7f91c2d9-cef2-55bb-8489-cb880b294f1f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85391,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/33/21336787bf44c5f6164d60107a61a884/pa/TJ12777_2c1e1ad775b89183096936873e753dd7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7f91c2d9-cef2-55bb-8489-cb880b294f1f/7f91c2d9-cef2-55bb-8489-cb880b294f1f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84281,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/33/21336787bf44c5f6164d60107a61a884/pa/TJ12777_774cd23c05a369332ea16400ec2761d1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7f91c2d9-cef2-55bb-8489-cb880b294f1f/7f91c2d9-cef2-55bb-8489-cb880b294f1f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80049,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/33/21336787bf44c5f6164d60107a61a884/pa/TJ12777_fa24e3435c8bf44e78b15984340cc81d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7f91c2d9-cef2-55bb-8489-cb880b294f1f/7f91c2d9-cef2-55bb-8489-cb880b294f1f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73495,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/33/21336787bf44c5f6164d60107a61a884/pa/TJ12777_4f0969cf69c323618639f615902ae7d0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7f91c2d9-cef2-55bb-8489-cb880b294f1f/7f91c2d9-cef2-55bb-8489-cb880b294f1f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75907,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/33/21336787bf44c5f6164d60107a61a884/pa/TJ12777_942f8ee3b37fa2ceafde1bb8d7b5afb9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7f91c2d9-cef2-55bb-8489-cb880b294f1f/7f91c2d9-cef2-55bb-8489-cb880b294f1f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76996,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/33/21336787bf44c5f6164d60107a61a884/pa/TJ12777_f6eac1d3ac39776038e9ecc23f80690a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7f91c2d9-cef2-55bb-8489-cb880b294f1f/7f91c2d9-cef2-55bb-8489-cb880b294f1f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65936,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/33/21336787bf44c5f6164d60107a61a884/pa/TJ12777_56d8793e66bc9fadb011777d5c761044.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7f91c2d9-cef2-55bb-8489-cb880b294f1f/7f91c2d9-cef2-55bb-8489-cb880b294f1f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83320,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/33/21336787bf44c5f6164d60107a61a884/pa/TJ12777_89fb456180a287b4231aae50b78faff6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7f91c2d9-cef2-55bb-8489-cb880b294f1f/7f91c2d9-cef2-55bb-8489-cb880b294f1f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82151,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/33/21336787bf44c5f6164d60107a61a884/pa/TJ12777_736781d59e17c4373d96bdb6f56006ae.jpg',
             'Width': 800}],
 'postal_code': '01360',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Ain',
 'province_code': 'FR-01',
 'region': 'Auvergne-Rhône-Alpes',
 'region_code': 'FR-84',
 'registration_date': '2019-05-27',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Land Rover Discovery 5 2.0 TD Sd4 SD4 HSE',
 'transmission': 'automatic',
 'trim': 'SD4 HSE',
 'year': 2019}
2026-04-27 08:05:30 [auto1.fr] INFO: Saving data for TJ12777: {'created_time': 1777277130.366473, 'last_price_update_time': 1777277130.366482, 'has_photos': True, 'auction_closing_time': 1777388965.0}
2026-04-27 08:05:30 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 7f91c2d9-cef2-55bb-8489-cb880b294f1f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UL64685> (referer: https://www.auto1.com/v1/car-details-view/UL64685/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6681282d-6954-5bd1-bafb-721f6169ba85 with identifier: UL64685
2026-04-27 08:05:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6681282d-6954-5bd1-bafb-721f6169ba85 with scrape type 1
2026-04-27 08:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6681282d-6954-5bd1-bafb-721f6169ba85
2026-04-27 08:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/4b/054b78d6aeb42638875bbb1dfbdb51ec/pa/UL64685_46e5df2fa45a62e4bbf5df356a1fc1ab.jpg not downloaded yet
2026-04-27 08:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/4b/054b78d6aeb42638875bbb1dfbdb51ec/pa/UL64685_37be5ff60a3793b970f0c1df2d142497.jpg not downloaded yet
2026-04-27 08:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/4b/054b78d6aeb42638875bbb1dfbdb51ec/pa/UL64685_64902bc7f59e25fe32e6274ab02bd331.jpg not downloaded yet
2026-04-27 08:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/4b/054b78d6aeb42638875bbb1dfbdb51ec/pa/UL64685_ca94f4c893440875888dce2817035dd1.jpg not downloaded yet
2026-04-27 08:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/4b/054b78d6aeb42638875bbb1dfbdb51ec/pa/UL64685_2435f195bfd1359915814083750c8102.jpg not downloaded yet
2026-04-27 08:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/4b/054b78d6aeb42638875bbb1dfbdb51ec/pa/UL64685_2dc25aea8167891ec9efcdaae50d9363.jpg not downloaded yet
2026-04-27 08:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/4b/054b78d6aeb42638875bbb1dfbdb51ec/pa/UL64685_4c29e8082e5fb84c029a4e0b59fefbc3.jpg not downloaded yet
2026-04-27 08:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/4b/054b78d6aeb42638875bbb1dfbdb51ec/pa/UL64685_8a58b52adc61d35b6fedee169bcb7b66.jpg not downloaded yet
2026-04-27 08:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/4b/054b78d6aeb42638875bbb1dfbdb51ec/pa/UL64685_c57a1f37d713be575c263ea25e89739b.jpg not downloaded yet
2026-04-27 08:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/4b/054b78d6aeb42638875bbb1dfbdb51ec/pa/UL64685_298a4b5576fb4d261d9a58dfc6fe3aa4.jpg not downloaded yet
2026-04-27 08:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KP94491/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/4b/054b78d6aeb42638875bbb1dfbdb51ec/pa/UL64685_298a4b5576fb4d261d9a58dfc6fe3aa4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/4b/054b78d6aeb42638875bbb1dfbdb51ec/pa/UL64685_c57a1f37d713be575c263ea25e89739b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c2e610>
2026-04-27 08:05:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6681282d-6954-5bd1-bafb-721f6169ba85/6681282d-6954-5bd1-bafb-721f6169ba85_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/4b/054b78d6aeb42638875bbb1dfbdb51ec/pa/UL64685_298a4b5576fb4d261d9a58dfc6fe3aa4.jpg saved to cache
2026-04-27 08:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6681282d-6954-5bd1-bafb-721f6169ba85
2026-04-27 08:05:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ae4610>
2026-04-27 08:05:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6681282d-6954-5bd1-bafb-721f6169ba85/6681282d-6954-5bd1-bafb-721f6169ba85_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/4b/054b78d6aeb42638875bbb1dfbdb51ec/pa/UL64685_c57a1f37d713be575c263ea25e89739b.jpg saved to cache
2026-04-27 08:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6681282d-6954-5bd1-bafb-721f6169ba85
2026-04-27 08:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DY47155> (referer: https://www.auto1.com/v1/car-details-view/DY47155/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/4b/054b78d6aeb42638875bbb1dfbdb51ec/pa/UL64685_8a58b52adc61d35b6fedee169bcb7b66.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c1f525c-a6ca-5ed4-a053-79d577b43c51 with identifier: DY47155
2026-04-27 08:05:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c1f525c-a6ca-5ed4-a053-79d577b43c51 with scrape type 1
2026-04-27 08:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2c1f525c-a6ca-5ed4-a053-79d577b43c51
2026-04-27 08:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/ed/54ed5648a58f48df834a5b45d5fea89e/pa/DY47155_04580f1ad94a266c2585680b11449107.jpg not downloaded yet
2026-04-27 08:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/ed/54ed5648a58f48df834a5b45d5fea89e/pa/DY47155_ec60cd2d679d08b8658f9563d19e9f9c.jpg not downloaded yet
2026-04-27 08:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/4b/054b78d6aeb42638875bbb1dfbdb51ec/pa/UL64685_4c29e8082e5fb84c029a4e0b59fefbc3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/ed/54ed5648a58f48df834a5b45d5fea89e/pa/DY47155_887c61dae9ca4f2c8a8cdf0fa37ec201.jpg not downloaded yet
2026-04-27 08:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/ed/54ed5648a58f48df834a5b45d5fea89e/pa/DY47155_0096722ef9f99577c785c8b7d96c905e.jpg not downloaded yet
2026-04-27 08:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/ed/54ed5648a58f48df834a5b45d5fea89e/pa/DY47155_72b119014ab2be97060f88e1d5b4cd46.jpg not downloaded yet
2026-04-27 08:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/ed/54ed5648a58f48df834a5b45d5fea89e/pa/DY47155_c3f20a3c1351a58465763eabbd20a492.jpg not downloaded yet
2026-04-27 08:05:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d34290>
2026-04-27 08:05:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6681282d-6954-5bd1-bafb-721f6169ba85/6681282d-6954-5bd1-bafb-721f6169ba85_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/4b/054b78d6aeb42638875bbb1dfbdb51ec/pa/UL64685_8a58b52adc61d35b6fedee169bcb7b66.jpg saved to cache
2026-04-27 08:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6681282d-6954-5bd1-bafb-721f6169ba85
2026-04-27 08:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/ed/54ed5648a58f48df834a5b45d5fea89e/pa/DY47155_a4e52da3bc97f2db6fc8026561c38134.jpg not downloaded yet
2026-04-27 08:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/ed/54ed5648a58f48df834a5b45d5fea89e/pa/DY47155_ec60cd2d679d08b8658f9563d19e9f9c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/ed/54ed5648a58f48df834a5b45d5fea89e/pa/DY47155_f205853586e7d6d8a107dc0e5d3bc480.jpg not downloaded yet
2026-04-27 08:05:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b58b50>
2026-04-27 08:05:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6681282d-6954-5bd1-bafb-721f6169ba85/6681282d-6954-5bd1-bafb-721f6169ba85_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/4b/054b78d6aeb42638875bbb1dfbdb51ec/pa/UL64685_4c29e8082e5fb84c029a4e0b59fefbc3.jpg saved to cache
2026-04-27 08:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6681282d-6954-5bd1-bafb-721f6169ba85
2026-04-27 08:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/ed/54ed5648a58f48df834a5b45d5fea89e/pa/DY47155_ea1d7ac6ce9757abc3170d6d29f1b9ad.jpg not downloaded yet
2026-04-27 08:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/ed/54ed5648a58f48df834a5b45d5fea89e/pa/DY47155_8e13015cef155e334519c73bc7c7f29e.jpg not downloaded yet
2026-04-27 08:05:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143807a250>
2026-04-27 08:05:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c1f525c-a6ca-5ed4-a053-79d577b43c51/2c1f525c-a6ca-5ed4-a053-79d577b43c51_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/ed/54ed5648a58f48df834a5b45d5fea89e/pa/DY47155_ec60cd2d679d08b8658f9563d19e9f9c.jpg saved to cache
2026-04-27 08:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2c1f525c-a6ca-5ed4-a053-79d577b43c51
2026-04-27 08:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/ed/54ed5648a58f48df834a5b45d5fea89e/pa/DY47155_a4e52da3bc97f2db6fc8026561c38134.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NC01103/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/ed/54ed5648a58f48df834a5b45d5fea89e/pa/DY47155_ea1d7ac6ce9757abc3170d6d29f1b9ad.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/ed/54ed5648a58f48df834a5b45d5fea89e/pa/DY47155_f205853586e7d6d8a107dc0e5d3bc480.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b34a90>
2026-04-27 08:05:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c1f525c-a6ca-5ed4-a053-79d577b43c51/2c1f525c-a6ca-5ed4-a053-79d577b43c51_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/ed/54ed5648a58f48df834a5b45d5fea89e/pa/DY47155_a4e52da3bc97f2db6fc8026561c38134.jpg saved to cache
2026-04-27 08:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2c1f525c-a6ca-5ed4-a053-79d577b43c51
2026-04-27 08:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/ed/54ed5648a58f48df834a5b45d5fea89e/pa/DY47155_c3f20a3c1351a58465763eabbd20a492.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438074d50>
2026-04-27 08:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c1f525c-a6ca-5ed4-a053-79d577b43c51/2c1f525c-a6ca-5ed4-a053-79d577b43c51_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/ed/54ed5648a58f48df834a5b45d5fea89e/pa/DY47155_ea1d7ac6ce9757abc3170d6d29f1b9ad.jpg saved to cache
2026-04-27 08:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2c1f525c-a6ca-5ed4-a053-79d577b43c51
2026-04-27 08:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/ed/54ed5648a58f48df834a5b45d5fea89e/pa/DY47155_8e13015cef155e334519c73bc7c7f29e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/ed/54ed5648a58f48df834a5b45d5fea89e/pa/DY47155_72b119014ab2be97060f88e1d5b4cd46.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438076410>
2026-04-27 08:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c1f525c-a6ca-5ed4-a053-79d577b43c51/2c1f525c-a6ca-5ed4-a053-79d577b43c51_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/ed/54ed5648a58f48df834a5b45d5fea89e/pa/DY47155_f205853586e7d6d8a107dc0e5d3bc480.jpg saved to cache
2026-04-27 08:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2c1f525c-a6ca-5ed4-a053-79d577b43c51
2026-04-27 08:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/ed/54ed5648a58f48df834a5b45d5fea89e/pa/DY47155_0096722ef9f99577c785c8b7d96c905e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c2be10>
2026-04-27 08:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c1f525c-a6ca-5ed4-a053-79d577b43c51/2c1f525c-a6ca-5ed4-a053-79d577b43c51_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/ed/54ed5648a58f48df834a5b45d5fea89e/pa/DY47155_c3f20a3c1351a58465763eabbd20a492.jpg saved to cache
2026-04-27 08:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2c1f525c-a6ca-5ed4-a053-79d577b43c51
2026-04-27 08:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/ed/54ed5648a58f48df834a5b45d5fea89e/pa/DY47155_887c61dae9ca4f2c8a8cdf0fa37ec201.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438077150>
2026-04-27 08:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c1f525c-a6ca-5ed4-a053-79d577b43c51/2c1f525c-a6ca-5ed4-a053-79d577b43c51_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/ed/54ed5648a58f48df834a5b45d5fea89e/pa/DY47155_8e13015cef155e334519c73bc7c7f29e.jpg saved to cache
2026-04-27 08:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2c1f525c-a6ca-5ed4-a053-79d577b43c51
2026-04-27 08:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ce9dd0>
2026-04-27 08:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c1f525c-a6ca-5ed4-a053-79d577b43c51/2c1f525c-a6ca-5ed4-a053-79d577b43c51_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/ed/54ed5648a58f48df834a5b45d5fea89e/pa/DY47155_72b119014ab2be97060f88e1d5b4cd46.jpg saved to cache
2026-04-27 08:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2c1f525c-a6ca-5ed4-a053-79d577b43c51
2026-04-27 08:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ff1e10>
2026-04-27 08:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c1f525c-a6ca-5ed4-a053-79d577b43c51/2c1f525c-a6ca-5ed4-a053-79d577b43c51_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/ed/54ed5648a58f48df834a5b45d5fea89e/pa/DY47155_0096722ef9f99577c785c8b7d96c905e.jpg saved to cache
2026-04-27 08:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2c1f525c-a6ca-5ed4-a053-79d577b43c51
2026-04-27 08:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/ed/54ed5648a58f48df834a5b45d5fea89e/pa/DY47155_04580f1ad94a266c2585680b11449107.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142be05e90>
2026-04-27 08:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c1f525c-a6ca-5ed4-a053-79d577b43c51/2c1f525c-a6ca-5ed4-a053-79d577b43c51_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/ed/54ed5648a58f48df834a5b45d5fea89e/pa/DY47155_887c61dae9ca4f2c8a8cdf0fa37ec201.jpg saved to cache
2026-04-27 08:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2c1f525c-a6ca-5ed4-a053-79d577b43c51
2026-04-27 08:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/4b/054b78d6aeb42638875bbb1dfbdb51ec/pa/UL64685_2dc25aea8167891ec9efcdaae50d9363.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438bfda50>
2026-04-27 08:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c1f525c-a6ca-5ed4-a053-79d577b43c51/2c1f525c-a6ca-5ed4-a053-79d577b43c51_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/ed/54ed5648a58f48df834a5b45d5fea89e/pa/DY47155_04580f1ad94a266c2585680b11449107.jpg saved to cache
2026-04-27 08:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2c1f525c-a6ca-5ed4-a053-79d577b43c51
2026-04-27 08:05:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2c1f525c-a6ca-5ed4-a053-79d577b43c51, skipping ID generation
2026-04-27 08:05:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c1f525c-a6ca-5ed4-a053-79d577b43c51 with scrape type 1
2026-04-27 08:05:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2c1f525c-a6ca-5ed4-a053-79d577b43c51 sending to next pipeline
2026-04-27 08:05:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2c1f525c-a6ca-5ed4-a053-79d577b43c51, identifier: DY47155
2026-04-27 08:05:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2c1f525c-a6ca-5ed4-a053-79d577b43c51 with identifier: DY47155
2026-04-27 08:05:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2c1f525c-a6ca-5ed4-a053-79d577b43c51 with identifier: DY47155
2026-04-27 08:05:36 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:05:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2c1f525c-a6ca-5ed4-a053-79d577b43c51 with identifier: DY47155 to the API
2026-04-27 08:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:05:36 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:05:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img54/ed/54ed5648a58f48df834a5b45d5fea89e/pa/DY47155_04580f1ad94a266c2585680b11449107.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': None,
 'city': 'Ingrandes sur Vienne',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 180,
 'expiration_date': '2026-04-28T15:36:16Z',
 'fuel_type': 'diesel',
 'id': '2c1f525c-a6ca-5ed4-a053-79d577b43c51',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DY47155',
 'listing': 'auction',
 'location': 'FR, Ingrandes sur Vienne',
 'location_confidence': None,
 'longitude': None,
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 162112,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2c1f525c-a6ca-5ed4-a053-79d577b43c51/2c1f525c-a6ca-5ed4-a053-79d577b43c51_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86241,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/ed/54ed5648a58f48df834a5b45d5fea89e/pa/DY47155_04580f1ad94a266c2585680b11449107.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2c1f525c-a6ca-5ed4-a053-79d577b43c51/2c1f525c-a6ca-5ed4-a053-79d577b43c51_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82253,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/ed/54ed5648a58f48df834a5b45d5fea89e/pa/DY47155_ec60cd2d679d08b8658f9563d19e9f9c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2c1f525c-a6ca-5ed4-a053-79d577b43c51/2c1f525c-a6ca-5ed4-a053-79d577b43c51_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74229,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/ed/54ed5648a58f48df834a5b45d5fea89e/pa/DY47155_887c61dae9ca4f2c8a8cdf0fa37ec201.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2c1f525c-a6ca-5ed4-a053-79d577b43c51/2c1f525c-a6ca-5ed4-a053-79d577b43c51_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52390,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/ed/54ed5648a58f48df834a5b45d5fea89e/pa/DY47155_0096722ef9f99577c785c8b7d96c905e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2c1f525c-a6ca-5ed4-a053-79d577b43c51/2c1f525c-a6ca-5ed4-a053-79d577b43c51_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70530,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/ed/54ed5648a58f48df834a5b45d5fea89e/pa/DY47155_72b119014ab2be97060f88e1d5b4cd46.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2c1f525c-a6ca-5ed4-a053-79d577b43c51/2c1f525c-a6ca-5ed4-a053-79d577b43c51_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76200,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/ed/54ed5648a58f48df834a5b45d5fea89e/pa/DY47155_c3f20a3c1351a58465763eabbd20a492.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2c1f525c-a6ca-5ed4-a053-79d577b43c51/2c1f525c-a6ca-5ed4-a053-79d577b43c51_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58529,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/ed/54ed5648a58f48df834a5b45d5fea89e/pa/DY47155_a4e52da3bc97f2db6fc8026561c38134.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2c1f525c-a6ca-5ed4-a053-79d577b43c51/2c1f525c-a6ca-5ed4-a053-79d577b43c51_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84040,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/ed/54ed5648a58f48df834a5b45d5fea89e/pa/DY47155_f205853586e7d6d8a107dc0e5d3bc480.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2c1f525c-a6ca-5ed4-a053-79d577b43c51/2c1f525c-a6ca-5ed4-a053-79d577b43c51_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81844,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/ed/54ed5648a58f48df834a5b45d5fea89e/pa/DY47155_ea1d7ac6ce9757abc3170d6d29f1b9ad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2c1f525c-a6ca-5ed4-a053-79d577b43c51/2c1f525c-a6ca-5ed4-a053-79d577b43c51_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50649,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/ed/54ed5648a58f48df834a5b45d5fea89e/pa/DY47155_8e13015cef155e334519c73bc7c7f29e.jpg',
             'Width': 800}],
 'postal_code': None,
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2017-09-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 2.0 Blue-HDi GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2017}
2026-04-27 08:05:37 [auto1.fr] INFO: Saving data for DY47155: {'created_time': 1777277137.023479, 'last_price_update_time': 1777277137.023491, 'has_photos': True, 'auction_closing_time': 1777390576.0}
2026-04-27 08:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/4b/054b78d6aeb42638875bbb1dfbdb51ec/pa/UL64685_2435f195bfd1359915814083750c8102.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FX33595> (referer: https://www.auto1.com/v1/car-details-view/FX33595/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142be06790>
2026-04-27 08:05:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6681282d-6954-5bd1-bafb-721f6169ba85/6681282d-6954-5bd1-bafb-721f6169ba85_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/4b/054b78d6aeb42638875bbb1dfbdb51ec/pa/UL64685_2dc25aea8167891ec9efcdaae50d9363.jpg saved to cache
2026-04-27 08:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6681282d-6954-5bd1-bafb-721f6169ba85
2026-04-27 08:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/4b/054b78d6aeb42638875bbb1dfbdb51ec/pa/UL64685_ca94f4c893440875888dce2817035dd1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a59090>
2026-04-27 08:05:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6681282d-6954-5bd1-bafb-721f6169ba85/6681282d-6954-5bd1-bafb-721f6169ba85_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/4b/054b78d6aeb42638875bbb1dfbdb51ec/pa/UL64685_2435f195bfd1359915814083750c8102.jpg saved to cache
2026-04-27 08:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6681282d-6954-5bd1-bafb-721f6169ba85
2026-04-27 08:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/4b/054b78d6aeb42638875bbb1dfbdb51ec/pa/UL64685_37be5ff60a3793b970f0c1df2d142497.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10b30bad-bc43-542a-b30a-603066b40c22 with identifier: FX33595
2026-04-27 08:05:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10b30bad-bc43-542a-b30a-603066b40c22 with scrape type 1
2026-04-27 08:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 10b30bad-bc43-542a-b30a-603066b40c22
2026-04-27 08:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/e6/71e609f71f675c3aa3292e55f10e855c/pa/FX33595_d724fff48da0797ce51bc3620a35525e.jpg not downloaded yet
2026-04-27 08:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/e6/71e609f71f675c3aa3292e55f10e855c/pa/FX33595_83a982271b203beebe39b532365b73db.jpg not downloaded yet
2026-04-27 08:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/4b/054b78d6aeb42638875bbb1dfbdb51ec/pa/UL64685_46e5df2fa45a62e4bbf5df356a1fc1ab.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/e6/71e609f71f675c3aa3292e55f10e855c/pa/FX33595_adf2871028b98f5569b80fe5e1bb1049.jpg not downloaded yet
2026-04-27 08:05:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438dfb090>
2026-04-27 08:05:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6681282d-6954-5bd1-bafb-721f6169ba85/6681282d-6954-5bd1-bafb-721f6169ba85_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/4b/054b78d6aeb42638875bbb1dfbdb51ec/pa/UL64685_ca94f4c893440875888dce2817035dd1.jpg saved to cache
2026-04-27 08:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6681282d-6954-5bd1-bafb-721f6169ba85
2026-04-27 08:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/4b/054b78d6aeb42638875bbb1dfbdb51ec/pa/UL64685_64902bc7f59e25fe32e6274ab02bd331.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/e6/71e609f71f675c3aa3292e55f10e855c/pa/FX33595_72f2ed2a2f01148f7d9dea094422d684.jpg not downloaded yet
2026-04-27 08:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/e6/71e609f71f675c3aa3292e55f10e855c/pa/FX33595_2f558a35bf81e2e8e3d967830826423a.jpg not downloaded yet
2026-04-27 08:05:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438077f50>
2026-04-27 08:05:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6681282d-6954-5bd1-bafb-721f6169ba85/6681282d-6954-5bd1-bafb-721f6169ba85_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/4b/054b78d6aeb42638875bbb1dfbdb51ec/pa/UL64685_37be5ff60a3793b970f0c1df2d142497.jpg saved to cache
2026-04-27 08:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6681282d-6954-5bd1-bafb-721f6169ba85
2026-04-27 08:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/e6/71e609f71f675c3aa3292e55f10e855c/pa/FX33595_d1b05f2b560ca78407d6841017950577.jpg not downloaded yet
2026-04-27 08:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/e6/71e609f71f675c3aa3292e55f10e855c/pa/FX33595_adf2871028b98f5569b80fe5e1bb1049.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/e6/71e609f71f675c3aa3292e55f10e855c/pa/FX33595_83a982271b203beebe39b532365b73db.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b58810>
2026-04-27 08:05:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6681282d-6954-5bd1-bafb-721f6169ba85/6681282d-6954-5bd1-bafb-721f6169ba85_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/4b/054b78d6aeb42638875bbb1dfbdb51ec/pa/UL64685_46e5df2fa45a62e4bbf5df356a1fc1ab.jpg saved to cache
2026-04-27 08:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6681282d-6954-5bd1-bafb-721f6169ba85
2026-04-27 08:05:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d26150>
2026-04-27 08:05:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6681282d-6954-5bd1-bafb-721f6169ba85/6681282d-6954-5bd1-bafb-721f6169ba85_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/4b/054b78d6aeb42638875bbb1dfbdb51ec/pa/UL64685_64902bc7f59e25fe32e6274ab02bd331.jpg saved to cache
2026-04-27 08:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6681282d-6954-5bd1-bafb-721f6169ba85
2026-04-27 08:05:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6681282d-6954-5bd1-bafb-721f6169ba85, skipping ID generation
2026-04-27 08:05:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6681282d-6954-5bd1-bafb-721f6169ba85 with scrape type 1
2026-04-27 08:05:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6681282d-6954-5bd1-bafb-721f6169ba85 sending to next pipeline
2026-04-27 08:05:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6681282d-6954-5bd1-bafb-721f6169ba85, identifier: UL64685
2026-04-27 08:05:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6681282d-6954-5bd1-bafb-721f6169ba85 with identifier: UL64685
2026-04-27 08:05:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6681282d-6954-5bd1-bafb-721f6169ba85 with identifier: UL64685
2026-04-27 08:05:37 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:05:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6681282d-6954-5bd1-bafb-721f6169ba85 with identifier: UL64685 to the API
2026-04-27 08:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:05:38 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:05:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img05/4b/054b78d6aeb42638875bbb1dfbdb51ec/pa/UL64685_64902bc7f59e25fe32e6274ab02bd331.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 42,
 'category': None,
 'city': 'Nanteuil-le-Haudouin',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 367,
 'expiration_date': '2026-04-28T15:07:16Z',
 'fuel_type': 'hybrid',
 'id': '6681282d-6954-5bd1-bafb-721f6169ba85',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 49.1408,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UL64685',
 'listing': 'auction',
 'location': 'FR, Nanteuil-le-Haudouin',
 'location_confidence': 'geocoded',
 'longitude': 2.8114,
 'make': 'Audi',
 'model': 'Q5 Sportback',
 'odometer': 101912,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6681282d-6954-5bd1-bafb-721f6169ba85/6681282d-6954-5bd1-bafb-721f6169ba85_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65206,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img05/4b/054b78d6aeb42638875bbb1dfbdb51ec/pa/UL64685_46e5df2fa45a62e4bbf5df356a1fc1ab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6681282d-6954-5bd1-bafb-721f6169ba85/6681282d-6954-5bd1-bafb-721f6169ba85_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60014,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img05/4b/054b78d6aeb42638875bbb1dfbdb51ec/pa/UL64685_37be5ff60a3793b970f0c1df2d142497.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6681282d-6954-5bd1-bafb-721f6169ba85/6681282d-6954-5bd1-bafb-721f6169ba85_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60352,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img05/4b/054b78d6aeb42638875bbb1dfbdb51ec/pa/UL64685_64902bc7f59e25fe32e6274ab02bd331.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6681282d-6954-5bd1-bafb-721f6169ba85/6681282d-6954-5bd1-bafb-721f6169ba85_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47099,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img05/4b/054b78d6aeb42638875bbb1dfbdb51ec/pa/UL64685_ca94f4c893440875888dce2817035dd1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6681282d-6954-5bd1-bafb-721f6169ba85/6681282d-6954-5bd1-bafb-721f6169ba85_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59107,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img05/4b/054b78d6aeb42638875bbb1dfbdb51ec/pa/UL64685_2435f195bfd1359915814083750c8102.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6681282d-6954-5bd1-bafb-721f6169ba85/6681282d-6954-5bd1-bafb-721f6169ba85_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58301,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img05/4b/054b78d6aeb42638875bbb1dfbdb51ec/pa/UL64685_2dc25aea8167891ec9efcdaae50d9363.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6681282d-6954-5bd1-bafb-721f6169ba85/6681282d-6954-5bd1-bafb-721f6169ba85_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46719,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img05/4b/054b78d6aeb42638875bbb1dfbdb51ec/pa/UL64685_4c29e8082e5fb84c029a4e0b59fefbc3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6681282d-6954-5bd1-bafb-721f6169ba85/6681282d-6954-5bd1-bafb-721f6169ba85_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71586,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img05/4b/054b78d6aeb42638875bbb1dfbdb51ec/pa/UL64685_8a58b52adc61d35b6fedee169bcb7b66.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6681282d-6954-5bd1-bafb-721f6169ba85/6681282d-6954-5bd1-bafb-721f6169ba85_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68263,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img05/4b/054b78d6aeb42638875bbb1dfbdb51ec/pa/UL64685_c57a1f37d713be575c263ea25e89739b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6681282d-6954-5bd1-bafb-721f6169ba85/6681282d-6954-5bd1-bafb-721f6169ba85_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61968,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img05/4b/054b78d6aeb42638875bbb1dfbdb51ec/pa/UL64685_298a4b5576fb4d261d9a58dfc6fe3aa4.jpg',
             'Width': 800}],
 'postal_code': '60440',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Oise',
 'province_code': 'FR-60',
 'region': 'Hauts-de-France',
 'region_code': 'FR-32',
 'registration_date': '2021-09-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q5 Sportback 55 TFSIe quattro edition one',
 'transmission': 'automatic',
 'trim': 'quattro edition one',
 'year': 2021}
2026-04-27 08:05:38 [auto1.fr] INFO: Saving data for UL64685: {'created_time': 1777277138.148893, 'last_price_update_time': 1777277138.148903, 'has_photos': True, 'auction_closing_time': 1777388836.0}
2026-04-27 08:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/e6/71e609f71f675c3aa3292e55f10e855c/pa/FX33595_d1b05f2b560ca78407d6841017950577.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/e6/71e609f71f675c3aa3292e55f10e855c/pa/FX33595_2f558a35bf81e2e8e3d967830826423a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ade210>
2026-04-27 08:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10b30bad-bc43-542a-b30a-603066b40c22/10b30bad-bc43-542a-b30a-603066b40c22_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/e6/71e609f71f675c3aa3292e55f10e855c/pa/FX33595_adf2871028b98f5569b80fe5e1bb1049.jpg saved to cache
2026-04-27 08:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 10b30bad-bc43-542a-b30a-603066b40c22
2026-04-27 08:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438dfa690>
2026-04-27 08:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10b30bad-bc43-542a-b30a-603066b40c22/10b30bad-bc43-542a-b30a-603066b40c22_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/e6/71e609f71f675c3aa3292e55f10e855c/pa/FX33595_83a982271b203beebe39b532365b73db.jpg saved to cache
2026-04-27 08:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 10b30bad-bc43-542a-b30a-603066b40c22
2026-04-27 08:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VN64150/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438caa8d0>
2026-04-27 08:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10b30bad-bc43-542a-b30a-603066b40c22/10b30bad-bc43-542a-b30a-603066b40c22_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/e6/71e609f71f675c3aa3292e55f10e855c/pa/FX33595_d1b05f2b560ca78407d6841017950577.jpg saved to cache
2026-04-27 08:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 10b30bad-bc43-542a-b30a-603066b40c22
2026-04-27 08:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/e6/71e609f71f675c3aa3292e55f10e855c/pa/FX33595_72f2ed2a2f01148f7d9dea094422d684.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f144750d750>
2026-04-27 08:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10b30bad-bc43-542a-b30a-603066b40c22/10b30bad-bc43-542a-b30a-603066b40c22_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/e6/71e609f71f675c3aa3292e55f10e855c/pa/FX33595_2f558a35bf81e2e8e3d967830826423a.jpg saved to cache
2026-04-27 08:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 10b30bad-bc43-542a-b30a-603066b40c22
2026-04-27 08:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/e6/71e609f71f675c3aa3292e55f10e855c/pa/FX33595_d724fff48da0797ce51bc3620a35525e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14391ec750>
2026-04-27 08:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10b30bad-bc43-542a-b30a-603066b40c22/10b30bad-bc43-542a-b30a-603066b40c22_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/e6/71e609f71f675c3aa3292e55f10e855c/pa/FX33595_72f2ed2a2f01148f7d9dea094422d684.jpg saved to cache
2026-04-27 08:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 10b30bad-bc43-542a-b30a-603066b40c22
2026-04-27 08:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/3e/143edc043d0d25521847ba35b0dbc02a/pa/RR97759_9a6cc6e50a3123fe8d8447fe9f372676.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b36bd0>
2026-04-27 08:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10b30bad-bc43-542a-b30a-603066b40c22/10b30bad-bc43-542a-b30a-603066b40c22_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/e6/71e609f71f675c3aa3292e55f10e855c/pa/FX33595_d724fff48da0797ce51bc3620a35525e.jpg saved to cache
2026-04-27 08:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 10b30bad-bc43-542a-b30a-603066b40c22
2026-04-27 08:05:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 10b30bad-bc43-542a-b30a-603066b40c22, skipping ID generation
2026-04-27 08:05:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10b30bad-bc43-542a-b30a-603066b40c22 with scrape type 1
2026-04-27 08:05:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 10b30bad-bc43-542a-b30a-603066b40c22 sending to next pipeline
2026-04-27 08:05:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 10b30bad-bc43-542a-b30a-603066b40c22, identifier: FX33595
2026-04-27 08:05:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 10b30bad-bc43-542a-b30a-603066b40c22 with identifier: FX33595
2026-04-27 08:05:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 10b30bad-bc43-542a-b30a-603066b40c22 with identifier: FX33595
2026-04-27 08:05:38 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:05:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 10b30bad-bc43-542a-b30a-603066b40c22 with identifier: FX33595 to the API
2026-04-27 08:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:05:38 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:05:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img71/e6/71e609f71f675c3aa3292e55f10e855c/pa/FX33595_d724fff48da0797ce51bc3620a35525e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'city': 'Ambarès-et-Lagrave',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 90,
 'expiration_date': '2026-04-28T15:28:05Z',
 'fuel_type': 'diesel',
 'id': '10b30bad-bc43-542a-b30a-603066b40c22',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 44.9274,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FX33595',
 'listing': 'auction',
 'location': 'FR, Ambarès-et-Lagrave',
 'location_confidence': 'geocoded',
 'longitude': -0.4914,
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 252054,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_10b30bad-bc43-542a-b30a-603066b40c22/10b30bad-bc43-542a-b30a-603066b40c22_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 143368,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/e6/71e609f71f675c3aa3292e55f10e855c/pa/FX33595_d724fff48da0797ce51bc3620a35525e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_10b30bad-bc43-542a-b30a-603066b40c22/10b30bad-bc43-542a-b30a-603066b40c22_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 141672,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/e6/71e609f71f675c3aa3292e55f10e855c/pa/FX33595_83a982271b203beebe39b532365b73db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_10b30bad-bc43-542a-b30a-603066b40c22/10b30bad-bc43-542a-b30a-603066b40c22_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102771,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/e6/71e609f71f675c3aa3292e55f10e855c/pa/FX33595_adf2871028b98f5569b80fe5e1bb1049.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_10b30bad-bc43-542a-b30a-603066b40c22/10b30bad-bc43-542a-b30a-603066b40c22_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89345,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/e6/71e609f71f675c3aa3292e55f10e855c/pa/FX33595_72f2ed2a2f01148f7d9dea094422d684.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_10b30bad-bc43-542a-b30a-603066b40c22/10b30bad-bc43-542a-b30a-603066b40c22_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56030,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/e6/71e609f71f675c3aa3292e55f10e855c/pa/FX33595_2f558a35bf81e2e8e3d967830826423a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_10b30bad-bc43-542a-b30a-603066b40c22/10b30bad-bc43-542a-b30a-603066b40c22_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35557,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/e6/71e609f71f675c3aa3292e55f10e855c/pa/FX33595_d1b05f2b560ca78407d6841017950577.jpg',
             'Width': 800}],
 'postal_code': '33440',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Gironde',
 'province_code': 'FR-33',
 'region': 'Nouvelle-Aquitaine',
 'region_code': 'FR-75',
 'registration_date': '2010-08-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.6 TDI Trendline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion Tech',
 'year': 2010}
2026-04-27 08:05:38 [auto1.fr] INFO: Saving data for FX33595: {'created_time': 1777277138.923565, 'last_price_update_time': 1777277138.923575, 'has_photos': True, 'auction_closing_time': 1777390085.0}
2026-04-27 08:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d7c050>
2026-04-27 08:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ec2e98d-2a63-59b3-92a4-07d52ea7a15f/1ec2e98d-2a63-59b3-92a4-07d52ea7a15f_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/3e/143edc043d0d25521847ba35b0dbc02a/pa/RR97759_9a6cc6e50a3123fe8d8447fe9f372676.jpg saved to cache
2026-04-27 08:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1ec2e98d-2a63-59b3-92a4-07d52ea7a15f
2026-04-27 08:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XD56636/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TR20925/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PZ40280/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MX01852/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KP94491> (referer: https://www.auto1.com/v1/car-details-view/KP94491/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bbb33146-6a3f-5e3c-91b9-9a9a2042ef34 with identifier: KP94491
2026-04-27 08:05:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbb33146-6a3f-5e3c-91b9-9a9a2042ef34 with scrape type 1
2026-04-27 08:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bbb33146-6a3f-5e3c-91b9-9a9a2042ef34
2026-04-27 08:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/d5/b5d5076b7b5274dff808a873d9975262/pa/KP94491_1868c86a542492b04613031aee7d4b69.jpg not downloaded yet
2026-04-27 08:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/d5/b5d5076b7b5274dff808a873d9975262/pa/KP94491_8f73cc3cb8083c4ddaec10306d07819c.jpg not downloaded yet
2026-04-27 08:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/d5/b5d5076b7b5274dff808a873d9975262/pa/KP94491_c8d3bf5164779b070de875f82866050b.jpg not downloaded yet
2026-04-27 08:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/d5/b5d5076b7b5274dff808a873d9975262/pa/KP94491_1758e307fed7a647e5643fe3b1ec44a5.jpg not downloaded yet
2026-04-27 08:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/d5/b5d5076b7b5274dff808a873d9975262/pa/KP94491_75f38dc849490cc324ee7687b07a89cd.jpg not downloaded yet
2026-04-27 08:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/d5/b5d5076b7b5274dff808a873d9975262/pa/KP94491_9f340934de42d18dd4358f96c1b5fb53.jpg not downloaded yet
2026-04-27 08:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/d5/b5d5076b7b5274dff808a873d9975262/pa/KP94491_a6dc0e97888244df6f9047a0f5ca7f57.jpg not downloaded yet
2026-04-27 08:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/d5/b5d5076b7b5274dff808a873d9975262/pa/KP94491_6b2ea0a6d619c9ce6e40647fce4aacef.jpg not downloaded yet
2026-04-27 08:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/d5/b5d5076b7b5274dff808a873d9975262/pa/KP94491_c3670d32ffdc42d4244a2bd9fed58ae4.jpg not downloaded yet
2026-04-27 08:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/d5/b5d5076b7b5274dff808a873d9975262/pa/KP94491_09cbb0fde018c7358fb91e747f02dda5.jpg not downloaded yet
2026-04-27 08:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NC01103> (referer: https://www.auto1.com/v1/car-details-view/NC01103/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/d5/b5d5076b7b5274dff808a873d9975262/pa/KP94491_09cbb0fde018c7358fb91e747f02dda5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fcff453a-b6cf-5468-b964-94ce286f491a with identifier: NC01103
2026-04-27 08:05:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fcff453a-b6cf-5468-b964-94ce286f491a with scrape type 1
2026-04-27 08:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fcff453a-b6cf-5468-b964-94ce286f491a
2026-04-27 08:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/76/b376f63b75f62f8c3ad73a003cf16c74/pa/NC01103_f78fc126d31331602b8ac11b2cd21799.jpg not downloaded yet
2026-04-27 08:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/d5/b5d5076b7b5274dff808a873d9975262/pa/KP94491_c3670d32ffdc42d4244a2bd9fed58ae4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/76/b376f63b75f62f8c3ad73a003cf16c74/pa/NC01103_16939f6b6208e4cfab390043e54afbda.jpg not downloaded yet
2026-04-27 08:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/76/b376f63b75f62f8c3ad73a003cf16c74/pa/NC01103_6b37517d8cd6812c9439060c50bf5c17.jpg not downloaded yet
2026-04-27 08:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143804a150>
2026-04-27 08:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbb33146-6a3f-5e3c-91b9-9a9a2042ef34/bbb33146-6a3f-5e3c-91b9-9a9a2042ef34_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/d5/b5d5076b7b5274dff808a873d9975262/pa/KP94491_09cbb0fde018c7358fb91e747f02dda5.jpg saved to cache
2026-04-27 08:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bbb33146-6a3f-5e3c-91b9-9a9a2042ef34
2026-04-27 08:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/76/b376f63b75f62f8c3ad73a003cf16c74/pa/NC01103_d9cd4a0e86a5cf28466b30b4e4c3cb91.jpg not downloaded yet
2026-04-27 08:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/76/b376f63b75f62f8c3ad73a003cf16c74/pa/NC01103_f78fc126d31331602b8ac11b2cd21799.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/76/b376f63b75f62f8c3ad73a003cf16c74/pa/NC01103_dbeda361d847d1cea08aa4fba4e64765.jpg not downloaded yet
2026-04-27 08:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/76/b376f63b75f62f8c3ad73a003cf16c74/pa/NC01103_cd4a7fc652039317a1f28a46839364d5.jpg not downloaded yet
2026-04-27 08:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b59b90>
2026-04-27 08:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbb33146-6a3f-5e3c-91b9-9a9a2042ef34/bbb33146-6a3f-5e3c-91b9-9a9a2042ef34_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/d5/b5d5076b7b5274dff808a873d9975262/pa/KP94491_c3670d32ffdc42d4244a2bd9fed58ae4.jpg saved to cache
2026-04-27 08:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bbb33146-6a3f-5e3c-91b9-9a9a2042ef34
2026-04-27 08:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/76/b376f63b75f62f8c3ad73a003cf16c74/pa/NC01103_55580c2cddcc210bf3cad9218891a7ec.jpg not downloaded yet
2026-04-27 08:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/76/b376f63b75f62f8c3ad73a003cf16c74/pa/NC01103_2557e1ad537a3b56fadbb699dceb99de.jpg not downloaded yet
2026-04-27 08:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/76/b376f63b75f62f8c3ad73a003cf16c74/pa/NC01103_3ea2ec3ad708331b822d34643eed01a9.jpg not downloaded yet
2026-04-27 08:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/76/b376f63b75f62f8c3ad73a003cf16c74/pa/NC01103_6b37517d8cd6812c9439060c50bf5c17.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/76/b376f63b75f62f8c3ad73a003cf16c74/pa/NC01103_0111eaf6778a992350d44769b16de9ec.jpg not downloaded yet
2026-04-27 08:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438df95d0>
2026-04-27 08:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcff453a-b6cf-5468-b964-94ce286f491a/fcff453a-b6cf-5468-b964-94ce286f491a_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/76/b376f63b75f62f8c3ad73a003cf16c74/pa/NC01103_f78fc126d31331602b8ac11b2cd21799.jpg saved to cache
2026-04-27 08:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fcff453a-b6cf-5468-b964-94ce286f491a
2026-04-27 08:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bfd0dd0>
2026-04-27 08:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcff453a-b6cf-5468-b964-94ce286f491a/fcff453a-b6cf-5468-b964-94ce286f491a_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/76/b376f63b75f62f8c3ad73a003cf16c74/pa/NC01103_6b37517d8cd6812c9439060c50bf5c17.jpg saved to cache
2026-04-27 08:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fcff453a-b6cf-5468-b964-94ce286f491a
2026-04-27 08:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/76/b376f63b75f62f8c3ad73a003cf16c74/pa/NC01103_3ea2ec3ad708331b822d34643eed01a9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/76/b376f63b75f62f8c3ad73a003cf16c74/pa/NC01103_0111eaf6778a992350d44769b16de9ec.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bfd0210>
2026-04-27 08:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcff453a-b6cf-5468-b964-94ce286f491a/fcff453a-b6cf-5468-b964-94ce286f491a_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/76/b376f63b75f62f8c3ad73a003cf16c74/pa/NC01103_3ea2ec3ad708331b822d34643eed01a9.jpg saved to cache
2026-04-27 08:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fcff453a-b6cf-5468-b964-94ce286f491a
2026-04-27 08:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/76/b376f63b75f62f8c3ad73a003cf16c74/pa/NC01103_2557e1ad537a3b56fadbb699dceb99de.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143809c310>
2026-04-27 08:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcff453a-b6cf-5468-b964-94ce286f491a/fcff453a-b6cf-5468-b964-94ce286f491a_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/76/b376f63b75f62f8c3ad73a003cf16c74/pa/NC01103_0111eaf6778a992350d44769b16de9ec.jpg saved to cache
2026-04-27 08:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fcff453a-b6cf-5468-b964-94ce286f491a
2026-04-27 08:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438f81c50>
2026-04-27 08:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcff453a-b6cf-5468-b964-94ce286f491a/fcff453a-b6cf-5468-b964-94ce286f491a_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/76/b376f63b75f62f8c3ad73a003cf16c74/pa/NC01103_2557e1ad537a3b56fadbb699dceb99de.jpg saved to cache
2026-04-27 08:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fcff453a-b6cf-5468-b964-94ce286f491a
2026-04-27 08:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/76/b376f63b75f62f8c3ad73a003cf16c74/pa/NC01103_55580c2cddcc210bf3cad9218891a7ec.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143812fad0>
2026-04-27 08:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcff453a-b6cf-5468-b964-94ce286f491a/fcff453a-b6cf-5468-b964-94ce286f491a_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/76/b376f63b75f62f8c3ad73a003cf16c74/pa/NC01103_55580c2cddcc210bf3cad9218891a7ec.jpg saved to cache
2026-04-27 08:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fcff453a-b6cf-5468-b964-94ce286f491a
2026-04-27 08:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/76/b376f63b75f62f8c3ad73a003cf16c74/pa/NC01103_cd4a7fc652039317a1f28a46839364d5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143805de90>
2026-04-27 08:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcff453a-b6cf-5468-b964-94ce286f491a/fcff453a-b6cf-5468-b964-94ce286f491a_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/76/b376f63b75f62f8c3ad73a003cf16c74/pa/NC01103_cd4a7fc652039317a1f28a46839364d5.jpg saved to cache
2026-04-27 08:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fcff453a-b6cf-5468-b964-94ce286f491a
2026-04-27 08:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/76/b376f63b75f62f8c3ad73a003cf16c74/pa/NC01103_dbeda361d847d1cea08aa4fba4e64765.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/76/b376f63b75f62f8c3ad73a003cf16c74/pa/NC01103_d9cd4a0e86a5cf28466b30b4e4c3cb91.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438136990>
2026-04-27 08:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcff453a-b6cf-5468-b964-94ce286f491a/fcff453a-b6cf-5468-b964-94ce286f491a_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/76/b376f63b75f62f8c3ad73a003cf16c74/pa/NC01103_dbeda361d847d1cea08aa4fba4e64765.jpg saved to cache
2026-04-27 08:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fcff453a-b6cf-5468-b964-94ce286f491a
2026-04-27 08:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d91390>
2026-04-27 08:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcff453a-b6cf-5468-b964-94ce286f491a/fcff453a-b6cf-5468-b964-94ce286f491a_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/76/b376f63b75f62f8c3ad73a003cf16c74/pa/NC01103_d9cd4a0e86a5cf28466b30b4e4c3cb91.jpg saved to cache
2026-04-27 08:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fcff453a-b6cf-5468-b964-94ce286f491a
2026-04-27 08:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/76/b376f63b75f62f8c3ad73a003cf16c74/pa/NC01103_16939f6b6208e4cfab390043e54afbda.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/d5/b5d5076b7b5274dff808a873d9975262/pa/KP94491_6b2ea0a6d619c9ce6e40647fce4aacef.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438caac90>
2026-04-27 08:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcff453a-b6cf-5468-b964-94ce286f491a/fcff453a-b6cf-5468-b964-94ce286f491a_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/76/b376f63b75f62f8c3ad73a003cf16c74/pa/NC01103_16939f6b6208e4cfab390043e54afbda.jpg saved to cache
2026-04-27 08:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fcff453a-b6cf-5468-b964-94ce286f491a
2026-04-27 08:05:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fcff453a-b6cf-5468-b964-94ce286f491a, skipping ID generation
2026-04-27 08:05:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fcff453a-b6cf-5468-b964-94ce286f491a with scrape type 1
2026-04-27 08:05:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fcff453a-b6cf-5468-b964-94ce286f491a sending to next pipeline
2026-04-27 08:05:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: fcff453a-b6cf-5468-b964-94ce286f491a, identifier: NC01103
2026-04-27 08:05:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: fcff453a-b6cf-5468-b964-94ce286f491a with identifier: NC01103
2026-04-27 08:05:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: fcff453a-b6cf-5468-b964-94ce286f491a with identifier: NC01103
2026-04-27 08:05:57 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:05:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: fcff453a-b6cf-5468-b964-94ce286f491a with identifier: NC01103 to the API
2026-04-27 08:05:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:05:57 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:05:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb3/76/b376f63b75f62f8c3ad73a003cf16c74/pa/NC01103_16939f6b6208e4cfab390043e54afbda.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'category': None,
 'city': 'Chartres de Bretagne',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-04-28T15:05:08Z',
 'fuel_type': 'diesel',
 'id': 'fcff453a-b6cf-5468-b964-94ce286f491a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.0398,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NC01103',
 'listing': 'auction',
 'location': 'FR, Chartres de Bretagne',
 'location_confidence': 'geocoded',
 'longitude': -1.7054,
 'make': 'Citroen',
 'model': 'C4 Grand Picasso',
 'odometer': 237982,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fcff453a-b6cf-5468-b964-94ce286f491a/fcff453a-b6cf-5468-b964-94ce286f491a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61094,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/76/b376f63b75f62f8c3ad73a003cf16c74/pa/NC01103_f78fc126d31331602b8ac11b2cd21799.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fcff453a-b6cf-5468-b964-94ce286f491a/fcff453a-b6cf-5468-b964-94ce286f491a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59290,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/76/b376f63b75f62f8c3ad73a003cf16c74/pa/NC01103_16939f6b6208e4cfab390043e54afbda.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fcff453a-b6cf-5468-b964-94ce286f491a/fcff453a-b6cf-5468-b964-94ce286f491a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53691,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/76/b376f63b75f62f8c3ad73a003cf16c74/pa/NC01103_6b37517d8cd6812c9439060c50bf5c17.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fcff453a-b6cf-5468-b964-94ce286f491a/fcff453a-b6cf-5468-b964-94ce286f491a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43983,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/76/b376f63b75f62f8c3ad73a003cf16c74/pa/NC01103_d9cd4a0e86a5cf28466b30b4e4c3cb91.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fcff453a-b6cf-5468-b964-94ce286f491a/fcff453a-b6cf-5468-b964-94ce286f491a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46561,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/76/b376f63b75f62f8c3ad73a003cf16c74/pa/NC01103_dbeda361d847d1cea08aa4fba4e64765.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fcff453a-b6cf-5468-b964-94ce286f491a/fcff453a-b6cf-5468-b964-94ce286f491a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54093,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/76/b376f63b75f62f8c3ad73a003cf16c74/pa/NC01103_cd4a7fc652039317a1f28a46839364d5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fcff453a-b6cf-5468-b964-94ce286f491a/fcff453a-b6cf-5468-b964-94ce286f491a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47566,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/76/b376f63b75f62f8c3ad73a003cf16c74/pa/NC01103_55580c2cddcc210bf3cad9218891a7ec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fcff453a-b6cf-5468-b964-94ce286f491a/fcff453a-b6cf-5468-b964-94ce286f491a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67978,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/76/b376f63b75f62f8c3ad73a003cf16c74/pa/NC01103_2557e1ad537a3b56fadbb699dceb99de.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fcff453a-b6cf-5468-b964-94ce286f491a/fcff453a-b6cf-5468-b964-94ce286f491a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62352,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/76/b376f63b75f62f8c3ad73a003cf16c74/pa/NC01103_3ea2ec3ad708331b822d34643eed01a9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fcff453a-b6cf-5468-b964-94ce286f491a/fcff453a-b6cf-5468-b964-94ce286f491a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58978,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/76/b376f63b75f62f8c3ad73a003cf16c74/pa/NC01103_0111eaf6778a992350d44769b16de9ec.jpg',
             'Width': 800}],
 'postal_code': '35131',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Ille-et-Vilaine',
 'province_code': 'FR-35',
 'region': 'Bretagne',
 'region_code': 'FR-53',
 'registration_date': '2018-07-23',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Citroen C4 Grand Picasso 1.6 Blue-HDi Feel',
 'transmission': 'automatic',
 'trim': 'Feel',
 'year': 2018}
2026-04-27 08:05:57 [auto1.fr] INFO: Saving data for NC01103: {'created_time': 1777277157.253338, 'last_price_update_time': 1777277157.253351, 'has_photos': True, 'auction_closing_time': 1777388708.0}
2026-04-27 08:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/d5/b5d5076b7b5274dff808a873d9975262/pa/KP94491_a6dc0e97888244df6f9047a0f5ca7f57.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RG55649/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JB08558/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380bcad0>
2026-04-27 08:05:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbb33146-6a3f-5e3c-91b9-9a9a2042ef34/bbb33146-6a3f-5e3c-91b9-9a9a2042ef34_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/d5/b5d5076b7b5274dff808a873d9975262/pa/KP94491_6b2ea0a6d619c9ce6e40647fce4aacef.jpg saved to cache
2026-04-27 08:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bbb33146-6a3f-5e3c-91b9-9a9a2042ef34
2026-04-27 08:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/d5/b5d5076b7b5274dff808a873d9975262/pa/KP94491_9f340934de42d18dd4358f96c1b5fb53.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bf1a9d0>
2026-04-27 08:05:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbb33146-6a3f-5e3c-91b9-9a9a2042ef34/bbb33146-6a3f-5e3c-91b9-9a9a2042ef34_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/d5/b5d5076b7b5274dff808a873d9975262/pa/KP94491_a6dc0e97888244df6f9047a0f5ca7f57.jpg saved to cache
2026-04-27 08:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bbb33146-6a3f-5e3c-91b9-9a9a2042ef34
2026-04-27 08:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/d5/b5d5076b7b5274dff808a873d9975262/pa/KP94491_75f38dc849490cc324ee7687b07a89cd.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/d5/b5d5076b7b5274dff808a873d9975262/pa/KP94491_c8d3bf5164779b070de875f82866050b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143809fa10>
2026-04-27 08:05:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbb33146-6a3f-5e3c-91b9-9a9a2042ef34/bbb33146-6a3f-5e3c-91b9-9a9a2042ef34_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/d5/b5d5076b7b5274dff808a873d9975262/pa/KP94491_9f340934de42d18dd4358f96c1b5fb53.jpg saved to cache
2026-04-27 08:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bbb33146-6a3f-5e3c-91b9-9a9a2042ef34
2026-04-27 08:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/d5/b5d5076b7b5274dff808a873d9975262/pa/KP94491_8f73cc3cb8083c4ddaec10306d07819c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/d5/b5d5076b7b5274dff808a873d9975262/pa/KP94491_1868c86a542492b04613031aee7d4b69.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438126050>
2026-04-27 08:05:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbb33146-6a3f-5e3c-91b9-9a9a2042ef34/bbb33146-6a3f-5e3c-91b9-9a9a2042ef34_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/d5/b5d5076b7b5274dff808a873d9975262/pa/KP94491_75f38dc849490cc324ee7687b07a89cd.jpg saved to cache
2026-04-27 08:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bbb33146-6a3f-5e3c-91b9-9a9a2042ef34
2026-04-27 08:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/d5/b5d5076b7b5274dff808a873d9975262/pa/KP94491_1758e307fed7a647e5643fe3b1ec44a5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143818ad10>
2026-04-27 08:05:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbb33146-6a3f-5e3c-91b9-9a9a2042ef34/bbb33146-6a3f-5e3c-91b9-9a9a2042ef34_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/d5/b5d5076b7b5274dff808a873d9975262/pa/KP94491_c8d3bf5164779b070de875f82866050b.jpg saved to cache
2026-04-27 08:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bbb33146-6a3f-5e3c-91b9-9a9a2042ef34
2026-04-27 08:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/3e/143edc043d0d25521847ba35b0dbc02a/pa/RR97759_1392321feee5b923360b75691addd91f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438134390>
2026-04-27 08:05:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbb33146-6a3f-5e3c-91b9-9a9a2042ef34/bbb33146-6a3f-5e3c-91b9-9a9a2042ef34_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/d5/b5d5076b7b5274dff808a873d9975262/pa/KP94491_8f73cc3cb8083c4ddaec10306d07819c.jpg saved to cache
2026-04-27 08:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bbb33146-6a3f-5e3c-91b9-9a9a2042ef34
2026-04-27 08:05:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143805f1d0>
2026-04-27 08:05:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbb33146-6a3f-5e3c-91b9-9a9a2042ef34/bbb33146-6a3f-5e3c-91b9-9a9a2042ef34_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/d5/b5d5076b7b5274dff808a873d9975262/pa/KP94491_1868c86a542492b04613031aee7d4b69.jpg saved to cache
2026-04-27 08:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bbb33146-6a3f-5e3c-91b9-9a9a2042ef34
2026-04-27 08:05:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d825d0>
2026-04-27 08:05:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbb33146-6a3f-5e3c-91b9-9a9a2042ef34/bbb33146-6a3f-5e3c-91b9-9a9a2042ef34_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/d5/b5d5076b7b5274dff808a873d9975262/pa/KP94491_1758e307fed7a647e5643fe3b1ec44a5.jpg saved to cache
2026-04-27 08:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bbb33146-6a3f-5e3c-91b9-9a9a2042ef34
2026-04-27 08:05:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bbb33146-6a3f-5e3c-91b9-9a9a2042ef34, skipping ID generation
2026-04-27 08:05:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbb33146-6a3f-5e3c-91b9-9a9a2042ef34 with scrape type 1
2026-04-27 08:05:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bbb33146-6a3f-5e3c-91b9-9a9a2042ef34 sending to next pipeline
2026-04-27 08:05:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: bbb33146-6a3f-5e3c-91b9-9a9a2042ef34, identifier: KP94491
2026-04-27 08:05:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: bbb33146-6a3f-5e3c-91b9-9a9a2042ef34 with identifier: KP94491
2026-04-27 08:05:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: bbb33146-6a3f-5e3c-91b9-9a9a2042ef34 with identifier: KP94491
2026-04-27 08:05:58 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:05:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: bbb33146-6a3f-5e3c-91b9-9a9a2042ef34 with identifier: KP94491 to the API
2026-04-27 08:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:05:58 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:05:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb5/d5/b5d5076b7b5274dff808a873d9975262/pa/KP94491_1758e307fed7a647e5643fe3b1ec44a5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 155,
 'category': 'Taxi',
 'city': 'Saint Aignan de Grandlieu',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.1L',
 'engine_horse_power': 170,
 'expiration_date': '2026-04-28T15:25:52Z',
 'fuel_type': 'diesel',
 'id': 'bbb33146-6a3f-5e3c-91b9-9a9a2042ef34',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'latitude': 47.1237,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KP94491',
 'listing': 'auction',
 'location': 'FR, Saint Aignan de Grandlieu',
 'location_confidence': 'geocoded',
 'longitude': -1.6308,
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 384292,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bbb33146-6a3f-5e3c-91b9-9a9a2042ef34/bbb33146-6a3f-5e3c-91b9-9a9a2042ef34_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69529,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/d5/b5d5076b7b5274dff808a873d9975262/pa/KP94491_1868c86a542492b04613031aee7d4b69.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bbb33146-6a3f-5e3c-91b9-9a9a2042ef34/bbb33146-6a3f-5e3c-91b9-9a9a2042ef34_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68413,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/d5/b5d5076b7b5274dff808a873d9975262/pa/KP94491_8f73cc3cb8083c4ddaec10306d07819c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bbb33146-6a3f-5e3c-91b9-9a9a2042ef34/bbb33146-6a3f-5e3c-91b9-9a9a2042ef34_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67657,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/d5/b5d5076b7b5274dff808a873d9975262/pa/KP94491_c8d3bf5164779b070de875f82866050b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bbb33146-6a3f-5e3c-91b9-9a9a2042ef34/bbb33146-6a3f-5e3c-91b9-9a9a2042ef34_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57372,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/d5/b5d5076b7b5274dff808a873d9975262/pa/KP94491_1758e307fed7a647e5643fe3b1ec44a5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bbb33146-6a3f-5e3c-91b9-9a9a2042ef34/bbb33146-6a3f-5e3c-91b9-9a9a2042ef34_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62762,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/d5/b5d5076b7b5274dff808a873d9975262/pa/KP94491_75f38dc849490cc324ee7687b07a89cd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bbb33146-6a3f-5e3c-91b9-9a9a2042ef34/bbb33146-6a3f-5e3c-91b9-9a9a2042ef34_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64131,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/d5/b5d5076b7b5274dff808a873d9975262/pa/KP94491_9f340934de42d18dd4358f96c1b5fb53.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bbb33146-6a3f-5e3c-91b9-9a9a2042ef34/bbb33146-6a3f-5e3c-91b9-9a9a2042ef34_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52344,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/d5/b5d5076b7b5274dff808a873d9975262/pa/KP94491_a6dc0e97888244df6f9047a0f5ca7f57.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bbb33146-6a3f-5e3c-91b9-9a9a2042ef34/bbb33146-6a3f-5e3c-91b9-9a9a2042ef34_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64596,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/d5/b5d5076b7b5274dff808a873d9975262/pa/KP94491_6b2ea0a6d619c9ce6e40647fce4aacef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bbb33146-6a3f-5e3c-91b9-9a9a2042ef34/bbb33146-6a3f-5e3c-91b9-9a9a2042ef34_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61925,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/d5/b5d5076b7b5274dff808a873d9975262/pa/KP94491_c3670d32ffdc42d4244a2bd9fed58ae4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bbb33146-6a3f-5e3c-91b9-9a9a2042ef34/bbb33146-6a3f-5e3c-91b9-9a9a2042ef34_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51738,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/d5/b5d5076b7b5274dff808a873d9975262/pa/KP94491_09cbb0fde018c7358fb91e747f02dda5.jpg',
             'Width': 800}],
 'postal_code': '44860',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Loire-Atlantique',
 'province_code': 'FR-44',
 'region': 'Pays de la Loire',
 'region_code': 'FR-52',
 'registration_date': '2019-06-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 220 4Matic Exclusive',
 'transmission': 'automatic',
 'trim': '4Matic Exclusive',
 'year': 2019}
2026-04-27 08:05:58 [auto1.fr] INFO: Saving data for KP94491: {'created_time': 1777277158.300483, 'last_price_update_time': 1777277158.300545, 'has_photos': True, 'auction_closing_time': 1777389952.0}
2026-04-27 08:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AV65681> (referer: https://www.auto1.com/v1/car-details-view/AV65681/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14381de310>
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ec2e98d-2a63-59b3-92a4-07d52ea7a15f/1ec2e98d-2a63-59b3-92a4-07d52ea7a15f_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/3e/143edc043d0d25521847ba35b0dbc02a/pa/RR97759_1392321feee5b923360b75691addd91f.jpg saved to cache
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1ec2e98d-2a63-59b3-92a4-07d52ea7a15f
2026-04-27 08:05:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3ae526e-15fd-5e74-ad56-a443bf92220e with identifier: AV65681
2026-04-27 08:05:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3ae526e-15fd-5e74-ad56-a443bf92220e with scrape type 1
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b3ae526e-15fd-5e74-ad56-a443bf92220e
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/20/4720b0aecf6a7f4236d65b74fe08558c/pa/AV65681_2c7154d71e89dc0e7d1e928abcec33bd.jpg not downloaded yet
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/20/4720b0aecf6a7f4236d65b74fe08558c/pa/AV65681_e79e84a30f359868acaee85b95958203.jpg not downloaded yet
2026-04-27 08:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/3e/143edc043d0d25521847ba35b0dbc02a/pa/RR97759_8951d756eae44bb7eb5821c44a867ca9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/20/4720b0aecf6a7f4236d65b74fe08558c/pa/AV65681_02dd0dd795851a9aac7d7e9b8d301dca.jpg not downloaded yet
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/20/4720b0aecf6a7f4236d65b74fe08558c/pa/AV65681_656436cb069cf3cd8a9cd8a44b332da1.jpg not downloaded yet
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/20/4720b0aecf6a7f4236d65b74fe08558c/pa/AV65681_cb6d7bc726b66e6b82ddcab22efde375.jpg not downloaded yet
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/20/4720b0aecf6a7f4236d65b74fe08558c/pa/AV65681_5a0478bf189f6929604da18c4a1cadcc.jpg not downloaded yet
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/20/4720b0aecf6a7f4236d65b74fe08558c/pa/AV65681_12b5650c69d41bbaa8066706e02bf09b.jpg not downloaded yet
2026-04-27 08:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/20/4720b0aecf6a7f4236d65b74fe08558c/pa/AV65681_2c7154d71e89dc0e7d1e928abcec33bd.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/20/4720b0aecf6a7f4236d65b74fe08558c/pa/AV65681_9dbbffbc2e5a4b00281b58b7bfb45b70.jpg not downloaded yet
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c86ad0>
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ec2e98d-2a63-59b3-92a4-07d52ea7a15f/1ec2e98d-2a63-59b3-92a4-07d52ea7a15f_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/3e/143edc043d0d25521847ba35b0dbc02a/pa/RR97759_8951d756eae44bb7eb5821c44a867ca9.jpg saved to cache
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1ec2e98d-2a63-59b3-92a4-07d52ea7a15f
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/20/4720b0aecf6a7f4236d65b74fe08558c/pa/AV65681_d3ab6b8e13cea9d287a6000d69057bae.jpg not downloaded yet
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/20/4720b0aecf6a7f4236d65b74fe08558c/pa/AV65681_46edb85c0fd06e667d9f3e6ac7b9bd12.jpg not downloaded yet
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14381dcbd0>
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3ae526e-15fd-5e74-ad56-a443bf92220e/b3ae526e-15fd-5e74-ad56-a443bf92220e_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/20/4720b0aecf6a7f4236d65b74fe08558c/pa/AV65681_2c7154d71e89dc0e7d1e928abcec33bd.jpg saved to cache
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b3ae526e-15fd-5e74-ad56-a443bf92220e
2026-04-27 08:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/20/4720b0aecf6a7f4236d65b74fe08558c/pa/AV65681_12b5650c69d41bbaa8066706e02bf09b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438fb9410>
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3ae526e-15fd-5e74-ad56-a443bf92220e/b3ae526e-15fd-5e74-ad56-a443bf92220e_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/20/4720b0aecf6a7f4236d65b74fe08558c/pa/AV65681_12b5650c69d41bbaa8066706e02bf09b.jpg saved to cache
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b3ae526e-15fd-5e74-ad56-a443bf92220e
2026-04-27 08:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/20/4720b0aecf6a7f4236d65b74fe08558c/pa/AV65681_46edb85c0fd06e667d9f3e6ac7b9bd12.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438add190>
2026-04-27 08:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3ae526e-15fd-5e74-ad56-a443bf92220e/b3ae526e-15fd-5e74-ad56-a443bf92220e_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/20/4720b0aecf6a7f4236d65b74fe08558c/pa/AV65681_46edb85c0fd06e667d9f3e6ac7b9bd12.jpg saved to cache
2026-04-27 08:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b3ae526e-15fd-5e74-ad56-a443bf92220e
2026-04-27 08:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/20/4720b0aecf6a7f4236d65b74fe08558c/pa/AV65681_d3ab6b8e13cea9d287a6000d69057bae.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438126ed0>
2026-04-27 08:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3ae526e-15fd-5e74-ad56-a443bf92220e/b3ae526e-15fd-5e74-ad56-a443bf92220e_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/20/4720b0aecf6a7f4236d65b74fe08558c/pa/AV65681_d3ab6b8e13cea9d287a6000d69057bae.jpg saved to cache
2026-04-27 08:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b3ae526e-15fd-5e74-ad56-a443bf92220e
2026-04-27 08:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/20/4720b0aecf6a7f4236d65b74fe08558c/pa/AV65681_9dbbffbc2e5a4b00281b58b7bfb45b70.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a5b210>
2026-04-27 08:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3ae526e-15fd-5e74-ad56-a443bf92220e/b3ae526e-15fd-5e74-ad56-a443bf92220e_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/20/4720b0aecf6a7f4236d65b74fe08558c/pa/AV65681_9dbbffbc2e5a4b00281b58b7bfb45b70.jpg saved to cache
2026-04-27 08:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b3ae526e-15fd-5e74-ad56-a443bf92220e
2026-04-27 08:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/20/4720b0aecf6a7f4236d65b74fe08558c/pa/AV65681_5a0478bf189f6929604da18c4a1cadcc.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SV53673/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438075dd0>
2026-04-27 08:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3ae526e-15fd-5e74-ad56-a443bf92220e/b3ae526e-15fd-5e74-ad56-a443bf92220e_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/20/4720b0aecf6a7f4236d65b74fe08558c/pa/AV65681_5a0478bf189f6929604da18c4a1cadcc.jpg saved to cache
2026-04-27 08:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b3ae526e-15fd-5e74-ad56-a443bf92220e
2026-04-27 08:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/20/4720b0aecf6a7f4236d65b74fe08558c/pa/AV65681_656436cb069cf3cd8a9cd8a44b332da1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/20/4720b0aecf6a7f4236d65b74fe08558c/pa/AV65681_cb6d7bc726b66e6b82ddcab22efde375.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438f82850>
2026-04-27 08:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3ae526e-15fd-5e74-ad56-a443bf92220e/b3ae526e-15fd-5e74-ad56-a443bf92220e_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/20/4720b0aecf6a7f4236d65b74fe08558c/pa/AV65681_656436cb069cf3cd8a9cd8a44b332da1.jpg saved to cache
2026-04-27 08:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b3ae526e-15fd-5e74-ad56-a443bf92220e
2026-04-27 08:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/20/4720b0aecf6a7f4236d65b74fe08558c/pa/AV65681_02dd0dd795851a9aac7d7e9b8d301dca.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438f93f90>
2026-04-27 08:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3ae526e-15fd-5e74-ad56-a443bf92220e/b3ae526e-15fd-5e74-ad56-a443bf92220e_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/20/4720b0aecf6a7f4236d65b74fe08558c/pa/AV65681_cb6d7bc726b66e6b82ddcab22efde375.jpg saved to cache
2026-04-27 08:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b3ae526e-15fd-5e74-ad56-a443bf92220e
2026-04-27 08:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143807bc90>
2026-04-27 08:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3ae526e-15fd-5e74-ad56-a443bf92220e/b3ae526e-15fd-5e74-ad56-a443bf92220e_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/20/4720b0aecf6a7f4236d65b74fe08558c/pa/AV65681_02dd0dd795851a9aac7d7e9b8d301dca.jpg saved to cache
2026-04-27 08:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b3ae526e-15fd-5e74-ad56-a443bf92220e
2026-04-27 08:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/20/4720b0aecf6a7f4236d65b74fe08558c/pa/AV65681_e79e84a30f359868acaee85b95958203.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:59 [scrapy.extensions.logstats] INFO: Crawled 437 pages (at 31 pages/min), scraped 387 items (at 15 items/min)
2026-04-27 08:05:59 [scrapy.extensions.memusage] INFO: Peak memory usage is 373MiB
2026-04-27 08:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14381df9d0>
2026-04-27 08:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3ae526e-15fd-5e74-ad56-a443bf92220e/b3ae526e-15fd-5e74-ad56-a443bf92220e_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/20/4720b0aecf6a7f4236d65b74fe08558c/pa/AV65681_e79e84a30f359868acaee85b95958203.jpg saved to cache
2026-04-27 08:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b3ae526e-15fd-5e74-ad56-a443bf92220e
2026-04-27 08:05:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b3ae526e-15fd-5e74-ad56-a443bf92220e, skipping ID generation
2026-04-27 08:05:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3ae526e-15fd-5e74-ad56-a443bf92220e with scrape type 1
2026-04-27 08:05:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b3ae526e-15fd-5e74-ad56-a443bf92220e sending to next pipeline
2026-04-27 08:06:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b3ae526e-15fd-5e74-ad56-a443bf92220e, identifier: AV65681
2026-04-27 08:06:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b3ae526e-15fd-5e74-ad56-a443bf92220e with identifier: AV65681
2026-04-27 08:06:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b3ae526e-15fd-5e74-ad56-a443bf92220e with identifier: AV65681
2026-04-27 08:06:00 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:06:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b3ae526e-15fd-5e74-ad56-a443bf92220e with identifier: AV65681 to the API
2026-04-27 08:06:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:06:00 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:06:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img47/20/4720b0aecf6a7f4236d65b74fe08558c/pa/AV65681_e79e84a30f359868acaee85b95958203.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'category': None,
 'city': 'Loyettes',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-04-28T15:03:41Z',
 'fuel_type': 'petrol',
 'id': 'b3ae526e-15fd-5e74-ad56-a443bf92220e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 45.7766,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AV65681',
 'listing': 'auction',
 'location': 'FR, Loyettes',
 'location_confidence': 'geocoded',
 'longitude': 5.2069,
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 115946,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b3ae526e-15fd-5e74-ad56-a443bf92220e/b3ae526e-15fd-5e74-ad56-a443bf92220e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58685,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/20/4720b0aecf6a7f4236d65b74fe08558c/pa/AV65681_2c7154d71e89dc0e7d1e928abcec33bd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b3ae526e-15fd-5e74-ad56-a443bf92220e/b3ae526e-15fd-5e74-ad56-a443bf92220e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56519,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/20/4720b0aecf6a7f4236d65b74fe08558c/pa/AV65681_e79e84a30f359868acaee85b95958203.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b3ae526e-15fd-5e74-ad56-a443bf92220e/b3ae526e-15fd-5e74-ad56-a443bf92220e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55086,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/20/4720b0aecf6a7f4236d65b74fe08558c/pa/AV65681_02dd0dd795851a9aac7d7e9b8d301dca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b3ae526e-15fd-5e74-ad56-a443bf92220e/b3ae526e-15fd-5e74-ad56-a443bf92220e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49703,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/20/4720b0aecf6a7f4236d65b74fe08558c/pa/AV65681_656436cb069cf3cd8a9cd8a44b332da1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b3ae526e-15fd-5e74-ad56-a443bf92220e/b3ae526e-15fd-5e74-ad56-a443bf92220e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53868,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/20/4720b0aecf6a7f4236d65b74fe08558c/pa/AV65681_cb6d7bc726b66e6b82ddcab22efde375.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b3ae526e-15fd-5e74-ad56-a443bf92220e/b3ae526e-15fd-5e74-ad56-a443bf92220e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57549,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/20/4720b0aecf6a7f4236d65b74fe08558c/pa/AV65681_5a0478bf189f6929604da18c4a1cadcc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b3ae526e-15fd-5e74-ad56-a443bf92220e/b3ae526e-15fd-5e74-ad56-a443bf92220e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52258,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/20/4720b0aecf6a7f4236d65b74fe08558c/pa/AV65681_12b5650c69d41bbaa8066706e02bf09b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b3ae526e-15fd-5e74-ad56-a443bf92220e/b3ae526e-15fd-5e74-ad56-a443bf92220e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108959,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/20/4720b0aecf6a7f4236d65b74fe08558c/pa/AV65681_9dbbffbc2e5a4b00281b58b7bfb45b70.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b3ae526e-15fd-5e74-ad56-a443bf92220e/b3ae526e-15fd-5e74-ad56-a443bf92220e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80450,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/20/4720b0aecf6a7f4236d65b74fe08558c/pa/AV65681_d3ab6b8e13cea9d287a6000d69057bae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b3ae526e-15fd-5e74-ad56-a443bf92220e/b3ae526e-15fd-5e74-ad56-a443bf92220e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67260,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/20/4720b0aecf6a7f4236d65b74fe08558c/pa/AV65681_46edb85c0fd06e667d9f3e6ac7b9bd12.jpg',
             'Width': 800}],
 'postal_code': '01360',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Ain',
 'province_code': 'FR-01',
 'region': 'Auvergne-Rhône-Alpes',
 'region_code': 'FR-84',
 'registration_date': '2019-04-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Signature',
 'transmission': 'manual',
 'trim': 'Signature',
 'year': 2019}
2026-04-27 08:06:00 [auto1.fr] INFO: Saving data for AV65681: {'created_time': 1777277160.61122, 'last_price_update_time': 1777277160.611232, 'has_photos': True, 'auction_closing_time': 1777388621.0}
2026-04-27 08:06:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CB45480> (referer: https://www.auto1.com/v1/car-details-view/CB45480/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:06:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:06:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/3e/143edc043d0d25521847ba35b0dbc02a/pa/RR97759_c8757a4bccf22f2b20cf927068c69254.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13b481fc-3a57-5346-ab37-8275a59f10e6 with identifier: CB45480
2026-04-27 08:06:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13b481fc-3a57-5346-ab37-8275a59f10e6 with scrape type 1
2026-04-27 08:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 13b481fc-3a57-5346-ab37-8275a59f10e6
2026-04-27 08:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/a0/91a003a6f47ce45b74287bb58a4bd462/pa/CB45480_07087e32a38c998c92498f408477c76c.jpg not downloaded yet
2026-04-27 08:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/a0/91a003a6f47ce45b74287bb58a4bd462/pa/CB45480_4e9174cf0cbe06a3e5046d7040197a44.jpg not downloaded yet
2026-04-27 08:06:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/3e/143edc043d0d25521847ba35b0dbc02a/pa/RR97759_50528a93487f5b6a6611664ae19e577c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/a0/91a003a6f47ce45b74287bb58a4bd462/pa/CB45480_c5e662a37dd5b7643df1f4d2c6ae7c5b.jpg not downloaded yet
2026-04-27 08:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/a0/91a003a6f47ce45b74287bb58a4bd462/pa/CB45480_5eee9f17a074b7c142e4ffaf8db7a821.jpg not downloaded yet
2026-04-27 08:06:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438079a50>
2026-04-27 08:06:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ec2e98d-2a63-59b3-92a4-07d52ea7a15f/1ec2e98d-2a63-59b3-92a4-07d52ea7a15f_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/3e/143edc043d0d25521847ba35b0dbc02a/pa/RR97759_c8757a4bccf22f2b20cf927068c69254.jpg saved to cache
2026-04-27 08:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1ec2e98d-2a63-59b3-92a4-07d52ea7a15f
2026-04-27 08:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/a0/91a003a6f47ce45b74287bb58a4bd462/pa/CB45480_fb5d7d44d889b1609e0c3d1eb5d4480e.jpg not downloaded yet
2026-04-27 08:06:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/a0/91a003a6f47ce45b74287bb58a4bd462/pa/CB45480_07087e32a38c998c92498f408477c76c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/a0/91a003a6f47ce45b74287bb58a4bd462/pa/CB45480_6ab13597b8f4e3c0f56c0e903c2df5de.jpg not downloaded yet
2026-04-27 08:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/a0/91a003a6f47ce45b74287bb58a4bd462/pa/CB45480_8d232445732c2d3fd5c0402f2d41d4cd.jpg not downloaded yet
2026-04-27 08:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/a0/91a003a6f47ce45b74287bb58a4bd462/pa/CB45480_5fb77490a645b1bc3bdb51a504059376.jpg not downloaded yet
2026-04-27 08:06:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c2fa10>
2026-04-27 08:06:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ec2e98d-2a63-59b3-92a4-07d52ea7a15f/1ec2e98d-2a63-59b3-92a4-07d52ea7a15f_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/3e/143edc043d0d25521847ba35b0dbc02a/pa/RR97759_50528a93487f5b6a6611664ae19e577c.jpg saved to cache
2026-04-27 08:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1ec2e98d-2a63-59b3-92a4-07d52ea7a15f
2026-04-27 08:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/a0/91a003a6f47ce45b74287bb58a4bd462/pa/CB45480_7d88e9813e5fbebb695c3a2535d7cf6e.jpg not downloaded yet
2026-04-27 08:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/a0/91a003a6f47ce45b74287bb58a4bd462/pa/CB45480_a3861792f1d238203e7287716e952233.jpg not downloaded yet
2026-04-27 08:06:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ff2c10>
2026-04-27 08:06:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13b481fc-3a57-5346-ab37-8275a59f10e6/13b481fc-3a57-5346-ab37-8275a59f10e6_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/a0/91a003a6f47ce45b74287bb58a4bd462/pa/CB45480_07087e32a38c998c92498f408477c76c.jpg saved to cache
2026-04-27 08:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 13b481fc-3a57-5346-ab37-8275a59f10e6
2026-04-27 08:06:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/a0/91a003a6f47ce45b74287bb58a4bd462/pa/CB45480_5eee9f17a074b7c142e4ffaf8db7a821.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438014e50>
2026-04-27 08:06:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13b481fc-3a57-5346-ab37-8275a59f10e6/13b481fc-3a57-5346-ab37-8275a59f10e6_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/a0/91a003a6f47ce45b74287bb58a4bd462/pa/CB45480_5eee9f17a074b7c142e4ffaf8db7a821.jpg saved to cache
2026-04-27 08:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 13b481fc-3a57-5346-ab37-8275a59f10e6
2026-04-27 08:06:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/a0/91a003a6f47ce45b74287bb58a4bd462/pa/CB45480_a3861792f1d238203e7287716e952233.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438dfa890>
2026-04-27 08:06:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13b481fc-3a57-5346-ab37-8275a59f10e6/13b481fc-3a57-5346-ab37-8275a59f10e6_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/a0/91a003a6f47ce45b74287bb58a4bd462/pa/CB45480_a3861792f1d238203e7287716e952233.jpg saved to cache
2026-04-27 08:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 13b481fc-3a57-5346-ab37-8275a59f10e6
2026-04-27 08:06:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XD56636> (referer: https://www.auto1.com/v1/car-details-view/XD56636/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:06:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:06:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/a0/91a003a6f47ce45b74287bb58a4bd462/pa/CB45480_7d88e9813e5fbebb695c3a2535d7cf6e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee2347b7-de96-55dc-80e2-c32537edc454 with identifier: XD56636
2026-04-27 08:06:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee2347b7-de96-55dc-80e2-c32537edc454 with scrape type 1
2026-04-27 08:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item ee2347b7-de96-55dc-80e2-c32537edc454
2026-04-27 08:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/b6/5eb6b167d788f4b50e659224b887fa24/pa/XD56636_2f5e6b45da1cad7d828ab9ed3dcf1dba.jpg not downloaded yet
2026-04-27 08:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/b6/5eb6b167d788f4b50e659224b887fa24/pa/XD56636_0e69d6bad087dc8db6e6d6c9f5e825f2.jpg not downloaded yet
2026-04-27 08:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/b6/5eb6b167d788f4b50e659224b887fa24/pa/XD56636_c863e281b333c1d4dfd4bd32040c8aca.jpg not downloaded yet
2026-04-27 08:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/b6/5eb6b167d788f4b50e659224b887fa24/pa/XD56636_f6f12fd9efa2f5473df9b68d96bf82a7.jpg not downloaded yet
2026-04-27 08:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/b6/5eb6b167d788f4b50e659224b887fa24/pa/XD56636_45f1cdafcb2e256975288799232831c6.jpg not downloaded yet
2026-04-27 08:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/b6/5eb6b167d788f4b50e659224b887fa24/pa/XD56636_f42e2cc6d6a5ee5b4205cb677688bed0.jpg not downloaded yet
2026-04-27 08:06:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/a0/91a003a6f47ce45b74287bb58a4bd462/pa/CB45480_5fb77490a645b1bc3bdb51a504059376.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438076ad0>
2026-04-27 08:06:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13b481fc-3a57-5346-ab37-8275a59f10e6/13b481fc-3a57-5346-ab37-8275a59f10e6_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/a0/91a003a6f47ce45b74287bb58a4bd462/pa/CB45480_7d88e9813e5fbebb695c3a2535d7cf6e.jpg saved to cache
2026-04-27 08:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 13b481fc-3a57-5346-ab37-8275a59f10e6
2026-04-27 08:06:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/a0/91a003a6f47ce45b74287bb58a4bd462/pa/CB45480_8d232445732c2d3fd5c0402f2d41d4cd.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438df8610>
2026-04-27 08:06:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13b481fc-3a57-5346-ab37-8275a59f10e6/13b481fc-3a57-5346-ab37-8275a59f10e6_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/a0/91a003a6f47ce45b74287bb58a4bd462/pa/CB45480_5fb77490a645b1bc3bdb51a504059376.jpg saved to cache
2026-04-27 08:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 13b481fc-3a57-5346-ab37-8275a59f10e6
2026-04-27 08:06:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/b6/5eb6b167d788f4b50e659224b887fa24/pa/XD56636_f42e2cc6d6a5ee5b4205cb677688bed0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/b6/5eb6b167d788f4b50e659224b887fa24/pa/XD56636_45f1cdafcb2e256975288799232831c6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f144781d5d0>
2026-04-27 08:06:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13b481fc-3a57-5346-ab37-8275a59f10e6/13b481fc-3a57-5346-ab37-8275a59f10e6_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/a0/91a003a6f47ce45b74287bb58a4bd462/pa/CB45480_8d232445732c2d3fd5c0402f2d41d4cd.jpg saved to cache
2026-04-27 08:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 13b481fc-3a57-5346-ab37-8275a59f10e6
2026-04-27 08:06:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f144781dbd0>
2026-04-27 08:06:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee2347b7-de96-55dc-80e2-c32537edc454/ee2347b7-de96-55dc-80e2-c32537edc454_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/b6/5eb6b167d788f4b50e659224b887fa24/pa/XD56636_f42e2cc6d6a5ee5b4205cb677688bed0.jpg saved to cache
2026-04-27 08:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ee2347b7-de96-55dc-80e2-c32537edc454
2026-04-27 08:06:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/b6/5eb6b167d788f4b50e659224b887fa24/pa/XD56636_f6f12fd9efa2f5473df9b68d96bf82a7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438dc9650>
2026-04-27 08:06:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee2347b7-de96-55dc-80e2-c32537edc454/ee2347b7-de96-55dc-80e2-c32537edc454_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/b6/5eb6b167d788f4b50e659224b887fa24/pa/XD56636_45f1cdafcb2e256975288799232831c6.jpg saved to cache
2026-04-27 08:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ee2347b7-de96-55dc-80e2-c32537edc454
2026-04-27 08:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/b6/5eb6b167d788f4b50e659224b887fa24/pa/XD56636_c863e281b333c1d4dfd4bd32040c8aca.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bf18750>
2026-04-27 08:06:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee2347b7-de96-55dc-80e2-c32537edc454/ee2347b7-de96-55dc-80e2-c32537edc454_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/b6/5eb6b167d788f4b50e659224b887fa24/pa/XD56636_f6f12fd9efa2f5473df9b68d96bf82a7.jpg saved to cache
2026-04-27 08:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ee2347b7-de96-55dc-80e2-c32537edc454
2026-04-27 08:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/b6/5eb6b167d788f4b50e659224b887fa24/pa/XD56636_2f5e6b45da1cad7d828ab9ed3dcf1dba.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438caa510>
2026-04-27 08:06:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee2347b7-de96-55dc-80e2-c32537edc454/ee2347b7-de96-55dc-80e2-c32537edc454_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/b6/5eb6b167d788f4b50e659224b887fa24/pa/XD56636_c863e281b333c1d4dfd4bd32040c8aca.jpg saved to cache
2026-04-27 08:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ee2347b7-de96-55dc-80e2-c32537edc454
2026-04-27 08:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/b6/5eb6b167d788f4b50e659224b887fa24/pa/XD56636_0e69d6bad087dc8db6e6d6c9f5e825f2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380565d0>
2026-04-27 08:06:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee2347b7-de96-55dc-80e2-c32537edc454/ee2347b7-de96-55dc-80e2-c32537edc454_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/b6/5eb6b167d788f4b50e659224b887fa24/pa/XD56636_2f5e6b45da1cad7d828ab9ed3dcf1dba.jpg saved to cache
2026-04-27 08:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ee2347b7-de96-55dc-80e2-c32537edc454
2026-04-27 08:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/a0/91a003a6f47ce45b74287bb58a4bd462/pa/CB45480_6ab13597b8f4e3c0f56c0e903c2df5de.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438137290>
2026-04-27 08:06:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee2347b7-de96-55dc-80e2-c32537edc454/ee2347b7-de96-55dc-80e2-c32537edc454_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/b6/5eb6b167d788f4b50e659224b887fa24/pa/XD56636_0e69d6bad087dc8db6e6d6c9f5e825f2.jpg saved to cache
2026-04-27 08:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ee2347b7-de96-55dc-80e2-c32537edc454
2026-04-27 08:06:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ee2347b7-de96-55dc-80e2-c32537edc454, skipping ID generation
2026-04-27 08:06:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee2347b7-de96-55dc-80e2-c32537edc454 with scrape type 1
2026-04-27 08:06:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ee2347b7-de96-55dc-80e2-c32537edc454 sending to next pipeline
2026-04-27 08:06:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ee2347b7-de96-55dc-80e2-c32537edc454, identifier: XD56636
2026-04-27 08:06:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ee2347b7-de96-55dc-80e2-c32537edc454 with identifier: XD56636
2026-04-27 08:06:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ee2347b7-de96-55dc-80e2-c32537edc454 with identifier: XD56636
2026-04-27 08:06:02 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:06:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ee2347b7-de96-55dc-80e2-c32537edc454 with identifier: XD56636 to the API
2026-04-27 08:06:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:06:02 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:06:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5e/b6/5eb6b167d788f4b50e659224b887fa24/pa/XD56636_0e69d6bad087dc8db6e6d6c9f5e825f2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'category': None,
 'city': 'Allennes-les-Marais',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.5L',
 'engine_horse_power': 85,
 'expiration_date': '2026-04-28T15:02:25Z',
 'fuel_type': 'diesel',
 'id': 'ee2347b7-de96-55dc-80e2-c32537edc454',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 50.5375,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XD56636',
 'listing': 'auction',
 'location': 'FR, Allennes-les-Marais',
 'location_confidence': 'geocoded',
 'longitude': 2.9536,
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 271975,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ee2347b7-de96-55dc-80e2-c32537edc454/ee2347b7-de96-55dc-80e2-c32537edc454_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89723,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/b6/5eb6b167d788f4b50e659224b887fa24/pa/XD56636_2f5e6b45da1cad7d828ab9ed3dcf1dba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ee2347b7-de96-55dc-80e2-c32537edc454/ee2347b7-de96-55dc-80e2-c32537edc454_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85131,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/b6/5eb6b167d788f4b50e659224b887fa24/pa/XD56636_0e69d6bad087dc8db6e6d6c9f5e825f2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ee2347b7-de96-55dc-80e2-c32537edc454/ee2347b7-de96-55dc-80e2-c32537edc454_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69609,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/b6/5eb6b167d788f4b50e659224b887fa24/pa/XD56636_c863e281b333c1d4dfd4bd32040c8aca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ee2347b7-de96-55dc-80e2-c32537edc454/ee2347b7-de96-55dc-80e2-c32537edc454_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57824,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/b6/5eb6b167d788f4b50e659224b887fa24/pa/XD56636_f6f12fd9efa2f5473df9b68d96bf82a7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ee2347b7-de96-55dc-80e2-c32537edc454/ee2347b7-de96-55dc-80e2-c32537edc454_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90618,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/b6/5eb6b167d788f4b50e659224b887fa24/pa/XD56636_45f1cdafcb2e256975288799232831c6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ee2347b7-de96-55dc-80e2-c32537edc454/ee2347b7-de96-55dc-80e2-c32537edc454_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37912,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/b6/5eb6b167d788f4b50e659224b887fa24/pa/XD56636_f42e2cc6d6a5ee5b4205cb677688bed0.jpg',
             'Width': 800}],
 'postal_code': '59251',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Nord',
 'province_code': 'FR-59',
 'region': 'Hauts-de-France',
 'region_code': 'FR-32',
 'registration_date': '2010-06-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Duster 1.5 dCi Lauréate 4x2',
 'transmission': 'manual',
 'trim': 'Lauréate 4x2',
 'year': 2010}
2026-04-27 08:06:02 [auto1.fr] INFO: Saving data for XD56636: {'created_time': 1777277162.879837, 'last_price_update_time': 1777277162.879848, 'has_photos': True, 'auction_closing_time': 1777388545.0}
2026-04-27 08:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/a0/91a003a6f47ce45b74287bb58a4bd462/pa/CB45480_fb5d7d44d889b1609e0c3d1eb5d4480e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/a0/91a003a6f47ce45b74287bb58a4bd462/pa/CB45480_c5e662a37dd5b7643df1f4d2c6ae7c5b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438dcb210>
2026-04-27 08:06:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13b481fc-3a57-5346-ab37-8275a59f10e6/13b481fc-3a57-5346-ab37-8275a59f10e6_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/a0/91a003a6f47ce45b74287bb58a4bd462/pa/CB45480_6ab13597b8f4e3c0f56c0e903c2df5de.jpg saved to cache
2026-04-27 08:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 13b481fc-3a57-5346-ab37-8275a59f10e6
2026-04-27 08:06:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c57ad0>
2026-04-27 08:06:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13b481fc-3a57-5346-ab37-8275a59f10e6/13b481fc-3a57-5346-ab37-8275a59f10e6_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/a0/91a003a6f47ce45b74287bb58a4bd462/pa/CB45480_fb5d7d44d889b1609e0c3d1eb5d4480e.jpg saved to cache
2026-04-27 08:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 13b481fc-3a57-5346-ab37-8275a59f10e6
2026-04-27 08:06:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143812cd10>
2026-04-27 08:06:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13b481fc-3a57-5346-ab37-8275a59f10e6/13b481fc-3a57-5346-ab37-8275a59f10e6_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/a0/91a003a6f47ce45b74287bb58a4bd462/pa/CB45480_c5e662a37dd5b7643df1f4d2c6ae7c5b.jpg saved to cache
2026-04-27 08:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 13b481fc-3a57-5346-ab37-8275a59f10e6
2026-04-27 08:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/a0/91a003a6f47ce45b74287bb58a4bd462/pa/CB45480_4e9174cf0cbe06a3e5046d7040197a44.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142be04250>
2026-04-27 08:06:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13b481fc-3a57-5346-ab37-8275a59f10e6/13b481fc-3a57-5346-ab37-8275a59f10e6_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/a0/91a003a6f47ce45b74287bb58a4bd462/pa/CB45480_4e9174cf0cbe06a3e5046d7040197a44.jpg saved to cache
2026-04-27 08:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 13b481fc-3a57-5346-ab37-8275a59f10e6
2026-04-27 08:06:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 13b481fc-3a57-5346-ab37-8275a59f10e6, skipping ID generation
2026-04-27 08:06:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13b481fc-3a57-5346-ab37-8275a59f10e6 with scrape type 1
2026-04-27 08:06:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 13b481fc-3a57-5346-ab37-8275a59f10e6 sending to next pipeline
2026-04-27 08:06:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 13b481fc-3a57-5346-ab37-8275a59f10e6, identifier: CB45480
2026-04-27 08:06:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 13b481fc-3a57-5346-ab37-8275a59f10e6 with identifier: CB45480
2026-04-27 08:06:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 13b481fc-3a57-5346-ab37-8275a59f10e6 with identifier: CB45480
2026-04-27 08:06:03 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:06:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 13b481fc-3a57-5346-ab37-8275a59f10e6 with identifier: CB45480 to the API
2026-04-27 08:06:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:06:03 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:06:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img91/a0/91a003a6f47ce45b74287bb58a4bd462/pa/CB45480_4e9174cf0cbe06a3e5046d7040197a44.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'city': 'Loyettes',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 130,
 'expiration_date': '2026-04-28T15:34:25Z',
 'fuel_type': 'petrol',
 'id': '13b481fc-3a57-5346-ab37-8275a59f10e6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 45.7766,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CB45480',
 'listing': 'auction',
 'location': 'FR, Loyettes',
 'location_confidence': 'geocoded',
 'longitude': 5.2069,
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 101171,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_13b481fc-3a57-5346-ab37-8275a59f10e6/13b481fc-3a57-5346-ab37-8275a59f10e6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83450,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/a0/91a003a6f47ce45b74287bb58a4bd462/pa/CB45480_07087e32a38c998c92498f408477c76c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_13b481fc-3a57-5346-ab37-8275a59f10e6/13b481fc-3a57-5346-ab37-8275a59f10e6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78608,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/a0/91a003a6f47ce45b74287bb58a4bd462/pa/CB45480_4e9174cf0cbe06a3e5046d7040197a44.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_13b481fc-3a57-5346-ab37-8275a59f10e6/13b481fc-3a57-5346-ab37-8275a59f10e6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72247,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/a0/91a003a6f47ce45b74287bb58a4bd462/pa/CB45480_c5e662a37dd5b7643df1f4d2c6ae7c5b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_13b481fc-3a57-5346-ab37-8275a59f10e6/13b481fc-3a57-5346-ab37-8275a59f10e6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63784,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/a0/91a003a6f47ce45b74287bb58a4bd462/pa/CB45480_5eee9f17a074b7c142e4ffaf8db7a821.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_13b481fc-3a57-5346-ab37-8275a59f10e6/13b481fc-3a57-5346-ab37-8275a59f10e6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64785,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/a0/91a003a6f47ce45b74287bb58a4bd462/pa/CB45480_fb5d7d44d889b1609e0c3d1eb5d4480e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_13b481fc-3a57-5346-ab37-8275a59f10e6/13b481fc-3a57-5346-ab37-8275a59f10e6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69346,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/a0/91a003a6f47ce45b74287bb58a4bd462/pa/CB45480_6ab13597b8f4e3c0f56c0e903c2df5de.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_13b481fc-3a57-5346-ab37-8275a59f10e6/13b481fc-3a57-5346-ab37-8275a59f10e6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59668,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/a0/91a003a6f47ce45b74287bb58a4bd462/pa/CB45480_8d232445732c2d3fd5c0402f2d41d4cd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_13b481fc-3a57-5346-ab37-8275a59f10e6/13b481fc-3a57-5346-ab37-8275a59f10e6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67815,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/a0/91a003a6f47ce45b74287bb58a4bd462/pa/CB45480_5fb77490a645b1bc3bdb51a504059376.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_13b481fc-3a57-5346-ab37-8275a59f10e6/13b481fc-3a57-5346-ab37-8275a59f10e6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78881,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/a0/91a003a6f47ce45b74287bb58a4bd462/pa/CB45480_7d88e9813e5fbebb695c3a2535d7cf6e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_13b481fc-3a57-5346-ab37-8275a59f10e6/13b481fc-3a57-5346-ab37-8275a59f10e6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54335,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/a0/91a003a6f47ce45b74287bb58a4bd462/pa/CB45480_a3861792f1d238203e7287716e952233.jpg',
             'Width': 800}],
 'postal_code': '01360',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Ain',
 'province_code': 'FR-01',
 'region': 'Auvergne-Rhône-Alpes',
 'region_code': 'FR-84',
 'registration_date': '2017-12-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.2 PureTech Crossway',
 'transmission': 'automatic',
 'trim': 'Crossway',
 'year': 2017}
2026-04-27 08:06:03 [auto1.fr] INFO: Saving data for CB45480: {'created_time': 1777277163.76578, 'last_price_update_time': 1777277163.765791, 'has_photos': True, 'auction_closing_time': 1777390465.0}
2026-04-27 08:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VN64150> (referer: https://www.auto1.com/v1/car-details-view/VN64150/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:06:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:06:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f74465d5-a5b8-5286-bb20-a2da7567e227 with identifier: VN64150
2026-04-27 08:06:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f74465d5-a5b8-5286-bb20-a2da7567e227 with scrape type 1
2026-04-27 08:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f74465d5-a5b8-5286-bb20-a2da7567e227
2026-04-27 08:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/e6/ece653bbf32a4100b948444e109591e7/pa/VN64150_6fc20ffe9fc057a678466e299682a977.jpg not downloaded yet
2026-04-27 08:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/e6/ece653bbf32a4100b948444e109591e7/pa/VN64150_91d8df37372d0d359223f2553c999883.jpg not downloaded yet
2026-04-27 08:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/e6/ece653bbf32a4100b948444e109591e7/pa/VN64150_d6fdc218f769d3d8883c3a6a2fe0623c.jpg not downloaded yet
2026-04-27 08:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/e6/ece653bbf32a4100b948444e109591e7/pa/VN64150_cd0c08bd1ce0ac43fb818755952300b3.jpg not downloaded yet
2026-04-27 08:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/e6/ece653bbf32a4100b948444e109591e7/pa/VN64150_67dfbddc2c8d91c593c6a1b37851e28d.jpg not downloaded yet
2026-04-27 08:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/e6/ece653bbf32a4100b948444e109591e7/pa/VN64150_b2af3d8b28adc5d516a0268f79097a54.jpg not downloaded yet
2026-04-27 08:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/e6/ece653bbf32a4100b948444e109591e7/pa/VN64150_e5383710adb5123870f97ab3d5def750.jpg not downloaded yet
2026-04-27 08:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/e6/ece653bbf32a4100b948444e109591e7/pa/VN64150_1fe0da44fba7781f8b0ba743f55de416.jpg not downloaded yet
2026-04-27 08:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/e6/ece653bbf32a4100b948444e109591e7/pa/VN64150_97de8a445e0223fa33b85c9a94e8d5a3.jpg not downloaded yet
2026-04-27 08:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/e6/ece653bbf32a4100b948444e109591e7/pa/VN64150_96d9142a5a91a1e1133ab06a1ad30821.jpg not downloaded yet
2026-04-27 08:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MX01852> (referer: https://www.auto1.com/v1/car-details-view/MX01852/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:06:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/e6/ece653bbf32a4100b948444e109591e7/pa/VN64150_96d9142a5a91a1e1133ab06a1ad30821.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: caf5a21d-bfad-5a01-9f38-be5acee2709a with identifier: MX01852
2026-04-27 08:06:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item caf5a21d-bfad-5a01-9f38-be5acee2709a with scrape type 1
2026-04-27 08:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item caf5a21d-bfad-5a01-9f38-be5acee2709a
2026-04-27 08:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/f0/2cf049182160ea434cd38a5c0c128e73/pa/MX01852_39742b0064375bf965900feada08479e.jpg not downloaded yet
2026-04-27 08:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/f0/2cf049182160ea434cd38a5c0c128e73/pa/MX01852_dcf093b575c3a0e7370f5ea32842fdeb.jpg not downloaded yet
2026-04-27 08:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/f0/2cf049182160ea434cd38a5c0c128e73/pa/MX01852_e4cd175f7abce9f41f1a3690216e328c.jpg not downloaded yet
2026-04-27 08:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/f0/2cf049182160ea434cd38a5c0c128e73/pa/MX01852_a91d67ae97fac84f1fa1c991c291a5c6.jpg not downloaded yet
2026-04-27 08:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/f0/2cf049182160ea434cd38a5c0c128e73/pa/MX01852_a4b9f5db58e2e15d15257efa90b2d49c.jpg not downloaded yet
2026-04-27 08:06:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bfd0e90>
2026-04-27 08:06:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f74465d5-a5b8-5286-bb20-a2da7567e227/f74465d5-a5b8-5286-bb20-a2da7567e227_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/e6/ece653bbf32a4100b948444e109591e7/pa/VN64150_96d9142a5a91a1e1133ab06a1ad30821.jpg saved to cache
2026-04-27 08:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f74465d5-a5b8-5286-bb20-a2da7567e227
2026-04-27 08:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/f0/2cf049182160ea434cd38a5c0c128e73/pa/MX01852_8f095bf945d1945e4f74723e81365408.jpg not downloaded yet
2026-04-27 08:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/e6/ece653bbf32a4100b948444e109591e7/pa/VN64150_97de8a445e0223fa33b85c9a94e8d5a3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c2d650>
2026-04-27 08:06:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f74465d5-a5b8-5286-bb20-a2da7567e227/f74465d5-a5b8-5286-bb20-a2da7567e227_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/e6/ece653bbf32a4100b948444e109591e7/pa/VN64150_97de8a445e0223fa33b85c9a94e8d5a3.jpg saved to cache
2026-04-27 08:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f74465d5-a5b8-5286-bb20-a2da7567e227
2026-04-27 08:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/f0/2cf049182160ea434cd38a5c0c128e73/pa/MX01852_8f095bf945d1945e4f74723e81365408.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438bfcd10>
2026-04-27 08:06:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_caf5a21d-bfad-5a01-9f38-be5acee2709a/caf5a21d-bfad-5a01-9f38-be5acee2709a_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/f0/2cf049182160ea434cd38a5c0c128e73/pa/MX01852_8f095bf945d1945e4f74723e81365408.jpg saved to cache
2026-04-27 08:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item caf5a21d-bfad-5a01-9f38-be5acee2709a
2026-04-27 08:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/f0/2cf049182160ea434cd38a5c0c128e73/pa/MX01852_a4b9f5db58e2e15d15257efa90b2d49c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380bfe90>
2026-04-27 08:06:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_caf5a21d-bfad-5a01-9f38-be5acee2709a/caf5a21d-bfad-5a01-9f38-be5acee2709a_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/f0/2cf049182160ea434cd38a5c0c128e73/pa/MX01852_a4b9f5db58e2e15d15257efa90b2d49c.jpg saved to cache
2026-04-27 08:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item caf5a21d-bfad-5a01-9f38-be5acee2709a
2026-04-27 08:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/f0/2cf049182160ea434cd38a5c0c128e73/pa/MX01852_a91d67ae97fac84f1fa1c991c291a5c6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/f0/2cf049182160ea434cd38a5c0c128e73/pa/MX01852_e4cd175f7abce9f41f1a3690216e328c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438eb6290>
2026-04-27 08:06:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_caf5a21d-bfad-5a01-9f38-be5acee2709a/caf5a21d-bfad-5a01-9f38-be5acee2709a_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/f0/2cf049182160ea434cd38a5c0c128e73/pa/MX01852_a91d67ae97fac84f1fa1c991c291a5c6.jpg saved to cache
2026-04-27 08:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item caf5a21d-bfad-5a01-9f38-be5acee2709a
2026-04-27 08:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438014390>
2026-04-27 08:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_caf5a21d-bfad-5a01-9f38-be5acee2709a/caf5a21d-bfad-5a01-9f38-be5acee2709a_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/f0/2cf049182160ea434cd38a5c0c128e73/pa/MX01852_e4cd175f7abce9f41f1a3690216e328c.jpg saved to cache
2026-04-27 08:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item caf5a21d-bfad-5a01-9f38-be5acee2709a
2026-04-27 08:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/f0/2cf049182160ea434cd38a5c0c128e73/pa/MX01852_dcf093b575c3a0e7370f5ea32842fdeb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/f0/2cf049182160ea434cd38a5c0c128e73/pa/MX01852_39742b0064375bf965900feada08479e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438fba2d0>
2026-04-27 08:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_caf5a21d-bfad-5a01-9f38-be5acee2709a/caf5a21d-bfad-5a01-9f38-be5acee2709a_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/f0/2cf049182160ea434cd38a5c0c128e73/pa/MX01852_dcf093b575c3a0e7370f5ea32842fdeb.jpg saved to cache
2026-04-27 08:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item caf5a21d-bfad-5a01-9f38-be5acee2709a
2026-04-27 08:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/e6/ece653bbf32a4100b948444e109591e7/pa/VN64150_1fe0da44fba7781f8b0ba743f55de416.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438adf050>
2026-04-27 08:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_caf5a21d-bfad-5a01-9f38-be5acee2709a/caf5a21d-bfad-5a01-9f38-be5acee2709a_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/f0/2cf049182160ea434cd38a5c0c128e73/pa/MX01852_39742b0064375bf965900feada08479e.jpg saved to cache
2026-04-27 08:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item caf5a21d-bfad-5a01-9f38-be5acee2709a
2026-04-27 08:06:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: caf5a21d-bfad-5a01-9f38-be5acee2709a, skipping ID generation
2026-04-27 08:06:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item caf5a21d-bfad-5a01-9f38-be5acee2709a with scrape type 1
2026-04-27 08:06:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item caf5a21d-bfad-5a01-9f38-be5acee2709a sending to next pipeline
2026-04-27 08:06:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: caf5a21d-bfad-5a01-9f38-be5acee2709a, identifier: MX01852
2026-04-27 08:06:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: caf5a21d-bfad-5a01-9f38-be5acee2709a with identifier: MX01852
2026-04-27 08:06:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: caf5a21d-bfad-5a01-9f38-be5acee2709a with identifier: MX01852
2026-04-27 08:06:10 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:06:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: caf5a21d-bfad-5a01-9f38-be5acee2709a with identifier: MX01852 to the API
2026-04-27 08:06:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:06:10 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:06:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2c/f0/2cf049182160ea434cd38a5c0c128e73/pa/MX01852_39742b0064375bf965900feada08479e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'city': 'Saint Aignan de Grandlieu',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 90,
 'expiration_date': '2026-04-28T15:11:26Z',
 'fuel_type': 'diesel',
 'id': 'caf5a21d-bfad-5a01-9f38-be5acee2709a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 47.1237,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MX01852',
 'listing': 'auction',
 'location': 'FR, Saint Aignan de Grandlieu',
 'location_confidence': 'geocoded',
 'longitude': -1.6308,
 'make': 'Suzuki',
 'model': 'SX4',
 'odometer': 218129,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_caf5a21d-bfad-5a01-9f38-be5acee2709a/caf5a21d-bfad-5a01-9f38-be5acee2709a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82557,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/f0/2cf049182160ea434cd38a5c0c128e73/pa/MX01852_39742b0064375bf965900feada08479e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_caf5a21d-bfad-5a01-9f38-be5acee2709a/caf5a21d-bfad-5a01-9f38-be5acee2709a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81129,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/f0/2cf049182160ea434cd38a5c0c128e73/pa/MX01852_dcf093b575c3a0e7370f5ea32842fdeb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_caf5a21d-bfad-5a01-9f38-be5acee2709a/caf5a21d-bfad-5a01-9f38-be5acee2709a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92422,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/f0/2cf049182160ea434cd38a5c0c128e73/pa/MX01852_e4cd175f7abce9f41f1a3690216e328c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_caf5a21d-bfad-5a01-9f38-be5acee2709a/caf5a21d-bfad-5a01-9f38-be5acee2709a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59919,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/f0/2cf049182160ea434cd38a5c0c128e73/pa/MX01852_a91d67ae97fac84f1fa1c991c291a5c6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_caf5a21d-bfad-5a01-9f38-be5acee2709a/caf5a21d-bfad-5a01-9f38-be5acee2709a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 125141,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/f0/2cf049182160ea434cd38a5c0c128e73/pa/MX01852_a4b9f5db58e2e15d15257efa90b2d49c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_caf5a21d-bfad-5a01-9f38-be5acee2709a/caf5a21d-bfad-5a01-9f38-be5acee2709a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38698,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/f0/2cf049182160ea434cd38a5c0c128e73/pa/MX01852_8f095bf945d1945e4f74723e81365408.jpg',
             'Width': 800}],
 'postal_code': '44860',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Loire-Atlantique',
 'province_code': 'FR-44',
 'region': 'Pays de la Loire',
 'region_code': 'FR-52',
 'registration_date': '2007-12-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Suzuki SX4 1.6 DDiS GL',
 'transmission': 'manual',
 'trim': 'GL',
 'year': 2007}
2026-04-27 08:06:10 [auto1.fr] INFO: Saving data for MX01852: {'created_time': 1777277170.880817, 'last_price_update_time': 1777277170.880827, 'has_photos': True, 'auction_closing_time': 1777389086.0}
2026-04-27 08:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/e6/ece653bbf32a4100b948444e109591e7/pa/VN64150_e5383710adb5123870f97ab3d5def750.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438014390>
2026-04-27 08:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f74465d5-a5b8-5286-bb20-a2da7567e227/f74465d5-a5b8-5286-bb20-a2da7567e227_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/e6/ece653bbf32a4100b948444e109591e7/pa/VN64150_1fe0da44fba7781f8b0ba743f55de416.jpg saved to cache
2026-04-27 08:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f74465d5-a5b8-5286-bb20-a2da7567e227
2026-04-27 08:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/e6/ece653bbf32a4100b948444e109591e7/pa/VN64150_b2af3d8b28adc5d516a0268f79097a54.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438adcc50>
2026-04-27 08:06:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f74465d5-a5b8-5286-bb20-a2da7567e227/f74465d5-a5b8-5286-bb20-a2da7567e227_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/e6/ece653bbf32a4100b948444e109591e7/pa/VN64150_e5383710adb5123870f97ab3d5def750.jpg saved to cache
2026-04-27 08:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f74465d5-a5b8-5286-bb20-a2da7567e227
2026-04-27 08:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/e6/ece653bbf32a4100b948444e109591e7/pa/VN64150_67dfbddc2c8d91c593c6a1b37851e28d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ca8b10>
2026-04-27 08:06:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f74465d5-a5b8-5286-bb20-a2da7567e227/f74465d5-a5b8-5286-bb20-a2da7567e227_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/e6/ece653bbf32a4100b948444e109591e7/pa/VN64150_b2af3d8b28adc5d516a0268f79097a54.jpg saved to cache
2026-04-27 08:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f74465d5-a5b8-5286-bb20-a2da7567e227
2026-04-27 08:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/e6/ece653bbf32a4100b948444e109591e7/pa/VN64150_cd0c08bd1ce0ac43fb818755952300b3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1439c75850>
2026-04-27 08:06:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f74465d5-a5b8-5286-bb20-a2da7567e227/f74465d5-a5b8-5286-bb20-a2da7567e227_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/e6/ece653bbf32a4100b948444e109591e7/pa/VN64150_67dfbddc2c8d91c593c6a1b37851e28d.jpg saved to cache
2026-04-27 08:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f74465d5-a5b8-5286-bb20-a2da7567e227
2026-04-27 08:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/e6/ece653bbf32a4100b948444e109591e7/pa/VN64150_d6fdc218f769d3d8883c3a6a2fe0623c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438adea10>
2026-04-27 08:06:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f74465d5-a5b8-5286-bb20-a2da7567e227/f74465d5-a5b8-5286-bb20-a2da7567e227_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/e6/ece653bbf32a4100b948444e109591e7/pa/VN64150_cd0c08bd1ce0ac43fb818755952300b3.jpg saved to cache
2026-04-27 08:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f74465d5-a5b8-5286-bb20-a2da7567e227
2026-04-27 08:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/e6/ece653bbf32a4100b948444e109591e7/pa/VN64150_91d8df37372d0d359223f2553c999883.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c2e910>
2026-04-27 08:06:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f74465d5-a5b8-5286-bb20-a2da7567e227/f74465d5-a5b8-5286-bb20-a2da7567e227_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/e6/ece653bbf32a4100b948444e109591e7/pa/VN64150_d6fdc218f769d3d8883c3a6a2fe0623c.jpg saved to cache
2026-04-27 08:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f74465d5-a5b8-5286-bb20-a2da7567e227
2026-04-27 08:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/e6/ece653bbf32a4100b948444e109591e7/pa/VN64150_6fc20ffe9fc057a678466e299682a977.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ca88d0>
2026-04-27 08:06:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f74465d5-a5b8-5286-bb20-a2da7567e227/f74465d5-a5b8-5286-bb20-a2da7567e227_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/e6/ece653bbf32a4100b948444e109591e7/pa/VN64150_91d8df37372d0d359223f2553c999883.jpg saved to cache
2026-04-27 08:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f74465d5-a5b8-5286-bb20-a2da7567e227
2026-04-27 08:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/3e/143edc043d0d25521847ba35b0dbc02a/pa/RR97759_b5607295ef4c02d899a7ad2ebd594ac4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438eb6b50>
2026-04-27 08:06:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f74465d5-a5b8-5286-bb20-a2da7567e227/f74465d5-a5b8-5286-bb20-a2da7567e227_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/e6/ece653bbf32a4100b948444e109591e7/pa/VN64150_6fc20ffe9fc057a678466e299682a977.jpg saved to cache
2026-04-27 08:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f74465d5-a5b8-5286-bb20-a2da7567e227
2026-04-27 08:06:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f74465d5-a5b8-5286-bb20-a2da7567e227, skipping ID generation
2026-04-27 08:06:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f74465d5-a5b8-5286-bb20-a2da7567e227 with scrape type 1
2026-04-27 08:06:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f74465d5-a5b8-5286-bb20-a2da7567e227 sending to next pipeline
2026-04-27 08:06:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f74465d5-a5b8-5286-bb20-a2da7567e227, identifier: VN64150
2026-04-27 08:06:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f74465d5-a5b8-5286-bb20-a2da7567e227 with identifier: VN64150
2026-04-27 08:06:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f74465d5-a5b8-5286-bb20-a2da7567e227 with identifier: VN64150
2026-04-27 08:06:11 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:06:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f74465d5-a5b8-5286-bb20-a2da7567e227 with identifier: VN64150 to the API
2026-04-27 08:06:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:06:11 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:06:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgec/e6/ece653bbf32a4100b948444e109591e7/pa/VN64150_6fc20ffe9fc057a678466e299682a977.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'category': None,
 'city': 'Allennes-les-Marais',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-04-28T15:42:19Z',
 'fuel_type': 'diesel',
 'id': 'f74465d5-a5b8-5286-bb20-a2da7567e227',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 50.5375,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VN64150',
 'listing': 'auction',
 'location': 'FR, Allennes-les-Marais',
 'location_confidence': 'geocoded',
 'longitude': 2.9536,
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 178953,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 18,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f74465d5-a5b8-5286-bb20-a2da7567e227/f74465d5-a5b8-5286-bb20-a2da7567e227_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48611,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/e6/ece653bbf32a4100b948444e109591e7/pa/VN64150_6fc20ffe9fc057a678466e299682a977.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f74465d5-a5b8-5286-bb20-a2da7567e227/f74465d5-a5b8-5286-bb20-a2da7567e227_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95349,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/e6/ece653bbf32a4100b948444e109591e7/pa/VN64150_91d8df37372d0d359223f2553c999883.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f74465d5-a5b8-5286-bb20-a2da7567e227/f74465d5-a5b8-5286-bb20-a2da7567e227_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42512,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/e6/ece653bbf32a4100b948444e109591e7/pa/VN64150_d6fdc218f769d3d8883c3a6a2fe0623c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f74465d5-a5b8-5286-bb20-a2da7567e227/f74465d5-a5b8-5286-bb20-a2da7567e227_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39769,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/e6/ece653bbf32a4100b948444e109591e7/pa/VN64150_cd0c08bd1ce0ac43fb818755952300b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f74465d5-a5b8-5286-bb20-a2da7567e227/f74465d5-a5b8-5286-bb20-a2da7567e227_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45080,
             'Height': 558,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/e6/ece653bbf32a4100b948444e109591e7/pa/VN64150_67dfbddc2c8d91c593c6a1b37851e28d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f74465d5-a5b8-5286-bb20-a2da7567e227/f74465d5-a5b8-5286-bb20-a2da7567e227_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44617,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/e6/ece653bbf32a4100b948444e109591e7/pa/VN64150_b2af3d8b28adc5d516a0268f79097a54.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f74465d5-a5b8-5286-bb20-a2da7567e227/f74465d5-a5b8-5286-bb20-a2da7567e227_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43866,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/e6/ece653bbf32a4100b948444e109591e7/pa/VN64150_e5383710adb5123870f97ab3d5def750.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f74465d5-a5b8-5286-bb20-a2da7567e227/f74465d5-a5b8-5286-bb20-a2da7567e227_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105587,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/e6/ece653bbf32a4100b948444e109591e7/pa/VN64150_1fe0da44fba7781f8b0ba743f55de416.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f74465d5-a5b8-5286-bb20-a2da7567e227/f74465d5-a5b8-5286-bb20-a2da7567e227_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56080,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/e6/ece653bbf32a4100b948444e109591e7/pa/VN64150_97de8a445e0223fa33b85c9a94e8d5a3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f74465d5-a5b8-5286-bb20-a2da7567e227/f74465d5-a5b8-5286-bb20-a2da7567e227_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58583,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/e6/ece653bbf32a4100b948444e109591e7/pa/VN64150_96d9142a5a91a1e1133ab06a1ad30821.jpg',
             'Width': 800}],
 'postal_code': '59251',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Nord',
 'province_code': 'FR-59',
 'region': 'Hauts-de-France',
 'region_code': 'FR-32',
 'registration_date': '2020-06-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2020}
2026-04-27 08:06:11 [auto1.fr] INFO: Saving data for VN64150: {'created_time': 1777277171.993487, 'last_price_update_time': 1777277171.993502, 'has_photos': True, 'auction_closing_time': 1777390939.0}
2026-04-27 08:06:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438eb5950>
2026-04-27 08:06:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ec2e98d-2a63-59b3-92a4-07d52ea7a15f/1ec2e98d-2a63-59b3-92a4-07d52ea7a15f_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/3e/143edc043d0d25521847ba35b0dbc02a/pa/RR97759_b5607295ef4c02d899a7ad2ebd594ac4.jpg saved to cache
2026-04-27 08:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1ec2e98d-2a63-59b3-92a4-07d52ea7a15f
2026-04-27 08:06:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1ec2e98d-2a63-59b3-92a4-07d52ea7a15f, skipping ID generation
2026-04-27 08:06:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ec2e98d-2a63-59b3-92a4-07d52ea7a15f with scrape type 1
2026-04-27 08:06:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1ec2e98d-2a63-59b3-92a4-07d52ea7a15f sending to next pipeline
2026-04-27 08:06:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 1ec2e98d-2a63-59b3-92a4-07d52ea7a15f, identifier: RR97759
2026-04-27 08:06:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 1ec2e98d-2a63-59b3-92a4-07d52ea7a15f with identifier: RR97759
2026-04-27 08:06:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 1ec2e98d-2a63-59b3-92a4-07d52ea7a15f with identifier: RR97759
2026-04-27 08:06:12 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:06:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 1ec2e98d-2a63-59b3-92a4-07d52ea7a15f with identifier: RR97759 to the API
2026-04-27 08:06:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:06:12 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:06:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img14/3e/143edc043d0d25521847ba35b0dbc02a/pa/RR97759_b5607295ef4c02d899a7ad2ebd594ac4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'category': None,
 'city': 'Beaucaire',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 163,
 'expiration_date': '2026-04-28T15:48:05Z',
 'fuel_type': 'diesel',
 'id': '1ec2e98d-2a63-59b3-92a4-07d52ea7a15f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 43.8081,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RR97759',
 'listing': 'auction',
 'location': 'FR, Beaucaire',
 'location_confidence': 'geocoded',
 'longitude': 4.6442,
 'make': 'Volvo',
 'model': 'S60',
 'odometer': 217444,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1ec2e98d-2a63-59b3-92a4-07d52ea7a15f/1ec2e98d-2a63-59b3-92a4-07d52ea7a15f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107334,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/3e/143edc043d0d25521847ba35b0dbc02a/pa/RR97759_baa3f24e1439b230b4baf16549d7ea26.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1ec2e98d-2a63-59b3-92a4-07d52ea7a15f/1ec2e98d-2a63-59b3-92a4-07d52ea7a15f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107618,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/3e/143edc043d0d25521847ba35b0dbc02a/pa/RR97759_3ef3272b87c15e2b1174b00d58aa0a0b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1ec2e98d-2a63-59b3-92a4-07d52ea7a15f/1ec2e98d-2a63-59b3-92a4-07d52ea7a15f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104148,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/3e/143edc043d0d25521847ba35b0dbc02a/pa/RR97759_c6b44210f3d0eccaff8def1d0c80f842.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1ec2e98d-2a63-59b3-92a4-07d52ea7a15f/1ec2e98d-2a63-59b3-92a4-07d52ea7a15f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88243,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/3e/143edc043d0d25521847ba35b0dbc02a/pa/RR97759_b5607295ef4c02d899a7ad2ebd594ac4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1ec2e98d-2a63-59b3-92a4-07d52ea7a15f/1ec2e98d-2a63-59b3-92a4-07d52ea7a15f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97762,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/3e/143edc043d0d25521847ba35b0dbc02a/pa/RR97759_fb8f2f5cf013e7fc04b453406da0b907.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1ec2e98d-2a63-59b3-92a4-07d52ea7a15f/1ec2e98d-2a63-59b3-92a4-07d52ea7a15f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100425,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/3e/143edc043d0d25521847ba35b0dbc02a/pa/RR97759_50528a93487f5b6a6611664ae19e577c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1ec2e98d-2a63-59b3-92a4-07d52ea7a15f/1ec2e98d-2a63-59b3-92a4-07d52ea7a15f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91357,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/3e/143edc043d0d25521847ba35b0dbc02a/pa/RR97759_c8757a4bccf22f2b20cf927068c69254.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1ec2e98d-2a63-59b3-92a4-07d52ea7a15f/1ec2e98d-2a63-59b3-92a4-07d52ea7a15f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113780,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/3e/143edc043d0d25521847ba35b0dbc02a/pa/RR97759_8951d756eae44bb7eb5821c44a867ca9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1ec2e98d-2a63-59b3-92a4-07d52ea7a15f/1ec2e98d-2a63-59b3-92a4-07d52ea7a15f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105053,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/3e/143edc043d0d25521847ba35b0dbc02a/pa/RR97759_1392321feee5b923360b75691addd91f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1ec2e98d-2a63-59b3-92a4-07d52ea7a15f/1ec2e98d-2a63-59b3-92a4-07d52ea7a15f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85282,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/3e/143edc043d0d25521847ba35b0dbc02a/pa/RR97759_9a6cc6e50a3123fe8d8447fe9f372676.jpg',
             'Width': 800}],
 'postal_code': '30300',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Gard',
 'province_code': 'FR-30',
 'region': 'Occitanie',
 'region_code': 'FR-76',
 'registration_date': '2010-11-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo S60 2.0 D4 Summum',
 'transmission': 'automatic',
 'trim': 'Summum',
 'year': 2010}
2026-04-27 08:06:12 [auto1.fr] INFO: Saving data for RR97759: {'created_time': 1777277172.436082, 'last_price_update_time': 1777277172.436095, 'has_photos': True, 'auction_closing_time': 1777391285.0}
2026-04-27 08:06:28 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.702(s), this was the 1st time calling it.
2026-04-27 08:06:28 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.176675073709209 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KY02364/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:06:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/41/fa41a81cf5db1951d5643e2591403562/pa/KL75694_5143dc77336d045a4b98e1c27d704d8d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b5b590>
2026-04-27 08:06:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3308c1b0-2410-5f92-8e87-9ef534df5fbc/3308c1b0-2410-5f92-8e87-9ef534df5fbc_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/41/fa41a81cf5db1951d5643e2591403562/pa/KL75694_5143dc77336d045a4b98e1c27d704d8d.jpg saved to cache
2026-04-27 08:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3308c1b0-2410-5f92-8e87-9ef534df5fbc
2026-04-27 08:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/41/fa41a81cf5db1951d5643e2591403562/pa/KL75694_218a5b3e804216752b82893ef79ce99e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:06:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438fb83d0>
2026-04-27 08:06:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3308c1b0-2410-5f92-8e87-9ef534df5fbc/3308c1b0-2410-5f92-8e87-9ef534df5fbc_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/41/fa41a81cf5db1951d5643e2591403562/pa/KL75694_218a5b3e804216752b82893ef79ce99e.jpg saved to cache
2026-04-27 08:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3308c1b0-2410-5f92-8e87-9ef534df5fbc
2026-04-27 08:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TR20925> (referer: https://www.auto1.com/v1/car-details-view/TR20925/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:06:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/05/550580bfbcf5b96bc7d80e0c0346bd49/pa/MB19012_50ec844930904c7d2cc7d998e0edb1cd.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 06654d21-a832-5b04-b659-c3ac6837bba8 with identifier: TR20925
2026-04-27 08:06:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06654d21-a832-5b04-b659-c3ac6837bba8 with scrape type 1
2026-04-27 08:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 06654d21-a832-5b04-b659-c3ac6837bba8
2026-04-27 08:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/1c/9e1c8076b115ec0deac4e0e0975aae77/pa/TR20925_6a19c76c9bebef6d28d34ad8a660a17a.jpg not downloaded yet
2026-04-27 08:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/1c/9e1c8076b115ec0deac4e0e0975aae77/pa/TR20925_37650594b980baed0954047e0f938a1d.jpg not downloaded yet
2026-04-27 08:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/1c/9e1c8076b115ec0deac4e0e0975aae77/pa/TR20925_bd3be39d596109a2094973b3b7b1ef98.jpg not downloaded yet
2026-04-27 08:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/1c/9e1c8076b115ec0deac4e0e0975aae77/pa/TR20925_9fa3114af4b19e7250299fd45af1e52d.jpg not downloaded yet
2026-04-27 08:06:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c296d0>
2026-04-27 08:06:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b2e2793-aa9c-51bc-ad0a-850dfdc8ef49/2b2e2793-aa9c-51bc-ad0a-850dfdc8ef49_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/05/550580bfbcf5b96bc7d80e0c0346bd49/pa/MB19012_50ec844930904c7d2cc7d998e0edb1cd.jpg saved to cache
2026-04-27 08:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2b2e2793-aa9c-51bc-ad0a-850dfdc8ef49
2026-04-27 08:06:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2b2e2793-aa9c-51bc-ad0a-850dfdc8ef49, skipping ID generation
2026-04-27 08:06:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b2e2793-aa9c-51bc-ad0a-850dfdc8ef49 with scrape type 1
2026-04-27 08:06:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2b2e2793-aa9c-51bc-ad0a-850dfdc8ef49 sending to next pipeline
2026-04-27 08:06:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2b2e2793-aa9c-51bc-ad0a-850dfdc8ef49, identifier: MB19012
2026-04-27 08:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/1c/9e1c8076b115ec0deac4e0e0975aae77/pa/TR20925_ab7383394bcfa58c359711411e9fc0fb.jpg not downloaded yet
2026-04-27 08:06:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2b2e2793-aa9c-51bc-ad0a-850dfdc8ef49 with identifier: MB19012
2026-04-27 08:06:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2b2e2793-aa9c-51bc-ad0a-850dfdc8ef49 with identifier: MB19012
2026-04-27 08:06:33 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:06:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2b2e2793-aa9c-51bc-ad0a-850dfdc8ef49 with identifier: MB19012 to the API
2026-04-27 08:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:06:34 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:06:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img55/05/550580bfbcf5b96bc7d80e0c0346bd49/pa/MB19012_50ec844930904c7d2cc7d998e0edb1cd.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': 'Taxi',
 'city': 'Boé',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-04-28T15:48:36Z',
 'fuel_type': 'diesel',
 'id': '2b2e2793-aa9c-51bc-ad0a-850dfdc8ef49',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 44.1602,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MB19012',
 'listing': 'auction',
 'location': 'FR, Boé',
 'location_confidence': 'geocoded',
 'longitude': 0.6281,
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 231051,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2b2e2793-aa9c-51bc-ad0a-850dfdc8ef49/2b2e2793-aa9c-51bc-ad0a-850dfdc8ef49_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87796,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/05/550580bfbcf5b96bc7d80e0c0346bd49/pa/MB19012_3f49e9125096bfb353f30a60e4c299fd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2b2e2793-aa9c-51bc-ad0a-850dfdc8ef49/2b2e2793-aa9c-51bc-ad0a-850dfdc8ef49_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91516,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/05/550580bfbcf5b96bc7d80e0c0346bd49/pa/MB19012_50ec844930904c7d2cc7d998e0edb1cd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2b2e2793-aa9c-51bc-ad0a-850dfdc8ef49/2b2e2793-aa9c-51bc-ad0a-850dfdc8ef49_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82671,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/05/550580bfbcf5b96bc7d80e0c0346bd49/pa/MB19012_de58128efcb012be2274d4bec617aabf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2b2e2793-aa9c-51bc-ad0a-850dfdc8ef49/2b2e2793-aa9c-51bc-ad0a-850dfdc8ef49_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72704,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/05/550580bfbcf5b96bc7d80e0c0346bd49/pa/MB19012_5ec141711717a67a630c4185f0dc838f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2b2e2793-aa9c-51bc-ad0a-850dfdc8ef49/2b2e2793-aa9c-51bc-ad0a-850dfdc8ef49_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81684,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/05/550580bfbcf5b96bc7d80e0c0346bd49/pa/MB19012_15351aa8fc68a9687178a081bbbdd801.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2b2e2793-aa9c-51bc-ad0a-850dfdc8ef49/2b2e2793-aa9c-51bc-ad0a-850dfdc8ef49_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85504,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/05/550580bfbcf5b96bc7d80e0c0346bd49/pa/MB19012_d301d6809aab34d5f97a3a53e5a06228.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2b2e2793-aa9c-51bc-ad0a-850dfdc8ef49/2b2e2793-aa9c-51bc-ad0a-850dfdc8ef49_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90374,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/05/550580bfbcf5b96bc7d80e0c0346bd49/pa/MB19012_a9ef17448ec2074ab7a92c34865e4d13.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2b2e2793-aa9c-51bc-ad0a-850dfdc8ef49/2b2e2793-aa9c-51bc-ad0a-850dfdc8ef49_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87148,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/05/550580bfbcf5b96bc7d80e0c0346bd49/pa/MB19012_e9ae2e626968354a88dfff5ddeb3c47c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2b2e2793-aa9c-51bc-ad0a-850dfdc8ef49/2b2e2793-aa9c-51bc-ad0a-850dfdc8ef49_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81670,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/05/550580bfbcf5b96bc7d80e0c0346bd49/pa/MB19012_de734e9acefd8b47919229ab24a56497.jpg',
             'Width': 800}],
 'postal_code': '47550',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Lot-et-Garonne',
 'province_code': 'FR-47',
 'region': 'Nouvelle-Aquitaine',
 'region_code': 'FR-75',
 'registration_date': '2022-05-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Superb 2.0 TDI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2022}
2026-04-27 08:06:34 [auto1.fr] INFO: Saving data for MB19012: {'created_time': 1777277194.11648, 'last_price_update_time': 1777277194.116492, 'has_photos': True, 'auction_closing_time': 1777391316.0}
2026-04-27 08:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/41/fa41a81cf5db1951d5643e2591403562/pa/KL75694_9740e0c4058585d471e97ff112943c6b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/1c/9e1c8076b115ec0deac4e0e0975aae77/pa/TR20925_8cbbc561b38289486dbdb50d97674b47.jpg not downloaded yet
2026-04-27 08:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/1c/9e1c8076b115ec0deac4e0e0975aae77/pa/TR20925_85511a9d1e8906ed34d47fae1802128e.jpg not downloaded yet
2026-04-27 08:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/1c/9e1c8076b115ec0deac4e0e0975aae77/pa/TR20925_51df7eabffa24945c0193e0a171ac378.jpg not downloaded yet
2026-04-27 08:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/1c/9e1c8076b115ec0deac4e0e0975aae77/pa/TR20925_3c902bfde06f2e6172966f2068d450c7.jpg not downloaded yet
2026-04-27 08:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/1c/9e1c8076b115ec0deac4e0e0975aae77/pa/TR20925_ad55654c5392ff9c7373a2f39edefaea.jpg not downloaded yet
2026-04-27 08:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142be19450>
2026-04-27 08:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3308c1b0-2410-5f92-8e87-9ef534df5fbc/3308c1b0-2410-5f92-8e87-9ef534df5fbc_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/41/fa41a81cf5db1951d5643e2591403562/pa/KL75694_9740e0c4058585d471e97ff112943c6b.jpg saved to cache
2026-04-27 08:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3308c1b0-2410-5f92-8e87-9ef534df5fbc
2026-04-27 08:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/1c/9e1c8076b115ec0deac4e0e0975aae77/pa/TR20925_ab7383394bcfa58c359711411e9fc0fb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c28650>
2026-04-27 08:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06654d21-a832-5b04-b659-c3ac6837bba8/06654d21-a832-5b04-b659-c3ac6837bba8_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/1c/9e1c8076b115ec0deac4e0e0975aae77/pa/TR20925_ab7383394bcfa58c359711411e9fc0fb.jpg saved to cache
2026-04-27 08:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 06654d21-a832-5b04-b659-c3ac6837bba8
2026-04-27 08:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/1c/9e1c8076b115ec0deac4e0e0975aae77/pa/TR20925_ad55654c5392ff9c7373a2f39edefaea.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/1c/9e1c8076b115ec0deac4e0e0975aae77/pa/TR20925_3c902bfde06f2e6172966f2068d450c7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d349d0>
2026-04-27 08:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06654d21-a832-5b04-b659-c3ac6837bba8/06654d21-a832-5b04-b659-c3ac6837bba8_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/1c/9e1c8076b115ec0deac4e0e0975aae77/pa/TR20925_ad55654c5392ff9c7373a2f39edefaea.jpg saved to cache
2026-04-27 08:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 06654d21-a832-5b04-b659-c3ac6837bba8
2026-04-27 08:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/1c/9e1c8076b115ec0deac4e0e0975aae77/pa/TR20925_51df7eabffa24945c0193e0a171ac378.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d83d50>
2026-04-27 08:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06654d21-a832-5b04-b659-c3ac6837bba8/06654d21-a832-5b04-b659-c3ac6837bba8_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/1c/9e1c8076b115ec0deac4e0e0975aae77/pa/TR20925_3c902bfde06f2e6172966f2068d450c7.jpg saved to cache
2026-04-27 08:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 06654d21-a832-5b04-b659-c3ac6837bba8
2026-04-27 08:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ae5990>
2026-04-27 08:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06654d21-a832-5b04-b659-c3ac6837bba8/06654d21-a832-5b04-b659-c3ac6837bba8_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/1c/9e1c8076b115ec0deac4e0e0975aae77/pa/TR20925_51df7eabffa24945c0193e0a171ac378.jpg saved to cache
2026-04-27 08:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 06654d21-a832-5b04-b659-c3ac6837bba8
2026-04-27 08:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/1c/9e1c8076b115ec0deac4e0e0975aae77/pa/TR20925_85511a9d1e8906ed34d47fae1802128e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438df9610>
2026-04-27 08:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06654d21-a832-5b04-b659-c3ac6837bba8/06654d21-a832-5b04-b659-c3ac6837bba8_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/1c/9e1c8076b115ec0deac4e0e0975aae77/pa/TR20925_85511a9d1e8906ed34d47fae1802128e.jpg saved to cache
2026-04-27 08:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 06654d21-a832-5b04-b659-c3ac6837bba8
2026-04-27 08:06:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/1c/9e1c8076b115ec0deac4e0e0975aae77/pa/TR20925_8cbbc561b38289486dbdb50d97674b47.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/1c/9e1c8076b115ec0deac4e0e0975aae77/pa/TR20925_9fa3114af4b19e7250299fd45af1e52d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142be19dd0>
2026-04-27 08:06:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06654d21-a832-5b04-b659-c3ac6837bba8/06654d21-a832-5b04-b659-c3ac6837bba8_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/1c/9e1c8076b115ec0deac4e0e0975aae77/pa/TR20925_8cbbc561b38289486dbdb50d97674b47.jpg saved to cache
2026-04-27 08:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 06654d21-a832-5b04-b659-c3ac6837bba8
2026-04-27 08:06:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142be19d90>
2026-04-27 08:06:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06654d21-a832-5b04-b659-c3ac6837bba8/06654d21-a832-5b04-b659-c3ac6837bba8_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/1c/9e1c8076b115ec0deac4e0e0975aae77/pa/TR20925_9fa3114af4b19e7250299fd45af1e52d.jpg saved to cache
2026-04-27 08:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 06654d21-a832-5b04-b659-c3ac6837bba8
2026-04-27 08:06:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/1c/9e1c8076b115ec0deac4e0e0975aae77/pa/TR20925_bd3be39d596109a2094973b3b7b1ef98.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/1c/9e1c8076b115ec0deac4e0e0975aae77/pa/TR20925_37650594b980baed0954047e0f938a1d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c2ac10>
2026-04-27 08:06:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06654d21-a832-5b04-b659-c3ac6837bba8/06654d21-a832-5b04-b659-c3ac6837bba8_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/1c/9e1c8076b115ec0deac4e0e0975aae77/pa/TR20925_bd3be39d596109a2094973b3b7b1ef98.jpg saved to cache
2026-04-27 08:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 06654d21-a832-5b04-b659-c3ac6837bba8
2026-04-27 08:06:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/1c/9e1c8076b115ec0deac4e0e0975aae77/pa/TR20925_6a19c76c9bebef6d28d34ad8a660a17a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c29090>
2026-04-27 08:06:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06654d21-a832-5b04-b659-c3ac6837bba8/06654d21-a832-5b04-b659-c3ac6837bba8_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/1c/9e1c8076b115ec0deac4e0e0975aae77/pa/TR20925_37650594b980baed0954047e0f938a1d.jpg saved to cache
2026-04-27 08:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 06654d21-a832-5b04-b659-c3ac6837bba8
2026-04-27 08:06:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/41/fa41a81cf5db1951d5643e2591403562/pa/KL75694_250380b321b8df4a05e173b9722cec7d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/63/4b6382b0303d74741db5398d8df031c7/pa/YR94758_454b430eb76582b19a7e46a061ac4630.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d35650>
2026-04-27 08:06:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06654d21-a832-5b04-b659-c3ac6837bba8/06654d21-a832-5b04-b659-c3ac6837bba8_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/1c/9e1c8076b115ec0deac4e0e0975aae77/pa/TR20925_6a19c76c9bebef6d28d34ad8a660a17a.jpg saved to cache
2026-04-27 08:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 06654d21-a832-5b04-b659-c3ac6837bba8
2026-04-27 08:06:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 06654d21-a832-5b04-b659-c3ac6837bba8, skipping ID generation
2026-04-27 08:06:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06654d21-a832-5b04-b659-c3ac6837bba8 with scrape type 1
2026-04-27 08:06:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 06654d21-a832-5b04-b659-c3ac6837bba8 sending to next pipeline
2026-04-27 08:06:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 06654d21-a832-5b04-b659-c3ac6837bba8, identifier: TR20925
2026-04-27 08:06:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 06654d21-a832-5b04-b659-c3ac6837bba8 with identifier: TR20925
2026-04-27 08:06:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 06654d21-a832-5b04-b659-c3ac6837bba8 with identifier: TR20925
2026-04-27 08:06:35 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:06:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 06654d21-a832-5b04-b659-c3ac6837bba8 with identifier: TR20925 to the API
2026-04-27 08:06:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:06:35 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:06:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img9e/1c/9e1c8076b115ec0deac4e0e0975aae77/pa/TR20925_6a19c76c9bebef6d28d34ad8a660a17a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'city': 'Le Havre',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 180,
 'expiration_date': '2026-04-28T15:59:31Z',
 'fuel_type': 'diesel',
 'id': '06654d21-a832-5b04-b659-c3ac6837bba8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 49.4935,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TR20925',
 'listing': 'auction',
 'location': 'FR, LE HAVRE',
 'location_confidence': 'geocoded',
 'longitude': 0.1079,
 'make': 'Citroen',
 'model': 'C5',
 'odometer': 172981,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_06654d21-a832-5b04-b659-c3ac6837bba8/06654d21-a832-5b04-b659-c3ac6837bba8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74548,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/1c/9e1c8076b115ec0deac4e0e0975aae77/pa/TR20925_6a19c76c9bebef6d28d34ad8a660a17a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_06654d21-a832-5b04-b659-c3ac6837bba8/06654d21-a832-5b04-b659-c3ac6837bba8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73778,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/1c/9e1c8076b115ec0deac4e0e0975aae77/pa/TR20925_37650594b980baed0954047e0f938a1d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_06654d21-a832-5b04-b659-c3ac6837bba8/06654d21-a832-5b04-b659-c3ac6837bba8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63256,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/1c/9e1c8076b115ec0deac4e0e0975aae77/pa/TR20925_bd3be39d596109a2094973b3b7b1ef98.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_06654d21-a832-5b04-b659-c3ac6837bba8/06654d21-a832-5b04-b659-c3ac6837bba8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55937,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/1c/9e1c8076b115ec0deac4e0e0975aae77/pa/TR20925_9fa3114af4b19e7250299fd45af1e52d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_06654d21-a832-5b04-b659-c3ac6837bba8/06654d21-a832-5b04-b659-c3ac6837bba8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57753,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/1c/9e1c8076b115ec0deac4e0e0975aae77/pa/TR20925_ab7383394bcfa58c359711411e9fc0fb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_06654d21-a832-5b04-b659-c3ac6837bba8/06654d21-a832-5b04-b659-c3ac6837bba8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64097,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/1c/9e1c8076b115ec0deac4e0e0975aae77/pa/TR20925_8cbbc561b38289486dbdb50d97674b47.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_06654d21-a832-5b04-b659-c3ac6837bba8/06654d21-a832-5b04-b659-c3ac6837bba8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56236,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/1c/9e1c8076b115ec0deac4e0e0975aae77/pa/TR20925_85511a9d1e8906ed34d47fae1802128e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_06654d21-a832-5b04-b659-c3ac6837bba8/06654d21-a832-5b04-b659-c3ac6837bba8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66402,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/1c/9e1c8076b115ec0deac4e0e0975aae77/pa/TR20925_51df7eabffa24945c0193e0a171ac378.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_06654d21-a832-5b04-b659-c3ac6837bba8/06654d21-a832-5b04-b659-c3ac6837bba8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58630,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/1c/9e1c8076b115ec0deac4e0e0975aae77/pa/TR20925_3c902bfde06f2e6172966f2068d450c7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_06654d21-a832-5b04-b659-c3ac6837bba8/06654d21-a832-5b04-b659-c3ac6837bba8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51341,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/1c/9e1c8076b115ec0deac4e0e0975aae77/pa/TR20925_ad55654c5392ff9c7373a2f39edefaea.jpg',
             'Width': 800}],
 'postal_code': '76050 CEDEX',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Seine-Maritime',
 'province_code': 'FR-76',
 'region': 'Normandie',
 'region_code': 'FR-28',
 'registration_date': '2016-01-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C5 2.0 Blue-HDi Exclusive',
 'transmission': 'automatic',
 'trim': 'Exclusive',
 'year': 2016}
2026-04-27 08:06:36 [auto1.fr] INFO: Saving data for TR20925: {'created_time': 1777277196.084186, 'last_price_update_time': 1777277196.084195, 'has_photos': True, 'auction_closing_time': 1777391971.0}
2026-04-27 08:06:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d83d90>
2026-04-27 08:06:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3308c1b0-2410-5f92-8e87-9ef534df5fbc/3308c1b0-2410-5f92-8e87-9ef534df5fbc_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/41/fa41a81cf5db1951d5643e2591403562/pa/KL75694_250380b321b8df4a05e173b9722cec7d.jpg saved to cache
2026-04-27 08:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3308c1b0-2410-5f92-8e87-9ef534df5fbc
2026-04-27 08:06:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d33d90>
2026-04-27 08:06:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5b47128-234d-5bd3-8080-5a370901ab37/a5b47128-234d-5bd3-8080-5a370901ab37_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/63/4b6382b0303d74741db5398d8df031c7/pa/YR94758_454b430eb76582b19a7e46a061ac4630.jpg saved to cache
2026-04-27 08:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a5b47128-234d-5bd3-8080-5a370901ab37
2026-04-27 08:06:40 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.031(s), this was the 1st time calling it.
2026-04-27 08:06:40 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.00466550768512 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:06:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:06:59 [scrapy.extensions.logstats] INFO: Crawled 442 pages (at 5 pages/min), scraped 395 items (at 8 items/min)
2026-04-27 08:06:59 [scrapy.extensions.memusage] INFO: Peak memory usage is 373MiB
2026-04-27 08:07:07 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.270(s), this was the 1st time calling it.
2026-04-27 08:07:07 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.888862687722748 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:07:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:07:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UV73863/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:07:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:07:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/9e/199eac146c3dc1752d32d51222853629/pa/KW37033_528145b3400474799acbc8a5bc42d81b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143812d210>
2026-04-27 08:07:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79bc9b0d-db94-501e-b2dd-b8a4bd20f020/79bc9b0d-db94-501e-b2dd-b8a4bd20f020_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/9e/199eac146c3dc1752d32d51222853629/pa/KW37033_528145b3400474799acbc8a5bc42d81b.jpg saved to cache
2026-04-27 08:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 79bc9b0d-db94-501e-b2dd-b8a4bd20f020
2026-04-27 08:07:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/0b/7f0b7088b40dafe183a8447898e229dd/pa/LS92623_ed70938ddddfd4349cf90dc9d65c2bb7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bf19090>
2026-04-27 08:07:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ede6990a-e7dd-5a03-ae54-44ec0c621440/ede6990a-e7dd-5a03-ae54-44ec0c621440_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/0b/7f0b7088b40dafe183a8447898e229dd/pa/LS92623_ed70938ddddfd4349cf90dc9d65c2bb7.jpg saved to cache
2026-04-27 08:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ede6990a-e7dd-5a03-ae54-44ec0c621440
2026-04-27 08:07:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SV53673> (referer: https://www.auto1.com/v1/car-details-view/SV53673/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:07:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:07:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2af2d6c-b715-532f-b244-c0a9ca16a056 with identifier: SV53673
2026-04-27 08:07:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2af2d6c-b715-532f-b244-c0a9ca16a056 with scrape type 1
2026-04-27 08:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c2af2d6c-b715-532f-b244-c0a9ca16a056
2026-04-27 08:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/9a/ca9a0e89dab404964221d56b3eed85f3/pa/SV53673_c8d7860c24f2a6cc4513ef120ed5eb7d.jpg not downloaded yet
2026-04-27 08:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/9a/ca9a0e89dab404964221d56b3eed85f3/pa/SV53673_44554d07c9d9b4c79f973e2b5a3d99fc.jpg not downloaded yet
2026-04-27 08:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/9a/ca9a0e89dab404964221d56b3eed85f3/pa/SV53673_6ff35c7c49a0681fc5004ba942413384.jpg not downloaded yet
2026-04-27 08:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/9a/ca9a0e89dab404964221d56b3eed85f3/pa/SV53673_047e7b0c401c1af675469a025173bf42.jpg not downloaded yet
2026-04-27 08:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/9a/ca9a0e89dab404964221d56b3eed85f3/pa/SV53673_5ae9ae38bd6b16cf527b01be53a874ff.jpg not downloaded yet
2026-04-27 08:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/9a/ca9a0e89dab404964221d56b3eed85f3/pa/SV53673_5b39bea059be1c27b824f81b2c265785.jpg not downloaded yet
2026-04-27 08:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/9a/ca9a0e89dab404964221d56b3eed85f3/pa/SV53673_d8754980592f6d5f31baa8a760cd57f4.jpg not downloaded yet
2026-04-27 08:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/9a/ca9a0e89dab404964221d56b3eed85f3/pa/SV53673_232777f0b9533412d8629ec3944fbb97.jpg not downloaded yet
2026-04-27 08:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/9a/ca9a0e89dab404964221d56b3eed85f3/pa/SV53673_6c505859d1bcf4669f8a050fa37acea9.jpg not downloaded yet
2026-04-27 08:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/9a/ca9a0e89dab404964221d56b3eed85f3/pa/SV53673_17cf1a5a6f5fd409ec48a7d74d0a7330.jpg not downloaded yet
2026-04-27 08:07:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PP18123/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:07:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:07:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/9a/ca9a0e89dab404964221d56b3eed85f3/pa/SV53673_17cf1a5a6f5fd409ec48a7d74d0a7330.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438079790>
2026-04-27 08:07:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2af2d6c-b715-532f-b244-c0a9ca16a056/c2af2d6c-b715-532f-b244-c0a9ca16a056_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/9a/ca9a0e89dab404964221d56b3eed85f3/pa/SV53673_17cf1a5a6f5fd409ec48a7d74d0a7330.jpg saved to cache
2026-04-27 08:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c2af2d6c-b715-532f-b244-c0a9ca16a056
2026-04-27 08:07:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KH97076/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:07:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:07:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/9a/ca9a0e89dab404964221d56b3eed85f3/pa/SV53673_6c505859d1bcf4669f8a050fa37acea9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438cabdd0>
2026-04-27 08:07:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2af2d6c-b715-532f-b244-c0a9ca16a056/c2af2d6c-b715-532f-b244-c0a9ca16a056_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/9a/ca9a0e89dab404964221d56b3eed85f3/pa/SV53673_6c505859d1bcf4669f8a050fa37acea9.jpg saved to cache
2026-04-27 08:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c2af2d6c-b715-532f-b244-c0a9ca16a056
2026-04-27 08:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PA01531> (referer: https://www.auto1.com/v1/car-details-view/PA01531/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:07:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:07:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb286b39-0711-549a-a598-b08b24480457 with identifier: PA01531
2026-04-27 08:07:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb286b39-0711-549a-a598-b08b24480457 with scrape type 1
2026-04-27 08:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cb286b39-0711-549a-a598-b08b24480457
2026-04-27 08:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/26/66269808e85ae321697fe9435ce11427/pa/PA01531_5efeb350bc0fcdc6c9f6a8e6d275852e.jpg not downloaded yet
2026-04-27 08:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/26/66269808e85ae321697fe9435ce11427/pa/PA01531_0a64663af6315f5931fcc9bd217949ae.jpg not downloaded yet
2026-04-27 08:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/26/66269808e85ae321697fe9435ce11427/pa/PA01531_89503c1a4b59989a782e3ea28d9668ca.jpg not downloaded yet
2026-04-27 08:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/26/66269808e85ae321697fe9435ce11427/pa/PA01531_42225493b654fe5694f892b7a9c3a465.jpg not downloaded yet
2026-04-27 08:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/26/66269808e85ae321697fe9435ce11427/pa/PA01531_338616cd87f856356cc96d5607905be8.jpg not downloaded yet
2026-04-27 08:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/9a/ca9a0e89dab404964221d56b3eed85f3/pa/SV53673_232777f0b9533412d8629ec3944fbb97.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/26/66269808e85ae321697fe9435ce11427/pa/PA01531_8d63dec22c418402af1a79e03bc18233.jpg not downloaded yet
2026-04-27 08:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/26/66269808e85ae321697fe9435ce11427/pa/PA01531_20d59ccf5744b852488889de1a30ea3a.jpg not downloaded yet
2026-04-27 08:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/26/66269808e85ae321697fe9435ce11427/pa/PA01531_b27b51c99044bca80ed9edc4427a0c82.jpg not downloaded yet
2026-04-27 08:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/26/66269808e85ae321697fe9435ce11427/pa/PA01531_7fbbac1e89c21da4808f6e2b7ae91b51.jpg not downloaded yet
2026-04-27 08:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/26/66269808e85ae321697fe9435ce11427/pa/PA01531_13849a9c3dab2e1d9937c3e7cec51200.jpg not downloaded yet
2026-04-27 08:07:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ae5f90>
2026-04-27 08:07:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2af2d6c-b715-532f-b244-c0a9ca16a056/c2af2d6c-b715-532f-b244-c0a9ca16a056_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/9a/ca9a0e89dab404964221d56b3eed85f3/pa/SV53673_232777f0b9533412d8629ec3944fbb97.jpg saved to cache
2026-04-27 08:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c2af2d6c-b715-532f-b244-c0a9ca16a056
2026-04-27 08:07:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/26/66269808e85ae321697fe9435ce11427/pa/PA01531_338616cd87f856356cc96d5607905be8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143809dc10>
2026-04-27 08:07:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb286b39-0711-549a-a598-b08b24480457/cb286b39-0711-549a-a598-b08b24480457_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/26/66269808e85ae321697fe9435ce11427/pa/PA01531_338616cd87f856356cc96d5607905be8.jpg saved to cache
2026-04-27 08:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cb286b39-0711-549a-a598-b08b24480457
2026-04-27 08:07:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/26/66269808e85ae321697fe9435ce11427/pa/PA01531_13849a9c3dab2e1d9937c3e7cec51200.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142be1aed0>
2026-04-27 08:07:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb286b39-0711-549a-a598-b08b24480457/cb286b39-0711-549a-a598-b08b24480457_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/26/66269808e85ae321697fe9435ce11427/pa/PA01531_13849a9c3dab2e1d9937c3e7cec51200.jpg saved to cache
2026-04-27 08:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cb286b39-0711-549a-a598-b08b24480457
2026-04-27 08:07:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/26/66269808e85ae321697fe9435ce11427/pa/PA01531_7fbbac1e89c21da4808f6e2b7ae91b51.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1439c46250>
2026-04-27 08:07:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb286b39-0711-549a-a598-b08b24480457/cb286b39-0711-549a-a598-b08b24480457_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/26/66269808e85ae321697fe9435ce11427/pa/PA01531_7fbbac1e89c21da4808f6e2b7ae91b51.jpg saved to cache
2026-04-27 08:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cb286b39-0711-549a-a598-b08b24480457
2026-04-27 08:07:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/26/66269808e85ae321697fe9435ce11427/pa/PA01531_b27b51c99044bca80ed9edc4427a0c82.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143805d450>
2026-04-27 08:07:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb286b39-0711-549a-a598-b08b24480457/cb286b39-0711-549a-a598-b08b24480457_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/26/66269808e85ae321697fe9435ce11427/pa/PA01531_b27b51c99044bca80ed9edc4427a0c82.jpg saved to cache
2026-04-27 08:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cb286b39-0711-549a-a598-b08b24480457
2026-04-27 08:07:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/26/66269808e85ae321697fe9435ce11427/pa/PA01531_20d59ccf5744b852488889de1a30ea3a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438077350>
2026-04-27 08:07:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb286b39-0711-549a-a598-b08b24480457/cb286b39-0711-549a-a598-b08b24480457_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/26/66269808e85ae321697fe9435ce11427/pa/PA01531_20d59ccf5744b852488889de1a30ea3a.jpg saved to cache
2026-04-27 08:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cb286b39-0711-549a-a598-b08b24480457
2026-04-27 08:07:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/26/66269808e85ae321697fe9435ce11427/pa/PA01531_8d63dec22c418402af1a79e03bc18233.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/26/66269808e85ae321697fe9435ce11427/pa/PA01531_42225493b654fe5694f892b7a9c3a465.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142be18fd0>
2026-04-27 08:07:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb286b39-0711-549a-a598-b08b24480457/cb286b39-0711-549a-a598-b08b24480457_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/26/66269808e85ae321697fe9435ce11427/pa/PA01531_8d63dec22c418402af1a79e03bc18233.jpg saved to cache
2026-04-27 08:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cb286b39-0711-549a-a598-b08b24480457
2026-04-27 08:07:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bf1b7d0>
2026-04-27 08:07:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb286b39-0711-549a-a598-b08b24480457/cb286b39-0711-549a-a598-b08b24480457_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/26/66269808e85ae321697fe9435ce11427/pa/PA01531_42225493b654fe5694f892b7a9c3a465.jpg saved to cache
2026-04-27 08:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cb286b39-0711-549a-a598-b08b24480457
2026-04-27 08:07:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/26/66269808e85ae321697fe9435ce11427/pa/PA01531_89503c1a4b59989a782e3ea28d9668ca.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SU63674/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:07:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:07:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/26/66269808e85ae321697fe9435ce11427/pa/PA01531_5efeb350bc0fcdc6c9f6a8e6d275852e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438135210>
2026-04-27 08:07:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb286b39-0711-549a-a598-b08b24480457/cb286b39-0711-549a-a598-b08b24480457_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/26/66269808e85ae321697fe9435ce11427/pa/PA01531_89503c1a4b59989a782e3ea28d9668ca.jpg saved to cache
2026-04-27 08:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cb286b39-0711-549a-a598-b08b24480457
2026-04-27 08:07:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/26/66269808e85ae321697fe9435ce11427/pa/PA01531_0a64663af6315f5931fcc9bd217949ae.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438dcb610>
2026-04-27 08:07:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb286b39-0711-549a-a598-b08b24480457/cb286b39-0711-549a-a598-b08b24480457_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/26/66269808e85ae321697fe9435ce11427/pa/PA01531_5efeb350bc0fcdc6c9f6a8e6d275852e.jpg saved to cache
2026-04-27 08:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cb286b39-0711-549a-a598-b08b24480457
2026-04-27 08:07:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142be19e50>
2026-04-27 08:07:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb286b39-0711-549a-a598-b08b24480457/cb286b39-0711-549a-a598-b08b24480457_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/26/66269808e85ae321697fe9435ce11427/pa/PA01531_0a64663af6315f5931fcc9bd217949ae.jpg saved to cache
2026-04-27 08:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cb286b39-0711-549a-a598-b08b24480457
2026-04-27 08:07:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cb286b39-0711-549a-a598-b08b24480457, skipping ID generation
2026-04-27 08:07:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb286b39-0711-549a-a598-b08b24480457 with scrape type 1
2026-04-27 08:07:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cb286b39-0711-549a-a598-b08b24480457 sending to next pipeline
2026-04-27 08:07:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: cb286b39-0711-549a-a598-b08b24480457, identifier: PA01531
2026-04-27 08:07:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: cb286b39-0711-549a-a598-b08b24480457 with identifier: PA01531
2026-04-27 08:07:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: cb286b39-0711-549a-a598-b08b24480457 with identifier: PA01531
2026-04-27 08:07:44 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:07:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: cb286b39-0711-549a-a598-b08b24480457 with identifier: PA01531 to the API
2026-04-27 08:07:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:07:44 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:07:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img66/26/66269808e85ae321697fe9435ce11427/pa/PA01531_0a64663af6315f5931fcc9bd217949ae.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'category': None,
 'city': 'Beaucaire',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 115,
 'expiration_date': '2026-04-28T15:46:32Z',
 'fuel_type': 'diesel',
 'id': 'cb286b39-0711-549a-a598-b08b24480457',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 43.8081,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PA01531',
 'listing': 'auction',
 'location': 'FR, Beaucaire',
 'location_confidence': 'geocoded',
 'longitude': 4.6442,
 'make': 'BMW',
 'model': '2er',
 'odometer': 180032,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cb286b39-0711-549a-a598-b08b24480457/cb286b39-0711-549a-a598-b08b24480457_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59433,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/26/66269808e85ae321697fe9435ce11427/pa/PA01531_5efeb350bc0fcdc6c9f6a8e6d275852e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cb286b39-0711-549a-a598-b08b24480457/cb286b39-0711-549a-a598-b08b24480457_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59373,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/26/66269808e85ae321697fe9435ce11427/pa/PA01531_0a64663af6315f5931fcc9bd217949ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cb286b39-0711-549a-a598-b08b24480457/cb286b39-0711-549a-a598-b08b24480457_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62798,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/26/66269808e85ae321697fe9435ce11427/pa/PA01531_89503c1a4b59989a782e3ea28d9668ca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cb286b39-0711-549a-a598-b08b24480457/cb286b39-0711-549a-a598-b08b24480457_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59200,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/26/66269808e85ae321697fe9435ce11427/pa/PA01531_42225493b654fe5694f892b7a9c3a465.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cb286b39-0711-549a-a598-b08b24480457/cb286b39-0711-549a-a598-b08b24480457_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55642,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/26/66269808e85ae321697fe9435ce11427/pa/PA01531_338616cd87f856356cc96d5607905be8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cb286b39-0711-549a-a598-b08b24480457/cb286b39-0711-549a-a598-b08b24480457_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47046,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/26/66269808e85ae321697fe9435ce11427/pa/PA01531_8d63dec22c418402af1a79e03bc18233.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cb286b39-0711-549a-a598-b08b24480457/cb286b39-0711-549a-a598-b08b24480457_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54576,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/26/66269808e85ae321697fe9435ce11427/pa/PA01531_20d59ccf5744b852488889de1a30ea3a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cb286b39-0711-549a-a598-b08b24480457/cb286b39-0711-549a-a598-b08b24480457_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98405,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/26/66269808e85ae321697fe9435ce11427/pa/PA01531_b27b51c99044bca80ed9edc4427a0c82.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cb286b39-0711-549a-a598-b08b24480457/cb286b39-0711-549a-a598-b08b24480457_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88320,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/26/66269808e85ae321697fe9435ce11427/pa/PA01531_7fbbac1e89c21da4808f6e2b7ae91b51.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cb286b39-0711-549a-a598-b08b24480457/cb286b39-0711-549a-a598-b08b24480457_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63048,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/26/66269808e85ae321697fe9435ce11427/pa/PA01531_13849a9c3dab2e1d9937c3e7cec51200.jpg',
             'Width': 800}],
 'postal_code': '30300',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Gard',
 'province_code': 'FR-30',
 'region': 'Occitanie',
 'region_code': 'FR-76',
 'registration_date': '2015-08-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 2er 216d Active Tourer Business',
 'transmission': 'manual',
 'trim': 'Business',
 'year': 2015}
2026-04-27 08:07:44 [auto1.fr] INFO: Saving data for PA01531: {'created_time': 1777277264.425987, 'last_price_update_time': 1777277264.425995, 'has_photos': True, 'auction_closing_time': 1777391192.0}
2026-04-27 08:07:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/9a/ca9a0e89dab404964221d56b3eed85f3/pa/SV53673_d8754980592f6d5f31baa8a760cd57f4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/9a/ca9a0e89dab404964221d56b3eed85f3/pa/SV53673_5b39bea059be1c27b824f81b2c265785.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c56050>
2026-04-27 08:07:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2af2d6c-b715-532f-b244-c0a9ca16a056/c2af2d6c-b715-532f-b244-c0a9ca16a056_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/9a/ca9a0e89dab404964221d56b3eed85f3/pa/SV53673_d8754980592f6d5f31baa8a760cd57f4.jpg saved to cache
2026-04-27 08:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c2af2d6c-b715-532f-b244-c0a9ca16a056
2026-04-27 08:07:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142be050d0>
2026-04-27 08:07:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2af2d6c-b715-532f-b244-c0a9ca16a056/c2af2d6c-b715-532f-b244-c0a9ca16a056_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/9a/ca9a0e89dab404964221d56b3eed85f3/pa/SV53673_5b39bea059be1c27b824f81b2c265785.jpg saved to cache
2026-04-27 08:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c2af2d6c-b715-532f-b244-c0a9ca16a056
2026-04-27 08:07:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/9a/ca9a0e89dab404964221d56b3eed85f3/pa/SV53673_5ae9ae38bd6b16cf527b01be53a874ff.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380bcfd0>
2026-04-27 08:07:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2af2d6c-b715-532f-b244-c0a9ca16a056/c2af2d6c-b715-532f-b244-c0a9ca16a056_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/9a/ca9a0e89dab404964221d56b3eed85f3/pa/SV53673_5ae9ae38bd6b16cf527b01be53a874ff.jpg saved to cache
2026-04-27 08:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c2af2d6c-b715-532f-b244-c0a9ca16a056
2026-04-27 08:07:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/9a/ca9a0e89dab404964221d56b3eed85f3/pa/SV53673_047e7b0c401c1af675469a025173bf42.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143809ead0>
2026-04-27 08:07:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2af2d6c-b715-532f-b244-c0a9ca16a056/c2af2d6c-b715-532f-b244-c0a9ca16a056_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/9a/ca9a0e89dab404964221d56b3eed85f3/pa/SV53673_047e7b0c401c1af675469a025173bf42.jpg saved to cache
2026-04-27 08:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c2af2d6c-b715-532f-b244-c0a9ca16a056
2026-04-27 08:07:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/9a/ca9a0e89dab404964221d56b3eed85f3/pa/SV53673_6ff35c7c49a0681fc5004ba942413384.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438adedd0>
2026-04-27 08:07:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2af2d6c-b715-532f-b244-c0a9ca16a056/c2af2d6c-b715-532f-b244-c0a9ca16a056_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/9a/ca9a0e89dab404964221d56b3eed85f3/pa/SV53673_6ff35c7c49a0681fc5004ba942413384.jpg saved to cache
2026-04-27 08:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c2af2d6c-b715-532f-b244-c0a9ca16a056
2026-04-27 08:07:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/9a/ca9a0e89dab404964221d56b3eed85f3/pa/SV53673_44554d07c9d9b4c79f973e2b5a3d99fc.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/9a/ca9a0e89dab404964221d56b3eed85f3/pa/SV53673_c8d7860c24f2a6cc4513ef120ed5eb7d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/63/4b6382b0303d74741db5398d8df031c7/pa/YR94758_7f038c6dc0519935b79515196a3c7570.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bfd0b90>
2026-04-27 08:07:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2af2d6c-b715-532f-b244-c0a9ca16a056/c2af2d6c-b715-532f-b244-c0a9ca16a056_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/9a/ca9a0e89dab404964221d56b3eed85f3/pa/SV53673_44554d07c9d9b4c79f973e2b5a3d99fc.jpg saved to cache
2026-04-27 08:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c2af2d6c-b715-532f-b244-c0a9ca16a056
2026-04-27 08:07:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/41/fa41a81cf5db1951d5643e2591403562/pa/KL75694_17b07b2658d56655850d90fb2e398b69.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438adfdd0>
2026-04-27 08:07:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2af2d6c-b715-532f-b244-c0a9ca16a056/c2af2d6c-b715-532f-b244-c0a9ca16a056_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/9a/ca9a0e89dab404964221d56b3eed85f3/pa/SV53673_c8d7860c24f2a6cc4513ef120ed5eb7d.jpg saved to cache
2026-04-27 08:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c2af2d6c-b715-532f-b244-c0a9ca16a056
2026-04-27 08:07:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c2af2d6c-b715-532f-b244-c0a9ca16a056, skipping ID generation
2026-04-27 08:07:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2af2d6c-b715-532f-b244-c0a9ca16a056 with scrape type 1
2026-04-27 08:07:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c2af2d6c-b715-532f-b244-c0a9ca16a056 sending to next pipeline
2026-04-27 08:07:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c2af2d6c-b715-532f-b244-c0a9ca16a056, identifier: SV53673
2026-04-27 08:07:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c2af2d6c-b715-532f-b244-c0a9ca16a056 with identifier: SV53673
2026-04-27 08:07:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c2af2d6c-b715-532f-b244-c0a9ca16a056 with identifier: SV53673
2026-04-27 08:07:45 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:07:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c2af2d6c-b715-532f-b244-c0a9ca16a056 with identifier: SV53673 to the API
2026-04-27 08:07:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:07:45 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:07:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgca/9a/ca9a0e89dab404964221d56b3eed85f3/pa/SV53673_c8d7860c24f2a6cc4513ef120ed5eb7d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 148,
 'category': None,
 'city': 'Nanteuil-le-Haudouin',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2026-04-28T15:28:27Z',
 'fuel_type': 'petrol',
 'id': 'c2af2d6c-b715-532f-b244-c0a9ca16a056',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 49.1408,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV53673',
 'listing': 'auction',
 'location': 'FR, Nanteuil-le-Haudouin',
 'location_confidence': 'geocoded',
 'longitude': 2.8114,
 'make': 'Citroen',
 'model': 'C5 Aircross',
 'odometer': 38236,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c2af2d6c-b715-532f-b244-c0a9ca16a056/c2af2d6c-b715-532f-b244-c0a9ca16a056_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67537,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/9a/ca9a0e89dab404964221d56b3eed85f3/pa/SV53673_c8d7860c24f2a6cc4513ef120ed5eb7d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c2af2d6c-b715-532f-b244-c0a9ca16a056/c2af2d6c-b715-532f-b244-c0a9ca16a056_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67024,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/9a/ca9a0e89dab404964221d56b3eed85f3/pa/SV53673_44554d07c9d9b4c79f973e2b5a3d99fc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c2af2d6c-b715-532f-b244-c0a9ca16a056/c2af2d6c-b715-532f-b244-c0a9ca16a056_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67451,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/9a/ca9a0e89dab404964221d56b3eed85f3/pa/SV53673_6ff35c7c49a0681fc5004ba942413384.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c2af2d6c-b715-532f-b244-c0a9ca16a056/c2af2d6c-b715-532f-b244-c0a9ca16a056_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57414,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/9a/ca9a0e89dab404964221d56b3eed85f3/pa/SV53673_047e7b0c401c1af675469a025173bf42.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c2af2d6c-b715-532f-b244-c0a9ca16a056/c2af2d6c-b715-532f-b244-c0a9ca16a056_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65883,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/9a/ca9a0e89dab404964221d56b3eed85f3/pa/SV53673_5ae9ae38bd6b16cf527b01be53a874ff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c2af2d6c-b715-532f-b244-c0a9ca16a056/c2af2d6c-b715-532f-b244-c0a9ca16a056_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69068,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/9a/ca9a0e89dab404964221d56b3eed85f3/pa/SV53673_5b39bea059be1c27b824f81b2c265785.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c2af2d6c-b715-532f-b244-c0a9ca16a056/c2af2d6c-b715-532f-b244-c0a9ca16a056_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56055,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/9a/ca9a0e89dab404964221d56b3eed85f3/pa/SV53673_d8754980592f6d5f31baa8a760cd57f4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c2af2d6c-b715-532f-b244-c0a9ca16a056/c2af2d6c-b715-532f-b244-c0a9ca16a056_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66141,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/9a/ca9a0e89dab404964221d56b3eed85f3/pa/SV53673_232777f0b9533412d8629ec3944fbb97.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c2af2d6c-b715-532f-b244-c0a9ca16a056/c2af2d6c-b715-532f-b244-c0a9ca16a056_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62581,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/9a/ca9a0e89dab404964221d56b3eed85f3/pa/SV53673_6c505859d1bcf4669f8a050fa37acea9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c2af2d6c-b715-532f-b244-c0a9ca16a056/c2af2d6c-b715-532f-b244-c0a9ca16a056_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 7720,
             'Height': 112,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/9a/ca9a0e89dab404964221d56b3eed85f3/pa/SV53673_17cf1a5a6f5fd409ec48a7d74d0a7330.jpg',
             'Width': 282}],
 'postal_code': '60440',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Oise',
 'province_code': 'FR-60',
 'region': 'Hauts-de-France',
 'region_code': 'FR-32',
 'registration_date': '2023-04-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C5 Aircross 1.2 PureTech Feel Pack',
 'transmission': 'automatic',
 'trim': 'Feel Pack',
 'year': 2023}
2026-04-27 08:07:45 [auto1.fr] INFO: Saving data for SV53673: {'created_time': 1777277265.77039, 'last_price_update_time': 1777277265.770403, 'has_photos': True, 'auction_closing_time': 1777390107.0}
2026-04-27 08:07:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/63/4b6382b0303d74741db5398d8df031c7/pa/YR94758_f2d23306f107d54137cdebfc6a900e91.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KX23637/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:07:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:07:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bfba250>
2026-04-27 08:07:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5b47128-234d-5bd3-8080-5a370901ab37/a5b47128-234d-5bd3-8080-5a370901ab37_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/63/4b6382b0303d74741db5398d8df031c7/pa/YR94758_7f038c6dc0519935b79515196a3c7570.jpg saved to cache
2026-04-27 08:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a5b47128-234d-5bd3-8080-5a370901ab37
2026-04-27 08:07:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438e00ed0>
2026-04-27 08:07:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3308c1b0-2410-5f92-8e87-9ef534df5fbc/3308c1b0-2410-5f92-8e87-9ef534df5fbc_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/41/fa41a81cf5db1951d5643e2591403562/pa/KL75694_17b07b2658d56655850d90fb2e398b69.jpg saved to cache
2026-04-27 08:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3308c1b0-2410-5f92-8e87-9ef534df5fbc
2026-04-27 08:07:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3308c1b0-2410-5f92-8e87-9ef534df5fbc, skipping ID generation
2026-04-27 08:07:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3308c1b0-2410-5f92-8e87-9ef534df5fbc with scrape type 1
2026-04-27 08:07:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3308c1b0-2410-5f92-8e87-9ef534df5fbc sending to next pipeline
2026-04-27 08:07:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3308c1b0-2410-5f92-8e87-9ef534df5fbc, identifier: KL75694
2026-04-27 08:07:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3308c1b0-2410-5f92-8e87-9ef534df5fbc with identifier: KL75694
2026-04-27 08:07:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3308c1b0-2410-5f92-8e87-9ef534df5fbc with identifier: KL75694
2026-04-27 08:07:46 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:07:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 3308c1b0-2410-5f92-8e87-9ef534df5fbc with identifier: KL75694 to the API
2026-04-27 08:07:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:07:46 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:07:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgfa/41/fa41a81cf5db1951d5643e2591403562/pa/KL75694_17b07b2658d56655850d90fb2e398b69.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 182,
 'category': None,
 'city': 'Marckolsheim',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 320,
 'expiration_date': '2026-04-28T15:36:27Z',
 'fuel_type': 'petrol',
 'id': '3308c1b0-2410-5f92-8e87-9ef534df5fbc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.1647,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KL75694',
 'listing': 'auction',
 'location': 'FR, Marckolsheim',
 'location_confidence': 'geocoded',
 'longitude': 7.544,
 'make': 'BMW',
 'model': '1er',
 'odometer': 123142,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3308c1b0-2410-5f92-8e87-9ef534df5fbc/3308c1b0-2410-5f92-8e87-9ef534df5fbc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103198,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/41/fa41a81cf5db1951d5643e2591403562/pa/KL75694_17b07b2658d56655850d90fb2e398b69.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3308c1b0-2410-5f92-8e87-9ef534df5fbc/3308c1b0-2410-5f92-8e87-9ef534df5fbc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102737,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/41/fa41a81cf5db1951d5643e2591403562/pa/KL75694_cf362788e911b9414cc8e9dd18a2802a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3308c1b0-2410-5f92-8e87-9ef534df5fbc/3308c1b0-2410-5f92-8e87-9ef534df5fbc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96247,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/41/fa41a81cf5db1951d5643e2591403562/pa/KL75694_234c3dd17b23431f06719537b47c104d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3308c1b0-2410-5f92-8e87-9ef534df5fbc/3308c1b0-2410-5f92-8e87-9ef534df5fbc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95943,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/41/fa41a81cf5db1951d5643e2591403562/pa/KL75694_250380b321b8df4a05e173b9722cec7d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3308c1b0-2410-5f92-8e87-9ef534df5fbc/3308c1b0-2410-5f92-8e87-9ef534df5fbc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98909,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/41/fa41a81cf5db1951d5643e2591403562/pa/KL75694_9740e0c4058585d471e97ff112943c6b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3308c1b0-2410-5f92-8e87-9ef534df5fbc/3308c1b0-2410-5f92-8e87-9ef534df5fbc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98828,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/41/fa41a81cf5db1951d5643e2591403562/pa/KL75694_218a5b3e804216752b82893ef79ce99e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3308c1b0-2410-5f92-8e87-9ef534df5fbc/3308c1b0-2410-5f92-8e87-9ef534df5fbc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102643,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/41/fa41a81cf5db1951d5643e2591403562/pa/KL75694_5143dc77336d045a4b98e1c27d704d8d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3308c1b0-2410-5f92-8e87-9ef534df5fbc/3308c1b0-2410-5f92-8e87-9ef534df5fbc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96515,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/41/fa41a81cf5db1951d5643e2591403562/pa/KL75694_f715a1bfdfde57cffcea206b1a813cf7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3308c1b0-2410-5f92-8e87-9ef534df5fbc/3308c1b0-2410-5f92-8e87-9ef534df5fbc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89396,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/41/fa41a81cf5db1951d5643e2591403562/pa/KL75694_fc9cb734eabffc4455846f981979ce47.jpg',
             'Width': 800}],
 'postal_code': '67390',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Bas-Rhin',
 'province_code': 'FR-67',
 'region': 'Grand Est',
 'region_code': 'FR-44',
 'registration_date': '2013-10-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er M135i xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2013}
2026-04-27 08:07:46 [auto1.fr] INFO: Saving data for KL75694: {'created_time': 1777277266.302114, 'last_price_update_time': 1777277266.302123, 'has_photos': True, 'auction_closing_time': 1777390587.0}
2026-04-27 08:07:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b5a010>
2026-04-27 08:07:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5b47128-234d-5bd3-8080-5a370901ab37/a5b47128-234d-5bd3-8080-5a370901ab37_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/63/4b6382b0303d74741db5398d8df031c7/pa/YR94758_f2d23306f107d54137cdebfc6a900e91.jpg saved to cache
2026-04-27 08:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a5b47128-234d-5bd3-8080-5a370901ab37
2026-04-27 08:07:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a5b47128-234d-5bd3-8080-5a370901ab37, skipping ID generation
2026-04-27 08:07:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5b47128-234d-5bd3-8080-5a370901ab37 with scrape type 1
2026-04-27 08:07:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a5b47128-234d-5bd3-8080-5a370901ab37 sending to next pipeline
2026-04-27 08:07:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a5b47128-234d-5bd3-8080-5a370901ab37, identifier: YR94758
2026-04-27 08:07:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a5b47128-234d-5bd3-8080-5a370901ab37 with identifier: YR94758
2026-04-27 08:07:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a5b47128-234d-5bd3-8080-5a370901ab37 with identifier: YR94758
2026-04-27 08:07:46 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:07:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a5b47128-234d-5bd3-8080-5a370901ab37 with identifier: YR94758 to the API
2026-04-27 08:07:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:07:46 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:07:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4b/63/4b6382b0303d74741db5398d8df031c7/pa/YR94758_f2d23306f107d54137cdebfc6a900e91.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'city': 'Marly-la-Ville',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO N\\/A',
 'engine': '2.1L',
 'engine_horse_power': 110,
 'expiration_date': '2026-04-28T15:00:04Z',
 'fuel_type': 'diesel',
 'id': 'a5b47128-234d-5bd3-8080-5a370901ab37',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 49.082,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YR94758',
 'listing': 'auction',
 'location': 'FR, Marly-la-ville',
 'location_confidence': 'geocoded',
 'longitude': 2.5035,
 'make': 'Citroen',
 'model': 'XM',
 'odometer': 228475,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a5b47128-234d-5bd3-8080-5a370901ab37/a5b47128-234d-5bd3-8080-5a370901ab37_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104951,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/63/4b6382b0303d74741db5398d8df031c7/pa/YR94758_fb5f11ae37a34f737272638e9d8b91c4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a5b47128-234d-5bd3-8080-5a370901ab37/a5b47128-234d-5bd3-8080-5a370901ab37_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113893,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/63/4b6382b0303d74741db5398d8df031c7/pa/YR94758_f2d23306f107d54137cdebfc6a900e91.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a5b47128-234d-5bd3-8080-5a370901ab37/a5b47128-234d-5bd3-8080-5a370901ab37_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89972,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/63/4b6382b0303d74741db5398d8df031c7/pa/YR94758_7f038c6dc0519935b79515196a3c7570.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a5b47128-234d-5bd3-8080-5a370901ab37/a5b47128-234d-5bd3-8080-5a370901ab37_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88024,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/63/4b6382b0303d74741db5398d8df031c7/pa/YR94758_813aacf801dcf52b715aec5775737e44.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a5b47128-234d-5bd3-8080-5a370901ab37/a5b47128-234d-5bd3-8080-5a370901ab37_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70529,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/63/4b6382b0303d74741db5398d8df031c7/pa/YR94758_454b430eb76582b19a7e46a061ac4630.jpg',
             'Width': 800}],
 'postal_code': '95670',
 'price': 0,
 'price_includes_vat': True,
 'province': "Val-d'Oise",
 'province_code': 'FR-95',
 'region': 'Île-de-France',
 'region_code': 'FR-11',
 'registration_date': '1994-08-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen XM 2.1 Turbodiesel TD SX',
 'transmission': 'manual',
 'trim': 'TD SX',
 'year': 1994}
2026-04-27 08:07:46 [auto1.fr] INFO: Saving data for YR94758: {'created_time': 1777277266.730574, 'last_price_update_time': 1777277266.730584, 'has_photos': True, 'auction_closing_time': 1777388404.0}
2026-04-27 08:07:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/9e/199eac146c3dc1752d32d51222853629/pa/KW37033_04eab17ffc66303213de09d1d4b4bfe2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/0b/7f0b7088b40dafe183a8447898e229dd/pa/LS92623_f0d64d739d69380b9dada13b49164c87.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d31e10>
2026-04-27 08:07:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79bc9b0d-db94-501e-b2dd-b8a4bd20f020/79bc9b0d-db94-501e-b2dd-b8a4bd20f020_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/9e/199eac146c3dc1752d32d51222853629/pa/KW37033_04eab17ffc66303213de09d1d4b4bfe2.jpg saved to cache
2026-04-27 08:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 79bc9b0d-db94-501e-b2dd-b8a4bd20f020
2026-04-27 08:07:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c2ca90>
2026-04-27 08:07:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ede6990a-e7dd-5a03-ae54-44ec0c621440/ede6990a-e7dd-5a03-ae54-44ec0c621440_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/0b/7f0b7088b40dafe183a8447898e229dd/pa/LS92623_f0d64d739d69380b9dada13b49164c87.jpg saved to cache
2026-04-27 08:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ede6990a-e7dd-5a03-ae54-44ec0c621440
2026-04-27 08:07:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KY02364> (referer: https://www.auto1.com/v1/car-details-view/KY02364/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:07:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:07:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 663ea528-ac0c-5b48-be07-6d076f0ec3b8 with identifier: KY02364
2026-04-27 08:07:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 663ea528-ac0c-5b48-be07-6d076f0ec3b8 with scrape type 1
2026-04-27 08:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 663ea528-ac0c-5b48-be07-6d076f0ec3b8
2026-04-27 08:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/b9/8bb9fd125e9b8bac3545b44e540ac7e1/pa/KY02364_51bd97a22ee0b932ab4314d93f49b2bf.jpg not downloaded yet
2026-04-27 08:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/b9/8bb9fd125e9b8bac3545b44e540ac7e1/pa/KY02364_350f71fef067296b885936d1514c6c8c.jpg not downloaded yet
2026-04-27 08:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/b9/8bb9fd125e9b8bac3545b44e540ac7e1/pa/KY02364_dc4c167c1e2c3c94290b5f5c4fcbc013.jpg not downloaded yet
2026-04-27 08:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/b9/8bb9fd125e9b8bac3545b44e540ac7e1/pa/KY02364_a859e6b7219105959384fd41de527f74.jpg not downloaded yet
2026-04-27 08:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/b9/8bb9fd125e9b8bac3545b44e540ac7e1/pa/KY02364_e17ebe7be9bbdad9da2e998576162d2e.jpg not downloaded yet
2026-04-27 08:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/b9/8bb9fd125e9b8bac3545b44e540ac7e1/pa/KY02364_ede00433bee8cd9667a55cd0f5554394.jpg not downloaded yet
2026-04-27 08:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/0b/7f0b7088b40dafe183a8447898e229dd/pa/LS92623_9e30f4e0492f6f838bcd58af126cde3f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438fbf9d0>
2026-04-27 08:07:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ede6990a-e7dd-5a03-ae54-44ec0c621440/ede6990a-e7dd-5a03-ae54-44ec0c621440_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/0b/7f0b7088b40dafe183a8447898e229dd/pa/LS92623_9e30f4e0492f6f838bcd58af126cde3f.jpg saved to cache
2026-04-27 08:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ede6990a-e7dd-5a03-ae54-44ec0c621440
2026-04-27 08:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/b9/8bb9fd125e9b8bac3545b44e540ac7e1/pa/KY02364_ede00433bee8cd9667a55cd0f5554394.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/b9/8bb9fd125e9b8bac3545b44e540ac7e1/pa/KY02364_e17ebe7be9bbdad9da2e998576162d2e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b5b7d0>
2026-04-27 08:07:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_663ea528-ac0c-5b48-be07-6d076f0ec3b8/663ea528-ac0c-5b48-be07-6d076f0ec3b8_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/b9/8bb9fd125e9b8bac3545b44e540ac7e1/pa/KY02364_ede00433bee8cd9667a55cd0f5554394.jpg saved to cache
2026-04-27 08:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 663ea528-ac0c-5b48-be07-6d076f0ec3b8
2026-04-27 08:07:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438135e10>
2026-04-27 08:07:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_663ea528-ac0c-5b48-be07-6d076f0ec3b8/663ea528-ac0c-5b48-be07-6d076f0ec3b8_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/b9/8bb9fd125e9b8bac3545b44e540ac7e1/pa/KY02364_e17ebe7be9bbdad9da2e998576162d2e.jpg saved to cache
2026-04-27 08:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 663ea528-ac0c-5b48-be07-6d076f0ec3b8
2026-04-27 08:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/b9/8bb9fd125e9b8bac3545b44e540ac7e1/pa/KY02364_a859e6b7219105959384fd41de527f74.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/b9/8bb9fd125e9b8bac3545b44e540ac7e1/pa/KY02364_dc4c167c1e2c3c94290b5f5c4fcbc013.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/b9/8bb9fd125e9b8bac3545b44e540ac7e1/pa/KY02364_350f71fef067296b885936d1514c6c8c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c2bb10>
2026-04-27 08:07:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_663ea528-ac0c-5b48-be07-6d076f0ec3b8/663ea528-ac0c-5b48-be07-6d076f0ec3b8_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/b9/8bb9fd125e9b8bac3545b44e540ac7e1/pa/KY02364_a859e6b7219105959384fd41de527f74.jpg saved to cache
2026-04-27 08:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 663ea528-ac0c-5b48-be07-6d076f0ec3b8
2026-04-27 08:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/b9/8bb9fd125e9b8bac3545b44e540ac7e1/pa/KY02364_51bd97a22ee0b932ab4314d93f49b2bf.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b58450>
2026-04-27 08:07:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_663ea528-ac0c-5b48-be07-6d076f0ec3b8/663ea528-ac0c-5b48-be07-6d076f0ec3b8_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/b9/8bb9fd125e9b8bac3545b44e540ac7e1/pa/KY02364_dc4c167c1e2c3c94290b5f5c4fcbc013.jpg saved to cache
2026-04-27 08:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 663ea528-ac0c-5b48-be07-6d076f0ec3b8
2026-04-27 08:07:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bf1bdd0>
2026-04-27 08:07:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_663ea528-ac0c-5b48-be07-6d076f0ec3b8/663ea528-ac0c-5b48-be07-6d076f0ec3b8_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/b9/8bb9fd125e9b8bac3545b44e540ac7e1/pa/KY02364_350f71fef067296b885936d1514c6c8c.jpg saved to cache
2026-04-27 08:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 663ea528-ac0c-5b48-be07-6d076f0ec3b8
2026-04-27 08:07:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d61a90>
2026-04-27 08:07:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_663ea528-ac0c-5b48-be07-6d076f0ec3b8/663ea528-ac0c-5b48-be07-6d076f0ec3b8_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/b9/8bb9fd125e9b8bac3545b44e540ac7e1/pa/KY02364_51bd97a22ee0b932ab4314d93f49b2bf.jpg saved to cache
2026-04-27 08:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 663ea528-ac0c-5b48-be07-6d076f0ec3b8
2026-04-27 08:07:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 663ea528-ac0c-5b48-be07-6d076f0ec3b8, skipping ID generation
2026-04-27 08:07:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 663ea528-ac0c-5b48-be07-6d076f0ec3b8 with scrape type 1
2026-04-27 08:07:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 663ea528-ac0c-5b48-be07-6d076f0ec3b8 sending to next pipeline
2026-04-27 08:07:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 663ea528-ac0c-5b48-be07-6d076f0ec3b8, identifier: KY02364
2026-04-27 08:07:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 663ea528-ac0c-5b48-be07-6d076f0ec3b8 with identifier: KY02364
2026-04-27 08:07:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 663ea528-ac0c-5b48-be07-6d076f0ec3b8 with identifier: KY02364
2026-04-27 08:07:48 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:07:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 663ea528-ac0c-5b48-be07-6d076f0ec3b8 with identifier: KY02364 to the API
2026-04-27 08:07:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:07:49 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:07:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8b/b9/8bb9fd125e9b8bac3545b44e540ac7e1/pa/KY02364_51bd97a22ee0b932ab4314d93f49b2bf.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'category': None,
 'city': 'Marly-la-Ville',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 110,
 'expiration_date': '2026-04-28T15:09:12Z',
 'fuel_type': 'diesel',
 'id': '663ea528-ac0c-5b48-be07-6d076f0ec3b8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 49.082,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KY02364',
 'listing': 'auction',
 'location': 'FR, Marly-la-ville',
 'location_confidence': 'geocoded',
 'longitude': 2.5035,
 'make': 'Peugeot',
 'model': '308',
 'odometer': 241400,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_663ea528-ac0c-5b48-be07-6d076f0ec3b8/663ea528-ac0c-5b48-be07-6d076f0ec3b8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104060,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/b9/8bb9fd125e9b8bac3545b44e540ac7e1/pa/KY02364_51bd97a22ee0b932ab4314d93f49b2bf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_663ea528-ac0c-5b48-be07-6d076f0ec3b8/663ea528-ac0c-5b48-be07-6d076f0ec3b8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110813,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/b9/8bb9fd125e9b8bac3545b44e540ac7e1/pa/KY02364_350f71fef067296b885936d1514c6c8c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_663ea528-ac0c-5b48-be07-6d076f0ec3b8/663ea528-ac0c-5b48-be07-6d076f0ec3b8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76022,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/b9/8bb9fd125e9b8bac3545b44e540ac7e1/pa/KY02364_dc4c167c1e2c3c94290b5f5c4fcbc013.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_663ea528-ac0c-5b48-be07-6d076f0ec3b8/663ea528-ac0c-5b48-be07-6d076f0ec3b8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89754,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/b9/8bb9fd125e9b8bac3545b44e540ac7e1/pa/KY02364_a859e6b7219105959384fd41de527f74.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_663ea528-ac0c-5b48-be07-6d076f0ec3b8/663ea528-ac0c-5b48-be07-6d076f0ec3b8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104849,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/b9/8bb9fd125e9b8bac3545b44e540ac7e1/pa/KY02364_e17ebe7be9bbdad9da2e998576162d2e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_663ea528-ac0c-5b48-be07-6d076f0ec3b8/663ea528-ac0c-5b48-be07-6d076f0ec3b8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65575,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/b9/8bb9fd125e9b8bac3545b44e540ac7e1/pa/KY02364_ede00433bee8cd9667a55cd0f5554394.jpg',
             'Width': 800}],
 'postal_code': '95670',
 'price': 0,
 'price_includes_vat': True,
 'province': "Val-d'Oise",
 'province_code': 'FR-95',
 'region': 'Île-de-France',
 'region_code': 'FR-11',
 'registration_date': '2013-04-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 308 1.6 HDi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2013}
2026-04-27 08:07:49 [auto1.fr] INFO: Saving data for KY02364: {'created_time': 1777277269.165157, 'last_price_update_time': 1777277269.165168, 'has_photos': True, 'auction_closing_time': 1777388952.0}
2026-04-27 08:07:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NK86276/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:07:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:07:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/41/2c415368711ab116d78e566182b5f5a6/pa/VR99778_378ddca60853e00ea9b450454df0d6d4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bf18810>
2026-04-27 08:07:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a249b8d-4f61-54a2-8efa-c3005989791a/7a249b8d-4f61-54a2-8efa-c3005989791a_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/41/2c415368711ab116d78e566182b5f5a6/pa/VR99778_378ddca60853e00ea9b450454df0d6d4.jpg saved to cache
2026-04-27 08:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7a249b8d-4f61-54a2-8efa-c3005989791a
2026-04-27 08:07:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:07:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:07:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/9e/199eac146c3dc1752d32d51222853629/pa/KW37033_f61eac9a924117c79bfad98740620e2e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:53 [auto1.fr] INFO: Channel: 24h | Page: 16 | totalHits: 4770 | hits on page: 40
2026-04-27 08:07:53 [auto1.fr] INFO: Found listing with ID: HS91891
2026-04-27 08:07:53 [auto1.fr] INFO: Scrape type for HS91891: 0
2026-04-27 08:07:53 [auto1.fr] INFO: Found listing with ID: GT31591
2026-04-27 08:07:53 [auto1.fr] INFO: Scrape type for GT31591: 0
2026-04-27 08:07:53 [auto1.fr] INFO: Found listing with ID: LK58488
2026-04-27 08:07:53 [auto1.fr] INFO: Scrape type for LK58488: 0
2026-04-27 08:07:53 [auto1.fr] INFO: Found listing with ID: MZ95816
2026-04-27 08:07:53 [auto1.fr] INFO: Scrape type for MZ95816: 0
2026-04-27 08:07:53 [auto1.fr] INFO: Found listing with ID: RH31827
2026-04-27 08:07:53 [auto1.fr] INFO: Scrape type for RH31827: 0
2026-04-27 08:07:53 [auto1.fr] INFO: Found listing with ID: MS72274
2026-04-27 08:07:53 [auto1.fr] INFO: Scrape type for MS72274: 0
2026-04-27 08:07:53 [auto1.fr] INFO: Found listing with ID: RY45034
2026-04-27 08:07:53 [auto1.fr] INFO: Scrape type for RY45034: 0
2026-04-27 08:07:53 [auto1.fr] INFO: Found listing with ID: SK64553
2026-04-27 08:07:53 [auto1.fr] INFO: Scrape type for SK64553: 0
2026-04-27 08:07:53 [auto1.fr] INFO: Found listing with ID: CM53599
2026-04-27 08:07:53 [auto1.fr] INFO: Scrape type for CM53599: 0
2026-04-27 08:07:53 [auto1.fr] INFO: Found listing with ID: CZ28253
2026-04-27 08:07:53 [auto1.fr] INFO: Scrape type for CZ28253: 0
2026-04-27 08:07:53 [auto1.fr] INFO: Found listing with ID: JN01057
2026-04-27 08:07:53 [auto1.fr] INFO: Scrape type for JN01057: 0
2026-04-27 08:07:53 [auto1.fr] INFO: Found listing with ID: UM47720
2026-04-27 08:07:53 [auto1.fr] INFO: Scrape type for UM47720: 0
2026-04-27 08:07:53 [auto1.fr] INFO: Found listing with ID: TX81047
2026-04-27 08:07:53 [auto1.fr] INFO: Scrape type for TX81047: 0
2026-04-27 08:07:53 [auto1.fr] INFO: Found listing with ID: XD98518
2026-04-27 08:07:53 [auto1.fr] INFO: Found listing with ID: NL98546
2026-04-27 08:07:53 [auto1.fr] INFO: Scrape type for NL98546: 0
2026-04-27 08:07:53 [auto1.fr] INFO: Found listing with ID: FC31311
2026-04-27 08:07:53 [auto1.fr] INFO: Scrape type for FC31311: 0
2026-04-27 08:07:53 [auto1.fr] INFO: Found listing with ID: WA76064
2026-04-27 08:07:53 [auto1.fr] INFO: Scrape type for WA76064: 0
2026-04-27 08:07:53 [auto1.fr] INFO: Found listing with ID: CU11970
2026-04-27 08:07:53 [auto1.fr] INFO: Scrape type for CU11970: 0
2026-04-27 08:07:53 [auto1.fr] INFO: Found listing with ID: PF14495
2026-04-27 08:07:53 [auto1.fr] INFO: Scrape type for PF14495: 0
2026-04-27 08:07:53 [auto1.fr] INFO: Found listing with ID: WH37826
2026-04-27 08:07:53 [auto1.fr] INFO: Scrape type for WH37826: 0
2026-04-27 08:07:53 [auto1.fr] INFO: Found listing with ID: HD20644
2026-04-27 08:07:53 [auto1.fr] INFO: Scrape type for HD20644: 0
2026-04-27 08:07:53 [auto1.fr] INFO: Found listing with ID: BD67804
2026-04-27 08:07:53 [auto1.fr] INFO: Scrape type for BD67804: 0
2026-04-27 08:07:53 [auto1.fr] INFO: Found listing with ID: ZK42332
2026-04-27 08:07:53 [auto1.fr] INFO: Scrape type for ZK42332: 0
2026-04-27 08:07:53 [auto1.fr] INFO: Found listing with ID: AV43022
2026-04-27 08:07:53 [auto1.fr] INFO: Scrape type for AV43022: 1
2026-04-27 08:07:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c29690>
2026-04-27 08:07:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79bc9b0d-db94-501e-b2dd-b8a4bd20f020/79bc9b0d-db94-501e-b2dd-b8a4bd20f020_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/9e/199eac146c3dc1752d32d51222853629/pa/KW37033_f61eac9a924117c79bfad98740620e2e.jpg saved to cache
2026-04-27 08:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 79bc9b0d-db94-501e-b2dd-b8a4bd20f020
2026-04-27 08:07:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 79bc9b0d-db94-501e-b2dd-b8a4bd20f020, skipping ID generation
2026-04-27 08:07:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79bc9b0d-db94-501e-b2dd-b8a4bd20f020 with scrape type 1
2026-04-27 08:07:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 79bc9b0d-db94-501e-b2dd-b8a4bd20f020 sending to next pipeline
2026-04-27 08:07:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 79bc9b0d-db94-501e-b2dd-b8a4bd20f020, identifier: KW37033
2026-04-27 08:07:54 [auto1.fr] INFO: Found listing with ID: BX84969
2026-04-27 08:07:54 [auto1.fr] INFO: Scrape type for BX84969: 2
2026-04-27 08:07:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19b007e8-bada-5713-87a8-d293faa0063d with identifier: BX84969
2026-04-27 08:07:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19b007e8-bada-5713-87a8-d293faa0063d with scrape type 2
2026-04-27 08:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 19b007e8-bada-5713-87a8-d293faa0063d with scrape type 2
2026-04-27 08:07:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 19b007e8-bada-5713-87a8-d293faa0063d, identifier: BX84969
2026-04-27 08:07:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 79bc9b0d-db94-501e-b2dd-b8a4bd20f020 with identifier: KW37033
2026-04-27 08:07:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 79bc9b0d-db94-501e-b2dd-b8a4bd20f020 with identifier: KW37033
2026-04-27 08:07:54 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:07:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 79bc9b0d-db94-501e-b2dd-b8a4bd20f020 with identifier: KW37033 to the API
2026-04-27 08:07:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:07:54 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:07:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img19/9e/199eac146c3dc1752d32d51222853629/pa/KW37033_f61eac9a924117c79bfad98740620e2e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'category': None,
 'city': 'Allennes-les-Marais',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 135,
 'expiration_date': '2026-04-28T15:49:27Z',
 'fuel_type': 'diesel',
 'id': '79bc9b0d-db94-501e-b2dd-b8a4bd20f020',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 50.5375,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KW37033',
 'listing': 'auction',
 'location': 'FR, Allennes-les-Marais',
 'location_confidence': 'geocoded',
 'longitude': 2.9536,
 'make': 'Peugeot',
 'model': '607',
 'odometer': 285009,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_79bc9b0d-db94-501e-b2dd-b8a4bd20f020/79bc9b0d-db94-501e-b2dd-b8a4bd20f020_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77932,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/9e/199eac146c3dc1752d32d51222853629/pa/KW37033_f61eac9a924117c79bfad98740620e2e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_79bc9b0d-db94-501e-b2dd-b8a4bd20f020/79bc9b0d-db94-501e-b2dd-b8a4bd20f020_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80577,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/9e/199eac146c3dc1752d32d51222853629/pa/KW37033_715b06e5466d68cf0a744d574be9cef6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_79bc9b0d-db94-501e-b2dd-b8a4bd20f020/79bc9b0d-db94-501e-b2dd-b8a4bd20f020_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73227,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/9e/199eac146c3dc1752d32d51222853629/pa/KW37033_04eab17ffc66303213de09d1d4b4bfe2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_79bc9b0d-db94-501e-b2dd-b8a4bd20f020/79bc9b0d-db94-501e-b2dd-b8a4bd20f020_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79171,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/9e/199eac146c3dc1752d32d51222853629/pa/KW37033_4d6e8e8d18b6288fd5918be5319e64fb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_79bc9b0d-db94-501e-b2dd-b8a4bd20f020/79bc9b0d-db94-501e-b2dd-b8a4bd20f020_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110869,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/9e/199eac146c3dc1752d32d51222853629/pa/KW37033_6ea5f890aec12032587e9f2f988dcaae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_79bc9b0d-db94-501e-b2dd-b8a4bd20f020/79bc9b0d-db94-501e-b2dd-b8a4bd20f020_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60985,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/9e/199eac146c3dc1752d32d51222853629/pa/KW37033_528145b3400474799acbc8a5bc42d81b.jpg',
             'Width': 800}],
 'postal_code': '59251',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Nord',
 'province_code': 'FR-59',
 'region': 'Hauts-de-France',
 'region_code': 'FR-32',
 'registration_date': '2010-09-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 607 2.0 HDi Sport Pack',
 'transmission': 'manual',
 'trim': 'Sport Pack',
 'year': 2010}
2026-04-27 08:07:54 [auto1.fr] INFO: Saving data for KW37033: {'created_time': 1777277274.52518, 'last_price_update_time': 1777277274.525197, 'has_photos': True, 'auction_closing_time': 1777391367.0}
2026-04-27 08:07:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 19b007e8-bada-5713-87a8-d293faa0063d with identifier: BX84969
2026-04-27 08:07:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 19b007e8-bada-5713-87a8-d293faa0063d with identifier: BX84969
2026-04-27 08:07:54 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:07:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 19b007e8-bada-5713-87a8-d293faa0063d with identifier: BX84969 to the API
2026-04-27 08:07:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:07:54 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:07:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 313,
 'expiration_date': '2026-04-28T15:03:54Z',
 'fuel_type': 'diesel',
 'id': '19b007e8-bada-5713-87a8-d293faa0063d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BX84969',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'BMW',
 'model': 'X6',
 'odometer': 150398,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2015-09-24',
 'seller_name': None,
 'title': 'BMW X6 xDrive 40d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-04-27 08:07:54 [auto1.fr] INFO: Saving data for BX84969: {'auction_closing_time': 1777388634.0, 'created_time': 1777022274.703965, 'has_photos': True, 'last_price_update_time': 1777277274.936013}
2026-04-27 08:07:54 [auto1.fr] INFO: Found listing with ID: BH32555
2026-04-27 08:07:54 [auto1.fr] INFO: Scrape type for BH32555: 1
2026-04-27 08:07:54 [auto1.fr] INFO: Found listing with ID: WT38074
2026-04-27 08:07:54 [auto1.fr] INFO: Scrape type for WT38074: 2
2026-04-27 08:07:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa2059e5-790e-5e3b-829c-1dd4f7ddff68 with identifier: WT38074
2026-04-27 08:07:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa2059e5-790e-5e3b-829c-1dd4f7ddff68 with scrape type 2
2026-04-27 08:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aa2059e5-790e-5e3b-829c-1dd4f7ddff68 with scrape type 2
2026-04-27 08:07:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: aa2059e5-790e-5e3b-829c-1dd4f7ddff68, identifier: WT38074
2026-04-27 08:07:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: aa2059e5-790e-5e3b-829c-1dd4f7ddff68 with identifier: WT38074
2026-04-27 08:07:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: aa2059e5-790e-5e3b-829c-1dd4f7ddff68 with identifier: WT38074
2026-04-27 08:07:55 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:07:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: aa2059e5-790e-5e3b-829c-1dd4f7ddff68 with identifier: WT38074 to the API
2026-04-27 08:07:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:07:55 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:07:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-04-28T15:02:51Z',
 'fuel_type': 'petrol',
 'id': 'aa2059e5-790e-5e3b-829c-1dd4f7ddff68',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WT38074',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Citroen',
 'model': 'C3 Aircross',
 'odometer': 111069,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2019-12-29',
 'seller_name': None,
 'title': 'Citroen C3 Aircross 1.2 PureTech Shine',
 'transmission': 'automatic',
 'trim': 'Shine',
 'year': 2019}
2026-04-27 08:07:55 [auto1.fr] INFO: Saving data for WT38074: {'auction_closing_time': 1777388571.0, 'created_time': 1777022568.113272, 'has_photos': True, 'last_price_update_time': 1777277275.396008}
2026-04-27 08:07:55 [auto1.fr] INFO: Found listing with ID: CS36824
2026-04-27 08:07:55 [auto1.fr] INFO: Scrape type for CS36824: 2
2026-04-27 08:07:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 838ca73a-6fda-567d-aa9a-c0fef27c020f with identifier: CS36824
2026-04-27 08:07:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 838ca73a-6fda-567d-aa9a-c0fef27c020f with scrape type 2
2026-04-27 08:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 838ca73a-6fda-567d-aa9a-c0fef27c020f with scrape type 2
2026-04-27 08:07:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 838ca73a-6fda-567d-aa9a-c0fef27c020f, identifier: CS36824
2026-04-27 08:07:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 838ca73a-6fda-567d-aa9a-c0fef27c020f with identifier: CS36824
2026-04-27 08:07:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 838ca73a-6fda-567d-aa9a-c0fef27c020f with identifier: CS36824
2026-04-27 08:07:55 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:07:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 838ca73a-6fda-567d-aa9a-c0fef27c020f with identifier: CS36824 to the API
2026-04-27 08:07:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:07:55 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:07:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-04-28T15:10:50Z',
 'fuel_type': 'petrol',
 'id': '838ca73a-6fda-567d-aa9a-c0fef27c020f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CS36824',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 173309,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2010-07-19',
 'seller_name': None,
 'title': 'Renault Clio 1.2 Expression Clim',
 'transmission': 'manual',
 'trim': 'Expression Clim',
 'year': 2010}
2026-04-27 08:07:55 [auto1.fr] INFO: Saving data for CS36824: {'auction_closing_time': 1777389050.0, 'created_time': 1777019356.47701, 'has_photos': True, 'last_price_update_time': 1777277275.795499}
2026-04-27 08:07:55 [auto1.fr] INFO: Found listing with ID: LZ28528
2026-04-27 08:07:55 [auto1.fr] INFO: Scrape type for LZ28528: 1
2026-04-27 08:07:55 [auto1.fr] INFO: Found listing with ID: CF38557
2026-04-27 08:07:55 [auto1.fr] INFO: Scrape type for CF38557: 2
2026-04-27 08:07:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 291ab2dc-90a3-5e84-9286-1baff9610ffe with identifier: CF38557
2026-04-27 08:07:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 291ab2dc-90a3-5e84-9286-1baff9610ffe with scrape type 2
2026-04-27 08:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 291ab2dc-90a3-5e84-9286-1baff9610ffe with scrape type 2
2026-04-27 08:07:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 291ab2dc-90a3-5e84-9286-1baff9610ffe, identifier: CF38557
2026-04-27 08:07:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 291ab2dc-90a3-5e84-9286-1baff9610ffe with identifier: CF38557
2026-04-27 08:07:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 291ab2dc-90a3-5e84-9286-1baff9610ffe with identifier: CF38557
2026-04-27 08:07:56 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:07:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 291ab2dc-90a3-5e84-9286-1baff9610ffe with identifier: CF38557 to the API
2026-04-27 08:07:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:07:56 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:07:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 510,
 'expiration_date': '2026-04-28T15:32:14Z',
 'fuel_type': 'petrol',
 'id': '291ab2dc-90a3-5e84-9286-1baff9610ffe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CF38557',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Land Rover',
 'model': 'Range Rover Sport',
 'odometer': 109039,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2015-10-01',
 'seller_name': None,
 'title': 'Land Rover Range Rover Sport 5.0 V8 HSE Dynamic',
 'transmission': 'automatic',
 'trim': 'HSE Dynamic',
 'year': 2015}
2026-04-27 08:07:56 [auto1.fr] INFO: Saving data for CF38557: {'auction_closing_time': 1777390334.0, 'created_time': 1777022188.449764, 'has_photos': True, 'last_price_update_time': 1777277276.239503}
2026-04-27 08:07:56 [auto1.fr] INFO: Found listing with ID: BB29544
2026-04-27 08:07:56 [auto1.fr] INFO: Scrape type for BB29544: 2
2026-04-27 08:07:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e0c7c97e-85f6-5893-9955-b72aeb0cfd8b with identifier: BB29544
2026-04-27 08:07:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0c7c97e-85f6-5893-9955-b72aeb0cfd8b with scrape type 2
2026-04-27 08:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e0c7c97e-85f6-5893-9955-b72aeb0cfd8b with scrape type 2
2026-04-27 08:07:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e0c7c97e-85f6-5893-9955-b72aeb0cfd8b, identifier: BB29544
2026-04-27 08:07:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e0c7c97e-85f6-5893-9955-b72aeb0cfd8b with identifier: BB29544
2026-04-27 08:07:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e0c7c97e-85f6-5893-9955-b72aeb0cfd8b with identifier: BB29544
2026-04-27 08:07:56 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:07:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e0c7c97e-85f6-5893-9955-b72aeb0cfd8b with identifier: BB29544 to the API
2026-04-27 08:07:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:07:56 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:07:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-04-28T15:34:50Z',
 'fuel_type': 'diesel',
 'id': 'e0c7c97e-85f6-5893-9955-b72aeb0cfd8b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BB29544',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Opel',
 'model': 'Zafira',
 'odometer': 254298,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2008-12-28',
 'seller_name': None,
 'title': 'Opel Zafira 1.7 CDTI Design',
 'transmission': 'manual',
 'trim': 'Design',
 'year': 2008}
2026-04-27 08:07:56 [auto1.fr] INFO: Saving data for BB29544: {'auction_closing_time': 1777390490.0, 'created_time': 1777021493.485063, 'has_photos': True, 'last_price_update_time': 1777277276.637446}
2026-04-27 08:07:56 [auto1.fr] INFO: Found listing with ID: UC15316
2026-04-27 08:07:56 [auto1.fr] INFO: Scrape type for UC15316: 1
2026-04-27 08:07:56 [auto1.fr] INFO: Found listing with ID: PB06449
2026-04-27 08:07:56 [auto1.fr] INFO: Scrape type for PB06449: 2
2026-04-27 08:07:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 652edafe-b8f6-5879-a807-f08e1d88b24b with identifier: PB06449
2026-04-27 08:07:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 652edafe-b8f6-5879-a807-f08e1d88b24b with scrape type 2
2026-04-27 08:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 652edafe-b8f6-5879-a807-f08e1d88b24b with scrape type 2
2026-04-27 08:07:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 652edafe-b8f6-5879-a807-f08e1d88b24b, identifier: PB06449
2026-04-27 08:07:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 652edafe-b8f6-5879-a807-f08e1d88b24b with identifier: PB06449
2026-04-27 08:07:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 652edafe-b8f6-5879-a807-f08e1d88b24b with identifier: PB06449
2026-04-27 08:07:56 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:07:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 652edafe-b8f6-5879-a807-f08e1d88b24b with identifier: PB06449 to the API
2026-04-27 08:07:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:07:56 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:07:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-04-28T15:27:31Z',
 'fuel_type': 'petrol',
 'id': '652edafe-b8f6-5879-a807-f08e1d88b24b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PB06449',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 143532,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2017-06-27',
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Crossway',
 'transmission': 'automatic',
 'trim': 'Crossway',
 'year': 2017}
2026-04-27 08:07:57 [auto1.fr] INFO: Saving data for PB06449: {'auction_closing_time': 1777390051.0, 'created_time': 1777022685.764464, 'has_photos': True, 'last_price_update_time': 1777277277.04369}
2026-04-27 08:07:57 [auto1.fr] INFO: Found listing with ID: ZD48015
2026-04-27 08:07:57 [auto1.fr] INFO: Scrape type for ZD48015: 1
2026-04-27 08:07:57 [auto1.fr] INFO: Found listing with ID: PN57067
2026-04-27 08:07:57 [auto1.fr] INFO: Scrape type for PN57067: 1
2026-04-27 08:07:57 [auto1.fr] INFO: Found listing with ID: CL54463
2026-04-27 08:07:57 [auto1.fr] INFO: Scrape type for CL54463: 1
2026-04-27 08:07:57 [auto1.fr] INFO: Found listing with ID: GW91833
2026-04-27 08:07:57 [auto1.fr] INFO: Scrape type for GW91833: 2
2026-04-27 08:07:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 72b9d1ce-4ace-5fc7-9ab0-b0f5160e5d34 with identifier: GW91833
2026-04-27 08:07:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72b9d1ce-4ace-5fc7-9ab0-b0f5160e5d34 with scrape type 2
2026-04-27 08:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 72b9d1ce-4ace-5fc7-9ab0-b0f5160e5d34 with scrape type 2
2026-04-27 08:07:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 72b9d1ce-4ace-5fc7-9ab0-b0f5160e5d34, identifier: GW91833
2026-04-27 08:07:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 72b9d1ce-4ace-5fc7-9ab0-b0f5160e5d34 with identifier: GW91833
2026-04-27 08:07:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 72b9d1ce-4ace-5fc7-9ab0-b0f5160e5d34 with identifier: GW91833
2026-04-27 08:07:57 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:07:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 72b9d1ce-4ace-5fc7-9ab0-b0f5160e5d34 with identifier: GW91833 to the API
2026-04-27 08:07:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:07:57 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:07:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-04-28T15:12:58Z',
 'fuel_type': 'diesel',
 'id': '72b9d1ce-4ace-5fc7-9ab0-b0f5160e5d34',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GW91833',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 103505,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2014-08-31',
 'seller_name': None,
 'title': 'Citroen C3 1.4 HDi Auto-Ecole',
 'transmission': 'manual',
 'trim': 'Auto-Ecole',
 'year': 2014}
2026-04-27 08:07:57 [auto1.fr] INFO: Saving data for GW91833: {'auction_closing_time': 1777389178.0, 'created_time': 1777020149.76988, 'has_photos': True, 'last_price_update_time': 1777277277.568693}
2026-04-27 08:07:57 [auto1.fr] INFO: Found listing with ID: XR47331
2026-04-27 08:07:57 [auto1.fr] INFO: Scrape type for XR47331: 1
2026-04-27 08:07:57 [auto1.fr] INFO: Found listing with ID: YP40813
2026-04-27 08:07:57 [auto1.fr] INFO: Scrape type for YP40813: 1
2026-04-27 08:07:57 [auto1.fr] INFO: Found listing with ID: MG55357
2026-04-27 08:07:57 [auto1.fr] INFO: Scrape type for MG55357: 1
2026-04-27 08:07:59 [scrapy.extensions.logstats] INFO: Crawled 452 pages (at 10 pages/min), scraped 408 items (at 13 items/min)
2026-04-27 08:07:59 [scrapy.extensions.memusage] INFO: Peak memory usage is 373MiB
2026-04-27 08:08:00 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.372(s), this was the 1st time calling it.
2026-04-27 08:08:00 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.298078712834289 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:08:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UV73863> (referer: https://www.auto1.com/v1/car-details-view/UV73863/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd6d9b04-3a8b-5971-a636-67efd13c1760 with identifier: UV73863
2026-04-27 08:08:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd6d9b04-3a8b-5971-a636-67efd13c1760 with scrape type 1
2026-04-27 08:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dd6d9b04-3a8b-5971-a636-67efd13c1760
2026-04-27 08:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/36/5e36edd68536a730ced07a2f4c62fa32/pa/UV73863_e232856817811003ced42568645d3758.jpg not downloaded yet
2026-04-27 08:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/36/5e36edd68536a730ced07a2f4c62fa32/pa/UV73863_91dba25afc28fbc1d5eeed575c43d1ca.jpg not downloaded yet
2026-04-27 08:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/36/5e36edd68536a730ced07a2f4c62fa32/pa/UV73863_763aca35f54ce59ad55f177fa79f918c.jpg not downloaded yet
2026-04-27 08:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/36/5e36edd68536a730ced07a2f4c62fa32/pa/UV73863_2a26e4ee1f61ee7ac9f6f5774d465cbd.jpg not downloaded yet
2026-04-27 08:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/36/5e36edd68536a730ced07a2f4c62fa32/pa/UV73863_27a0b51223c42f79f74fafa48d9bfa31.jpg not downloaded yet
2026-04-27 08:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/36/5e36edd68536a730ced07a2f4c62fa32/pa/UV73863_62c9ca03149a4af45766678af91dd58c.jpg not downloaded yet
2026-04-27 08:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/36/5e36edd68536a730ced07a2f4c62fa32/pa/UV73863_0ebb69db98170599918e481e1af37863.jpg not downloaded yet
2026-04-27 08:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/36/5e36edd68536a730ced07a2f4c62fa32/pa/UV73863_d1dce4b79fcc9b511b7ba684a835372c.jpg not downloaded yet
2026-04-27 08:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/36/5e36edd68536a730ced07a2f4c62fa32/pa/UV73863_df5d586f847905879b1255b6fbd8191f.jpg not downloaded yet
2026-04-27 08:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/36/5e36edd68536a730ced07a2f4c62fa32/pa/UV73863_6c912660424f26c5005f6792a3899fed.jpg not downloaded yet
2026-04-27 08:08:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PP18123> (referer: https://www.auto1.com/v1/car-details-view/PP18123/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/36/5e36edd68536a730ced07a2f4c62fa32/pa/UV73863_6c912660424f26c5005f6792a3899fed.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b251514-3c24-5ada-b8a9-edcd1e732bfd with identifier: PP18123
2026-04-27 08:08:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b251514-3c24-5ada-b8a9-edcd1e732bfd with scrape type 1
2026-04-27 08:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4b251514-3c24-5ada-b8a9-edcd1e732bfd
2026-04-27 08:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/89/e9892bf395d152deffbdef520d378e37/pa/PP18123_1c7b62f42f3ef2dc7580e7ba66b26a0f.jpg not downloaded yet
2026-04-27 08:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/89/e9892bf395d152deffbdef520d378e37/pa/PP18123_ce54345ee8b1f639928a0e8977288233.jpg not downloaded yet
2026-04-27 08:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/89/e9892bf395d152deffbdef520d378e37/pa/PP18123_4ac4f8da4fd2a6a0fa8ee4efde41f12b.jpg not downloaded yet
2026-04-27 08:08:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/36/5e36edd68536a730ced07a2f4c62fa32/pa/UV73863_df5d586f847905879b1255b6fbd8191f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/89/e9892bf395d152deffbdef520d378e37/pa/PP18123_c16f0fd7b0230ba60c5d5f1c286c863c.jpg not downloaded yet
2026-04-27 08:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/89/e9892bf395d152deffbdef520d378e37/pa/PP18123_d9c157ac9fcb191ebe80410ad50a4562.jpg not downloaded yet
2026-04-27 08:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/89/e9892bf395d152deffbdef520d378e37/pa/PP18123_1bdbe9b8c4c3d28ccf99d1b73b298e48.jpg not downloaded yet
2026-04-27 08:08:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bfba5d0>
2026-04-27 08:08:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd6d9b04-3a8b-5971-a636-67efd13c1760/dd6d9b04-3a8b-5971-a636-67efd13c1760_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/36/5e36edd68536a730ced07a2f4c62fa32/pa/UV73863_6c912660424f26c5005f6792a3899fed.jpg saved to cache
2026-04-27 08:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item dd6d9b04-3a8b-5971-a636-67efd13c1760
2026-04-27 08:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/89/e9892bf395d152deffbdef520d378e37/pa/PP18123_07374131fdc5d27e32c54612704dceb7.jpg not downloaded yet
2026-04-27 08:08:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/89/e9892bf395d152deffbdef520d378e37/pa/PP18123_ce54345ee8b1f639928a0e8977288233.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/89/e9892bf395d152deffbdef520d378e37/pa/PP18123_02c69db6ac0b9c7818a61ea2e0925268.jpg not downloaded yet
2026-04-27 08:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/89/e9892bf395d152deffbdef520d378e37/pa/PP18123_ee1e863e57b190254a346f0a16393db4.jpg not downloaded yet
2026-04-27 08:08:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d32c50>
2026-04-27 08:08:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd6d9b04-3a8b-5971-a636-67efd13c1760/dd6d9b04-3a8b-5971-a636-67efd13c1760_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/36/5e36edd68536a730ced07a2f4c62fa32/pa/UV73863_df5d586f847905879b1255b6fbd8191f.jpg saved to cache
2026-04-27 08:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dd6d9b04-3a8b-5971-a636-67efd13c1760
2026-04-27 08:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/89/e9892bf395d152deffbdef520d378e37/pa/PP18123_c900ed68f99f0b3da272d7ebeeaac4c8.jpg not downloaded yet
2026-04-27 08:08:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/89/e9892bf395d152deffbdef520d378e37/pa/PP18123_07374131fdc5d27e32c54612704dceb7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ceb250>
2026-04-27 08:08:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b251514-3c24-5ada-b8a9-edcd1e732bfd/4b251514-3c24-5ada-b8a9-edcd1e732bfd_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/89/e9892bf395d152deffbdef520d378e37/pa/PP18123_ce54345ee8b1f639928a0e8977288233.jpg saved to cache
2026-04-27 08:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4b251514-3c24-5ada-b8a9-edcd1e732bfd
2026-04-27 08:08:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/89/e9892bf395d152deffbdef520d378e37/pa/PP18123_ee1e863e57b190254a346f0a16393db4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438054a90>
2026-04-27 08:08:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b251514-3c24-5ada-b8a9-edcd1e732bfd/4b251514-3c24-5ada-b8a9-edcd1e732bfd_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/89/e9892bf395d152deffbdef520d378e37/pa/PP18123_07374131fdc5d27e32c54612704dceb7.jpg saved to cache
2026-04-27 08:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4b251514-3c24-5ada-b8a9-edcd1e732bfd
2026-04-27 08:08:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/89/e9892bf395d152deffbdef520d378e37/pa/PP18123_c900ed68f99f0b3da272d7ebeeaac4c8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14381366d0>
2026-04-27 08:08:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b251514-3c24-5ada-b8a9-edcd1e732bfd/4b251514-3c24-5ada-b8a9-edcd1e732bfd_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/89/e9892bf395d152deffbdef520d378e37/pa/PP18123_ee1e863e57b190254a346f0a16393db4.jpg saved to cache
2026-04-27 08:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4b251514-3c24-5ada-b8a9-edcd1e732bfd
2026-04-27 08:08:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/89/e9892bf395d152deffbdef520d378e37/pa/PP18123_02c69db6ac0b9c7818a61ea2e0925268.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380577d0>
2026-04-27 08:08:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b251514-3c24-5ada-b8a9-edcd1e732bfd/4b251514-3c24-5ada-b8a9-edcd1e732bfd_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/89/e9892bf395d152deffbdef520d378e37/pa/PP18123_c900ed68f99f0b3da272d7ebeeaac4c8.jpg saved to cache
2026-04-27 08:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4b251514-3c24-5ada-b8a9-edcd1e732bfd
2026-04-27 08:08:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438cea250>
2026-04-27 08:08:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b251514-3c24-5ada-b8a9-edcd1e732bfd/4b251514-3c24-5ada-b8a9-edcd1e732bfd_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/89/e9892bf395d152deffbdef520d378e37/pa/PP18123_02c69db6ac0b9c7818a61ea2e0925268.jpg saved to cache
2026-04-27 08:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4b251514-3c24-5ada-b8a9-edcd1e732bfd
2026-04-27 08:08:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/89/e9892bf395d152deffbdef520d378e37/pa/PP18123_1bdbe9b8c4c3d28ccf99d1b73b298e48.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c54d90>
2026-04-27 08:08:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b251514-3c24-5ada-b8a9-edcd1e732bfd/4b251514-3c24-5ada-b8a9-edcd1e732bfd_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/89/e9892bf395d152deffbdef520d378e37/pa/PP18123_1bdbe9b8c4c3d28ccf99d1b73b298e48.jpg saved to cache
2026-04-27 08:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4b251514-3c24-5ada-b8a9-edcd1e732bfd
2026-04-27 08:08:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/89/e9892bf395d152deffbdef520d378e37/pa/PP18123_d9c157ac9fcb191ebe80410ad50a4562.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/89/e9892bf395d152deffbdef520d378e37/pa/PP18123_c16f0fd7b0230ba60c5d5f1c286c863c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d60390>
2026-04-27 08:08:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b251514-3c24-5ada-b8a9-edcd1e732bfd/4b251514-3c24-5ada-b8a9-edcd1e732bfd_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/89/e9892bf395d152deffbdef520d378e37/pa/PP18123_d9c157ac9fcb191ebe80410ad50a4562.jpg saved to cache
2026-04-27 08:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4b251514-3c24-5ada-b8a9-edcd1e732bfd
2026-04-27 08:08:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d351d0>
2026-04-27 08:08:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b251514-3c24-5ada-b8a9-edcd1e732bfd/4b251514-3c24-5ada-b8a9-edcd1e732bfd_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/89/e9892bf395d152deffbdef520d378e37/pa/PP18123_c16f0fd7b0230ba60c5d5f1c286c863c.jpg saved to cache
2026-04-27 08:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4b251514-3c24-5ada-b8a9-edcd1e732bfd
2026-04-27 08:08:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/89/e9892bf395d152deffbdef520d378e37/pa/PP18123_4ac4f8da4fd2a6a0fa8ee4efde41f12b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:08:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/89/e9892bf395d152deffbdef520d378e37/pa/PP18123_1c7b62f42f3ef2dc7580e7ba66b26a0f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/36/5e36edd68536a730ced07a2f4c62fa32/pa/UV73863_d1dce4b79fcc9b511b7ba684a835372c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b5a710>
2026-04-27 08:08:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b251514-3c24-5ada-b8a9-edcd1e732bfd/4b251514-3c24-5ada-b8a9-edcd1e732bfd_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/89/e9892bf395d152deffbdef520d378e37/pa/PP18123_4ac4f8da4fd2a6a0fa8ee4efde41f12b.jpg saved to cache
2026-04-27 08:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4b251514-3c24-5ada-b8a9-edcd1e732bfd
2026-04-27 08:08:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/36/5e36edd68536a730ced07a2f4c62fa32/pa/UV73863_0ebb69db98170599918e481e1af37863.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380bea90>
2026-04-27 08:08:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b251514-3c24-5ada-b8a9-edcd1e732bfd/4b251514-3c24-5ada-b8a9-edcd1e732bfd_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/89/e9892bf395d152deffbdef520d378e37/pa/PP18123_1c7b62f42f3ef2dc7580e7ba66b26a0f.jpg saved to cache
2026-04-27 08:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4b251514-3c24-5ada-b8a9-edcd1e732bfd
2026-04-27 08:08:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4b251514-3c24-5ada-b8a9-edcd1e732bfd, skipping ID generation
2026-04-27 08:08:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b251514-3c24-5ada-b8a9-edcd1e732bfd with scrape type 1
2026-04-27 08:08:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4b251514-3c24-5ada-b8a9-edcd1e732bfd sending to next pipeline
2026-04-27 08:08:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4b251514-3c24-5ada-b8a9-edcd1e732bfd, identifier: PP18123
2026-04-27 08:08:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4b251514-3c24-5ada-b8a9-edcd1e732bfd with identifier: PP18123
2026-04-27 08:08:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4b251514-3c24-5ada-b8a9-edcd1e732bfd with identifier: PP18123
2026-04-27 08:08:06 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 4b251514-3c24-5ada-b8a9-edcd1e732bfd with identifier: PP18123 to the API
2026-04-27 08:08:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:06 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge9/89/e9892bf395d152deffbdef520d378e37/pa/PP18123_1c7b62f42f3ef2dc7580e7ba66b26a0f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 166,
 'category': None,
 'city': 'Loyettes',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 258,
 'expiration_date': '2026-04-28T15:46:44Z',
 'fuel_type': 'diesel',
 'id': '4b251514-3c24-5ada-b8a9-edcd1e732bfd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 45.7766,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PP18123',
 'listing': 'auction',
 'location': 'FR, Loyettes',
 'location_confidence': 'geocoded',
 'longitude': 5.2069,
 'make': 'Mercedes-Benz',
 'model': 'CLS-Klasse',
 'odometer': 18871,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4b251514-3c24-5ada-b8a9-edcd1e732bfd/4b251514-3c24-5ada-b8a9-edcd1e732bfd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72921,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/89/e9892bf395d152deffbdef520d378e37/pa/PP18123_1c7b62f42f3ef2dc7580e7ba66b26a0f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4b251514-3c24-5ada-b8a9-edcd1e732bfd/4b251514-3c24-5ada-b8a9-edcd1e732bfd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77264,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/89/e9892bf395d152deffbdef520d378e37/pa/PP18123_ce54345ee8b1f639928a0e8977288233.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4b251514-3c24-5ada-b8a9-edcd1e732bfd/4b251514-3c24-5ada-b8a9-edcd1e732bfd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70677,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/89/e9892bf395d152deffbdef520d378e37/pa/PP18123_4ac4f8da4fd2a6a0fa8ee4efde41f12b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4b251514-3c24-5ada-b8a9-edcd1e732bfd/4b251514-3c24-5ada-b8a9-edcd1e732bfd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66602,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/89/e9892bf395d152deffbdef520d378e37/pa/PP18123_c16f0fd7b0230ba60c5d5f1c286c863c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4b251514-3c24-5ada-b8a9-edcd1e732bfd/4b251514-3c24-5ada-b8a9-edcd1e732bfd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64667,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/89/e9892bf395d152deffbdef520d378e37/pa/PP18123_d9c157ac9fcb191ebe80410ad50a4562.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4b251514-3c24-5ada-b8a9-edcd1e732bfd/4b251514-3c24-5ada-b8a9-edcd1e732bfd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67272,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/89/e9892bf395d152deffbdef520d378e37/pa/PP18123_1bdbe9b8c4c3d28ccf99d1b73b298e48.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4b251514-3c24-5ada-b8a9-edcd1e732bfd/4b251514-3c24-5ada-b8a9-edcd1e732bfd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62863,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/89/e9892bf395d152deffbdef520d378e37/pa/PP18123_07374131fdc5d27e32c54612704dceb7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4b251514-3c24-5ada-b8a9-edcd1e732bfd/4b251514-3c24-5ada-b8a9-edcd1e732bfd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73979,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/89/e9892bf395d152deffbdef520d378e37/pa/PP18123_02c69db6ac0b9c7818a61ea2e0925268.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4b251514-3c24-5ada-b8a9-edcd1e732bfd/4b251514-3c24-5ada-b8a9-edcd1e732bfd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75248,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/89/e9892bf395d152deffbdef520d378e37/pa/PP18123_ee1e863e57b190254a346f0a16393db4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4b251514-3c24-5ada-b8a9-edcd1e732bfd/4b251514-3c24-5ada-b8a9-edcd1e732bfd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59106,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/89/e9892bf395d152deffbdef520d378e37/pa/PP18123_c900ed68f99f0b3da272d7ebeeaac4c8.jpg',
             'Width': 800}],
 'postal_code': '01360',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Ain',
 'province_code': 'FR-01',
 'region': 'Auvergne-Rhône-Alpes',
 'region_code': 'FR-84',
 'registration_date': '2015-12-22',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Mercedes-Benz CLS-Klasse CLS 350 d 4Matic BlueTEC',
 'transmission': 'automatic',
 'trim': '4Matic BlueTEC',
 'year': 2015}
2026-04-27 08:08:06 [auto1.fr] INFO: Saving data for PP18123: {'created_time': 1777277286.489963, 'last_price_update_time': 1777277286.489975, 'has_photos': True, 'auction_closing_time': 1777391204.0}
2026-04-27 08:08:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/36/5e36edd68536a730ced07a2f4c62fa32/pa/UV73863_62c9ca03149a4af45766678af91dd58c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bfd2ed0>
2026-04-27 08:08:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd6d9b04-3a8b-5971-a636-67efd13c1760/dd6d9b04-3a8b-5971-a636-67efd13c1760_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/36/5e36edd68536a730ced07a2f4c62fa32/pa/UV73863_d1dce4b79fcc9b511b7ba684a835372c.jpg saved to cache
2026-04-27 08:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dd6d9b04-3a8b-5971-a636-67efd13c1760
2026-04-27 08:08:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438e15890>
2026-04-27 08:08:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd6d9b04-3a8b-5971-a636-67efd13c1760/dd6d9b04-3a8b-5971-a636-67efd13c1760_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/36/5e36edd68536a730ced07a2f4c62fa32/pa/UV73863_0ebb69db98170599918e481e1af37863.jpg saved to cache
2026-04-27 08:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dd6d9b04-3a8b-5971-a636-67efd13c1760
2026-04-27 08:08:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/36/5e36edd68536a730ced07a2f4c62fa32/pa/UV73863_27a0b51223c42f79f74fafa48d9bfa31.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d368d0>
2026-04-27 08:08:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd6d9b04-3a8b-5971-a636-67efd13c1760/dd6d9b04-3a8b-5971-a636-67efd13c1760_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/36/5e36edd68536a730ced07a2f4c62fa32/pa/UV73863_62c9ca03149a4af45766678af91dd58c.jpg saved to cache
2026-04-27 08:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dd6d9b04-3a8b-5971-a636-67efd13c1760
2026-04-27 08:08:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/36/5e36edd68536a730ced07a2f4c62fa32/pa/UV73863_2a26e4ee1f61ee7ac9f6f5774d465cbd.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d93890>
2026-04-27 08:08:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd6d9b04-3a8b-5971-a636-67efd13c1760/dd6d9b04-3a8b-5971-a636-67efd13c1760_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/36/5e36edd68536a730ced07a2f4c62fa32/pa/UV73863_27a0b51223c42f79f74fafa48d9bfa31.jpg saved to cache
2026-04-27 08:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dd6d9b04-3a8b-5971-a636-67efd13c1760
2026-04-27 08:08:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/36/5e36edd68536a730ced07a2f4c62fa32/pa/UV73863_763aca35f54ce59ad55f177fa79f918c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a62f10>
2026-04-27 08:08:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd6d9b04-3a8b-5971-a636-67efd13c1760/dd6d9b04-3a8b-5971-a636-67efd13c1760_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/36/5e36edd68536a730ced07a2f4c62fa32/pa/UV73863_2a26e4ee1f61ee7ac9f6f5774d465cbd.jpg saved to cache
2026-04-27 08:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dd6d9b04-3a8b-5971-a636-67efd13c1760
2026-04-27 08:08:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/36/5e36edd68536a730ced07a2f4c62fa32/pa/UV73863_91dba25afc28fbc1d5eeed575c43d1ca.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/36/5e36edd68536a730ced07a2f4c62fa32/pa/UV73863_e232856817811003ced42568645d3758.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438dfb390>
2026-04-27 08:08:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd6d9b04-3a8b-5971-a636-67efd13c1760/dd6d9b04-3a8b-5971-a636-67efd13c1760_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/36/5e36edd68536a730ced07a2f4c62fa32/pa/UV73863_763aca35f54ce59ad55f177fa79f918c.jpg saved to cache
2026-04-27 08:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dd6d9b04-3a8b-5971-a636-67efd13c1760
2026-04-27 08:08:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438e7c190>
2026-04-27 08:08:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd6d9b04-3a8b-5971-a636-67efd13c1760/dd6d9b04-3a8b-5971-a636-67efd13c1760_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/36/5e36edd68536a730ced07a2f4c62fa32/pa/UV73863_91dba25afc28fbc1d5eeed575c43d1ca.jpg saved to cache
2026-04-27 08:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dd6d9b04-3a8b-5971-a636-67efd13c1760
2026-04-27 08:08:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1447517e10>
2026-04-27 08:08:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd6d9b04-3a8b-5971-a636-67efd13c1760/dd6d9b04-3a8b-5971-a636-67efd13c1760_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/36/5e36edd68536a730ced07a2f4c62fa32/pa/UV73863_e232856817811003ced42568645d3758.jpg saved to cache
2026-04-27 08:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dd6d9b04-3a8b-5971-a636-67efd13c1760
2026-04-27 08:08:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dd6d9b04-3a8b-5971-a636-67efd13c1760, skipping ID generation
2026-04-27 08:08:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd6d9b04-3a8b-5971-a636-67efd13c1760 with scrape type 1
2026-04-27 08:08:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dd6d9b04-3a8b-5971-a636-67efd13c1760 sending to next pipeline
2026-04-27 08:08:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: dd6d9b04-3a8b-5971-a636-67efd13c1760, identifier: UV73863
2026-04-27 08:08:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: dd6d9b04-3a8b-5971-a636-67efd13c1760 with identifier: UV73863
2026-04-27 08:08:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: dd6d9b04-3a8b-5971-a636-67efd13c1760 with identifier: UV73863
2026-04-27 08:08:07 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: dd6d9b04-3a8b-5971-a636-67efd13c1760 with identifier: UV73863 to the API
2026-04-27 08:08:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:07 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5e/36/5e36edd68536a730ced07a2f4c62fa32/pa/UV73863_e232856817811003ced42568645d3758.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'category': None,
 'city': 'LA CHAPELLE LONGUEVILLE',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 105,
 'expiration_date': '2026-04-28T15:39:30Z',
 'fuel_type': 'diesel',
 'id': 'dd6d9b04-3a8b-5971-a636-67efd13c1760',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UV73863',
 'listing': 'auction',
 'location': 'FR, LA CHAPELLE LONGUEVILLE',
 'location_confidence': None,
 'longitude': None,
 'make': 'Fiat',
 'model': 'Doblo',
 'odometer': 74434,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dd6d9b04-3a8b-5971-a636-67efd13c1760/dd6d9b04-3a8b-5971-a636-67efd13c1760_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84319,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/36/5e36edd68536a730ced07a2f4c62fa32/pa/UV73863_e232856817811003ced42568645d3758.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dd6d9b04-3a8b-5971-a636-67efd13c1760/dd6d9b04-3a8b-5971-a636-67efd13c1760_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81445,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/36/5e36edd68536a730ced07a2f4c62fa32/pa/UV73863_91dba25afc28fbc1d5eeed575c43d1ca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dd6d9b04-3a8b-5971-a636-67efd13c1760/dd6d9b04-3a8b-5971-a636-67efd13c1760_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66091,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/36/5e36edd68536a730ced07a2f4c62fa32/pa/UV73863_763aca35f54ce59ad55f177fa79f918c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dd6d9b04-3a8b-5971-a636-67efd13c1760/dd6d9b04-3a8b-5971-a636-67efd13c1760_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56214,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/36/5e36edd68536a730ced07a2f4c62fa32/pa/UV73863_2a26e4ee1f61ee7ac9f6f5774d465cbd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dd6d9b04-3a8b-5971-a636-67efd13c1760/dd6d9b04-3a8b-5971-a636-67efd13c1760_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69391,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/36/5e36edd68536a730ced07a2f4c62fa32/pa/UV73863_27a0b51223c42f79f74fafa48d9bfa31.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dd6d9b04-3a8b-5971-a636-67efd13c1760/dd6d9b04-3a8b-5971-a636-67efd13c1760_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60849,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/36/5e36edd68536a730ced07a2f4c62fa32/pa/UV73863_62c9ca03149a4af45766678af91dd58c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dd6d9b04-3a8b-5971-a636-67efd13c1760/dd6d9b04-3a8b-5971-a636-67efd13c1760_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58667,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/36/5e36edd68536a730ced07a2f4c62fa32/pa/UV73863_0ebb69db98170599918e481e1af37863.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dd6d9b04-3a8b-5971-a636-67efd13c1760/dd6d9b04-3a8b-5971-a636-67efd13c1760_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73451,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/36/5e36edd68536a730ced07a2f4c62fa32/pa/UV73863_d1dce4b79fcc9b511b7ba684a835372c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dd6d9b04-3a8b-5971-a636-67efd13c1760/dd6d9b04-3a8b-5971-a636-67efd13c1760_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67423,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/36/5e36edd68536a730ced07a2f4c62fa32/pa/UV73863_df5d586f847905879b1255b6fbd8191f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dd6d9b04-3a8b-5971-a636-67efd13c1760/dd6d9b04-3a8b-5971-a636-67efd13c1760_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79158,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/36/5e36edd68536a730ced07a2f4c62fa32/pa/UV73863_6c912660424f26c5005f6792a3899fed.jpg',
             'Width': 800}],
 'postal_code': None,
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2018-11-28',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Fiat Doblo 1.6 JTDM SX Maxi Furgone',
 'transmission': 'manual',
 'trim': 'SX Maxi Furgone',
 'year': 2018}
2026-04-27 08:08:08 [auto1.fr] INFO: Saving data for UV73863: {'created_time': 1777277288.094248, 'last_price_update_time': 1777277288.094262, 'has_photos': True, 'auction_closing_time': 1777390770.0}
2026-04-27 08:08:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KH97076> (referer: https://www.auto1.com/v1/car-details-view/KH97076/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 931fbc9e-a7f9-5971-a8f4-52a0656dd16e with identifier: KH97076
2026-04-27 08:08:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 931fbc9e-a7f9-5971-a8f4-52a0656dd16e with scrape type 1
2026-04-27 08:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 931fbc9e-a7f9-5971-a8f4-52a0656dd16e
2026-04-27 08:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/98/699810b43409fa40b840c32c6f159c07/pa/KH97076_a7048d433c64ad500019090f34d1c0c2.jpg not downloaded yet
2026-04-27 08:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/98/699810b43409fa40b840c32c6f159c07/pa/KH97076_3a70815b341e3c651a914045f3ce05c5.jpg not downloaded yet
2026-04-27 08:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/98/699810b43409fa40b840c32c6f159c07/pa/KH97076_b01a2f26308bb2b18f6b3c4dc8a9ac42.jpg not downloaded yet
2026-04-27 08:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/98/699810b43409fa40b840c32c6f159c07/pa/KH97076_60a11d271f0ab4b6742a7a37f255055d.jpg not downloaded yet
2026-04-27 08:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/98/699810b43409fa40b840c32c6f159c07/pa/KH97076_265610a0e33a526a97a95f91ab5cc9c4.jpg not downloaded yet
2026-04-27 08:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/98/699810b43409fa40b840c32c6f159c07/pa/KH97076_e967a32e1c735ac45e4f2111ef626cf9.jpg not downloaded yet
2026-04-27 08:08:10 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.213(s), this was the 1st time calling it.
2026-04-27 08:08:10 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.057481006549885 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:08:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SU63674> (referer: https://www.auto1.com/v1/car-details-view/SU63674/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/98/699810b43409fa40b840c32c6f159c07/pa/KH97076_e967a32e1c735ac45e4f2111ef626cf9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64af02dd-1fed-5948-a4ef-1b7025cb0ac4 with identifier: SU63674
2026-04-27 08:08:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64af02dd-1fed-5948-a4ef-1b7025cb0ac4 with scrape type 1
2026-04-27 08:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 64af02dd-1fed-5948-a4ef-1b7025cb0ac4
2026-04-27 08:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/28/8c283c2af42ec88d3f14144819eb25f3/pa/SU63674_c6682f658e6b831b815ece7c748aa0f8.jpg not downloaded yet
2026-04-27 08:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/28/8c283c2af42ec88d3f14144819eb25f3/pa/SU63674_ff7b506e2ad054930fa8b59d6c9807a0.jpg not downloaded yet
2026-04-27 08:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/28/8c283c2af42ec88d3f14144819eb25f3/pa/SU63674_3e21e232259dfe652fe0b19aa978a84a.jpg not downloaded yet
2026-04-27 08:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/28/8c283c2af42ec88d3f14144819eb25f3/pa/SU63674_fc4970b305701ad3f432b8630d09f11d.jpg not downloaded yet
2026-04-27 08:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/28/8c283c2af42ec88d3f14144819eb25f3/pa/SU63674_06807605926febcf58c167aa81bd1553.jpg not downloaded yet
2026-04-27 08:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/28/8c283c2af42ec88d3f14144819eb25f3/pa/SU63674_41aeafe9aae2a89b7bfe6f2bf297e163.jpg not downloaded yet
2026-04-27 08:08:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d601d0>
2026-04-27 08:08:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_931fbc9e-a7f9-5971-a8f4-52a0656dd16e/931fbc9e-a7f9-5971-a8f4-52a0656dd16e_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/98/699810b43409fa40b840c32c6f159c07/pa/KH97076_e967a32e1c735ac45e4f2111ef626cf9.jpg saved to cache
2026-04-27 08:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 931fbc9e-a7f9-5971-a8f4-52a0656dd16e
2026-04-27 08:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/28/8c283c2af42ec88d3f14144819eb25f3/pa/SU63674_a108d099d396969ccec1cdbe65af4d24.jpg not downloaded yet
2026-04-27 08:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/28/8c283c2af42ec88d3f14144819eb25f3/pa/SU63674_6126fa1fbc5d1c929ae953a9edc74915.jpg not downloaded yet
2026-04-27 08:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/28/8c283c2af42ec88d3f14144819eb25f3/pa/SU63674_a19cec7e8db7873f3d74f2755df3643a.jpg not downloaded yet
2026-04-27 08:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/28/8c283c2af42ec88d3f14144819eb25f3/pa/SU63674_f4f59f2673cedd8bbd40adf6a601ebe1.jpg not downloaded yet
2026-04-27 08:08:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/98/699810b43409fa40b840c32c6f159c07/pa/KH97076_265610a0e33a526a97a95f91ab5cc9c4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f144781c190>
2026-04-27 08:08:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_931fbc9e-a7f9-5971-a8f4-52a0656dd16e/931fbc9e-a7f9-5971-a8f4-52a0656dd16e_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/98/699810b43409fa40b840c32c6f159c07/pa/KH97076_265610a0e33a526a97a95f91ab5cc9c4.jpg saved to cache
2026-04-27 08:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 931fbc9e-a7f9-5971-a8f4-52a0656dd16e
2026-04-27 08:08:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/28/8c283c2af42ec88d3f14144819eb25f3/pa/SU63674_f4f59f2673cedd8bbd40adf6a601ebe1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/28/8c283c2af42ec88d3f14144819eb25f3/pa/SU63674_a19cec7e8db7873f3d74f2755df3643a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/28/8c283c2af42ec88d3f14144819eb25f3/pa/SU63674_6126fa1fbc5d1c929ae953a9edc74915.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c2ae10>
2026-04-27 08:08:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64af02dd-1fed-5948-a4ef-1b7025cb0ac4/64af02dd-1fed-5948-a4ef-1b7025cb0ac4_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/28/8c283c2af42ec88d3f14144819eb25f3/pa/SU63674_f4f59f2673cedd8bbd40adf6a601ebe1.jpg saved to cache
2026-04-27 08:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 64af02dd-1fed-5948-a4ef-1b7025cb0ac4
2026-04-27 08:08:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380a6910>
2026-04-27 08:08:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64af02dd-1fed-5948-a4ef-1b7025cb0ac4/64af02dd-1fed-5948-a4ef-1b7025cb0ac4_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/28/8c283c2af42ec88d3f14144819eb25f3/pa/SU63674_a19cec7e8db7873f3d74f2755df3643a.jpg saved to cache
2026-04-27 08:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 64af02dd-1fed-5948-a4ef-1b7025cb0ac4
2026-04-27 08:08:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438fbf590>
2026-04-27 08:08:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64af02dd-1fed-5948-a4ef-1b7025cb0ac4/64af02dd-1fed-5948-a4ef-1b7025cb0ac4_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/28/8c283c2af42ec88d3f14144819eb25f3/pa/SU63674_6126fa1fbc5d1c929ae953a9edc74915.jpg saved to cache
2026-04-27 08:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 64af02dd-1fed-5948-a4ef-1b7025cb0ac4
2026-04-27 08:08:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/28/8c283c2af42ec88d3f14144819eb25f3/pa/SU63674_a108d099d396969ccec1cdbe65af4d24.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/28/8c283c2af42ec88d3f14144819eb25f3/pa/SU63674_41aeafe9aae2a89b7bfe6f2bf297e163.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bf19410>
2026-04-27 08:08:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64af02dd-1fed-5948-a4ef-1b7025cb0ac4/64af02dd-1fed-5948-a4ef-1b7025cb0ac4_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/28/8c283c2af42ec88d3f14144819eb25f3/pa/SU63674_a108d099d396969ccec1cdbe65af4d24.jpg saved to cache
2026-04-27 08:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 64af02dd-1fed-5948-a4ef-1b7025cb0ac4
2026-04-27 08:08:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438cb5fd0>
2026-04-27 08:08:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64af02dd-1fed-5948-a4ef-1b7025cb0ac4/64af02dd-1fed-5948-a4ef-1b7025cb0ac4_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/28/8c283c2af42ec88d3f14144819eb25f3/pa/SU63674_41aeafe9aae2a89b7bfe6f2bf297e163.jpg saved to cache
2026-04-27 08:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 64af02dd-1fed-5948-a4ef-1b7025cb0ac4
2026-04-27 08:08:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/28/8c283c2af42ec88d3f14144819eb25f3/pa/SU63674_06807605926febcf58c167aa81bd1553.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438dca050>
2026-04-27 08:08:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64af02dd-1fed-5948-a4ef-1b7025cb0ac4/64af02dd-1fed-5948-a4ef-1b7025cb0ac4_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/28/8c283c2af42ec88d3f14144819eb25f3/pa/SU63674_06807605926febcf58c167aa81bd1553.jpg saved to cache
2026-04-27 08:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 64af02dd-1fed-5948-a4ef-1b7025cb0ac4
2026-04-27 08:08:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/28/8c283c2af42ec88d3f14144819eb25f3/pa/SU63674_fc4970b305701ad3f432b8630d09f11d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d36a90>
2026-04-27 08:08:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64af02dd-1fed-5948-a4ef-1b7025cb0ac4/64af02dd-1fed-5948-a4ef-1b7025cb0ac4_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/28/8c283c2af42ec88d3f14144819eb25f3/pa/SU63674_fc4970b305701ad3f432b8630d09f11d.jpg saved to cache
2026-04-27 08:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 64af02dd-1fed-5948-a4ef-1b7025cb0ac4
2026-04-27 08:08:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/28/8c283c2af42ec88d3f14144819eb25f3/pa/SU63674_3e21e232259dfe652fe0b19aa978a84a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/28/8c283c2af42ec88d3f14144819eb25f3/pa/SU63674_ff7b506e2ad054930fa8b59d6c9807a0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/28/8c283c2af42ec88d3f14144819eb25f3/pa/SU63674_c6682f658e6b831b815ece7c748aa0f8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142be1b210>
2026-04-27 08:08:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64af02dd-1fed-5948-a4ef-1b7025cb0ac4/64af02dd-1fed-5948-a4ef-1b7025cb0ac4_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/28/8c283c2af42ec88d3f14144819eb25f3/pa/SU63674_3e21e232259dfe652fe0b19aa978a84a.jpg saved to cache
2026-04-27 08:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 64af02dd-1fed-5948-a4ef-1b7025cb0ac4
2026-04-27 08:08:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bfbbd50>
2026-04-27 08:08:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64af02dd-1fed-5948-a4ef-1b7025cb0ac4/64af02dd-1fed-5948-a4ef-1b7025cb0ac4_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/28/8c283c2af42ec88d3f14144819eb25f3/pa/SU63674_ff7b506e2ad054930fa8b59d6c9807a0.jpg saved to cache
2026-04-27 08:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 64af02dd-1fed-5948-a4ef-1b7025cb0ac4
2026-04-27 08:08:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380a4a90>
2026-04-27 08:08:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64af02dd-1fed-5948-a4ef-1b7025cb0ac4/64af02dd-1fed-5948-a4ef-1b7025cb0ac4_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/28/8c283c2af42ec88d3f14144819eb25f3/pa/SU63674_c6682f658e6b831b815ece7c748aa0f8.jpg saved to cache
2026-04-27 08:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 64af02dd-1fed-5948-a4ef-1b7025cb0ac4
2026-04-27 08:08:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 64af02dd-1fed-5948-a4ef-1b7025cb0ac4, skipping ID generation
2026-04-27 08:08:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64af02dd-1fed-5948-a4ef-1b7025cb0ac4 with scrape type 1
2026-04-27 08:08:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 64af02dd-1fed-5948-a4ef-1b7025cb0ac4 sending to next pipeline
2026-04-27 08:08:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 64af02dd-1fed-5948-a4ef-1b7025cb0ac4, identifier: SU63674
2026-04-27 08:08:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 64af02dd-1fed-5948-a4ef-1b7025cb0ac4 with identifier: SU63674
2026-04-27 08:08:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 64af02dd-1fed-5948-a4ef-1b7025cb0ac4 with identifier: SU63674
2026-04-27 08:08:15 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 64af02dd-1fed-5948-a4ef-1b7025cb0ac4 with identifier: SU63674 to the API
2026-04-27 08:08:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:15 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8c/28/8c283c2af42ec88d3f14144819eb25f3/pa/SU63674_c6682f658e6b831b815ece7c748aa0f8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'category': None,
 'city': 'LA CHAPELLE LONGUEVILLE',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 130,
 'expiration_date': '2026-04-28T15:32:14Z',
 'fuel_type': 'diesel',
 'id': '64af02dd-1fed-5948-a4ef-1b7025cb0ac4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SU63674',
 'listing': 'auction',
 'location': 'FR, LA CHAPELLE LONGUEVILLE',
 'location_confidence': None,
 'longitude': None,
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 105211,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_64af02dd-1fed-5948-a4ef-1b7025cb0ac4/64af02dd-1fed-5948-a4ef-1b7025cb0ac4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65135,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/28/8c283c2af42ec88d3f14144819eb25f3/pa/SU63674_c6682f658e6b831b815ece7c748aa0f8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_64af02dd-1fed-5948-a4ef-1b7025cb0ac4/64af02dd-1fed-5948-a4ef-1b7025cb0ac4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68426,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/28/8c283c2af42ec88d3f14144819eb25f3/pa/SU63674_ff7b506e2ad054930fa8b59d6c9807a0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_64af02dd-1fed-5948-a4ef-1b7025cb0ac4/64af02dd-1fed-5948-a4ef-1b7025cb0ac4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67478,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/28/8c283c2af42ec88d3f14144819eb25f3/pa/SU63674_3e21e232259dfe652fe0b19aa978a84a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_64af02dd-1fed-5948-a4ef-1b7025cb0ac4/64af02dd-1fed-5948-a4ef-1b7025cb0ac4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49526,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/28/8c283c2af42ec88d3f14144819eb25f3/pa/SU63674_fc4970b305701ad3f432b8630d09f11d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_64af02dd-1fed-5948-a4ef-1b7025cb0ac4/64af02dd-1fed-5948-a4ef-1b7025cb0ac4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57457,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/28/8c283c2af42ec88d3f14144819eb25f3/pa/SU63674_06807605926febcf58c167aa81bd1553.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_64af02dd-1fed-5948-a4ef-1b7025cb0ac4/64af02dd-1fed-5948-a4ef-1b7025cb0ac4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63208,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/28/8c283c2af42ec88d3f14144819eb25f3/pa/SU63674_41aeafe9aae2a89b7bfe6f2bf297e163.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_64af02dd-1fed-5948-a4ef-1b7025cb0ac4/64af02dd-1fed-5948-a4ef-1b7025cb0ac4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45601,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/28/8c283c2af42ec88d3f14144819eb25f3/pa/SU63674_a108d099d396969ccec1cdbe65af4d24.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_64af02dd-1fed-5948-a4ef-1b7025cb0ac4/64af02dd-1fed-5948-a4ef-1b7025cb0ac4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64510,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/28/8c283c2af42ec88d3f14144819eb25f3/pa/SU63674_6126fa1fbc5d1c929ae953a9edc74915.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_64af02dd-1fed-5948-a4ef-1b7025cb0ac4/64af02dd-1fed-5948-a4ef-1b7025cb0ac4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70674,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/28/8c283c2af42ec88d3f14144819eb25f3/pa/SU63674_a19cec7e8db7873f3d74f2755df3643a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_64af02dd-1fed-5948-a4ef-1b7025cb0ac4/64af02dd-1fed-5948-a4ef-1b7025cb0ac4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53206,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/28/8c283c2af42ec88d3f14144819eb25f3/pa/SU63674_f4f59f2673cedd8bbd40adf6a601ebe1.jpg',
             'Width': 800}],
 'postal_code': None,
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2020-05-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi GT Line',
 'transmission': 'automatic',
 'trim': 'GT Line',
 'year': 2020}
2026-04-27 08:08:15 [auto1.fr] INFO: Saving data for SU63674: {'created_time': 1777277295.696996, 'last_price_update_time': 1777277295.697008, 'has_photos': True, 'auction_closing_time': 1777390334.0}
2026-04-27 08:08:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/98/699810b43409fa40b840c32c6f159c07/pa/KH97076_60a11d271f0ab4b6742a7a37f255055d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:08:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438caaed0>
2026-04-27 08:08:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_931fbc9e-a7f9-5971-a8f4-52a0656dd16e/931fbc9e-a7f9-5971-a8f4-52a0656dd16e_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/98/699810b43409fa40b840c32c6f159c07/pa/KH97076_60a11d271f0ab4b6742a7a37f255055d.jpg saved to cache
2026-04-27 08:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 931fbc9e-a7f9-5971-a8f4-52a0656dd16e
2026-04-27 08:08:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/98/699810b43409fa40b840c32c6f159c07/pa/KH97076_b01a2f26308bb2b18f6b3c4dc8a9ac42.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/98/699810b43409fa40b840c32c6f159c07/pa/KH97076_3a70815b341e3c651a914045f3ce05c5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c846d0>
2026-04-27 08:08:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_931fbc9e-a7f9-5971-a8f4-52a0656dd16e/931fbc9e-a7f9-5971-a8f4-52a0656dd16e_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/98/699810b43409fa40b840c32c6f159c07/pa/KH97076_b01a2f26308bb2b18f6b3c4dc8a9ac42.jpg saved to cache
2026-04-27 08:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 931fbc9e-a7f9-5971-a8f4-52a0656dd16e
2026-04-27 08:08:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/98/699810b43409fa40b840c32c6f159c07/pa/KH97076_a7048d433c64ad500019090f34d1c0c2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d63890>
2026-04-27 08:08:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_931fbc9e-a7f9-5971-a8f4-52a0656dd16e/931fbc9e-a7f9-5971-a8f4-52a0656dd16e_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/98/699810b43409fa40b840c32c6f159c07/pa/KH97076_3a70815b341e3c651a914045f3ce05c5.jpg saved to cache
2026-04-27 08:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 931fbc9e-a7f9-5971-a8f4-52a0656dd16e
2026-04-27 08:08:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a5a150>
2026-04-27 08:08:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_931fbc9e-a7f9-5971-a8f4-52a0656dd16e/931fbc9e-a7f9-5971-a8f4-52a0656dd16e_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/98/699810b43409fa40b840c32c6f159c07/pa/KH97076_a7048d433c64ad500019090f34d1c0c2.jpg saved to cache
2026-04-27 08:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 931fbc9e-a7f9-5971-a8f4-52a0656dd16e
2026-04-27 08:08:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 931fbc9e-a7f9-5971-a8f4-52a0656dd16e, skipping ID generation
2026-04-27 08:08:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 931fbc9e-a7f9-5971-a8f4-52a0656dd16e with scrape type 1
2026-04-27 08:08:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 931fbc9e-a7f9-5971-a8f4-52a0656dd16e sending to next pipeline
2026-04-27 08:08:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 931fbc9e-a7f9-5971-a8f4-52a0656dd16e, identifier: KH97076
2026-04-27 08:08:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 931fbc9e-a7f9-5971-a8f4-52a0656dd16e with identifier: KH97076
2026-04-27 08:08:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 931fbc9e-a7f9-5971-a8f4-52a0656dd16e with identifier: KH97076
2026-04-27 08:08:16 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 931fbc9e-a7f9-5971-a8f4-52a0656dd16e with identifier: KH97076 to the API
2026-04-27 08:08:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:16 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img69/98/699810b43409fa40b840c32c6f159c07/pa/KH97076_a7048d433c64ad500019090f34d1c0c2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 145,
 'category': None,
 'city': 'Loyettes',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 95,
 'expiration_date': '2026-04-28T15:50:55Z',
 'fuel_type': 'petrol',
 'id': '931fbc9e-a7f9-5971-a8f4-52a0656dd16e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 45.7766,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KH97076',
 'listing': 'auction',
 'location': 'FR, Loyettes',
 'location_confidence': 'geocoded',
 'longitude': 5.2069,
 'make': 'Fiat',
 'model': '500L',
 'odometer': 234852,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_931fbc9e-a7f9-5971-a8f4-52a0656dd16e/931fbc9e-a7f9-5971-a8f4-52a0656dd16e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74960,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/98/699810b43409fa40b840c32c6f159c07/pa/KH97076_a7048d433c64ad500019090f34d1c0c2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_931fbc9e-a7f9-5971-a8f4-52a0656dd16e/931fbc9e-a7f9-5971-a8f4-52a0656dd16e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76527,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/98/699810b43409fa40b840c32c6f159c07/pa/KH97076_3a70815b341e3c651a914045f3ce05c5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_931fbc9e-a7f9-5971-a8f4-52a0656dd16e/931fbc9e-a7f9-5971-a8f4-52a0656dd16e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83243,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/98/699810b43409fa40b840c32c6f159c07/pa/KH97076_b01a2f26308bb2b18f6b3c4dc8a9ac42.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_931fbc9e-a7f9-5971-a8f4-52a0656dd16e/931fbc9e-a7f9-5971-a8f4-52a0656dd16e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65477,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/98/699810b43409fa40b840c32c6f159c07/pa/KH97076_60a11d271f0ab4b6742a7a37f255055d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_931fbc9e-a7f9-5971-a8f4-52a0656dd16e/931fbc9e-a7f9-5971-a8f4-52a0656dd16e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99065,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/98/699810b43409fa40b840c32c6f159c07/pa/KH97076_265610a0e33a526a97a95f91ab5cc9c4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_931fbc9e-a7f9-5971-a8f4-52a0656dd16e/931fbc9e-a7f9-5971-a8f4-52a0656dd16e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46544,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/98/699810b43409fa40b840c32c6f159c07/pa/KH97076_e967a32e1c735ac45e4f2111ef626cf9.jpg',
             'Width': 800}],
 'postal_code': '01360',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Ain',
 'province_code': 'FR-01',
 'region': 'Auvergne-Rhône-Alpes',
 'region_code': 'FR-84',
 'registration_date': '2013-07-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat 500L 1.4 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2013}
2026-04-27 08:08:16 [auto1.fr] INFO: Saving data for KH97076: {'created_time': 1777277296.717699, 'last_price_update_time': 1777277296.717709, 'has_photos': True, 'auction_closing_time': 1777391455.0}
2026-04-27 08:08:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PZ40280> (referer: https://www.auto1.com/v1/car-details-view/PZ40280/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fbc55af0-3d87-58bb-a403-2196d12973af with identifier: PZ40280
2026-04-27 08:08:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fbc55af0-3d87-58bb-a403-2196d12973af with scrape type 1
2026-04-27 08:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fbc55af0-3d87-58bb-a403-2196d12973af
2026-04-27 08:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/0d/210da1334e1e6913afba5cf0c9a99eb2/pa/PZ40280_6ab74b7e0548859a0a8864f9667e893c.jpg not downloaded yet
2026-04-27 08:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/0d/210da1334e1e6913afba5cf0c9a99eb2/pa/PZ40280_43c88e8051b5dc53fac8501f44ba1b4d.jpg not downloaded yet
2026-04-27 08:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/0d/210da1334e1e6913afba5cf0c9a99eb2/pa/PZ40280_c157778659e7ac30609a1d3c6056bdef.jpg not downloaded yet
2026-04-27 08:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/0d/210da1334e1e6913afba5cf0c9a99eb2/pa/PZ40280_9dc9841f5e5aeea7550477d8bf68f5df.jpg not downloaded yet
2026-04-27 08:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/0d/210da1334e1e6913afba5cf0c9a99eb2/pa/PZ40280_cb2ace2524ca1fbd1fd0260262907bda.jpg not downloaded yet
2026-04-27 08:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/0d/210da1334e1e6913afba5cf0c9a99eb2/pa/PZ40280_c9c7929f7fe264163e8e35cbae668f1b.jpg not downloaded yet
2026-04-27 08:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/0d/210da1334e1e6913afba5cf0c9a99eb2/pa/PZ40280_b67bdd3cbc89b2d191fa3d7d1541256f.jpg not downloaded yet
2026-04-27 08:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/0d/210da1334e1e6913afba5cf0c9a99eb2/pa/PZ40280_51012298fd6fd1e6350fb6d2b4585395.jpg not downloaded yet
2026-04-27 08:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/0d/210da1334e1e6913afba5cf0c9a99eb2/pa/PZ40280_3036d632253e70fd7e380ef2420df4aa.jpg not downloaded yet
2026-04-27 08:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/0d/210da1334e1e6913afba5cf0c9a99eb2/pa/PZ40280_2d13ce921e7b0298b7403d09e25e4a72.jpg not downloaded yet
2026-04-27 08:08:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KX23637> (referer: https://www.auto1.com/v1/car-details-view/KX23637/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5bfb2794-433d-5dce-872c-aeb7cda9b5bd with identifier: KX23637
2026-04-27 08:08:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5bfb2794-433d-5dce-872c-aeb7cda9b5bd with scrape type 1
2026-04-27 08:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 5bfb2794-433d-5dce-872c-aeb7cda9b5bd
2026-04-27 08:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/b3/80b3e7e3fba610500fa9d158f7f3cf61/pa/KX23637_bb1897671941bb26f093deada34cdab0.jpg not downloaded yet
2026-04-27 08:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/b3/80b3e7e3fba610500fa9d158f7f3cf61/pa/KX23637_cf94cb6f2710a8e5cfeb69fbbc5bc1c4.jpg not downloaded yet
2026-04-27 08:08:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/0d/210da1334e1e6913afba5cf0c9a99eb2/pa/PZ40280_2d13ce921e7b0298b7403d09e25e4a72.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/b3/80b3e7e3fba610500fa9d158f7f3cf61/pa/KX23637_47932221ad3d0fdcc7b6c6f2e775c602.jpg not downloaded yet
2026-04-27 08:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/b3/80b3e7e3fba610500fa9d158f7f3cf61/pa/KX23637_4bfbbfef7c412b2a62a447d95eaa2a00.jpg not downloaded yet
2026-04-27 08:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/b3/80b3e7e3fba610500fa9d158f7f3cf61/pa/KX23637_60bb90a4f47b0373d5e97aa84ae5161e.jpg not downloaded yet
2026-04-27 08:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/b3/80b3e7e3fba610500fa9d158f7f3cf61/pa/KX23637_fdbcc6c3d36bcec4dd0bc2ccdf324cc1.jpg not downloaded yet
2026-04-27 08:08:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438136f50>
2026-04-27 08:08:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbc55af0-3d87-58bb-a403-2196d12973af/fbc55af0-3d87-58bb-a403-2196d12973af_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/0d/210da1334e1e6913afba5cf0c9a99eb2/pa/PZ40280_2d13ce921e7b0298b7403d09e25e4a72.jpg saved to cache
2026-04-27 08:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fbc55af0-3d87-58bb-a403-2196d12973af
2026-04-27 08:08:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/b3/80b3e7e3fba610500fa9d158f7f3cf61/pa/KX23637_cf94cb6f2710a8e5cfeb69fbbc5bc1c4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d90a50>
2026-04-27 08:08:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bfb2794-433d-5dce-872c-aeb7cda9b5bd/5bfb2794-433d-5dce-872c-aeb7cda9b5bd_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/b3/80b3e7e3fba610500fa9d158f7f3cf61/pa/KX23637_cf94cb6f2710a8e5cfeb69fbbc5bc1c4.jpg saved to cache
2026-04-27 08:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5bfb2794-433d-5dce-872c-aeb7cda9b5bd
2026-04-27 08:08:18 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.850(s), this was the 1st time calling it.
2026-04-27 08:08:18 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.040411157811855 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:08:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/b3/80b3e7e3fba610500fa9d158f7f3cf61/pa/KX23637_fdbcc6c3d36bcec4dd0bc2ccdf324cc1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c28410>
2026-04-27 08:08:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bfb2794-433d-5dce-872c-aeb7cda9b5bd/5bfb2794-433d-5dce-872c-aeb7cda9b5bd_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/b3/80b3e7e3fba610500fa9d158f7f3cf61/pa/KX23637_fdbcc6c3d36bcec4dd0bc2ccdf324cc1.jpg saved to cache
2026-04-27 08:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5bfb2794-433d-5dce-872c-aeb7cda9b5bd
2026-04-27 08:08:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/b3/80b3e7e3fba610500fa9d158f7f3cf61/pa/KX23637_60bb90a4f47b0373d5e97aa84ae5161e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d61890>
2026-04-27 08:08:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bfb2794-433d-5dce-872c-aeb7cda9b5bd/5bfb2794-433d-5dce-872c-aeb7cda9b5bd_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/b3/80b3e7e3fba610500fa9d158f7f3cf61/pa/KX23637_60bb90a4f47b0373d5e97aa84ae5161e.jpg saved to cache
2026-04-27 08:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5bfb2794-433d-5dce-872c-aeb7cda9b5bd
2026-04-27 08:08:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/b3/80b3e7e3fba610500fa9d158f7f3cf61/pa/KX23637_4bfbbfef7c412b2a62a447d95eaa2a00.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d30090>
2026-04-27 08:08:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bfb2794-433d-5dce-872c-aeb7cda9b5bd/5bfb2794-433d-5dce-872c-aeb7cda9b5bd_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/b3/80b3e7e3fba610500fa9d158f7f3cf61/pa/KX23637_4bfbbfef7c412b2a62a447d95eaa2a00.jpg saved to cache
2026-04-27 08:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5bfb2794-433d-5dce-872c-aeb7cda9b5bd
2026-04-27 08:08:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/b3/80b3e7e3fba610500fa9d158f7f3cf61/pa/KX23637_47932221ad3d0fdcc7b6c6f2e775c602.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/b3/80b3e7e3fba610500fa9d158f7f3cf61/pa/KX23637_bb1897671941bb26f093deada34cdab0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380a6a50>
2026-04-27 08:08:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bfb2794-433d-5dce-872c-aeb7cda9b5bd/5bfb2794-433d-5dce-872c-aeb7cda9b5bd_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/b3/80b3e7e3fba610500fa9d158f7f3cf61/pa/KX23637_47932221ad3d0fdcc7b6c6f2e775c602.jpg saved to cache
2026-04-27 08:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5bfb2794-433d-5dce-872c-aeb7cda9b5bd
2026-04-27 08:08:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438df9e50>
2026-04-27 08:08:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bfb2794-433d-5dce-872c-aeb7cda9b5bd/5bfb2794-433d-5dce-872c-aeb7cda9b5bd_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/b3/80b3e7e3fba610500fa9d158f7f3cf61/pa/KX23637_bb1897671941bb26f093deada34cdab0.jpg saved to cache
2026-04-27 08:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5bfb2794-433d-5dce-872c-aeb7cda9b5bd
2026-04-27 08:08:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5bfb2794-433d-5dce-872c-aeb7cda9b5bd, skipping ID generation
2026-04-27 08:08:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5bfb2794-433d-5dce-872c-aeb7cda9b5bd with scrape type 1
2026-04-27 08:08:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5bfb2794-433d-5dce-872c-aeb7cda9b5bd sending to next pipeline
2026-04-27 08:08:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5bfb2794-433d-5dce-872c-aeb7cda9b5bd, identifier: KX23637
2026-04-27 08:08:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5bfb2794-433d-5dce-872c-aeb7cda9b5bd with identifier: KX23637
2026-04-27 08:08:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5bfb2794-433d-5dce-872c-aeb7cda9b5bd with identifier: KX23637
2026-04-27 08:08:19 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 5bfb2794-433d-5dce-872c-aeb7cda9b5bd with identifier: KX23637 to the API
2026-04-27 08:08:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:19 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img80/b3/80b3e7e3fba610500fa9d158f7f3cf61/pa/KX23637_bb1897671941bb26f093deada34cdab0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 157,
 'category': None,
 'city': 'Ambarès-et-Lagrave',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2026-04-28T15:30:02Z',
 'fuel_type': 'petrol',
 'id': '5bfb2794-433d-5dce-872c-aeb7cda9b5bd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 44.9274,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KX23637',
 'listing': 'auction',
 'location': 'FR, Ambarès-et-Lagrave',
 'location_confidence': 'geocoded',
 'longitude': -0.4914,
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 149077,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5bfb2794-433d-5dce-872c-aeb7cda9b5bd/5bfb2794-433d-5dce-872c-aeb7cda9b5bd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65098,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/b3/80b3e7e3fba610500fa9d158f7f3cf61/pa/KX23637_bb1897671941bb26f093deada34cdab0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5bfb2794-433d-5dce-872c-aeb7cda9b5bd/5bfb2794-433d-5dce-872c-aeb7cda9b5bd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74617,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/b3/80b3e7e3fba610500fa9d158f7f3cf61/pa/KX23637_cf94cb6f2710a8e5cfeb69fbbc5bc1c4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5bfb2794-433d-5dce-872c-aeb7cda9b5bd/5bfb2794-433d-5dce-872c-aeb7cda9b5bd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76441,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/b3/80b3e7e3fba610500fa9d158f7f3cf61/pa/KX23637_47932221ad3d0fdcc7b6c6f2e775c602.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5bfb2794-433d-5dce-872c-aeb7cda9b5bd/5bfb2794-433d-5dce-872c-aeb7cda9b5bd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67264,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/b3/80b3e7e3fba610500fa9d158f7f3cf61/pa/KX23637_4bfbbfef7c412b2a62a447d95eaa2a00.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5bfb2794-433d-5dce-872c-aeb7cda9b5bd/5bfb2794-433d-5dce-872c-aeb7cda9b5bd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79967,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/b3/80b3e7e3fba610500fa9d158f7f3cf61/pa/KX23637_60bb90a4f47b0373d5e97aa84ae5161e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5bfb2794-433d-5dce-872c-aeb7cda9b5bd/5bfb2794-433d-5dce-872c-aeb7cda9b5bd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24971,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/b3/80b3e7e3fba610500fa9d158f7f3cf61/pa/KX23637_fdbcc6c3d36bcec4dd0bc2ccdf324cc1.jpg',
             'Width': 800}],
 'postal_code': '33440',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Gironde',
 'province_code': 'FR-33',
 'region': 'Nouvelle-Aquitaine',
 'region_code': 'FR-75',
 'registration_date': '2008-09-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 1.6 Ti-VCT Ghia',
 'transmission': 'manual',
 'trim': 'Ghia',
 'year': 2008}
2026-04-27 08:08:20 [auto1.fr] INFO: Saving data for KX23637: {'created_time': 1777277300.081357, 'last_price_update_time': 1777277300.081371, 'has_photos': True, 'auction_closing_time': 1777390202.0}
2026-04-27 08:08:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/0d/210da1334e1e6913afba5cf0c9a99eb2/pa/PZ40280_3036d632253e70fd7e380ef2420df4aa.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438cfbe90>
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbc55af0-3d87-58bb-a403-2196d12973af/fbc55af0-3d87-58bb-a403-2196d12973af_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/0d/210da1334e1e6913afba5cf0c9a99eb2/pa/PZ40280_3036d632253e70fd7e380ef2420df4aa.jpg saved to cache
2026-04-27 08:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fbc55af0-3d87-58bb-a403-2196d12973af
2026-04-27 08:08:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YJ90773/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/0d/210da1334e1e6913afba5cf0c9a99eb2/pa/PZ40280_51012298fd6fd1e6350fb6d2b4585395.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ceac10>
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbc55af0-3d87-58bb-a403-2196d12973af/fbc55af0-3d87-58bb-a403-2196d12973af_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/0d/210da1334e1e6913afba5cf0c9a99eb2/pa/PZ40280_51012298fd6fd1e6350fb6d2b4585395.jpg saved to cache
2026-04-27 08:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fbc55af0-3d87-58bb-a403-2196d12973af
2026-04-27 08:08:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/0d/210da1334e1e6913afba5cf0c9a99eb2/pa/PZ40280_b67bdd3cbc89b2d191fa3d7d1541256f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a18150>
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbc55af0-3d87-58bb-a403-2196d12973af/fbc55af0-3d87-58bb-a403-2196d12973af_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/0d/210da1334e1e6913afba5cf0c9a99eb2/pa/PZ40280_b67bdd3cbc89b2d191fa3d7d1541256f.jpg saved to cache
2026-04-27 08:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fbc55af0-3d87-58bb-a403-2196d12973af
2026-04-27 08:08:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/0d/210da1334e1e6913afba5cf0c9a99eb2/pa/PZ40280_c9c7929f7fe264163e8e35cbae668f1b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ce8b90>
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbc55af0-3d87-58bb-a403-2196d12973af/fbc55af0-3d87-58bb-a403-2196d12973af_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/0d/210da1334e1e6913afba5cf0c9a99eb2/pa/PZ40280_c9c7929f7fe264163e8e35cbae668f1b.jpg saved to cache
2026-04-27 08:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fbc55af0-3d87-58bb-a403-2196d12973af
2026-04-27 08:08:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/0d/210da1334e1e6913afba5cf0c9a99eb2/pa/PZ40280_cb2ace2524ca1fbd1fd0260262907bda.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438087fd0>
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbc55af0-3d87-58bb-a403-2196d12973af/fbc55af0-3d87-58bb-a403-2196d12973af_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/0d/210da1334e1e6913afba5cf0c9a99eb2/pa/PZ40280_cb2ace2524ca1fbd1fd0260262907bda.jpg saved to cache
2026-04-27 08:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fbc55af0-3d87-58bb-a403-2196d12973af
2026-04-27 08:08:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/0d/210da1334e1e6913afba5cf0c9a99eb2/pa/PZ40280_9dc9841f5e5aeea7550477d8bf68f5df.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HS98603/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a63ed0>
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbc55af0-3d87-58bb-a403-2196d12973af/fbc55af0-3d87-58bb-a403-2196d12973af_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/0d/210da1334e1e6913afba5cf0c9a99eb2/pa/PZ40280_9dc9841f5e5aeea7550477d8bf68f5df.jpg saved to cache
2026-04-27 08:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fbc55af0-3d87-58bb-a403-2196d12973af
2026-04-27 08:08:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/0d/210da1334e1e6913afba5cf0c9a99eb2/pa/PZ40280_c157778659e7ac30609a1d3c6056bdef.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/0d/210da1334e1e6913afba5cf0c9a99eb2/pa/PZ40280_6ab74b7e0548859a0a8864f9667e893c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438fbf890>
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbc55af0-3d87-58bb-a403-2196d12973af/fbc55af0-3d87-58bb-a403-2196d12973af_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/0d/210da1334e1e6913afba5cf0c9a99eb2/pa/PZ40280_c157778659e7ac30609a1d3c6056bdef.jpg saved to cache
2026-04-27 08:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fbc55af0-3d87-58bb-a403-2196d12973af
2026-04-27 08:08:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/0d/210da1334e1e6913afba5cf0c9a99eb2/pa/PZ40280_43c88e8051b5dc53fac8501f44ba1b4d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ca8550>
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbc55af0-3d87-58bb-a403-2196d12973af/fbc55af0-3d87-58bb-a403-2196d12973af_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/0d/210da1334e1e6913afba5cf0c9a99eb2/pa/PZ40280_6ab74b7e0548859a0a8864f9667e893c.jpg saved to cache
2026-04-27 08:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fbc55af0-3d87-58bb-a403-2196d12973af
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a1ac50>
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbc55af0-3d87-58bb-a403-2196d12973af/fbc55af0-3d87-58bb-a403-2196d12973af_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/0d/210da1334e1e6913afba5cf0c9a99eb2/pa/PZ40280_43c88e8051b5dc53fac8501f44ba1b4d.jpg saved to cache
2026-04-27 08:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fbc55af0-3d87-58bb-a403-2196d12973af
2026-04-27 08:08:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fbc55af0-3d87-58bb-a403-2196d12973af, skipping ID generation
2026-04-27 08:08:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fbc55af0-3d87-58bb-a403-2196d12973af with scrape type 1
2026-04-27 08:08:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fbc55af0-3d87-58bb-a403-2196d12973af sending to next pipeline
2026-04-27 08:08:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: fbc55af0-3d87-58bb-a403-2196d12973af, identifier: PZ40280
2026-04-27 08:08:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: fbc55af0-3d87-58bb-a403-2196d12973af with identifier: PZ40280
2026-04-27 08:08:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: fbc55af0-3d87-58bb-a403-2196d12973af with identifier: PZ40280
2026-04-27 08:08:21 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: fbc55af0-3d87-58bb-a403-2196d12973af with identifier: PZ40280 to the API
2026-04-27 08:08:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:21 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img21/0d/210da1334e1e6913afba5cf0c9a99eb2/pa/PZ40280_43c88e8051b5dc53fac8501f44ba1b4d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'category': None,
 'city': 'Loyettes',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 101,
 'expiration_date': '2026-04-28T15:07:53Z',
 'fuel_type': 'petrol',
 'id': 'fbc55af0-3d87-58bb-a403-2196d12973af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 45.7766,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PZ40280',
 'listing': 'auction',
 'location': 'FR, Loyettes',
 'location_confidence': 'geocoded',
 'longitude': 5.2069,
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 25655,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fbc55af0-3d87-58bb-a403-2196d12973af/fbc55af0-3d87-58bb-a403-2196d12973af_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83614,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/0d/210da1334e1e6913afba5cf0c9a99eb2/pa/PZ40280_6ab74b7e0548859a0a8864f9667e893c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fbc55af0-3d87-58bb-a403-2196d12973af/fbc55af0-3d87-58bb-a403-2196d12973af_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84441,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/0d/210da1334e1e6913afba5cf0c9a99eb2/pa/PZ40280_43c88e8051b5dc53fac8501f44ba1b4d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fbc55af0-3d87-58bb-a403-2196d12973af/fbc55af0-3d87-58bb-a403-2196d12973af_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73222,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/0d/210da1334e1e6913afba5cf0c9a99eb2/pa/PZ40280_c157778659e7ac30609a1d3c6056bdef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fbc55af0-3d87-58bb-a403-2196d12973af/fbc55af0-3d87-58bb-a403-2196d12973af_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57015,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/0d/210da1334e1e6913afba5cf0c9a99eb2/pa/PZ40280_9dc9841f5e5aeea7550477d8bf68f5df.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fbc55af0-3d87-58bb-a403-2196d12973af/fbc55af0-3d87-58bb-a403-2196d12973af_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67517,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/0d/210da1334e1e6913afba5cf0c9a99eb2/pa/PZ40280_cb2ace2524ca1fbd1fd0260262907bda.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fbc55af0-3d87-58bb-a403-2196d12973af/fbc55af0-3d87-58bb-a403-2196d12973af_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74738,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/0d/210da1334e1e6913afba5cf0c9a99eb2/pa/PZ40280_c9c7929f7fe264163e8e35cbae668f1b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fbc55af0-3d87-58bb-a403-2196d12973af/fbc55af0-3d87-58bb-a403-2196d12973af_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59108,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/0d/210da1334e1e6913afba5cf0c9a99eb2/pa/PZ40280_b67bdd3cbc89b2d191fa3d7d1541256f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fbc55af0-3d87-58bb-a403-2196d12973af/fbc55af0-3d87-58bb-a403-2196d12973af_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83320,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/0d/210da1334e1e6913afba5cf0c9a99eb2/pa/PZ40280_51012298fd6fd1e6350fb6d2b4585395.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fbc55af0-3d87-58bb-a403-2196d12973af/fbc55af0-3d87-58bb-a403-2196d12973af_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86240,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/0d/210da1334e1e6913afba5cf0c9a99eb2/pa/PZ40280_3036d632253e70fd7e380ef2420df4aa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fbc55af0-3d87-58bb-a403-2196d12973af/fbc55af0-3d87-58bb-a403-2196d12973af_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46232,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/0d/210da1334e1e6913afba5cf0c9a99eb2/pa/PZ40280_2d13ce921e7b0298b7403d09e25e4a72.jpg',
             'Width': 800}],
 'postal_code': '01360',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Ain',
 'province_code': 'FR-01',
 'region': 'Auvergne-Rhône-Alpes',
 'region_code': 'FR-84',
 'registration_date': '2024-03-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2024}
2026-04-27 08:08:21 [auto1.fr] INFO: Saving data for PZ40280: {'created_time': 1777277301.903252, 'last_price_update_time': 1777277301.903264, 'has_photos': True, 'auction_closing_time': 1777388873.0}
2026-04-27 08:08:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NK86276> (referer: https://www.auto1.com/v1/car-details-view/NK86276/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9a6e479-7deb-514b-920c-63915f0f03e1 with identifier: NK86276
2026-04-27 08:08:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9a6e479-7deb-514b-920c-63915f0f03e1 with scrape type 1
2026-04-27 08:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c9a6e479-7deb-514b-920c-63915f0f03e1
2026-04-27 08:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/61/84619bd772d5cf874ba66a2f0d9a34cd/pa/NK86276_b63bf2bffbbcae02ec052aa65781b538.jpg not downloaded yet
2026-04-27 08:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/61/84619bd772d5cf874ba66a2f0d9a34cd/pa/NK86276_9a322ad9cc933832411535ab0d7e5281.jpg not downloaded yet
2026-04-27 08:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/61/84619bd772d5cf874ba66a2f0d9a34cd/pa/NK86276_9f496a8528ab677e7fa2d303ec991cbd.jpg not downloaded yet
2026-04-27 08:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/61/84619bd772d5cf874ba66a2f0d9a34cd/pa/NK86276_21835e47563121f6e150cc12a7156fdf.jpg not downloaded yet
2026-04-27 08:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/61/84619bd772d5cf874ba66a2f0d9a34cd/pa/NK86276_3f8307429b7adad893abe559f4cddfb5.jpg not downloaded yet
2026-04-27 08:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/61/84619bd772d5cf874ba66a2f0d9a34cd/pa/NK86276_51da36c650ffa6e1d849dd990f36af1a.jpg not downloaded yet
2026-04-27 08:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/61/84619bd772d5cf874ba66a2f0d9a34cd/pa/NK86276_a7ac7cfa10cfb46cfe4c124c7d99da4a.jpg not downloaded yet
2026-04-27 08:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/61/84619bd772d5cf874ba66a2f0d9a34cd/pa/NK86276_4f96711935e727c27bdcfbc8de386245.jpg not downloaded yet
2026-04-27 08:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/61/84619bd772d5cf874ba66a2f0d9a34cd/pa/NK86276_0ce735665f8ff28e6e7d8c7afb23c672.jpg not downloaded yet
2026-04-27 08:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/61/84619bd772d5cf874ba66a2f0d9a34cd/pa/NK86276_759df21da72e8f7cbf6293ba004e94e9.jpg not downloaded yet
2026-04-27 08:08:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:08:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LT67510/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/61/84619bd772d5cf874ba66a2f0d9a34cd/pa/NK86276_759df21da72e8f7cbf6293ba004e94e9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438cfaa10>
2026-04-27 08:08:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9a6e479-7deb-514b-920c-63915f0f03e1/c9a6e479-7deb-514b-920c-63915f0f03e1_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/61/84619bd772d5cf874ba66a2f0d9a34cd/pa/NK86276_759df21da72e8f7cbf6293ba004e94e9.jpg saved to cache
2026-04-27 08:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c9a6e479-7deb-514b-920c-63915f0f03e1
2026-04-27 08:08:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JB08558> (referer: https://www.auto1.com/v1/car-details-view/JB08558/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/61/84619bd772d5cf874ba66a2f0d9a34cd/pa/NK86276_0ce735665f8ff28e6e7d8c7afb23c672.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 59e2b3f6-1009-5d21-9c48-2d3a3e968cfe with identifier: JB08558
2026-04-27 08:08:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59e2b3f6-1009-5d21-9c48-2d3a3e968cfe with scrape type 1
2026-04-27 08:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 59e2b3f6-1009-5d21-9c48-2d3a3e968cfe
2026-04-27 08:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/7d/6f7d1d9e4ab2d3dffd0159eae0b2655e/pa/JB08558_b6ffd69326ae476ea179966e3df43327.jpg not downloaded yet
2026-04-27 08:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/7d/6f7d1d9e4ab2d3dffd0159eae0b2655e/pa/JB08558_af15c0fe9e76ef33b979b25122f6a598.jpg not downloaded yet
2026-04-27 08:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/7d/6f7d1d9e4ab2d3dffd0159eae0b2655e/pa/JB08558_8e63218f45ea90249d89539947fa20a0.jpg not downloaded yet
2026-04-27 08:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/7d/6f7d1d9e4ab2d3dffd0159eae0b2655e/pa/JB08558_eeb5e28c14f2ddfdea2f77690cafecff.jpg not downloaded yet
2026-04-27 08:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/7d/6f7d1d9e4ab2d3dffd0159eae0b2655e/pa/JB08558_036fd4f5ad2af8da436a8c7627818747.jpg not downloaded yet
2026-04-27 08:08:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bf18410>
2026-04-27 08:08:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9a6e479-7deb-514b-920c-63915f0f03e1/c9a6e479-7deb-514b-920c-63915f0f03e1_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/61/84619bd772d5cf874ba66a2f0d9a34cd/pa/NK86276_0ce735665f8ff28e6e7d8c7afb23c672.jpg saved to cache
2026-04-27 08:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c9a6e479-7deb-514b-920c-63915f0f03e1
2026-04-27 08:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/7d/6f7d1d9e4ab2d3dffd0159eae0b2655e/pa/JB08558_7aec5f228a7e8231a6986582bef91fd3.jpg not downloaded yet
2026-04-27 08:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/7d/6f7d1d9e4ab2d3dffd0159eae0b2655e/pa/JB08558_b4151946f83e48f020ae6572047fec98.jpg not downloaded yet
2026-04-27 08:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/7d/6f7d1d9e4ab2d3dffd0159eae0b2655e/pa/JB08558_0cc5efa426f47877c6bf42ee8eb2b4e4.jpg not downloaded yet
2026-04-27 08:08:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/61/84619bd772d5cf874ba66a2f0d9a34cd/pa/NK86276_4f96711935e727c27bdcfbc8de386245.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/7d/6f7d1d9e4ab2d3dffd0159eae0b2655e/pa/JB08558_4139fd007abee93829927f210b4d9b5f.jpg not downloaded yet
2026-04-27 08:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/7d/6f7d1d9e4ab2d3dffd0159eae0b2655e/pa/JB08558_45be98dc0357b16fef41c8ee1df5abcc.jpg not downloaded yet
2026-04-27 08:08:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380a7790>
2026-04-27 08:08:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9a6e479-7deb-514b-920c-63915f0f03e1/c9a6e479-7deb-514b-920c-63915f0f03e1_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/61/84619bd772d5cf874ba66a2f0d9a34cd/pa/NK86276_4f96711935e727c27bdcfbc8de386245.jpg saved to cache
2026-04-27 08:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c9a6e479-7deb-514b-920c-63915f0f03e1
2026-04-27 08:08:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/7d/6f7d1d9e4ab2d3dffd0159eae0b2655e/pa/JB08558_0cc5efa426f47877c6bf42ee8eb2b4e4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d62d10>
2026-04-27 08:08:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59e2b3f6-1009-5d21-9c48-2d3a3e968cfe/59e2b3f6-1009-5d21-9c48-2d3a3e968cfe_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/7d/6f7d1d9e4ab2d3dffd0159eae0b2655e/pa/JB08558_0cc5efa426f47877c6bf42ee8eb2b4e4.jpg saved to cache
2026-04-27 08:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 59e2b3f6-1009-5d21-9c48-2d3a3e968cfe
2026-04-27 08:08:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/7d/6f7d1d9e4ab2d3dffd0159eae0b2655e/pa/JB08558_45be98dc0357b16fef41c8ee1df5abcc.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438e00d10>
2026-04-27 08:08:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59e2b3f6-1009-5d21-9c48-2d3a3e968cfe/59e2b3f6-1009-5d21-9c48-2d3a3e968cfe_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/7d/6f7d1d9e4ab2d3dffd0159eae0b2655e/pa/JB08558_45be98dc0357b16fef41c8ee1df5abcc.jpg saved to cache
2026-04-27 08:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 59e2b3f6-1009-5d21-9c48-2d3a3e968cfe
2026-04-27 08:08:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/7d/6f7d1d9e4ab2d3dffd0159eae0b2655e/pa/JB08558_4139fd007abee93829927f210b4d9b5f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b28d10>
2026-04-27 08:08:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59e2b3f6-1009-5d21-9c48-2d3a3e968cfe/59e2b3f6-1009-5d21-9c48-2d3a3e968cfe_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/7d/6f7d1d9e4ab2d3dffd0159eae0b2655e/pa/JB08558_4139fd007abee93829927f210b4d9b5f.jpg saved to cache
2026-04-27 08:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 59e2b3f6-1009-5d21-9c48-2d3a3e968cfe
2026-04-27 08:08:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/7d/6f7d1d9e4ab2d3dffd0159eae0b2655e/pa/JB08558_b4151946f83e48f020ae6572047fec98.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bf1acd0>
2026-04-27 08:08:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59e2b3f6-1009-5d21-9c48-2d3a3e968cfe/59e2b3f6-1009-5d21-9c48-2d3a3e968cfe_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/7d/6f7d1d9e4ab2d3dffd0159eae0b2655e/pa/JB08558_b4151946f83e48f020ae6572047fec98.jpg saved to cache
2026-04-27 08:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 59e2b3f6-1009-5d21-9c48-2d3a3e968cfe
2026-04-27 08:08:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/7d/6f7d1d9e4ab2d3dffd0159eae0b2655e/pa/JB08558_7aec5f228a7e8231a6986582bef91fd3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/7d/6f7d1d9e4ab2d3dffd0159eae0b2655e/pa/JB08558_036fd4f5ad2af8da436a8c7627818747.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d61e90>
2026-04-27 08:08:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59e2b3f6-1009-5d21-9c48-2d3a3e968cfe/59e2b3f6-1009-5d21-9c48-2d3a3e968cfe_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/7d/6f7d1d9e4ab2d3dffd0159eae0b2655e/pa/JB08558_7aec5f228a7e8231a6986582bef91fd3.jpg saved to cache
2026-04-27 08:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 59e2b3f6-1009-5d21-9c48-2d3a3e968cfe
2026-04-27 08:08:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d62210>
2026-04-27 08:08:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59e2b3f6-1009-5d21-9c48-2d3a3e968cfe/59e2b3f6-1009-5d21-9c48-2d3a3e968cfe_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/7d/6f7d1d9e4ab2d3dffd0159eae0b2655e/pa/JB08558_036fd4f5ad2af8da436a8c7627818747.jpg saved to cache
2026-04-27 08:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 59e2b3f6-1009-5d21-9c48-2d3a3e968cfe
2026-04-27 08:08:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/7d/6f7d1d9e4ab2d3dffd0159eae0b2655e/pa/JB08558_eeb5e28c14f2ddfdea2f77690cafecff.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143818acd0>
2026-04-27 08:08:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59e2b3f6-1009-5d21-9c48-2d3a3e968cfe/59e2b3f6-1009-5d21-9c48-2d3a3e968cfe_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/7d/6f7d1d9e4ab2d3dffd0159eae0b2655e/pa/JB08558_eeb5e28c14f2ddfdea2f77690cafecff.jpg saved to cache
2026-04-27 08:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 59e2b3f6-1009-5d21-9c48-2d3a3e968cfe
2026-04-27 08:08:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/7d/6f7d1d9e4ab2d3dffd0159eae0b2655e/pa/JB08558_8e63218f45ea90249d89539947fa20a0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380864d0>
2026-04-27 08:08:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59e2b3f6-1009-5d21-9c48-2d3a3e968cfe/59e2b3f6-1009-5d21-9c48-2d3a3e968cfe_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/7d/6f7d1d9e4ab2d3dffd0159eae0b2655e/pa/JB08558_8e63218f45ea90249d89539947fa20a0.jpg saved to cache
2026-04-27 08:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 59e2b3f6-1009-5d21-9c48-2d3a3e968cfe
2026-04-27 08:08:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/7d/6f7d1d9e4ab2d3dffd0159eae0b2655e/pa/JB08558_af15c0fe9e76ef33b979b25122f6a598.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/7d/6f7d1d9e4ab2d3dffd0159eae0b2655e/pa/JB08558_b6ffd69326ae476ea179966e3df43327.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b2a2d0>
2026-04-27 08:08:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59e2b3f6-1009-5d21-9c48-2d3a3e968cfe/59e2b3f6-1009-5d21-9c48-2d3a3e968cfe_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/7d/6f7d1d9e4ab2d3dffd0159eae0b2655e/pa/JB08558_af15c0fe9e76ef33b979b25122f6a598.jpg saved to cache
2026-04-27 08:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 59e2b3f6-1009-5d21-9c48-2d3a3e968cfe
2026-04-27 08:08:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438cf9910>
2026-04-27 08:08:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59e2b3f6-1009-5d21-9c48-2d3a3e968cfe/59e2b3f6-1009-5d21-9c48-2d3a3e968cfe_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/7d/6f7d1d9e4ab2d3dffd0159eae0b2655e/pa/JB08558_b6ffd69326ae476ea179966e3df43327.jpg saved to cache
2026-04-27 08:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 59e2b3f6-1009-5d21-9c48-2d3a3e968cfe
2026-04-27 08:08:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 59e2b3f6-1009-5d21-9c48-2d3a3e968cfe, skipping ID generation
2026-04-27 08:08:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59e2b3f6-1009-5d21-9c48-2d3a3e968cfe with scrape type 1
2026-04-27 08:08:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 59e2b3f6-1009-5d21-9c48-2d3a3e968cfe sending to next pipeline
2026-04-27 08:08:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 59e2b3f6-1009-5d21-9c48-2d3a3e968cfe, identifier: JB08558
2026-04-27 08:08:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 59e2b3f6-1009-5d21-9c48-2d3a3e968cfe with identifier: JB08558
2026-04-27 08:08:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 59e2b3f6-1009-5d21-9c48-2d3a3e968cfe with identifier: JB08558
2026-04-27 08:08:29 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 59e2b3f6-1009-5d21-9c48-2d3a3e968cfe with identifier: JB08558 to the API
2026-04-27 08:08:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:29 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6f/7d/6f7d1d9e4ab2d3dffd0159eae0b2655e/pa/JB08558_b6ffd69326ae476ea179966e3df43327.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': None,
 'city': 'Ambarès-et-Lagrave',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 101,
 'expiration_date': '2026-04-28T15:16:34Z',
 'fuel_type': 'petrol',
 'id': '59e2b3f6-1009-5d21-9c48-2d3a3e968cfe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 44.9274,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JB08558',
 'listing': 'auction',
 'location': 'FR, Ambarès-et-Lagrave',
 'location_confidence': 'geocoded',
 'longitude': -0.4914,
 'make': 'Opel',
 'model': 'Mokka X',
 'odometer': 25241,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_59e2b3f6-1009-5d21-9c48-2d3a3e968cfe/59e2b3f6-1009-5d21-9c48-2d3a3e968cfe_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 126046,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/7d/6f7d1d9e4ab2d3dffd0159eae0b2655e/pa/JB08558_b6ffd69326ae476ea179966e3df43327.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_59e2b3f6-1009-5d21-9c48-2d3a3e968cfe/59e2b3f6-1009-5d21-9c48-2d3a3e968cfe_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120067,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/7d/6f7d1d9e4ab2d3dffd0159eae0b2655e/pa/JB08558_af15c0fe9e76ef33b979b25122f6a598.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_59e2b3f6-1009-5d21-9c48-2d3a3e968cfe/59e2b3f6-1009-5d21-9c48-2d3a3e968cfe_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 123787,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/7d/6f7d1d9e4ab2d3dffd0159eae0b2655e/pa/JB08558_8e63218f45ea90249d89539947fa20a0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_59e2b3f6-1009-5d21-9c48-2d3a3e968cfe/59e2b3f6-1009-5d21-9c48-2d3a3e968cfe_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98162,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/7d/6f7d1d9e4ab2d3dffd0159eae0b2655e/pa/JB08558_eeb5e28c14f2ddfdea2f77690cafecff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_59e2b3f6-1009-5d21-9c48-2d3a3e968cfe/59e2b3f6-1009-5d21-9c48-2d3a3e968cfe_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103227,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/7d/6f7d1d9e4ab2d3dffd0159eae0b2655e/pa/JB08558_036fd4f5ad2af8da436a8c7627818747.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_59e2b3f6-1009-5d21-9c48-2d3a3e968cfe/59e2b3f6-1009-5d21-9c48-2d3a3e968cfe_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115776,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/7d/6f7d1d9e4ab2d3dffd0159eae0b2655e/pa/JB08558_7aec5f228a7e8231a6986582bef91fd3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_59e2b3f6-1009-5d21-9c48-2d3a3e968cfe/59e2b3f6-1009-5d21-9c48-2d3a3e968cfe_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88710,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/7d/6f7d1d9e4ab2d3dffd0159eae0b2655e/pa/JB08558_b4151946f83e48f020ae6572047fec98.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_59e2b3f6-1009-5d21-9c48-2d3a3e968cfe/59e2b3f6-1009-5d21-9c48-2d3a3e968cfe_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114501,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/7d/6f7d1d9e4ab2d3dffd0159eae0b2655e/pa/JB08558_0cc5efa426f47877c6bf42ee8eb2b4e4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_59e2b3f6-1009-5d21-9c48-2d3a3e968cfe/59e2b3f6-1009-5d21-9c48-2d3a3e968cfe_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 119720,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/7d/6f7d1d9e4ab2d3dffd0159eae0b2655e/pa/JB08558_4139fd007abee93829927f210b4d9b5f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_59e2b3f6-1009-5d21-9c48-2d3a3e968cfe/59e2b3f6-1009-5d21-9c48-2d3a3e968cfe_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76368,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/7d/6f7d1d9e4ab2d3dffd0159eae0b2655e/pa/JB08558_45be98dc0357b16fef41c8ee1df5abcc.jpg',
             'Width': 800}],
 'postal_code': '33440',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Gironde',
 'province_code': 'FR-33',
 'region': 'Nouvelle-Aquitaine',
 'region_code': 'FR-75',
 'registration_date': '2023-04-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Mokka X 1.2 Turbo Business Elegance',
 'transmission': 'manual',
 'trim': 'Business Elegance',
 'year': 2023}
2026-04-27 08:08:29 [auto1.fr] INFO: Saving data for JB08558: {'created_time': 1777277309.762356, 'last_price_update_time': 1777277309.762368, 'has_photos': True, 'auction_closing_time': 1777389394.0}
2026-04-27 08:08:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/61/84619bd772d5cf874ba66a2f0d9a34cd/pa/NK86276_a7ac7cfa10cfb46cfe4c124c7d99da4a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380a5c50>
2026-04-27 08:08:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9a6e479-7deb-514b-920c-63915f0f03e1/c9a6e479-7deb-514b-920c-63915f0f03e1_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/61/84619bd772d5cf874ba66a2f0d9a34cd/pa/NK86276_a7ac7cfa10cfb46cfe4c124c7d99da4a.jpg saved to cache
2026-04-27 08:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c9a6e479-7deb-514b-920c-63915f0f03e1
2026-04-27 08:08:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/61/84619bd772d5cf874ba66a2f0d9a34cd/pa/NK86276_51da36c650ffa6e1d849dd990f36af1a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ce8110>
2026-04-27 08:08:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9a6e479-7deb-514b-920c-63915f0f03e1/c9a6e479-7deb-514b-920c-63915f0f03e1_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/61/84619bd772d5cf874ba66a2f0d9a34cd/pa/NK86276_51da36c650ffa6e1d849dd990f36af1a.jpg saved to cache
2026-04-27 08:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c9a6e479-7deb-514b-920c-63915f0f03e1
2026-04-27 08:08:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/61/84619bd772d5cf874ba66a2f0d9a34cd/pa/NK86276_3f8307429b7adad893abe559f4cddfb5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438df9550>
2026-04-27 08:08:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9a6e479-7deb-514b-920c-63915f0f03e1/c9a6e479-7deb-514b-920c-63915f0f03e1_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/61/84619bd772d5cf874ba66a2f0d9a34cd/pa/NK86276_3f8307429b7adad893abe559f4cddfb5.jpg saved to cache
2026-04-27 08:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c9a6e479-7deb-514b-920c-63915f0f03e1
2026-04-27 08:08:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/61/84619bd772d5cf874ba66a2f0d9a34cd/pa/NK86276_21835e47563121f6e150cc12a7156fdf.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438f83d90>
2026-04-27 08:08:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9a6e479-7deb-514b-920c-63915f0f03e1/c9a6e479-7deb-514b-920c-63915f0f03e1_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/61/84619bd772d5cf874ba66a2f0d9a34cd/pa/NK86276_21835e47563121f6e150cc12a7156fdf.jpg saved to cache
2026-04-27 08:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c9a6e479-7deb-514b-920c-63915f0f03e1
2026-04-27 08:08:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/61/84619bd772d5cf874ba66a2f0d9a34cd/pa/NK86276_9f496a8528ab677e7fa2d303ec991cbd.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/61/84619bd772d5cf874ba66a2f0d9a34cd/pa/NK86276_9a322ad9cc933832411535ab0d7e5281.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438cb7650>
2026-04-27 08:08:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9a6e479-7deb-514b-920c-63915f0f03e1/c9a6e479-7deb-514b-920c-63915f0f03e1_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/61/84619bd772d5cf874ba66a2f0d9a34cd/pa/NK86276_9f496a8528ab677e7fa2d303ec991cbd.jpg saved to cache
2026-04-27 08:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c9a6e479-7deb-514b-920c-63915f0f03e1
2026-04-27 08:08:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/61/84619bd772d5cf874ba66a2f0d9a34cd/pa/NK86276_b63bf2bffbbcae02ec052aa65781b538.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c2a0d0>
2026-04-27 08:08:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9a6e479-7deb-514b-920c-63915f0f03e1/c9a6e479-7deb-514b-920c-63915f0f03e1_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/61/84619bd772d5cf874ba66a2f0d9a34cd/pa/NK86276_9a322ad9cc933832411535ab0d7e5281.jpg saved to cache
2026-04-27 08:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c9a6e479-7deb-514b-920c-63915f0f03e1
2026-04-27 08:08:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YP40813/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438df9050>
2026-04-27 08:08:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9a6e479-7deb-514b-920c-63915f0f03e1/c9a6e479-7deb-514b-920c-63915f0f03e1_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/61/84619bd772d5cf874ba66a2f0d9a34cd/pa/NK86276_b63bf2bffbbcae02ec052aa65781b538.jpg saved to cache
2026-04-27 08:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c9a6e479-7deb-514b-920c-63915f0f03e1
2026-04-27 08:08:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c9a6e479-7deb-514b-920c-63915f0f03e1, skipping ID generation
2026-04-27 08:08:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9a6e479-7deb-514b-920c-63915f0f03e1 with scrape type 1
2026-04-27 08:08:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c9a6e479-7deb-514b-920c-63915f0f03e1 sending to next pipeline
2026-04-27 08:08:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c9a6e479-7deb-514b-920c-63915f0f03e1, identifier: NK86276
2026-04-27 08:08:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c9a6e479-7deb-514b-920c-63915f0f03e1 with identifier: NK86276
2026-04-27 08:08:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c9a6e479-7deb-514b-920c-63915f0f03e1 with identifier: NK86276
2026-04-27 08:08:31 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c9a6e479-7deb-514b-920c-63915f0f03e1 with identifier: NK86276 to the API
2026-04-27 08:08:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:31 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img84/61/84619bd772d5cf874ba66a2f0d9a34cd/pa/NK86276_b63bf2bffbbcae02ec052aa65781b538.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 179,
 'category': None,
 'city': 'Allennes-les-Marais',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '3.0L',
 'engine_horse_power': 313,
 'expiration_date': '2026-04-28T15:26:50Z',
 'fuel_type': 'diesel',
 'id': 'c9a6e479-7deb-514b-920c-63915f0f03e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 50.5375,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NK86276',
 'listing': 'auction',
 'location': 'FR, Allennes-les-Marais',
 'location_confidence': 'geocoded',
 'longitude': 2.9536,
 'make': 'Audi',
 'model': 'SQ5',
 'odometer': 264102,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c9a6e479-7deb-514b-920c-63915f0f03e1/c9a6e479-7deb-514b-920c-63915f0f03e1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78984,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/61/84619bd772d5cf874ba66a2f0d9a34cd/pa/NK86276_b63bf2bffbbcae02ec052aa65781b538.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c9a6e479-7deb-514b-920c-63915f0f03e1/c9a6e479-7deb-514b-920c-63915f0f03e1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75784,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/61/84619bd772d5cf874ba66a2f0d9a34cd/pa/NK86276_9a322ad9cc933832411535ab0d7e5281.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c9a6e479-7deb-514b-920c-63915f0f03e1/c9a6e479-7deb-514b-920c-63915f0f03e1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72693,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/61/84619bd772d5cf874ba66a2f0d9a34cd/pa/NK86276_9f496a8528ab677e7fa2d303ec991cbd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c9a6e479-7deb-514b-920c-63915f0f03e1/c9a6e479-7deb-514b-920c-63915f0f03e1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65247,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/61/84619bd772d5cf874ba66a2f0d9a34cd/pa/NK86276_21835e47563121f6e150cc12a7156fdf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c9a6e479-7deb-514b-920c-63915f0f03e1/c9a6e479-7deb-514b-920c-63915f0f03e1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66313,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/61/84619bd772d5cf874ba66a2f0d9a34cd/pa/NK86276_3f8307429b7adad893abe559f4cddfb5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c9a6e479-7deb-514b-920c-63915f0f03e1/c9a6e479-7deb-514b-920c-63915f0f03e1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65353,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/61/84619bd772d5cf874ba66a2f0d9a34cd/pa/NK86276_51da36c650ffa6e1d849dd990f36af1a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c9a6e479-7deb-514b-920c-63915f0f03e1/c9a6e479-7deb-514b-920c-63915f0f03e1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56703,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/61/84619bd772d5cf874ba66a2f0d9a34cd/pa/NK86276_a7ac7cfa10cfb46cfe4c124c7d99da4a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c9a6e479-7deb-514b-920c-63915f0f03e1/c9a6e479-7deb-514b-920c-63915f0f03e1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68113,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/61/84619bd772d5cf874ba66a2f0d9a34cd/pa/NK86276_4f96711935e727c27bdcfbc8de386245.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c9a6e479-7deb-514b-920c-63915f0f03e1/c9a6e479-7deb-514b-920c-63915f0f03e1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77654,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/61/84619bd772d5cf874ba66a2f0d9a34cd/pa/NK86276_0ce735665f8ff28e6e7d8c7afb23c672.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c9a6e479-7deb-514b-920c-63915f0f03e1/c9a6e479-7deb-514b-920c-63915f0f03e1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60450,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/61/84619bd772d5cf874ba66a2f0d9a34cd/pa/NK86276_759df21da72e8f7cbf6293ba004e94e9.jpg',
             'Width': 800}],
 'postal_code': '59251',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Nord',
 'province_code': 'FR-59',
 'region': 'Hauts-de-France',
 'region_code': 'FR-32',
 'registration_date': '2013-12-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi SQ5 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2013}
2026-04-27 08:08:31 [auto1.fr] INFO: Saving data for NK86276: {'created_time': 1777277311.768261, 'last_price_update_time': 1777277311.76827, 'has_photos': True, 'auction_closing_time': 1777390010.0}
2026-04-27 08:08:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JP78113> (referer: https://www.auto1.com/v1/car-details-view/JP78113/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7b2491b-991d-5f7a-be53-7374c8b7c841 with identifier: JP78113
2026-04-27 08:08:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7b2491b-991d-5f7a-be53-7374c8b7c841 with scrape type 1
2026-04-27 08:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item a7b2491b-991d-5f7a-be53-7374c8b7c841
2026-04-27 08:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/c1/65c1c1b8ea1ea055c95417017ed2a365/pa/JP78113_a5b686fc406b6f2968914e3a29699dcb.jpg not downloaded yet
2026-04-27 08:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/c1/65c1c1b8ea1ea055c95417017ed2a365/pa/JP78113_3347b350bf08b7be84ddd4b782427b4a.jpg not downloaded yet
2026-04-27 08:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/c1/65c1c1b8ea1ea055c95417017ed2a365/pa/JP78113_a9cf5576b0cf1a38555f4a96d350e1e3.jpg not downloaded yet
2026-04-27 08:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/c1/65c1c1b8ea1ea055c95417017ed2a365/pa/JP78113_7730204a0c6b0e2b973075f5321d3656.jpg not downloaded yet
2026-04-27 08:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/c1/65c1c1b8ea1ea055c95417017ed2a365/pa/JP78113_3463322789c3eaa0ede3a635781d35da.jpg not downloaded yet
2026-04-27 08:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/c1/65c1c1b8ea1ea055c95417017ed2a365/pa/JP78113_8ea3d3248d8f1b9c4661fe3d4394260e.jpg not downloaded yet
2026-04-27 08:08:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CL54463/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/c1/65c1c1b8ea1ea055c95417017ed2a365/pa/JP78113_8ea3d3248d8f1b9c4661fe3d4394260e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380a50d0>
2026-04-27 08:08:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7b2491b-991d-5f7a-be53-7374c8b7c841/a7b2491b-991d-5f7a-be53-7374c8b7c841_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/c1/65c1c1b8ea1ea055c95417017ed2a365/pa/JP78113_8ea3d3248d8f1b9c4661fe3d4394260e.jpg saved to cache
2026-04-27 08:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a7b2491b-991d-5f7a-be53-7374c8b7c841
2026-04-27 08:08:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MG55357/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/c1/65c1c1b8ea1ea055c95417017ed2a365/pa/JP78113_3463322789c3eaa0ede3a635781d35da.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a58090>
2026-04-27 08:08:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7b2491b-991d-5f7a-be53-7374c8b7c841/a7b2491b-991d-5f7a-be53-7374c8b7c841_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/c1/65c1c1b8ea1ea055c95417017ed2a365/pa/JP78113_3463322789c3eaa0ede3a635781d35da.jpg saved to cache
2026-04-27 08:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a7b2491b-991d-5f7a-be53-7374c8b7c841
2026-04-27 08:08:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YJ90773> (referer: https://www.auto1.com/v1/car-details-view/YJ90773/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f6d6f77-5e5b-5d60-b6ae-4ad2c9e3f510 with identifier: YJ90773
2026-04-27 08:08:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f6d6f77-5e5b-5d60-b6ae-4ad2c9e3f510 with scrape type 1
2026-04-27 08:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4f6d6f77-5e5b-5d60-b6ae-4ad2c9e3f510
2026-04-27 08:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/22/dc227ccb06ae25cf2911247db7c016cb/pa/YJ90773_7e5fe9ed09a891c94f67ac5de01b7f52.jpg not downloaded yet
2026-04-27 08:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/22/dc227ccb06ae25cf2911247db7c016cb/pa/YJ90773_049680893dbae9de32a880b12292aca4.jpg not downloaded yet
2026-04-27 08:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/22/dc227ccb06ae25cf2911247db7c016cb/pa/YJ90773_fae4db9f9245f0ec93a286fc6d201b50.jpg not downloaded yet
2026-04-27 08:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/22/dc227ccb06ae25cf2911247db7c016cb/pa/YJ90773_39eacd3f21d65e1f196af5381c7f3ee2.jpg not downloaded yet
2026-04-27 08:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/22/dc227ccb06ae25cf2911247db7c016cb/pa/YJ90773_ac1bf9e25b3d779bc1fcc298c39e3cce.jpg not downloaded yet
2026-04-27 08:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/22/dc227ccb06ae25cf2911247db7c016cb/pa/YJ90773_c1291c22897f40237d884a8d30fd1646.jpg not downloaded yet
2026-04-27 08:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/22/dc227ccb06ae25cf2911247db7c016cb/pa/YJ90773_640b429e3238f78ff1d698e9f1b24916.jpg not downloaded yet
2026-04-27 08:08:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/c1/65c1c1b8ea1ea055c95417017ed2a365/pa/JP78113_7730204a0c6b0e2b973075f5321d3656.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/22/dc227ccb06ae25cf2911247db7c016cb/pa/YJ90773_9ed2ebaa9502368bfa34f3a432584ed4.jpg not downloaded yet
2026-04-27 08:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/22/dc227ccb06ae25cf2911247db7c016cb/pa/YJ90773_7e1179dbdaa98e1e0507310bf0f7e0c2.jpg not downloaded yet
2026-04-27 08:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/22/dc227ccb06ae25cf2911247db7c016cb/pa/YJ90773_92218a64271e0803a00fbfc316981c7d.jpg not downloaded yet
2026-04-27 08:08:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438adf490>
2026-04-27 08:08:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7b2491b-991d-5f7a-be53-7374c8b7c841/a7b2491b-991d-5f7a-be53-7374c8b7c841_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/c1/65c1c1b8ea1ea055c95417017ed2a365/pa/JP78113_7730204a0c6b0e2b973075f5321d3656.jpg saved to cache
2026-04-27 08:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a7b2491b-991d-5f7a-be53-7374c8b7c841
2026-04-27 08:08:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/22/dc227ccb06ae25cf2911247db7c016cb/pa/YJ90773_640b429e3238f78ff1d698e9f1b24916.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438cb7110>
2026-04-27 08:08:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f6d6f77-5e5b-5d60-b6ae-4ad2c9e3f510/4f6d6f77-5e5b-5d60-b6ae-4ad2c9e3f510_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/22/dc227ccb06ae25cf2911247db7c016cb/pa/YJ90773_640b429e3238f78ff1d698e9f1b24916.jpg saved to cache
2026-04-27 08:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4f6d6f77-5e5b-5d60-b6ae-4ad2c9e3f510
2026-04-27 08:08:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XR47331/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/22/dc227ccb06ae25cf2911247db7c016cb/pa/YJ90773_7e1179dbdaa98e1e0507310bf0f7e0c2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/22/dc227ccb06ae25cf2911247db7c016cb/pa/YJ90773_92218a64271e0803a00fbfc316981c7d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f144781d090>
2026-04-27 08:08:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f6d6f77-5e5b-5d60-b6ae-4ad2c9e3f510/4f6d6f77-5e5b-5d60-b6ae-4ad2c9e3f510_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/22/dc227ccb06ae25cf2911247db7c016cb/pa/YJ90773_7e1179dbdaa98e1e0507310bf0f7e0c2.jpg saved to cache
2026-04-27 08:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4f6d6f77-5e5b-5d60-b6ae-4ad2c9e3f510
2026-04-27 08:08:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/22/dc227ccb06ae25cf2911247db7c016cb/pa/YJ90773_9ed2ebaa9502368bfa34f3a432584ed4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438075050>
2026-04-27 08:08:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f6d6f77-5e5b-5d60-b6ae-4ad2c9e3f510/4f6d6f77-5e5b-5d60-b6ae-4ad2c9e3f510_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/22/dc227ccb06ae25cf2911247db7c016cb/pa/YJ90773_92218a64271e0803a00fbfc316981c7d.jpg saved to cache
2026-04-27 08:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4f6d6f77-5e5b-5d60-b6ae-4ad2c9e3f510
2026-04-27 08:08:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/22/dc227ccb06ae25cf2911247db7c016cb/pa/YJ90773_c1291c22897f40237d884a8d30fd1646.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a19a10>
2026-04-27 08:08:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f6d6f77-5e5b-5d60-b6ae-4ad2c9e3f510/4f6d6f77-5e5b-5d60-b6ae-4ad2c9e3f510_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/22/dc227ccb06ae25cf2911247db7c016cb/pa/YJ90773_9ed2ebaa9502368bfa34f3a432584ed4.jpg saved to cache
2026-04-27 08:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4f6d6f77-5e5b-5d60-b6ae-4ad2c9e3f510
2026-04-27 08:08:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438dfa210>
2026-04-27 08:08:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f6d6f77-5e5b-5d60-b6ae-4ad2c9e3f510/4f6d6f77-5e5b-5d60-b6ae-4ad2c9e3f510_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/22/dc227ccb06ae25cf2911247db7c016cb/pa/YJ90773_c1291c22897f40237d884a8d30fd1646.jpg saved to cache
2026-04-27 08:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4f6d6f77-5e5b-5d60-b6ae-4ad2c9e3f510
2026-04-27 08:08:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/22/dc227ccb06ae25cf2911247db7c016cb/pa/YJ90773_ac1bf9e25b3d779bc1fcc298c39e3cce.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PN57067/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/22/dc227ccb06ae25cf2911247db7c016cb/pa/YJ90773_39eacd3f21d65e1f196af5381c7f3ee2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/22/dc227ccb06ae25cf2911247db7c016cb/pa/YJ90773_049680893dbae9de32a880b12292aca4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b586d0>
2026-04-27 08:08:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f6d6f77-5e5b-5d60-b6ae-4ad2c9e3f510/4f6d6f77-5e5b-5d60-b6ae-4ad2c9e3f510_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/22/dc227ccb06ae25cf2911247db7c016cb/pa/YJ90773_ac1bf9e25b3d779bc1fcc298c39e3cce.jpg saved to cache
2026-04-27 08:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4f6d6f77-5e5b-5d60-b6ae-4ad2c9e3f510
2026-04-27 08:08:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/22/dc227ccb06ae25cf2911247db7c016cb/pa/YJ90773_7e5fe9ed09a891c94f67ac5de01b7f52.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d34390>
2026-04-27 08:08:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f6d6f77-5e5b-5d60-b6ae-4ad2c9e3f510/4f6d6f77-5e5b-5d60-b6ae-4ad2c9e3f510_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/22/dc227ccb06ae25cf2911247db7c016cb/pa/YJ90773_39eacd3f21d65e1f196af5381c7f3ee2.jpg saved to cache
2026-04-27 08:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4f6d6f77-5e5b-5d60-b6ae-4ad2c9e3f510
2026-04-27 08:08:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14381dc510>
2026-04-27 08:08:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f6d6f77-5e5b-5d60-b6ae-4ad2c9e3f510/4f6d6f77-5e5b-5d60-b6ae-4ad2c9e3f510_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/22/dc227ccb06ae25cf2911247db7c016cb/pa/YJ90773_049680893dbae9de32a880b12292aca4.jpg saved to cache
2026-04-27 08:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4f6d6f77-5e5b-5d60-b6ae-4ad2c9e3f510
2026-04-27 08:08:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438dd8f90>
2026-04-27 08:08:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f6d6f77-5e5b-5d60-b6ae-4ad2c9e3f510/4f6d6f77-5e5b-5d60-b6ae-4ad2c9e3f510_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/22/dc227ccb06ae25cf2911247db7c016cb/pa/YJ90773_7e5fe9ed09a891c94f67ac5de01b7f52.jpg saved to cache
2026-04-27 08:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4f6d6f77-5e5b-5d60-b6ae-4ad2c9e3f510
2026-04-27 08:08:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/c1/65c1c1b8ea1ea055c95417017ed2a365/pa/JP78113_a9cf5576b0cf1a38555f4a96d350e1e3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/22/dc227ccb06ae25cf2911247db7c016cb/pa/YJ90773_fae4db9f9245f0ec93a286fc6d201b50.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438f92ad0>
2026-04-27 08:08:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7b2491b-991d-5f7a-be53-7374c8b7c841/a7b2491b-991d-5f7a-be53-7374c8b7c841_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/c1/65c1c1b8ea1ea055c95417017ed2a365/pa/JP78113_a9cf5576b0cf1a38555f4a96d350e1e3.jpg saved to cache
2026-04-27 08:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a7b2491b-991d-5f7a-be53-7374c8b7c841
2026-04-27 08:08:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bfd2f90>
2026-04-27 08:08:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f6d6f77-5e5b-5d60-b6ae-4ad2c9e3f510/4f6d6f77-5e5b-5d60-b6ae-4ad2c9e3f510_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/22/dc227ccb06ae25cf2911247db7c016cb/pa/YJ90773_fae4db9f9245f0ec93a286fc6d201b50.jpg saved to cache
2026-04-27 08:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4f6d6f77-5e5b-5d60-b6ae-4ad2c9e3f510
2026-04-27 08:08:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4f6d6f77-5e5b-5d60-b6ae-4ad2c9e3f510, skipping ID generation
2026-04-27 08:08:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f6d6f77-5e5b-5d60-b6ae-4ad2c9e3f510 with scrape type 1
2026-04-27 08:08:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4f6d6f77-5e5b-5d60-b6ae-4ad2c9e3f510 sending to next pipeline
2026-04-27 08:08:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4f6d6f77-5e5b-5d60-b6ae-4ad2c9e3f510, identifier: YJ90773
2026-04-27 08:08:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4f6d6f77-5e5b-5d60-b6ae-4ad2c9e3f510 with identifier: YJ90773
2026-04-27 08:08:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4f6d6f77-5e5b-5d60-b6ae-4ad2c9e3f510 with identifier: YJ90773
2026-04-27 08:08:36 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 4f6d6f77-5e5b-5d60-b6ae-4ad2c9e3f510 with identifier: YJ90773 to the API
2026-04-27 08:08:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:36 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgdc/22/dc227ccb06ae25cf2911247db7c016cb/pa/YJ90773_fae4db9f9245f0ec93a286fc6d201b50.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'city': 'Le Cellier',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2026-04-28T15:55:14Z',
 'fuel_type': 'diesel',
 'id': '4f6d6f77-5e5b-5d60-b6ae-4ad2c9e3f510',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 47.3196,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ90773',
 'listing': 'auction',
 'location': 'FR, Le Cellier',
 'location_confidence': 'geocoded',
 'longitude': -1.3472,
 'make': 'Peugeot',
 'model': '208',
 'odometer': 196021,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4f6d6f77-5e5b-5d60-b6ae-4ad2c9e3f510/4f6d6f77-5e5b-5d60-b6ae-4ad2c9e3f510_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70955,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/22/dc227ccb06ae25cf2911247db7c016cb/pa/YJ90773_7e5fe9ed09a891c94f67ac5de01b7f52.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4f6d6f77-5e5b-5d60-b6ae-4ad2c9e3f510/4f6d6f77-5e5b-5d60-b6ae-4ad2c9e3f510_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65459,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/22/dc227ccb06ae25cf2911247db7c016cb/pa/YJ90773_049680893dbae9de32a880b12292aca4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4f6d6f77-5e5b-5d60-b6ae-4ad2c9e3f510/4f6d6f77-5e5b-5d60-b6ae-4ad2c9e3f510_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72864,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/22/dc227ccb06ae25cf2911247db7c016cb/pa/YJ90773_fae4db9f9245f0ec93a286fc6d201b50.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4f6d6f77-5e5b-5d60-b6ae-4ad2c9e3f510/4f6d6f77-5e5b-5d60-b6ae-4ad2c9e3f510_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51218,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/22/dc227ccb06ae25cf2911247db7c016cb/pa/YJ90773_39eacd3f21d65e1f196af5381c7f3ee2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4f6d6f77-5e5b-5d60-b6ae-4ad2c9e3f510/4f6d6f77-5e5b-5d60-b6ae-4ad2c9e3f510_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62321,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/22/dc227ccb06ae25cf2911247db7c016cb/pa/YJ90773_ac1bf9e25b3d779bc1fcc298c39e3cce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4f6d6f77-5e5b-5d60-b6ae-4ad2c9e3f510/4f6d6f77-5e5b-5d60-b6ae-4ad2c9e3f510_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66350,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/22/dc227ccb06ae25cf2911247db7c016cb/pa/YJ90773_c1291c22897f40237d884a8d30fd1646.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4f6d6f77-5e5b-5d60-b6ae-4ad2c9e3f510/4f6d6f77-5e5b-5d60-b6ae-4ad2c9e3f510_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49111,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/22/dc227ccb06ae25cf2911247db7c016cb/pa/YJ90773_640b429e3238f78ff1d698e9f1b24916.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4f6d6f77-5e5b-5d60-b6ae-4ad2c9e3f510/4f6d6f77-5e5b-5d60-b6ae-4ad2c9e3f510_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64711,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/22/dc227ccb06ae25cf2911247db7c016cb/pa/YJ90773_9ed2ebaa9502368bfa34f3a432584ed4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4f6d6f77-5e5b-5d60-b6ae-4ad2c9e3f510/4f6d6f77-5e5b-5d60-b6ae-4ad2c9e3f510_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69702,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/22/dc227ccb06ae25cf2911247db7c016cb/pa/YJ90773_7e1179dbdaa98e1e0507310bf0f7e0c2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4f6d6f77-5e5b-5d60-b6ae-4ad2c9e3f510/4f6d6f77-5e5b-5d60-b6ae-4ad2c9e3f510_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60589,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/22/dc227ccb06ae25cf2911247db7c016cb/pa/YJ90773_92218a64271e0803a00fbfc316981c7d.jpg',
             'Width': 800}],
 'postal_code': '44850',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Loire-Atlantique',
 'province_code': 'FR-44',
 'region': 'Pays de la Loire',
 'region_code': 'FR-52',
 'registration_date': '2018-10-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 208 1.5 Blue-HDi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2018}
2026-04-27 08:08:36 [auto1.fr] INFO: Saving data for YJ90773: {'created_time': 1777277316.87332, 'last_price_update_time': 1777277316.873332, 'has_photos': True, 'auction_closing_time': 1777391714.0}
2026-04-27 08:08:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/c1/65c1c1b8ea1ea055c95417017ed2a365/pa/JP78113_3347b350bf08b7be84ddd4b782427b4a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UC15316/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZD48015/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/c1/65c1c1b8ea1ea055c95417017ed2a365/pa/JP78113_a5b686fc406b6f2968914e3a29699dcb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14381dd590>
2026-04-27 08:08:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7b2491b-991d-5f7a-be53-7374c8b7c841/a7b2491b-991d-5f7a-be53-7374c8b7c841_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/c1/65c1c1b8ea1ea055c95417017ed2a365/pa/JP78113_3347b350bf08b7be84ddd4b782427b4a.jpg saved to cache
2026-04-27 08:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a7b2491b-991d-5f7a-be53-7374c8b7c841
2026-04-27 08:08:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/0b/7f0b7088b40dafe183a8447898e229dd/pa/LS92623_531265922bab7ef418aa86a911f39d21.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14381de010>
2026-04-27 08:08:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7b2491b-991d-5f7a-be53-7374c8b7c841/a7b2491b-991d-5f7a-be53-7374c8b7c841_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/c1/65c1c1b8ea1ea055c95417017ed2a365/pa/JP78113_a5b686fc406b6f2968914e3a29699dcb.jpg saved to cache
2026-04-27 08:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a7b2491b-991d-5f7a-be53-7374c8b7c841
2026-04-27 08:08:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a7b2491b-991d-5f7a-be53-7374c8b7c841, skipping ID generation
2026-04-27 08:08:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7b2491b-991d-5f7a-be53-7374c8b7c841 with scrape type 1
2026-04-27 08:08:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a7b2491b-991d-5f7a-be53-7374c8b7c841 sending to next pipeline
2026-04-27 08:08:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a7b2491b-991d-5f7a-be53-7374c8b7c841, identifier: JP78113
2026-04-27 08:08:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a7b2491b-991d-5f7a-be53-7374c8b7c841 with identifier: JP78113
2026-04-27 08:08:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a7b2491b-991d-5f7a-be53-7374c8b7c841 with identifier: JP78113
2026-04-27 08:08:37 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a7b2491b-991d-5f7a-be53-7374c8b7c841 with identifier: JP78113 to the API
2026-04-27 08:08:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:37 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img65/c1/65c1c1b8ea1ea055c95417017ed2a365/pa/JP78113_a5b686fc406b6f2968914e3a29699dcb.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 191,
 'category': None,
 'city': 'Le Havre',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-04-28T15:37:31Z',
 'fuel_type': 'diesel',
 'id': 'a7b2491b-991d-5f7a-be53-7374c8b7c841',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 49.4935,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JP78113',
 'listing': 'auction',
 'location': 'FR, LE HAVRE',
 'location_confidence': 'geocoded',
 'longitude': 0.1079,
 'make': 'Renault',
 'model': 'Koleos',
 'odometer': 181648,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a7b2491b-991d-5f7a-be53-7374c8b7c841/a7b2491b-991d-5f7a-be53-7374c8b7c841_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78327,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/c1/65c1c1b8ea1ea055c95417017ed2a365/pa/JP78113_a5b686fc406b6f2968914e3a29699dcb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a7b2491b-991d-5f7a-be53-7374c8b7c841/a7b2491b-991d-5f7a-be53-7374c8b7c841_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70467,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/c1/65c1c1b8ea1ea055c95417017ed2a365/pa/JP78113_3347b350bf08b7be84ddd4b782427b4a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a7b2491b-991d-5f7a-be53-7374c8b7c841/a7b2491b-991d-5f7a-be53-7374c8b7c841_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73798,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/c1/65c1c1b8ea1ea055c95417017ed2a365/pa/JP78113_a9cf5576b0cf1a38555f4a96d350e1e3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a7b2491b-991d-5f7a-be53-7374c8b7c841/a7b2491b-991d-5f7a-be53-7374c8b7c841_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63713,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/c1/65c1c1b8ea1ea055c95417017ed2a365/pa/JP78113_7730204a0c6b0e2b973075f5321d3656.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a7b2491b-991d-5f7a-be53-7374c8b7c841/a7b2491b-991d-5f7a-be53-7374c8b7c841_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80265,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/c1/65c1c1b8ea1ea055c95417017ed2a365/pa/JP78113_3463322789c3eaa0ede3a635781d35da.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a7b2491b-991d-5f7a-be53-7374c8b7c841/a7b2491b-991d-5f7a-be53-7374c8b7c841_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38481,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/c1/65c1c1b8ea1ea055c95417017ed2a365/pa/JP78113_8ea3d3248d8f1b9c4661fe3d4394260e.jpg',
             'Width': 800}],
 'postal_code': '76050 CEDEX',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Seine-Maritime',
 'province_code': 'FR-76',
 'region': 'Normandie',
 'region_code': 'FR-28',
 'registration_date': '2010-01-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Koleos 2.0 dCi Privilège',
 'transmission': 'manual',
 'trim': 'Privilège',
 'year': 2010}
2026-04-27 08:08:37 [auto1.fr] INFO: Saving data for JP78113: {'created_time': 1777277317.533152, 'last_price_update_time': 1777277317.533165, 'has_photos': True, 'auction_closing_time': 1777390651.0}
2026-04-27 08:08:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LT67510> (referer: https://www.auto1.com/v1/car-details-view/LT67510/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14381dc2d0>
2026-04-27 08:08:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ede6990a-e7dd-5a03-ae54-44ec0c621440/ede6990a-e7dd-5a03-ae54-44ec0c621440_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/0b/7f0b7088b40dafe183a8447898e229dd/pa/LS92623_531265922bab7ef418aa86a911f39d21.jpg saved to cache
2026-04-27 08:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ede6990a-e7dd-5a03-ae54-44ec0c621440
2026-04-27 08:08:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ede6990a-e7dd-5a03-ae54-44ec0c621440, skipping ID generation
2026-04-27 08:08:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ede6990a-e7dd-5a03-ae54-44ec0c621440 with scrape type 1
2026-04-27 08:08:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ede6990a-e7dd-5a03-ae54-44ec0c621440 sending to next pipeline
2026-04-27 08:08:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ede6990a-e7dd-5a03-ae54-44ec0c621440, identifier: LS92623
2026-04-27 08:08:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ede6990a-e7dd-5a03-ae54-44ec0c621440 with identifier: LS92623
2026-04-27 08:08:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ede6990a-e7dd-5a03-ae54-44ec0c621440 with identifier: LS92623
2026-04-27 08:08:37 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ede6990a-e7dd-5a03-ae54-44ec0c621440 with identifier: LS92623 to the API
2026-04-27 08:08:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:37 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img7f/0b/7f0b7088b40dafe183a8447898e229dd/pa/LS92623_531265922bab7ef418aa86a911f39d21.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'city': 'Vezin-le-Coquet',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-04-28T15:28:42Z',
 'fuel_type': 'diesel',
 'id': 'ede6990a-e7dd-5a03-ae54-44ec0c621440',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.119,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LS92623',
 'listing': 'auction',
 'location': 'FR, Vezin-le-Coquet',
 'location_confidence': 'geocoded',
 'longitude': -1.7563,
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 297218,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ede6990a-e7dd-5a03-ae54-44ec0c621440/ede6990a-e7dd-5a03-ae54-44ec0c621440_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81846,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/0b/7f0b7088b40dafe183a8447898e229dd/pa/LS92623_531265922bab7ef418aa86a911f39d21.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ede6990a-e7dd-5a03-ae54-44ec0c621440/ede6990a-e7dd-5a03-ae54-44ec0c621440_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80535,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/0b/7f0b7088b40dafe183a8447898e229dd/pa/LS92623_9e30f4e0492f6f838bcd58af126cde3f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ede6990a-e7dd-5a03-ae54-44ec0c621440/ede6990a-e7dd-5a03-ae54-44ec0c621440_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74081,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/0b/7f0b7088b40dafe183a8447898e229dd/pa/LS92623_f0d64d739d69380b9dada13b49164c87.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ede6990a-e7dd-5a03-ae54-44ec0c621440/ede6990a-e7dd-5a03-ae54-44ec0c621440_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72695,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/0b/7f0b7088b40dafe183a8447898e229dd/pa/LS92623_b226e308107f4822b8f789d50c608797.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ede6990a-e7dd-5a03-ae54-44ec0c621440/ede6990a-e7dd-5a03-ae54-44ec0c621440_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75992,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/0b/7f0b7088b40dafe183a8447898e229dd/pa/LS92623_70bab704b408abf7483c081226e24daa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ede6990a-e7dd-5a03-ae54-44ec0c621440/ede6990a-e7dd-5a03-ae54-44ec0c621440_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81488,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/0b/7f0b7088b40dafe183a8447898e229dd/pa/LS92623_ed70938ddddfd4349cf90dc9d65c2bb7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ede6990a-e7dd-5a03-ae54-44ec0c621440/ede6990a-e7dd-5a03-ae54-44ec0c621440_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65545,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/0b/7f0b7088b40dafe183a8447898e229dd/pa/LS92623_aa7a286ade948d1cb7b9c2819fc2458e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ede6990a-e7dd-5a03-ae54-44ec0c621440/ede6990a-e7dd-5a03-ae54-44ec0c621440_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77676,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/0b/7f0b7088b40dafe183a8447898e229dd/pa/LS92623_4dfb52504b8f0c099def11f05ab3f415.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ede6990a-e7dd-5a03-ae54-44ec0c621440/ede6990a-e7dd-5a03-ae54-44ec0c621440_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76475,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/0b/7f0b7088b40dafe183a8447898e229dd/pa/LS92623_9aeb6d89307a49a05ea41d6a58320bbc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ede6990a-e7dd-5a03-ae54-44ec0c621440/ede6990a-e7dd-5a03-ae54-44ec0c621440_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60638,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/0b/7f0b7088b40dafe183a8447898e229dd/pa/LS92623_30800d6cdce47e7f766837ea2017d837.jpg',
             'Width': 800}],
 'postal_code': '35132',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Ille-et-Vilaine',
 'province_code': 'FR-35',
 'region': 'Bretagne',
 'region_code': 'FR-53',
 'registration_date': '2016-01-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Passat 1.6 TDI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2016}
2026-04-27 08:08:38 [auto1.fr] INFO: Saving data for LS92623: {'created_time': 1777277318.042743, 'last_price_update_time': 1777277318.042754, 'has_photos': True, 'auction_closing_time': 1777390122.0}
2026-04-27 08:08:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7fecc4e4-7769-5524-a347-c29b419d0918 with identifier: LT67510
2026-04-27 08:08:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7fecc4e4-7769-5524-a347-c29b419d0918 with scrape type 1
2026-04-27 08:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7fecc4e4-7769-5524-a347-c29b419d0918
2026-04-27 08:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/95/0d95f370f56fc9c14f3527a694ea5beb/pa/LT67510_c8c141fb7ae4b6018e48438b906478c9.jpg not downloaded yet
2026-04-27 08:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/95/0d95f370f56fc9c14f3527a694ea5beb/pa/LT67510_c0f8d59512d55319930fd0c1cd33da2f.jpg not downloaded yet
2026-04-27 08:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/95/0d95f370f56fc9c14f3527a694ea5beb/pa/LT67510_e4560f330df473eef55dcca907595e43.jpg not downloaded yet
2026-04-27 08:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/95/0d95f370f56fc9c14f3527a694ea5beb/pa/LT67510_af22adafb2359bebb62a61cd12d74d33.jpg not downloaded yet
2026-04-27 08:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/95/0d95f370f56fc9c14f3527a694ea5beb/pa/LT67510_3f84edf8b5f9bb2426a404ff8e1f6ae2.jpg not downloaded yet
2026-04-27 08:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/95/0d95f370f56fc9c14f3527a694ea5beb/pa/LT67510_0659e08c081cf0f03b6f329585f53b47.jpg not downloaded yet
2026-04-27 08:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/95/0d95f370f56fc9c14f3527a694ea5beb/pa/LT67510_157279ba1043baa0649f7a5fd824d8d8.jpg not downloaded yet
2026-04-27 08:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/95/0d95f370f56fc9c14f3527a694ea5beb/pa/LT67510_2d6fd53c75de7b806c32ab4a37470e06.jpg not downloaded yet
2026-04-27 08:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/95/0d95f370f56fc9c14f3527a694ea5beb/pa/LT67510_579fddd915228a3a5631cc017c8a14e9.jpg not downloaded yet
2026-04-27 08:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/95/0d95f370f56fc9c14f3527a694ea5beb/pa/LT67510_d4add116d1a43b31d5241561ea905df5.jpg not downloaded yet
2026-04-27 08:08:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AV43022/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/95/0d95f370f56fc9c14f3527a694ea5beb/pa/LT67510_d4add116d1a43b31d5241561ea905df5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/95/0d95f370f56fc9c14f3527a694ea5beb/pa/LT67510_579fddd915228a3a5631cc017c8a14e9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438054a90>
2026-04-27 08:08:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fecc4e4-7769-5524-a347-c29b419d0918/7fecc4e4-7769-5524-a347-c29b419d0918_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/95/0d95f370f56fc9c14f3527a694ea5beb/pa/LT67510_d4add116d1a43b31d5241561ea905df5.jpg saved to cache
2026-04-27 08:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7fecc4e4-7769-5524-a347-c29b419d0918
2026-04-27 08:08:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c2d1d0>
2026-04-27 08:08:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fecc4e4-7769-5524-a347-c29b419d0918/7fecc4e4-7769-5524-a347-c29b419d0918_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/95/0d95f370f56fc9c14f3527a694ea5beb/pa/LT67510_579fddd915228a3a5631cc017c8a14e9.jpg saved to cache
2026-04-27 08:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7fecc4e4-7769-5524-a347-c29b419d0918
2026-04-27 08:08:41 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.258(s), this was the 1st time calling it.
2026-04-27 08:08:41 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.4803421933944065 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:08:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CL54463> (referer: https://www.auto1.com/v1/car-details-view/CL54463/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/95/0d95f370f56fc9c14f3527a694ea5beb/pa/LT67510_2d6fd53c75de7b806c32ab4a37470e06.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5589f96a-3c9e-502e-beba-e1f96ad831ea with identifier: CL54463
2026-04-27 08:08:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5589f96a-3c9e-502e-beba-e1f96ad831ea with scrape type 1
2026-04-27 08:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5589f96a-3c9e-502e-beba-e1f96ad831ea
2026-04-27 08:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/eb/daeba81fbf00e8ae6a705e2723fe78e4/pa/CL54463_02631500da04d88f7dd402e0a10b632d.jpg not downloaded yet
2026-04-27 08:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/eb/daeba81fbf00e8ae6a705e2723fe78e4/pa/CL54463_b61bde701386961d08f8173b094375cf.jpg not downloaded yet
2026-04-27 08:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/eb/daeba81fbf00e8ae6a705e2723fe78e4/pa/CL54463_aa627eece6605fecb499b4771de0a154.jpg not downloaded yet
2026-04-27 08:08:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/95/0d95f370f56fc9c14f3527a694ea5beb/pa/LT67510_157279ba1043baa0649f7a5fd824d8d8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/eb/daeba81fbf00e8ae6a705e2723fe78e4/pa/CL54463_46c171f727541fe5d3c6a6ccf58e6cb9.jpg not downloaded yet
2026-04-27 08:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/eb/daeba81fbf00e8ae6a705e2723fe78e4/pa/CL54463_3a977ed61661cf1602259e64abc572f5.jpg not downloaded yet
2026-04-27 08:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/eb/daeba81fbf00e8ae6a705e2723fe78e4/pa/CL54463_6922773a7a45358872bdd6fbea81cdaf.jpg not downloaded yet
2026-04-27 08:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/eb/daeba81fbf00e8ae6a705e2723fe78e4/pa/CL54463_b6ae74d787de25b75fc7037333951fb1.jpg not downloaded yet
2026-04-27 08:08:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bfd1a10>
2026-04-27 08:08:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fecc4e4-7769-5524-a347-c29b419d0918/7fecc4e4-7769-5524-a347-c29b419d0918_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/95/0d95f370f56fc9c14f3527a694ea5beb/pa/LT67510_2d6fd53c75de7b806c32ab4a37470e06.jpg saved to cache
2026-04-27 08:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7fecc4e4-7769-5524-a347-c29b419d0918
2026-04-27 08:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/eb/daeba81fbf00e8ae6a705e2723fe78e4/pa/CL54463_daded514ad48c828780ccd07ec1c580d.jpg not downloaded yet
2026-04-27 08:08:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/eb/daeba81fbf00e8ae6a705e2723fe78e4/pa/CL54463_aa627eece6605fecb499b4771de0a154.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/eb/daeba81fbf00e8ae6a705e2723fe78e4/pa/CL54463_cb29c9d419eabe3dd1f2e358fb68a2bc.jpg not downloaded yet
2026-04-27 08:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/eb/daeba81fbf00e8ae6a705e2723fe78e4/pa/CL54463_065d522bb6f9cbd533015423acf96a47.jpg not downloaded yet
2026-04-27 08:08:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438086190>
2026-04-27 08:08:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fecc4e4-7769-5524-a347-c29b419d0918/7fecc4e4-7769-5524-a347-c29b419d0918_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/95/0d95f370f56fc9c14f3527a694ea5beb/pa/LT67510_157279ba1043baa0649f7a5fd824d8d8.jpg saved to cache
2026-04-27 08:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7fecc4e4-7769-5524-a347-c29b419d0918
2026-04-27 08:08:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ceaa10>
2026-04-27 08:08:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5589f96a-3c9e-502e-beba-e1f96ad831ea/5589f96a-3c9e-502e-beba-e1f96ad831ea_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/eb/daeba81fbf00e8ae6a705e2723fe78e4/pa/CL54463_aa627eece6605fecb499b4771de0a154.jpg saved to cache
2026-04-27 08:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5589f96a-3c9e-502e-beba-e1f96ad831ea
2026-04-27 08:08:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/eb/daeba81fbf00e8ae6a705e2723fe78e4/pa/CL54463_b6ae74d787de25b75fc7037333951fb1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438057650>
2026-04-27 08:08:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5589f96a-3c9e-502e-beba-e1f96ad831ea/5589f96a-3c9e-502e-beba-e1f96ad831ea_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/eb/daeba81fbf00e8ae6a705e2723fe78e4/pa/CL54463_b6ae74d787de25b75fc7037333951fb1.jpg saved to cache
2026-04-27 08:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5589f96a-3c9e-502e-beba-e1f96ad831ea
2026-04-27 08:08:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/eb/daeba81fbf00e8ae6a705e2723fe78e4/pa/CL54463_065d522bb6f9cbd533015423acf96a47.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14381dcdd0>
2026-04-27 08:08:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5589f96a-3c9e-502e-beba-e1f96ad831ea/5589f96a-3c9e-502e-beba-e1f96ad831ea_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/eb/daeba81fbf00e8ae6a705e2723fe78e4/pa/CL54463_065d522bb6f9cbd533015423acf96a47.jpg saved to cache
2026-04-27 08:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5589f96a-3c9e-502e-beba-e1f96ad831ea
2026-04-27 08:08:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/eb/daeba81fbf00e8ae6a705e2723fe78e4/pa/CL54463_cb29c9d419eabe3dd1f2e358fb68a2bc.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b35b90>
2026-04-27 08:08:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5589f96a-3c9e-502e-beba-e1f96ad831ea/5589f96a-3c9e-502e-beba-e1f96ad831ea_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/eb/daeba81fbf00e8ae6a705e2723fe78e4/pa/CL54463_cb29c9d419eabe3dd1f2e358fb68a2bc.jpg saved to cache
2026-04-27 08:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5589f96a-3c9e-502e-beba-e1f96ad831ea
2026-04-27 08:08:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/eb/daeba81fbf00e8ae6a705e2723fe78e4/pa/CL54463_daded514ad48c828780ccd07ec1c580d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/eb/daeba81fbf00e8ae6a705e2723fe78e4/pa/CL54463_6922773a7a45358872bdd6fbea81cdaf.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d63b10>
2026-04-27 08:08:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5589f96a-3c9e-502e-beba-e1f96ad831ea/5589f96a-3c9e-502e-beba-e1f96ad831ea_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/eb/daeba81fbf00e8ae6a705e2723fe78e4/pa/CL54463_daded514ad48c828780ccd07ec1c580d.jpg saved to cache
2026-04-27 08:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5589f96a-3c9e-502e-beba-e1f96ad831ea
2026-04-27 08:08:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d61610>
2026-04-27 08:08:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5589f96a-3c9e-502e-beba-e1f96ad831ea/5589f96a-3c9e-502e-beba-e1f96ad831ea_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/eb/daeba81fbf00e8ae6a705e2723fe78e4/pa/CL54463_6922773a7a45358872bdd6fbea81cdaf.jpg saved to cache
2026-04-27 08:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5589f96a-3c9e-502e-beba-e1f96ad831ea
2026-04-27 08:08:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MG55357> (referer: https://www.auto1.com/v1/car-details-view/MG55357/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fba15d8f-091d-5b38-8c8d-7abeb673ffc3 with identifier: MG55357
2026-04-27 08:08:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fba15d8f-091d-5b38-8c8d-7abeb673ffc3 with scrape type 1
2026-04-27 08:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fba15d8f-091d-5b38-8c8d-7abeb673ffc3
2026-04-27 08:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/4c/084cc5c7d88aa9c97e46473ba0d70036/pa/MG55357_d2d799bcd8805c2546f87532f48891db.jpg not downloaded yet
2026-04-27 08:08:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/eb/daeba81fbf00e8ae6a705e2723fe78e4/pa/CL54463_3a977ed61661cf1602259e64abc572f5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/4c/084cc5c7d88aa9c97e46473ba0d70036/pa/MG55357_8cc7ba387a7a05cbef1adbdfdbd05d1d.jpg not downloaded yet
2026-04-27 08:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/4c/084cc5c7d88aa9c97e46473ba0d70036/pa/MG55357_cb163655bbb2d310d21e27a6dbc17d5d.jpg not downloaded yet
2026-04-27 08:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/4c/084cc5c7d88aa9c97e46473ba0d70036/pa/MG55357_febdd67934e30dc11260bf745973c9e6.jpg not downloaded yet
2026-04-27 08:08:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/eb/daeba81fbf00e8ae6a705e2723fe78e4/pa/CL54463_46c171f727541fe5d3c6a6ccf58e6cb9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/4c/084cc5c7d88aa9c97e46473ba0d70036/pa/MG55357_9884a7de4528287502693ca597a7ccdd.jpg not downloaded yet
2026-04-27 08:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/4c/084cc5c7d88aa9c97e46473ba0d70036/pa/MG55357_afe3be645c5c9cddab4ec69933ac0012.jpg not downloaded yet
2026-04-27 08:08:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/4c/084cc5c7d88aa9c97e46473ba0d70036/pa/MG55357_d2d799bcd8805c2546f87532f48891db.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/4c/084cc5c7d88aa9c97e46473ba0d70036/pa/MG55357_66af9aacd50081e1dde855fc01be0f59.jpg not downloaded yet
2026-04-27 08:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/4c/084cc5c7d88aa9c97e46473ba0d70036/pa/MG55357_e447290aa9732e585d3ba020b8aa64e5.jpg not downloaded yet
2026-04-27 08:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/4c/084cc5c7d88aa9c97e46473ba0d70036/pa/MG55357_bc1bf1c9a0fb475dcd4e32fc5783cbc7.jpg not downloaded yet
2026-04-27 08:08:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d37c90>
2026-04-27 08:08:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5589f96a-3c9e-502e-beba-e1f96ad831ea/5589f96a-3c9e-502e-beba-e1f96ad831ea_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/eb/daeba81fbf00e8ae6a705e2723fe78e4/pa/CL54463_3a977ed61661cf1602259e64abc572f5.jpg saved to cache
2026-04-27 08:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5589f96a-3c9e-502e-beba-e1f96ad831ea
2026-04-27 08:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/4c/084cc5c7d88aa9c97e46473ba0d70036/pa/MG55357_209290d0d47cbf1035a30f8a904ddae0.jpg not downloaded yet
2026-04-27 08:08:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143805ec50>
2026-04-27 08:08:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5589f96a-3c9e-502e-beba-e1f96ad831ea/5589f96a-3c9e-502e-beba-e1f96ad831ea_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/eb/daeba81fbf00e8ae6a705e2723fe78e4/pa/CL54463_46c171f727541fe5d3c6a6ccf58e6cb9.jpg saved to cache
2026-04-27 08:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5589f96a-3c9e-502e-beba-e1f96ad831ea
2026-04-27 08:08:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/4c/084cc5c7d88aa9c97e46473ba0d70036/pa/MG55357_febdd67934e30dc11260bf745973c9e6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14474b8890>
2026-04-27 08:08:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fba15d8f-091d-5b38-8c8d-7abeb673ffc3/fba15d8f-091d-5b38-8c8d-7abeb673ffc3_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/4c/084cc5c7d88aa9c97e46473ba0d70036/pa/MG55357_d2d799bcd8805c2546f87532f48891db.jpg saved to cache
2026-04-27 08:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fba15d8f-091d-5b38-8c8d-7abeb673ffc3
2026-04-27 08:08:43 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 265.877(s), this was the 2nd time calling it.
2026-04-27 08:08:43 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.628473927782051 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:08:43 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.083(s), this was the 1st time calling it.
2026-04-27 08:08:43 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.234022077263702 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:08:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/4c/084cc5c7d88aa9c97e46473ba0d70036/pa/MG55357_afe3be645c5c9cddab4ec69933ac0012.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438cf97d0>
2026-04-27 08:08:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fba15d8f-091d-5b38-8c8d-7abeb673ffc3/fba15d8f-091d-5b38-8c8d-7abeb673ffc3_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/4c/084cc5c7d88aa9c97e46473ba0d70036/pa/MG55357_febdd67934e30dc11260bf745973c9e6.jpg saved to cache
2026-04-27 08:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fba15d8f-091d-5b38-8c8d-7abeb673ffc3
2026-04-27 08:08:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a62f50>
2026-04-27 08:08:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fba15d8f-091d-5b38-8c8d-7abeb673ffc3/fba15d8f-091d-5b38-8c8d-7abeb673ffc3_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/4c/084cc5c7d88aa9c97e46473ba0d70036/pa/MG55357_afe3be645c5c9cddab4ec69933ac0012.jpg saved to cache
2026-04-27 08:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fba15d8f-091d-5b38-8c8d-7abeb673ffc3
2026-04-27 08:08:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/4c/084cc5c7d88aa9c97e46473ba0d70036/pa/MG55357_209290d0d47cbf1035a30f8a904ddae0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/4c/084cc5c7d88aa9c97e46473ba0d70036/pa/MG55357_bc1bf1c9a0fb475dcd4e32fc5783cbc7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438fbc510>
2026-04-27 08:08:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fba15d8f-091d-5b38-8c8d-7abeb673ffc3/fba15d8f-091d-5b38-8c8d-7abeb673ffc3_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/4c/084cc5c7d88aa9c97e46473ba0d70036/pa/MG55357_209290d0d47cbf1035a30f8a904ddae0.jpg saved to cache
2026-04-27 08:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fba15d8f-091d-5b38-8c8d-7abeb673ffc3
2026-04-27 08:08:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380492d0>
2026-04-27 08:08:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fba15d8f-091d-5b38-8c8d-7abeb673ffc3/fba15d8f-091d-5b38-8c8d-7abeb673ffc3_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/4c/084cc5c7d88aa9c97e46473ba0d70036/pa/MG55357_bc1bf1c9a0fb475dcd4e32fc5783cbc7.jpg saved to cache
2026-04-27 08:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fba15d8f-091d-5b38-8c8d-7abeb673ffc3
2026-04-27 08:08:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/4c/084cc5c7d88aa9c97e46473ba0d70036/pa/MG55357_e447290aa9732e585d3ba020b8aa64e5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/4c/084cc5c7d88aa9c97e46473ba0d70036/pa/MG55357_66af9aacd50081e1dde855fc01be0f59.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143804bc50>
2026-04-27 08:08:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fba15d8f-091d-5b38-8c8d-7abeb673ffc3/fba15d8f-091d-5b38-8c8d-7abeb673ffc3_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/4c/084cc5c7d88aa9c97e46473ba0d70036/pa/MG55357_e447290aa9732e585d3ba020b8aa64e5.jpg saved to cache
2026-04-27 08:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fba15d8f-091d-5b38-8c8d-7abeb673ffc3
2026-04-27 08:08:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438026dd0>
2026-04-27 08:08:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fba15d8f-091d-5b38-8c8d-7abeb673ffc3/fba15d8f-091d-5b38-8c8d-7abeb673ffc3_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/4c/084cc5c7d88aa9c97e46473ba0d70036/pa/MG55357_66af9aacd50081e1dde855fc01be0f59.jpg saved to cache
2026-04-27 08:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fba15d8f-091d-5b38-8c8d-7abeb673ffc3
2026-04-27 08:08:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/4c/084cc5c7d88aa9c97e46473ba0d70036/pa/MG55357_9884a7de4528287502693ca597a7ccdd.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/4c/084cc5c7d88aa9c97e46473ba0d70036/pa/MG55357_cb163655bbb2d310d21e27a6dbc17d5d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438be9850>
2026-04-27 08:08:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fba15d8f-091d-5b38-8c8d-7abeb673ffc3/fba15d8f-091d-5b38-8c8d-7abeb673ffc3_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/4c/084cc5c7d88aa9c97e46473ba0d70036/pa/MG55357_9884a7de4528287502693ca597a7ccdd.jpg saved to cache
2026-04-27 08:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fba15d8f-091d-5b38-8c8d-7abeb673ffc3
2026-04-27 08:08:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/4c/084cc5c7d88aa9c97e46473ba0d70036/pa/MG55357_8cc7ba387a7a05cbef1adbdfdbd05d1d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/eb/daeba81fbf00e8ae6a705e2723fe78e4/pa/CL54463_02631500da04d88f7dd402e0a10b632d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ceb950>
2026-04-27 08:08:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fba15d8f-091d-5b38-8c8d-7abeb673ffc3/fba15d8f-091d-5b38-8c8d-7abeb673ffc3_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/4c/084cc5c7d88aa9c97e46473ba0d70036/pa/MG55357_cb163655bbb2d310d21e27a6dbc17d5d.jpg saved to cache
2026-04-27 08:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fba15d8f-091d-5b38-8c8d-7abeb673ffc3
2026-04-27 08:08:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b372d0>
2026-04-27 08:08:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fba15d8f-091d-5b38-8c8d-7abeb673ffc3/fba15d8f-091d-5b38-8c8d-7abeb673ffc3_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/4c/084cc5c7d88aa9c97e46473ba0d70036/pa/MG55357_8cc7ba387a7a05cbef1adbdfdbd05d1d.jpg saved to cache
2026-04-27 08:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fba15d8f-091d-5b38-8c8d-7abeb673ffc3
2026-04-27 08:08:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fba15d8f-091d-5b38-8c8d-7abeb673ffc3, skipping ID generation
2026-04-27 08:08:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fba15d8f-091d-5b38-8c8d-7abeb673ffc3 with scrape type 1
2026-04-27 08:08:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fba15d8f-091d-5b38-8c8d-7abeb673ffc3 sending to next pipeline
2026-04-27 08:08:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: fba15d8f-091d-5b38-8c8d-7abeb673ffc3, identifier: MG55357
2026-04-27 08:08:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: fba15d8f-091d-5b38-8c8d-7abeb673ffc3 with identifier: MG55357
2026-04-27 08:08:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: fba15d8f-091d-5b38-8c8d-7abeb673ffc3 with identifier: MG55357
2026-04-27 08:08:44 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: fba15d8f-091d-5b38-8c8d-7abeb673ffc3 with identifier: MG55357 to the API
2026-04-27 08:08:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:44 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img08/4c/084cc5c7d88aa9c97e46473ba0d70036/pa/MG55357_8cc7ba387a7a05cbef1adbdfdbd05d1d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'city': 'Tarnos',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 125,
 'expiration_date': '2026-04-28T15:27:00Z',
 'fuel_type': 'petrol',
 'id': 'fba15d8f-091d-5b38-8c8d-7abeb673ffc3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 43.5417,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MG55357',
 'listing': 'auction',
 'location': 'FR, Tarnos',
 'location_confidence': 'geocoded',
 'longitude': -1.4628,
 'make': 'Ford',
 'model': 'Puma',
 'odometer': 58315,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fba15d8f-091d-5b38-8c8d-7abeb673ffc3/fba15d8f-091d-5b38-8c8d-7abeb673ffc3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77665,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/4c/084cc5c7d88aa9c97e46473ba0d70036/pa/MG55357_d2d799bcd8805c2546f87532f48891db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fba15d8f-091d-5b38-8c8d-7abeb673ffc3/fba15d8f-091d-5b38-8c8d-7abeb673ffc3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80626,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/4c/084cc5c7d88aa9c97e46473ba0d70036/pa/MG55357_8cc7ba387a7a05cbef1adbdfdbd05d1d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fba15d8f-091d-5b38-8c8d-7abeb673ffc3/fba15d8f-091d-5b38-8c8d-7abeb673ffc3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72765,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/4c/084cc5c7d88aa9c97e46473ba0d70036/pa/MG55357_cb163655bbb2d310d21e27a6dbc17d5d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fba15d8f-091d-5b38-8c8d-7abeb673ffc3/fba15d8f-091d-5b38-8c8d-7abeb673ffc3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60117,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/4c/084cc5c7d88aa9c97e46473ba0d70036/pa/MG55357_febdd67934e30dc11260bf745973c9e6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fba15d8f-091d-5b38-8c8d-7abeb673ffc3/fba15d8f-091d-5b38-8c8d-7abeb673ffc3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59865,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/4c/084cc5c7d88aa9c97e46473ba0d70036/pa/MG55357_9884a7de4528287502693ca597a7ccdd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fba15d8f-091d-5b38-8c8d-7abeb673ffc3/fba15d8f-091d-5b38-8c8d-7abeb673ffc3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68600,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/4c/084cc5c7d88aa9c97e46473ba0d70036/pa/MG55357_afe3be645c5c9cddab4ec69933ac0012.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fba15d8f-091d-5b38-8c8d-7abeb673ffc3/fba15d8f-091d-5b38-8c8d-7abeb673ffc3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57902,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/4c/084cc5c7d88aa9c97e46473ba0d70036/pa/MG55357_66af9aacd50081e1dde855fc01be0f59.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fba15d8f-091d-5b38-8c8d-7abeb673ffc3/fba15d8f-091d-5b38-8c8d-7abeb673ffc3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78975,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/4c/084cc5c7d88aa9c97e46473ba0d70036/pa/MG55357_e447290aa9732e585d3ba020b8aa64e5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fba15d8f-091d-5b38-8c8d-7abeb673ffc3/fba15d8f-091d-5b38-8c8d-7abeb673ffc3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76579,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/4c/084cc5c7d88aa9c97e46473ba0d70036/pa/MG55357_bc1bf1c9a0fb475dcd4e32fc5783cbc7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fba15d8f-091d-5b38-8c8d-7abeb673ffc3/fba15d8f-091d-5b38-8c8d-7abeb673ffc3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49597,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/4c/084cc5c7d88aa9c97e46473ba0d70036/pa/MG55357_209290d0d47cbf1035a30f8a904ddae0.jpg',
             'Width': 800}],
 'postal_code': '40220',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Landes',
 'province_code': 'FR-40',
 'region': 'Nouvelle-Aquitaine',
 'region_code': 'FR-75',
 'registration_date': '2022-07-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Puma 1.0 EcoBoost Mild-Hybrid ST-Line',
 'transmission': 'automatic',
 'trim': 'ST-Line',
 'year': 2022}
2026-04-27 08:08:45 [auto1.fr] INFO: Saving data for MG55357: {'created_time': 1777277325.066977, 'last_price_update_time': 1777277325.066989, 'has_photos': True, 'auction_closing_time': 1777390020.0}
2026-04-27 08:08:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/95/0d95f370f56fc9c14f3527a694ea5beb/pa/LT67510_0659e08c081cf0f03b6f329585f53b47.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/eb/daeba81fbf00e8ae6a705e2723fe78e4/pa/CL54463_b61bde701386961d08f8173b094375cf.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d601d0>
2026-04-27 08:08:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5589f96a-3c9e-502e-beba-e1f96ad831ea/5589f96a-3c9e-502e-beba-e1f96ad831ea_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/eb/daeba81fbf00e8ae6a705e2723fe78e4/pa/CL54463_02631500da04d88f7dd402e0a10b632d.jpg saved to cache
2026-04-27 08:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5589f96a-3c9e-502e-beba-e1f96ad831ea
2026-04-27 08:08:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/95/0d95f370f56fc9c14f3527a694ea5beb/pa/LT67510_3f84edf8b5f9bb2426a404ff8e1f6ae2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/95/0d95f370f56fc9c14f3527a694ea5beb/pa/LT67510_af22adafb2359bebb62a61cd12d74d33.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BH32555/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/95/0d95f370f56fc9c14f3527a694ea5beb/pa/LT67510_e4560f330df473eef55dcca907595e43.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143801e2d0>
2026-04-27 08:08:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fecc4e4-7769-5524-a347-c29b419d0918/7fecc4e4-7769-5524-a347-c29b419d0918_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/95/0d95f370f56fc9c14f3527a694ea5beb/pa/LT67510_0659e08c081cf0f03b6f329585f53b47.jpg saved to cache
2026-04-27 08:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7fecc4e4-7769-5524-a347-c29b419d0918
2026-04-27 08:08:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/95/0d95f370f56fc9c14f3527a694ea5beb/pa/LT67510_c0f8d59512d55319930fd0c1cd33da2f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a1a8d0>
2026-04-27 08:08:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5589f96a-3c9e-502e-beba-e1f96ad831ea/5589f96a-3c9e-502e-beba-e1f96ad831ea_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/eb/daeba81fbf00e8ae6a705e2723fe78e4/pa/CL54463_b61bde701386961d08f8173b094375cf.jpg saved to cache
2026-04-27 08:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5589f96a-3c9e-502e-beba-e1f96ad831ea
2026-04-27 08:08:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5589f96a-3c9e-502e-beba-e1f96ad831ea, skipping ID generation
2026-04-27 08:08:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5589f96a-3c9e-502e-beba-e1f96ad831ea with scrape type 1
2026-04-27 08:08:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5589f96a-3c9e-502e-beba-e1f96ad831ea sending to next pipeline
2026-04-27 08:08:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5589f96a-3c9e-502e-beba-e1f96ad831ea, identifier: CL54463
2026-04-27 08:08:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5589f96a-3c9e-502e-beba-e1f96ad831ea with identifier: CL54463
2026-04-27 08:08:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5589f96a-3c9e-502e-beba-e1f96ad831ea with identifier: CL54463
2026-04-27 08:08:45 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 5589f96a-3c9e-502e-beba-e1f96ad831ea with identifier: CL54463 to the API
2026-04-27 08:08:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:45 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgda/eb/daeba81fbf00e8ae6a705e2723fe78e4/pa/CL54463_b61bde701386961d08f8173b094375cf.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'category': None,
 'city': 'Beaucaire',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 95,
 'expiration_date': '2026-04-28T15:17:15Z',
 'fuel_type': 'diesel',
 'id': '5589f96a-3c9e-502e-beba-e1f96ad831ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 43.8081,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CL54463',
 'listing': 'auction',
 'location': 'FR, Beaucaire',
 'location_confidence': 'geocoded',
 'longitude': 4.6442,
 'make': 'Fiat',
 'model': '500X',
 'odometer': 173559,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5589f96a-3c9e-502e-beba-e1f96ad831ea/5589f96a-3c9e-502e-beba-e1f96ad831ea_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59037,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/eb/daeba81fbf00e8ae6a705e2723fe78e4/pa/CL54463_02631500da04d88f7dd402e0a10b632d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5589f96a-3c9e-502e-beba-e1f96ad831ea/5589f96a-3c9e-502e-beba-e1f96ad831ea_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63400,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/eb/daeba81fbf00e8ae6a705e2723fe78e4/pa/CL54463_b61bde701386961d08f8173b094375cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5589f96a-3c9e-502e-beba-e1f96ad831ea/5589f96a-3c9e-502e-beba-e1f96ad831ea_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63656,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/eb/daeba81fbf00e8ae6a705e2723fe78e4/pa/CL54463_aa627eece6605fecb499b4771de0a154.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5589f96a-3c9e-502e-beba-e1f96ad831ea/5589f96a-3c9e-502e-beba-e1f96ad831ea_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53459,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/eb/daeba81fbf00e8ae6a705e2723fe78e4/pa/CL54463_46c171f727541fe5d3c6a6ccf58e6cb9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5589f96a-3c9e-502e-beba-e1f96ad831ea/5589f96a-3c9e-502e-beba-e1f96ad831ea_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60396,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/eb/daeba81fbf00e8ae6a705e2723fe78e4/pa/CL54463_3a977ed61661cf1602259e64abc572f5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5589f96a-3c9e-502e-beba-e1f96ad831ea/5589f96a-3c9e-502e-beba-e1f96ad831ea_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60720,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/eb/daeba81fbf00e8ae6a705e2723fe78e4/pa/CL54463_6922773a7a45358872bdd6fbea81cdaf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5589f96a-3c9e-502e-beba-e1f96ad831ea/5589f96a-3c9e-502e-beba-e1f96ad831ea_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47574,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/eb/daeba81fbf00e8ae6a705e2723fe78e4/pa/CL54463_b6ae74d787de25b75fc7037333951fb1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5589f96a-3c9e-502e-beba-e1f96ad831ea/5589f96a-3c9e-502e-beba-e1f96ad831ea_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57645,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/eb/daeba81fbf00e8ae6a705e2723fe78e4/pa/CL54463_daded514ad48c828780ccd07ec1c580d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5589f96a-3c9e-502e-beba-e1f96ad831ea/5589f96a-3c9e-502e-beba-e1f96ad831ea_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57043,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/eb/daeba81fbf00e8ae6a705e2723fe78e4/pa/CL54463_cb29c9d419eabe3dd1f2e358fb68a2bc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5589f96a-3c9e-502e-beba-e1f96ad831ea/5589f96a-3c9e-502e-beba-e1f96ad831ea_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59353,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/eb/daeba81fbf00e8ae6a705e2723fe78e4/pa/CL54463_065d522bb6f9cbd533015423acf96a47.jpg',
             'Width': 800}],
 'postal_code': '30300',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Gard',
 'province_code': 'FR-30',
 'region': 'Occitanie',
 'region_code': 'FR-76',
 'registration_date': '2017-09-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat 500X 1.3 M-Jet Live Edizione',
 'transmission': 'manual',
 'trim': 'Live Edizione',
 'year': 2017}
2026-04-27 08:08:45 [auto1.fr] INFO: Saving data for CL54463: {'created_time': 1777277325.673581, 'last_price_update_time': 1777277325.673592, 'has_photos': True, 'auction_closing_time': 1777389435.0}
2026-04-27 08:08:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438cfbe10>
2026-04-27 08:08:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fecc4e4-7769-5524-a347-c29b419d0918/7fecc4e4-7769-5524-a347-c29b419d0918_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/95/0d95f370f56fc9c14f3527a694ea5beb/pa/LT67510_3f84edf8b5f9bb2426a404ff8e1f6ae2.jpg saved to cache
2026-04-27 08:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7fecc4e4-7769-5524-a347-c29b419d0918
2026-04-27 08:08:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438fbcc10>
2026-04-27 08:08:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fecc4e4-7769-5524-a347-c29b419d0918/7fecc4e4-7769-5524-a347-c29b419d0918_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/95/0d95f370f56fc9c14f3527a694ea5beb/pa/LT67510_af22adafb2359bebb62a61cd12d74d33.jpg saved to cache
2026-04-27 08:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7fecc4e4-7769-5524-a347-c29b419d0918
2026-04-27 08:08:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d7f890>
2026-04-27 08:08:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fecc4e4-7769-5524-a347-c29b419d0918/7fecc4e4-7769-5524-a347-c29b419d0918_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/95/0d95f370f56fc9c14f3527a694ea5beb/pa/LT67510_e4560f330df473eef55dcca907595e43.jpg saved to cache
2026-04-27 08:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7fecc4e4-7769-5524-a347-c29b419d0918
2026-04-27 08:08:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d33610>
2026-04-27 08:08:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fecc4e4-7769-5524-a347-c29b419d0918/7fecc4e4-7769-5524-a347-c29b419d0918_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/95/0d95f370f56fc9c14f3527a694ea5beb/pa/LT67510_c0f8d59512d55319930fd0c1cd33da2f.jpg saved to cache
2026-04-27 08:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7fecc4e4-7769-5524-a347-c29b419d0918
2026-04-27 08:08:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/ee/57ee939dbc6037af254f3298d373abec/pa/ME56071_c49b3b9e97b2a4de0bb9d874c556eb1a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LZ28528/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/41/2c415368711ab116d78e566182b5f5a6/pa/VR99778_8f965f66abe74382e9016aa290780364.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143ad8dc50>
2026-04-27 08:08:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6c13646-eae3-5047-adc8-149922bde6d6/e6c13646-eae3-5047-adc8-149922bde6d6_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/ee/57ee939dbc6037af254f3298d373abec/pa/ME56071_c49b3b9e97b2a4de0bb9d874c556eb1a.jpg saved to cache
2026-04-27 08:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e6c13646-eae3-5047-adc8-149922bde6d6
2026-04-27 08:08:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/ed/55edeacb5dfe4d1f0eff4388c4e774f9/pa/ES75996_9a7e04584cf34b77ce755b45420855f7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143817f290>
2026-04-27 08:08:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a249b8d-4f61-54a2-8efa-c3005989791a/7a249b8d-4f61-54a2-8efa-c3005989791a_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/41/2c415368711ab116d78e566182b5f5a6/pa/VR99778_8f965f66abe74382e9016aa290780364.jpg saved to cache
2026-04-27 08:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7a249b8d-4f61-54a2-8efa-c3005989791a
2026-04-27 08:08:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7a249b8d-4f61-54a2-8efa-c3005989791a, skipping ID generation
2026-04-27 08:08:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a249b8d-4f61-54a2-8efa-c3005989791a with scrape type 1
2026-04-27 08:08:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7a249b8d-4f61-54a2-8efa-c3005989791a sending to next pipeline
2026-04-27 08:08:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7a249b8d-4f61-54a2-8efa-c3005989791a, identifier: VR99778
2026-04-27 08:08:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7a249b8d-4f61-54a2-8efa-c3005989791a with identifier: VR99778
2026-04-27 08:08:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7a249b8d-4f61-54a2-8efa-c3005989791a with identifier: VR99778
2026-04-27 08:08:46 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 7a249b8d-4f61-54a2-8efa-c3005989791a with identifier: VR99778 to the API
2026-04-27 08:08:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:46 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2c/41/2c415368711ab116d78e566182b5f5a6/pa/VR99778_8f965f66abe74382e9016aa290780364.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'category': None,
 'city': 'Loyettes',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 125,
 'expiration_date': '2026-04-28T15:18:37Z',
 'fuel_type': 'diesel',
 'id': '7a249b8d-4f61-54a2-8efa-c3005989791a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 45.7766,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VR99778',
 'listing': 'auction',
 'location': 'FR, Loyettes',
 'location_confidence': 'geocoded',
 'longitude': 5.2069,
 'make': 'Toyota',
 'model': 'Auris',
 'odometer': 227871,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7a249b8d-4f61-54a2-8efa-c3005989791a/7a249b8d-4f61-54a2-8efa-c3005989791a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100806,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/41/2c415368711ab116d78e566182b5f5a6/pa/VR99778_8f965f66abe74382e9016aa290780364.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7a249b8d-4f61-54a2-8efa-c3005989791a/7a249b8d-4f61-54a2-8efa-c3005989791a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85031,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/41/2c415368711ab116d78e566182b5f5a6/pa/VR99778_cffde45a6ce8209dccd0f003f7a0f34e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7a249b8d-4f61-54a2-8efa-c3005989791a/7a249b8d-4f61-54a2-8efa-c3005989791a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77762,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/41/2c415368711ab116d78e566182b5f5a6/pa/VR99778_20e92b4e17fc364c35307c54472ed866.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7a249b8d-4f61-54a2-8efa-c3005989791a/7a249b8d-4f61-54a2-8efa-c3005989791a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35140,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/41/2c415368711ab116d78e566182b5f5a6/pa/VR99778_0b6cb942fc293a755a01da680fa1747f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7a249b8d-4f61-54a2-8efa-c3005989791a/7a249b8d-4f61-54a2-8efa-c3005989791a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91233,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/41/2c415368711ab116d78e566182b5f5a6/pa/VR99778_8e4c1e00cabc95ce00666ec11a208430.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7a249b8d-4f61-54a2-8efa-c3005989791a/7a249b8d-4f61-54a2-8efa-c3005989791a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41527,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/41/2c415368711ab116d78e566182b5f5a6/pa/VR99778_378ddca60853e00ea9b450454df0d6d4.jpg',
             'Width': 800}],
 'postal_code': '01360',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Ain',
 'province_code': 'FR-01',
 'region': 'Auvergne-Rhône-Alpes',
 'region_code': 'FR-84',
 'registration_date': '2009-05-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Auris 2.0 D-4D Luna Pack',
 'transmission': 'manual',
 'trim': 'Luna Pack',
 'year': 2009}
2026-04-27 08:08:46 [auto1.fr] INFO: Saving data for VR99778: {'created_time': 1777277326.683927, 'last_price_update_time': 1777277326.683937, 'has_photos': True, 'auction_closing_time': 1777389517.0}
2026-04-27 08:08:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/ee/57ee939dbc6037af254f3298d373abec/pa/ME56071_695e2d177d856361d595402295fb736d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7fecc4e4-7769-5524-a347-c29b419d0918 with identifier: LT67510
2026-04-27 08:08:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7fecc4e4-7769-5524-a347-c29b419d0918 with identifier: LT67510
2026-04-27 08:08:46 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 7fecc4e4-7769-5524-a347-c29b419d0918 with identifier: LT67510 to the API
2026-04-27 08:08:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:46 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:46 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'category': None,
 'city': 'Marseille',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-04-28T15:00:55Z',
 'fuel_type': 'diesel',
 'id': '7fecc4e4-7769-5524-a347-c29b419d0918',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 43.2969,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LT67510',
 'listing': 'auction',
 'location': 'FR, Marseille',
 'location_confidence': 'geocoded',
 'longitude': 5.3811,
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 168482,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 20,
 'photo_urls': ['https://img-pa.auto1.com/img0d/95/0d95f370f56fc9c14f3527a694ea5beb/pa/LT67510_c8c141fb7ae4b6018e48438b906478c9.jpg',
                'https://img-pa.auto1.com/img0d/95/0d95f370f56fc9c14f3527a694ea5beb/pa/LT67510_c0f8d59512d55319930fd0c1cd33da2f.jpg',
                'https://img-pa.auto1.com/img0d/95/0d95f370f56fc9c14f3527a694ea5beb/pa/LT67510_e4560f330df473eef55dcca907595e43.jpg',
                'https://img-pa.auto1.com/img0d/95/0d95f370f56fc9c14f3527a694ea5beb/pa/LT67510_af22adafb2359bebb62a61cd12d74d33.jpg',
                'https://img-pa.auto1.com/img0d/95/0d95f370f56fc9c14f3527a694ea5beb/pa/LT67510_3f84edf8b5f9bb2426a404ff8e1f6ae2.jpg',
                'https://img-pa.auto1.com/img0d/95/0d95f370f56fc9c14f3527a694ea5beb/pa/LT67510_0659e08c081cf0f03b6f329585f53b47.jpg',
                'https://img-pa.auto1.com/img0d/95/0d95f370f56fc9c14f3527a694ea5beb/pa/LT67510_157279ba1043baa0649f7a5fd824d8d8.jpg',
                'https://img-pa.auto1.com/img0d/95/0d95f370f56fc9c14f3527a694ea5beb/pa/LT67510_2d6fd53c75de7b806c32ab4a37470e06.jpg',
                'https://img-pa.auto1.com/img0d/95/0d95f370f56fc9c14f3527a694ea5beb/pa/LT67510_579fddd915228a3a5631cc017c8a14e9.jpg',
                'https://img-pa.auto1.com/img0d/95/0d95f370f56fc9c14f3527a694ea5beb/pa/LT67510_d4add116d1a43b31d5241561ea905df5.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7fecc4e4-7769-5524-a347-c29b419d0918/7fecc4e4-7769-5524-a347-c29b419d0918_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52894,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/95/0d95f370f56fc9c14f3527a694ea5beb/pa/LT67510_c0f8d59512d55319930fd0c1cd33da2f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7fecc4e4-7769-5524-a347-c29b419d0918/7fecc4e4-7769-5524-a347-c29b419d0918_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55266,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/95/0d95f370f56fc9c14f3527a694ea5beb/pa/LT67510_e4560f330df473eef55dcca907595e43.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7fecc4e4-7769-5524-a347-c29b419d0918/7fecc4e4-7769-5524-a347-c29b419d0918_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45060,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/95/0d95f370f56fc9c14f3527a694ea5beb/pa/LT67510_af22adafb2359bebb62a61cd12d74d33.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7fecc4e4-7769-5524-a347-c29b419d0918/7fecc4e4-7769-5524-a347-c29b419d0918_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52809,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/95/0d95f370f56fc9c14f3527a694ea5beb/pa/LT67510_3f84edf8b5f9bb2426a404ff8e1f6ae2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7fecc4e4-7769-5524-a347-c29b419d0918/7fecc4e4-7769-5524-a347-c29b419d0918_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50055,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/95/0d95f370f56fc9c14f3527a694ea5beb/pa/LT67510_0659e08c081cf0f03b6f329585f53b47.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7fecc4e4-7769-5524-a347-c29b419d0918/7fecc4e4-7769-5524-a347-c29b419d0918_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46120,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/95/0d95f370f56fc9c14f3527a694ea5beb/pa/LT67510_157279ba1043baa0649f7a5fd824d8d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7fecc4e4-7769-5524-a347-c29b419d0918/7fecc4e4-7769-5524-a347-c29b419d0918_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100622,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/95/0d95f370f56fc9c14f3527a694ea5beb/pa/LT67510_2d6fd53c75de7b806c32ab4a37470e06.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7fecc4e4-7769-5524-a347-c29b419d0918/7fecc4e4-7769-5524-a347-c29b419d0918_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72712,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/95/0d95f370f56fc9c14f3527a694ea5beb/pa/LT67510_579fddd915228a3a5631cc017c8a14e9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7fecc4e4-7769-5524-a347-c29b419d0918/7fecc4e4-7769-5524-a347-c29b419d0918_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75253,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/95/0d95f370f56fc9c14f3527a694ea5beb/pa/LT67510_d4add116d1a43b31d5241561ea905df5.jpg',
             'Width': 800}],
 'postal_code': '13000',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Bouches-du-Rhône',
 'province_code': 'FR-13',
 'region': "Provence-Alpes-Côte d'Azur",
 'region_code': 'FR-93',
 'registration_date': '2019-10-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi Executive',
 'transmission': 'manual',
 'trim': 'Executive',
 'year': 2019}
2026-04-27 08:08:47 [auto1.fr] INFO: Saving data for LT67510: {'created_time': 1777277327.011214, 'last_price_update_time': 1777277327.011225, 'has_photos': True, 'auction_closing_time': 1777388455.0}
2026-04-27 08:08:47 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 7fecc4e4-7769-5524-a347-c29b419d0918 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:08:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HS98603> (referer: https://www.auto1.com/v1/car-details-view/HS98603/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:08:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438170dd0>
2026-04-27 08:08:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b87b37dd-bb05-57ca-9480-c8a45accf666/b87b37dd-bb05-57ca-9480-c8a45accf666_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/ed/55edeacb5dfe4d1f0eff4388c4e774f9/pa/ES75996_9a7e04584cf34b77ce755b45420855f7.jpg saved to cache
2026-04-27 08:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b87b37dd-bb05-57ca-9480-c8a45accf666
2026-04-27 08:08:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438fcee90>
2026-04-27 08:08:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6c13646-eae3-5047-adc8-149922bde6d6/e6c13646-eae3-5047-adc8-149922bde6d6_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/ee/57ee939dbc6037af254f3298d373abec/pa/ME56071_695e2d177d856361d595402295fb736d.jpg saved to cache
2026-04-27 08:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e6c13646-eae3-5047-adc8-149922bde6d6
2026-04-27 08:08:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15181183-93ee-5342-8755-ef9f7231813f with identifier: HS98603
2026-04-27 08:08:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15181183-93ee-5342-8755-ef9f7231813f with scrape type 1
2026-04-27 08:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 15181183-93ee-5342-8755-ef9f7231813f
2026-04-27 08:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/c4/82c499e4ea4e4073e88df64869b12bcb/pa/HS98603_cb8499c88dc0a8735fae387ebfa23909.jpg not downloaded yet
2026-04-27 08:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/c4/82c499e4ea4e4073e88df64869b12bcb/pa/HS98603_d2524999610ddb1a9756734ac4f4ddd7.jpg not downloaded yet
2026-04-27 08:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/c4/82c499e4ea4e4073e88df64869b12bcb/pa/HS98603_92a7bf705852ecb609b4921ae5931631.jpg not downloaded yet
2026-04-27 08:08:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/ed/55edeacb5dfe4d1f0eff4388c4e774f9/pa/ES75996_196d06d4b8a8e6892c8f9dfc3d716f83.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/c4/82c499e4ea4e4073e88df64869b12bcb/pa/HS98603_0cd30e13036fbd042d324ca07b768afe.jpg not downloaded yet
2026-04-27 08:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/c4/82c499e4ea4e4073e88df64869b12bcb/pa/HS98603_00b3639d20edd3c9902d81f8f4f05bb3.jpg not downloaded yet
2026-04-27 08:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/c4/82c499e4ea4e4073e88df64869b12bcb/pa/HS98603_1b41f43ebbbbb575410ce22aa9a7485a.jpg not downloaded yet
2026-04-27 08:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/c4/82c499e4ea4e4073e88df64869b12bcb/pa/HS98603_e8a4dcf777ce9e3d17c67fffa20bde9a.jpg not downloaded yet
2026-04-27 08:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/c4/82c499e4ea4e4073e88df64869b12bcb/pa/HS98603_762b73f75fbe4fc7cd4c7a177acbaf2e.jpg not downloaded yet
2026-04-27 08:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/c4/82c499e4ea4e4073e88df64869b12bcb/pa/HS98603_a5199a17eb454251b45dee2dd054ce64.jpg not downloaded yet
2026-04-27 08:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/c4/82c499e4ea4e4073e88df64869b12bcb/pa/HS98603_65c7da0cea07896483cb6304f5844ea1.jpg not downloaded yet
2026-04-27 08:08:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1447b83510>
2026-04-27 08:08:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b87b37dd-bb05-57ca-9480-c8a45accf666/b87b37dd-bb05-57ca-9480-c8a45accf666_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/ed/55edeacb5dfe4d1f0eff4388c4e774f9/pa/ES75996_196d06d4b8a8e6892c8f9dfc3d716f83.jpg saved to cache
2026-04-27 08:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b87b37dd-bb05-57ca-9480-c8a45accf666
2026-04-27 08:08:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/c4/82c499e4ea4e4073e88df64869b12bcb/pa/HS98603_92a7bf705852ecb609b4921ae5931631.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438fb5690>
2026-04-27 08:08:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15181183-93ee-5342-8755-ef9f7231813f/15181183-93ee-5342-8755-ef9f7231813f_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/c4/82c499e4ea4e4073e88df64869b12bcb/pa/HS98603_92a7bf705852ecb609b4921ae5931631.jpg saved to cache
2026-04-27 08:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 15181183-93ee-5342-8755-ef9f7231813f
2026-04-27 08:08:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/c4/82c499e4ea4e4073e88df64869b12bcb/pa/HS98603_65c7da0cea07896483cb6304f5844ea1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/c4/82c499e4ea4e4073e88df64869b12bcb/pa/HS98603_a5199a17eb454251b45dee2dd054ce64.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/c4/82c499e4ea4e4073e88df64869b12bcb/pa/HS98603_762b73f75fbe4fc7cd4c7a177acbaf2e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438181710>
2026-04-27 08:08:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15181183-93ee-5342-8755-ef9f7231813f/15181183-93ee-5342-8755-ef9f7231813f_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/c4/82c499e4ea4e4073e88df64869b12bcb/pa/HS98603_65c7da0cea07896483cb6304f5844ea1.jpg saved to cache
2026-04-27 08:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 15181183-93ee-5342-8755-ef9f7231813f
2026-04-27 08:08:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438fb5710>
2026-04-27 08:08:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15181183-93ee-5342-8755-ef9f7231813f/15181183-93ee-5342-8755-ef9f7231813f_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/c4/82c499e4ea4e4073e88df64869b12bcb/pa/HS98603_a5199a17eb454251b45dee2dd054ce64.jpg saved to cache
2026-04-27 08:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 15181183-93ee-5342-8755-ef9f7231813f
2026-04-27 08:08:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c8c290>
2026-04-27 08:08:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15181183-93ee-5342-8755-ef9f7231813f/15181183-93ee-5342-8755-ef9f7231813f_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/c4/82c499e4ea4e4073e88df64869b12bcb/pa/HS98603_762b73f75fbe4fc7cd4c7a177acbaf2e.jpg saved to cache
2026-04-27 08:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 15181183-93ee-5342-8755-ef9f7231813f
2026-04-27 08:08:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/c4/82c499e4ea4e4073e88df64869b12bcb/pa/HS98603_e8a4dcf777ce9e3d17c67fffa20bde9a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438fb4ed0>
2026-04-27 08:08:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15181183-93ee-5342-8755-ef9f7231813f/15181183-93ee-5342-8755-ef9f7231813f_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/c4/82c499e4ea4e4073e88df64869b12bcb/pa/HS98603_e8a4dcf777ce9e3d17c67fffa20bde9a.jpg saved to cache
2026-04-27 08:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 15181183-93ee-5342-8755-ef9f7231813f
2026-04-27 08:08:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YP40813> (referer: https://www.auto1.com/v1/car-details-view/YP40813/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/c4/82c499e4ea4e4073e88df64869b12bcb/pa/HS98603_1b41f43ebbbbb575410ce22aa9a7485a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: acb98fde-2686-5bfd-9376-80f693bf2c89 with identifier: YP40813
2026-04-27 08:08:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item acb98fde-2686-5bfd-9376-80f693bf2c89 with scrape type 1
2026-04-27 08:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item acb98fde-2686-5bfd-9376-80f693bf2c89
2026-04-27 08:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/3e/263e834f8d45b62fd7a256a01e4a9eae/pa/YP40813_2def953cc15946f67571f54e76f8602a.jpg not downloaded yet
2026-04-27 08:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/3e/263e834f8d45b62fd7a256a01e4a9eae/pa/YP40813_0520200777e6c2fe4d0bb395fb8fc776.jpg not downloaded yet
2026-04-27 08:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/3e/263e834f8d45b62fd7a256a01e4a9eae/pa/YP40813_8e6ac156b94adb1895f107f5984cdb59.jpg not downloaded yet
2026-04-27 08:08:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c8d2d0>
2026-04-27 08:08:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15181183-93ee-5342-8755-ef9f7231813f/15181183-93ee-5342-8755-ef9f7231813f_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/c4/82c499e4ea4e4073e88df64869b12bcb/pa/HS98603_1b41f43ebbbbb575410ce22aa9a7485a.jpg saved to cache
2026-04-27 08:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 15181183-93ee-5342-8755-ef9f7231813f
2026-04-27 08:08:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/c4/82c499e4ea4e4073e88df64869b12bcb/pa/HS98603_00b3639d20edd3c9902d81f8f4f05bb3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/3e/263e834f8d45b62fd7a256a01e4a9eae/pa/YP40813_cd7e92152fa84fd0a05c013fc2586762.jpg not downloaded yet
2026-04-27 08:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/3e/263e834f8d45b62fd7a256a01e4a9eae/pa/YP40813_c1ce318b79a1951718174f9983ad3eef.jpg not downloaded yet
2026-04-27 08:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/3e/263e834f8d45b62fd7a256a01e4a9eae/pa/YP40813_b52ddeb46a98bfca0d7bddd475481edd.jpg not downloaded yet
2026-04-27 08:08:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/c4/82c499e4ea4e4073e88df64869b12bcb/pa/HS98603_0cd30e13036fbd042d324ca07b768afe.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/3e/263e834f8d45b62fd7a256a01e4a9eae/pa/YP40813_cc9c2a2e6a8d922a001cb1db77b9da72.jpg not downloaded yet
2026-04-27 08:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/3e/263e834f8d45b62fd7a256a01e4a9eae/pa/YP40813_b4f81d448fbd36d2894277d519e36872.jpg not downloaded yet
2026-04-27 08:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/3e/263e834f8d45b62fd7a256a01e4a9eae/pa/YP40813_534ea50c431ec9d5eb2d374b3961ccfb.jpg not downloaded yet
2026-04-27 08:08:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/3e/263e834f8d45b62fd7a256a01e4a9eae/pa/YP40813_8e6ac156b94adb1895f107f5984cdb59.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/3e/263e834f8d45b62fd7a256a01e4a9eae/pa/YP40813_6d499a92f899ecbbf2041e71165f7fa2.jpg not downloaded yet
2026-04-27 08:08:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d92190>
2026-04-27 08:08:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15181183-93ee-5342-8755-ef9f7231813f/15181183-93ee-5342-8755-ef9f7231813f_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/c4/82c499e4ea4e4073e88df64869b12bcb/pa/HS98603_00b3639d20edd3c9902d81f8f4f05bb3.jpg saved to cache
2026-04-27 08:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 15181183-93ee-5342-8755-ef9f7231813f
2026-04-27 08:08:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/3e/263e834f8d45b62fd7a256a01e4a9eae/pa/YP40813_b52ddeb46a98bfca0d7bddd475481edd.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/3e/263e834f8d45b62fd7a256a01e4a9eae/pa/YP40813_b4f81d448fbd36d2894277d519e36872.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380bb510>
2026-04-27 08:08:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15181183-93ee-5342-8755-ef9f7231813f/15181183-93ee-5342-8755-ef9f7231813f_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/c4/82c499e4ea4e4073e88df64869b12bcb/pa/HS98603_0cd30e13036fbd042d324ca07b768afe.jpg saved to cache
2026-04-27 08:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 15181183-93ee-5342-8755-ef9f7231813f
2026-04-27 08:08:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438bc6ed0>
2026-04-27 08:08:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acb98fde-2686-5bfd-9376-80f693bf2c89/acb98fde-2686-5bfd-9376-80f693bf2c89_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/3e/263e834f8d45b62fd7a256a01e4a9eae/pa/YP40813_8e6ac156b94adb1895f107f5984cdb59.jpg saved to cache
2026-04-27 08:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item acb98fde-2686-5bfd-9376-80f693bf2c89
2026-04-27 08:08:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/3e/263e834f8d45b62fd7a256a01e4a9eae/pa/YP40813_534ea50c431ec9d5eb2d374b3961ccfb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/3e/263e834f8d45b62fd7a256a01e4a9eae/pa/YP40813_6d499a92f899ecbbf2041e71165f7fa2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c8f350>
2026-04-27 08:08:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acb98fde-2686-5bfd-9376-80f693bf2c89/acb98fde-2686-5bfd-9376-80f693bf2c89_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/3e/263e834f8d45b62fd7a256a01e4a9eae/pa/YP40813_b52ddeb46a98bfca0d7bddd475481edd.jpg saved to cache
2026-04-27 08:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item acb98fde-2686-5bfd-9376-80f693bf2c89
2026-04-27 08:08:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d44c90>
2026-04-27 08:08:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acb98fde-2686-5bfd-9376-80f693bf2c89/acb98fde-2686-5bfd-9376-80f693bf2c89_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/3e/263e834f8d45b62fd7a256a01e4a9eae/pa/YP40813_b4f81d448fbd36d2894277d519e36872.jpg saved to cache
2026-04-27 08:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item acb98fde-2686-5bfd-9376-80f693bf2c89
2026-04-27 08:08:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/3e/263e834f8d45b62fd7a256a01e4a9eae/pa/YP40813_cc9c2a2e6a8d922a001cb1db77b9da72.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/3e/263e834f8d45b62fd7a256a01e4a9eae/pa/YP40813_c1ce318b79a1951718174f9983ad3eef.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bfb8410>
2026-04-27 08:08:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acb98fde-2686-5bfd-9376-80f693bf2c89/acb98fde-2686-5bfd-9376-80f693bf2c89_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/3e/263e834f8d45b62fd7a256a01e4a9eae/pa/YP40813_534ea50c431ec9d5eb2d374b3961ccfb.jpg saved to cache
2026-04-27 08:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item acb98fde-2686-5bfd-9376-80f693bf2c89
2026-04-27 08:08:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438bf1d90>
2026-04-27 08:08:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acb98fde-2686-5bfd-9376-80f693bf2c89/acb98fde-2686-5bfd-9376-80f693bf2c89_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/3e/263e834f8d45b62fd7a256a01e4a9eae/pa/YP40813_6d499a92f899ecbbf2041e71165f7fa2.jpg saved to cache
2026-04-27 08:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item acb98fde-2686-5bfd-9376-80f693bf2c89
2026-04-27 08:08:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/3e/263e834f8d45b62fd7a256a01e4a9eae/pa/YP40813_0520200777e6c2fe4d0bb395fb8fc776.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/3e/263e834f8d45b62fd7a256a01e4a9eae/pa/YP40813_cd7e92152fa84fd0a05c013fc2586762.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438136590>
2026-04-27 08:08:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acb98fde-2686-5bfd-9376-80f693bf2c89/acb98fde-2686-5bfd-9376-80f693bf2c89_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/3e/263e834f8d45b62fd7a256a01e4a9eae/pa/YP40813_cc9c2a2e6a8d922a001cb1db77b9da72.jpg saved to cache
2026-04-27 08:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item acb98fde-2686-5bfd-9376-80f693bf2c89
2026-04-27 08:08:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143817c950>
2026-04-27 08:08:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acb98fde-2686-5bfd-9376-80f693bf2c89/acb98fde-2686-5bfd-9376-80f693bf2c89_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/3e/263e834f8d45b62fd7a256a01e4a9eae/pa/YP40813_c1ce318b79a1951718174f9983ad3eef.jpg saved to cache
2026-04-27 08:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item acb98fde-2686-5bfd-9376-80f693bf2c89
2026-04-27 08:08:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/3e/263e834f8d45b62fd7a256a01e4a9eae/pa/YP40813_2def953cc15946f67571f54e76f8602a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/c4/82c499e4ea4e4073e88df64869b12bcb/pa/HS98603_d2524999610ddb1a9756734ac4f4ddd7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d44710>
2026-04-27 08:08:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acb98fde-2686-5bfd-9376-80f693bf2c89/acb98fde-2686-5bfd-9376-80f693bf2c89_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/3e/263e834f8d45b62fd7a256a01e4a9eae/pa/YP40813_0520200777e6c2fe4d0bb395fb8fc776.jpg saved to cache
2026-04-27 08:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item acb98fde-2686-5bfd-9376-80f693bf2c89
2026-04-27 08:08:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d71310>
2026-04-27 08:08:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acb98fde-2686-5bfd-9376-80f693bf2c89/acb98fde-2686-5bfd-9376-80f693bf2c89_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/3e/263e834f8d45b62fd7a256a01e4a9eae/pa/YP40813_cd7e92152fa84fd0a05c013fc2586762.jpg saved to cache
2026-04-27 08:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item acb98fde-2686-5bfd-9376-80f693bf2c89
2026-04-27 08:08:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/c4/82c499e4ea4e4073e88df64869b12bcb/pa/HS98603_cb8499c88dc0a8735fae387ebfa23909.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438cb8ad0>
2026-04-27 08:08:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acb98fde-2686-5bfd-9376-80f693bf2c89/acb98fde-2686-5bfd-9376-80f693bf2c89_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/3e/263e834f8d45b62fd7a256a01e4a9eae/pa/YP40813_2def953cc15946f67571f54e76f8602a.jpg saved to cache
2026-04-27 08:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item acb98fde-2686-5bfd-9376-80f693bf2c89
2026-04-27 08:08:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: acb98fde-2686-5bfd-9376-80f693bf2c89, skipping ID generation
2026-04-27 08:08:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item acb98fde-2686-5bfd-9376-80f693bf2c89 with scrape type 1
2026-04-27 08:08:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item acb98fde-2686-5bfd-9376-80f693bf2c89 sending to next pipeline
2026-04-27 08:08:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: acb98fde-2686-5bfd-9376-80f693bf2c89, identifier: YP40813
2026-04-27 08:08:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438bfe5d0>
2026-04-27 08:08:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15181183-93ee-5342-8755-ef9f7231813f/15181183-93ee-5342-8755-ef9f7231813f_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/c4/82c499e4ea4e4073e88df64869b12bcb/pa/HS98603_d2524999610ddb1a9756734ac4f4ddd7.jpg saved to cache
2026-04-27 08:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 15181183-93ee-5342-8755-ef9f7231813f
2026-04-27 08:08:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: acb98fde-2686-5bfd-9376-80f693bf2c89 with identifier: YP40813
2026-04-27 08:08:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: acb98fde-2686-5bfd-9376-80f693bf2c89 with identifier: YP40813
2026-04-27 08:08:49 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: acb98fde-2686-5bfd-9376-80f693bf2c89 with identifier: YP40813 to the API
2026-04-27 08:08:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:49 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img26/3e/263e834f8d45b62fd7a256a01e4a9eae/pa/YP40813_2def953cc15946f67571f54e76f8602a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 38,
 'category': 'Taxi',
 'city': 'Villenoy',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 218,
 'expiration_date': '2026-04-28T15:55:02Z',
 'fuel_type': 'hybrid',
 'id': 'acb98fde-2686-5bfd-9376-80f693bf2c89',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.9411,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YP40813',
 'listing': 'auction',
 'location': 'FR, Villenoy',
 'location_confidence': 'geocoded',
 'longitude': 2.8602,
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 443556,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_acb98fde-2686-5bfd-9376-80f693bf2c89/acb98fde-2686-5bfd-9376-80f693bf2c89_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78570,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/3e/263e834f8d45b62fd7a256a01e4a9eae/pa/YP40813_2def953cc15946f67571f54e76f8602a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_acb98fde-2686-5bfd-9376-80f693bf2c89/acb98fde-2686-5bfd-9376-80f693bf2c89_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75897,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/3e/263e834f8d45b62fd7a256a01e4a9eae/pa/YP40813_0520200777e6c2fe4d0bb395fb8fc776.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_acb98fde-2686-5bfd-9376-80f693bf2c89/acb98fde-2686-5bfd-9376-80f693bf2c89_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73361,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/3e/263e834f8d45b62fd7a256a01e4a9eae/pa/YP40813_8e6ac156b94adb1895f107f5984cdb59.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_acb98fde-2686-5bfd-9376-80f693bf2c89/acb98fde-2686-5bfd-9376-80f693bf2c89_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69437,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/3e/263e834f8d45b62fd7a256a01e4a9eae/pa/YP40813_cd7e92152fa84fd0a05c013fc2586762.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_acb98fde-2686-5bfd-9376-80f693bf2c89/acb98fde-2686-5bfd-9376-80f693bf2c89_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70229,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/3e/263e834f8d45b62fd7a256a01e4a9eae/pa/YP40813_c1ce318b79a1951718174f9983ad3eef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_acb98fde-2686-5bfd-9376-80f693bf2c89/acb98fde-2686-5bfd-9376-80f693bf2c89_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73751,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/3e/263e834f8d45b62fd7a256a01e4a9eae/pa/YP40813_b52ddeb46a98bfca0d7bddd475481edd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_acb98fde-2686-5bfd-9376-80f693bf2c89/acb98fde-2686-5bfd-9376-80f693bf2c89_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66244,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/3e/263e834f8d45b62fd7a256a01e4a9eae/pa/YP40813_cc9c2a2e6a8d922a001cb1db77b9da72.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_acb98fde-2686-5bfd-9376-80f693bf2c89/acb98fde-2686-5bfd-9376-80f693bf2c89_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75521,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/3e/263e834f8d45b62fd7a256a01e4a9eae/pa/YP40813_b4f81d448fbd36d2894277d519e36872.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_acb98fde-2686-5bfd-9376-80f693bf2c89/acb98fde-2686-5bfd-9376-80f693bf2c89_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72539,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/3e/263e834f8d45b62fd7a256a01e4a9eae/pa/YP40813_534ea50c431ec9d5eb2d374b3961ccfb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_acb98fde-2686-5bfd-9376-80f693bf2c89/acb98fde-2686-5bfd-9376-80f693bf2c89_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72574,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/3e/263e834f8d45b62fd7a256a01e4a9eae/pa/YP40813_6d499a92f899ecbbf2041e71165f7fa2.jpg',
             'Width': 800}],
 'postal_code': '77124',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Seine-et-Marne',
 'province_code': 'FR-77',
 'region': 'Île-de-France',
 'region_code': 'FR-11',
 'registration_date': '2018-04-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Passat 1.4 GTE',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-04-27 08:08:49 [auto1.fr] INFO: Saving data for YP40813: {'created_time': 1777277329.689201, 'last_price_update_time': 1777277329.689211, 'has_photos': True, 'auction_closing_time': 1777391702.0}
2026-04-27 08:08:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/ee/57ee939dbc6037af254f3298d373abec/pa/ME56071_5d7d828cc48824c62b83fc84f4734907.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-04-27 08:08:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YZ25603/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438045d90>
2026-04-27 08:08:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15181183-93ee-5342-8755-ef9f7231813f/15181183-93ee-5342-8755-ef9f7231813f_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/c4/82c499e4ea4e4073e88df64869b12bcb/pa/HS98603_cb8499c88dc0a8735fae387ebfa23909.jpg saved to cache
2026-04-27 08:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 15181183-93ee-5342-8755-ef9f7231813f
2026-04-27 08:08:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 15181183-93ee-5342-8755-ef9f7231813f, skipping ID generation
2026-04-27 08:08:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15181183-93ee-5342-8755-ef9f7231813f with scrape type 1
2026-04-27 08:08:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 15181183-93ee-5342-8755-ef9f7231813f sending to next pipeline
2026-04-27 08:08:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 15181183-93ee-5342-8755-ef9f7231813f, identifier: HS98603
2026-04-27 08:08:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 15181183-93ee-5342-8755-ef9f7231813f with identifier: HS98603
2026-04-27 08:08:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 15181183-93ee-5342-8755-ef9f7231813f with identifier: HS98603
2026-04-27 08:08:49 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 15181183-93ee-5342-8755-ef9f7231813f with identifier: HS98603 to the API
2026-04-27 08:08:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:50 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img82/c4/82c499e4ea4e4073e88df64869b12bcb/pa/HS98603_cb8499c88dc0a8735fae387ebfa23909.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'city': 'Montataire',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.7L',
 'engine_horse_power': 130,
 'expiration_date': '2026-04-28T15:43:10Z',
 'fuel_type': 'diesel',
 'id': '15181183-93ee-5342-8755-ef9f7231813f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 49.259,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HS98603',
 'listing': 'auction',
 'location': 'FR, Montataire',
 'location_confidence': 'geocoded',
 'longitude': 2.4378,
 'make': 'Opel',
 'model': 'Mokka',
 'odometer': 77928,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_15181183-93ee-5342-8755-ef9f7231813f/15181183-93ee-5342-8755-ef9f7231813f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70414,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/c4/82c499e4ea4e4073e88df64869b12bcb/pa/HS98603_cb8499c88dc0a8735fae387ebfa23909.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_15181183-93ee-5342-8755-ef9f7231813f/15181183-93ee-5342-8755-ef9f7231813f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68061,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/c4/82c499e4ea4e4073e88df64869b12bcb/pa/HS98603_d2524999610ddb1a9756734ac4f4ddd7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_15181183-93ee-5342-8755-ef9f7231813f/15181183-93ee-5342-8755-ef9f7231813f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67314,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/c4/82c499e4ea4e4073e88df64869b12bcb/pa/HS98603_92a7bf705852ecb609b4921ae5931631.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_15181183-93ee-5342-8755-ef9f7231813f/15181183-93ee-5342-8755-ef9f7231813f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52195,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/c4/82c499e4ea4e4073e88df64869b12bcb/pa/HS98603_0cd30e13036fbd042d324ca07b768afe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_15181183-93ee-5342-8755-ef9f7231813f/15181183-93ee-5342-8755-ef9f7231813f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68633,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/c4/82c499e4ea4e4073e88df64869b12bcb/pa/HS98603_00b3639d20edd3c9902d81f8f4f05bb3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_15181183-93ee-5342-8755-ef9f7231813f/15181183-93ee-5342-8755-ef9f7231813f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67942,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/c4/82c499e4ea4e4073e88df64869b12bcb/pa/HS98603_1b41f43ebbbbb575410ce22aa9a7485a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_15181183-93ee-5342-8755-ef9f7231813f/15181183-93ee-5342-8755-ef9f7231813f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61600,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/c4/82c499e4ea4e4073e88df64869b12bcb/pa/HS98603_e8a4dcf777ce9e3d17c67fffa20bde9a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_15181183-93ee-5342-8755-ef9f7231813f/15181183-93ee-5342-8755-ef9f7231813f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70695,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/c4/82c499e4ea4e4073e88df64869b12bcb/pa/HS98603_762b73f75fbe4fc7cd4c7a177acbaf2e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_15181183-93ee-5342-8755-ef9f7231813f/15181183-93ee-5342-8755-ef9f7231813f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68198,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/c4/82c499e4ea4e4073e88df64869b12bcb/pa/HS98603_a5199a17eb454251b45dee2dd054ce64.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_15181183-93ee-5342-8755-ef9f7231813f/15181183-93ee-5342-8755-ef9f7231813f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66190,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/c4/82c499e4ea4e4073e88df64869b12bcb/pa/HS98603_65c7da0cea07896483cb6304f5844ea1.jpg',
             'Width': 800}],
 'postal_code': '60160',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Oise',
 'province_code': 'FR-60',
 'region': 'Hauts-de-France',
 'region_code': 'FR-32',
 'registration_date': '2015-04-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Mokka 1.7 CDTI Selective',
 'transmission': 'manual',
 'trim': 'Selective',
 'year': 2015}
2026-04-27 08:08:50 [auto1.fr] INFO: Saving data for HS98603: {'created_time': 1777277330.157131, 'last_price_update_time': 1777277330.157141, 'has_photos': True, 'auction_closing_time': 1777390990.0}
2026-04-27 08:08:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:08:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d90450>
2026-04-27 08:08:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6c13646-eae3-5047-adc8-149922bde6d6/e6c13646-eae3-5047-adc8-149922bde6d6_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/ee/57ee939dbc6037af254f3298d373abec/pa/ME56071_5d7d828cc48824c62b83fc84f4734907.jpg saved to cache
2026-04-27 08:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e6c13646-eae3-5047-adc8-149922bde6d6
2026-04-27 08:08:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RG55649> (referer: https://www.auto1.com/v1/car-details-view/RG55649/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/ed/55edeacb5dfe4d1f0eff4388c4e774f9/pa/ES75996_16d708c93f65bcf8c15ee8b3eb98fa3f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 86838530-5df1-5b24-8ba3-e768bfc932c4 with identifier: RG55649
2026-04-27 08:08:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86838530-5df1-5b24-8ba3-e768bfc932c4 with scrape type 1
2026-04-27 08:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 86838530-5df1-5b24-8ba3-e768bfc932c4
2026-04-27 08:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/98/be98a1639b8706604972a3fbf1f6df30/pa/RG55649_92128cfb0eb0852d91a315419cf0f40c.jpg already downloaded
2026-04-27 08:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/98/be98a1639b8706604972a3fbf1f6df30/pa/RG55649_b70e31988669647396b5bce64449d554.jpg already downloaded
2026-04-27 08:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/98/be98a1639b8706604972a3fbf1f6df30/pa/RG55649_a78dd859735bc25df852ec324be6dd40.jpg already downloaded
2026-04-27 08:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/98/be98a1639b8706604972a3fbf1f6df30/pa/RG55649_24a1292d7ae80d842dc61deaf57cbe79.jpg already downloaded
2026-04-27 08:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/98/be98a1639b8706604972a3fbf1f6df30/pa/RG55649_03751dc4e12f07668ba0f1cda02e5706.jpg already downloaded
2026-04-27 08:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/98/be98a1639b8706604972a3fbf1f6df30/pa/RG55649_b6679344455d2c5b20c2ccc462240cf3.jpg already downloaded
2026-04-27 08:08:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 86838530-5df1-5b24-8ba3-e768bfc932c4, identifier: RG55649
2026-04-27 08:08:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 86838530-5df1-5b24-8ba3-e768bfc932c4 with identifier: RG55649
2026-04-27 08:08:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 86838530-5df1-5b24-8ba3-e768bfc932c4 with identifier: RG55649
2026-04-27 08:08:50 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 86838530-5df1-5b24-8ba3-e768bfc932c4 with identifier: RG55649 to the API
2026-04-27 08:08:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:50 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RG55649>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'category': None,
 'city': 'Saint Aignan de Grandlieu',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.9L',
 'engine_horse_power': 105,
 'expiration_date': '2026-04-28T15:53:32Z',
 'fuel_type': 'diesel',
 'id': '86838530-5df1-5b24-8ba3-e768bfc932c4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 47.1237,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RG55649',
 'listing': 'auction',
 'location': 'FR, Saint Aignan de Grandlieu',
 'location_confidence': 'geocoded',
 'longitude': -1.6308,
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 277499,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/imgbe/98/be98a1639b8706604972a3fbf1f6df30/pa/RG55649_92128cfb0eb0852d91a315419cf0f40c.jpg',
                'https://img-pa.auto1.com/imgbe/98/be98a1639b8706604972a3fbf1f6df30/pa/RG55649_b70e31988669647396b5bce64449d554.jpg',
                'https://img-pa.auto1.com/imgbe/98/be98a1639b8706604972a3fbf1f6df30/pa/RG55649_a78dd859735bc25df852ec324be6dd40.jpg',
                'https://img-pa.auto1.com/imgbe/98/be98a1639b8706604972a3fbf1f6df30/pa/RG55649_24a1292d7ae80d842dc61deaf57cbe79.jpg',
                'https://img-pa.auto1.com/imgbe/98/be98a1639b8706604972a3fbf1f6df30/pa/RG55649_03751dc4e12f07668ba0f1cda02e5706.jpg',
                'https://img-pa.auto1.com/imgbe/98/be98a1639b8706604972a3fbf1f6df30/pa/RG55649_b6679344455d2c5b20c2ccc462240cf3.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_86838530-5df1-5b24-8ba3-e768bfc932c4/86838530-5df1-5b24-8ba3-e768bfc932c4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75891,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/98/be98a1639b8706604972a3fbf1f6df30/pa/RG55649_92128cfb0eb0852d91a315419cf0f40c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_86838530-5df1-5b24-8ba3-e768bfc932c4/86838530-5df1-5b24-8ba3-e768bfc932c4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78334,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/98/be98a1639b8706604972a3fbf1f6df30/pa/RG55649_b70e31988669647396b5bce64449d554.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_86838530-5df1-5b24-8ba3-e768bfc932c4/86838530-5df1-5b24-8ba3-e768bfc932c4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79434,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/98/be98a1639b8706604972a3fbf1f6df30/pa/RG55649_a78dd859735bc25df852ec324be6dd40.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_86838530-5df1-5b24-8ba3-e768bfc932c4/86838530-5df1-5b24-8ba3-e768bfc932c4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61351,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/98/be98a1639b8706604972a3fbf1f6df30/pa/RG55649_24a1292d7ae80d842dc61deaf57cbe79.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_86838530-5df1-5b24-8ba3-e768bfc932c4/86838530-5df1-5b24-8ba3-e768bfc932c4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93445,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/98/be98a1639b8706604972a3fbf1f6df30/pa/RG55649_03751dc4e12f07668ba0f1cda02e5706.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_86838530-5df1-5b24-8ba3-e768bfc932c4/86838530-5df1-5b24-8ba3-e768bfc932c4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43549,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/98/be98a1639b8706604972a3fbf1f6df30/pa/RG55649_b6679344455d2c5b20c2ccc462240cf3.jpg',
             'Width': 800}],
 'postal_code': '44860',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Loire-Atlantique',
 'province_code': 'FR-44',
 'region': 'Pays de la Loire',
 'region_code': 'FR-52',
 'registration_date': '2008-06-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf V 1.9 TDI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2008}
2026-04-27 08:08:50 [auto1.fr] INFO: Saving data for RG55649: {'created_time': 1777277330.863929, 'last_price_update_time': 1777277330.863939, 'has_photos': True, 'auction_closing_time': 1777391612.0}
2026-04-27 08:08:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/ee/57ee939dbc6037af254f3298d373abec/pa/ME56071_85e2aa97a2056fd887cb00ddd9d609a7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143ad8d5d0>
2026-04-27 08:08:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b87b37dd-bb05-57ca-9480-c8a45accf666/b87b37dd-bb05-57ca-9480-c8a45accf666_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/ed/55edeacb5dfe4d1f0eff4388c4e774f9/pa/ES75996_16d708c93f65bcf8c15ee8b3eb98fa3f.jpg saved to cache
2026-04-27 08:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b87b37dd-bb05-57ca-9480-c8a45accf666
2026-04-27 08:08:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d91250>
2026-04-27 08:08:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6c13646-eae3-5047-adc8-149922bde6d6/e6c13646-eae3-5047-adc8-149922bde6d6_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/ee/57ee939dbc6037af254f3298d373abec/pa/ME56071_85e2aa97a2056fd887cb00ddd9d609a7.jpg saved to cache
2026-04-27 08:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e6c13646-eae3-5047-adc8-149922bde6d6
2026-04-27 08:08:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PN57067> (referer: https://www.auto1.com/v1/car-details-view/PN57067/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/ed/55edeacb5dfe4d1f0eff4388c4e774f9/pa/ES75996_c1c9b063ac7502c80b3d639bd1b9618f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64adcd84-27e0-5b2d-8220-81be987bdd54 with identifier: PN57067
2026-04-27 08:08:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64adcd84-27e0-5b2d-8220-81be987bdd54 with scrape type 1
2026-04-27 08:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 64adcd84-27e0-5b2d-8220-81be987bdd54
2026-04-27 08:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/b4/08b4787c931be30de336bf8c3fe73703/pa/PN57067_76dbc559a863719cd450556d87c33879.jpg not downloaded yet
2026-04-27 08:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/b4/08b4787c931be30de336bf8c3fe73703/pa/PN57067_ef9ead1b303173a983fc1479e84b9103.jpg not downloaded yet
2026-04-27 08:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/b4/08b4787c931be30de336bf8c3fe73703/pa/PN57067_d3677d6096965e6615234822c5a5f539.jpg not downloaded yet
2026-04-27 08:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/b4/08b4787c931be30de336bf8c3fe73703/pa/PN57067_f2be913275fdc83f3a45cec7c7900ba4.jpg not downloaded yet
2026-04-27 08:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/b4/08b4787c931be30de336bf8c3fe73703/pa/PN57067_b3d4ae4ea25bec06382cb213cc7af8c3.jpg not downloaded yet
2026-04-27 08:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/b4/08b4787c931be30de336bf8c3fe73703/pa/PN57067_d1867250dafe9b09c42c7c672e93f92b.jpg not downloaded yet
2026-04-27 08:08:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438bf10d0>
2026-04-27 08:08:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b87b37dd-bb05-57ca-9480-c8a45accf666/b87b37dd-bb05-57ca-9480-c8a45accf666_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/ed/55edeacb5dfe4d1f0eff4388c4e774f9/pa/ES75996_c1c9b063ac7502c80b3d639bd1b9618f.jpg saved to cache
2026-04-27 08:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b87b37dd-bb05-57ca-9480-c8a45accf666
2026-04-27 08:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/b4/08b4787c931be30de336bf8c3fe73703/pa/PN57067_62096ff6f467e89f213f08ee61aba71b.jpg not downloaded yet
2026-04-27 08:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/b4/08b4787c931be30de336bf8c3fe73703/pa/PN57067_62f4d71723342c1ca63fb0cb75b32275.jpg not downloaded yet
2026-04-27 08:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/b4/08b4787c931be30de336bf8c3fe73703/pa/PN57067_0358425d2a5169b1ec102515e1408efb.jpg not downloaded yet
2026-04-27 08:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/b4/08b4787c931be30de336bf8c3fe73703/pa/PN57067_f3b8f0a2fda7aaf05a01f436a58fa221.jpg not downloaded yet
2026-04-27 08:08:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:51 [auto1.fr] INFO: Channel: 24h | Page: 17 | totalHits: 4771 | hits on page: 40
2026-04-27 08:08:51 [auto1.fr] INFO: Found listing with ID: MG55357
2026-04-27 08:08:51 [auto1.fr] INFO: Scrape type for MG55357: 0
2026-04-27 08:08:51 [auto1.fr] INFO: Found listing with ID: TH45766
2026-04-27 08:08:51 [auto1.fr] INFO: Scrape type for TH45766: 1
2026-04-27 08:08:51 [auto1.fr] INFO: Found listing with ID: RZ77484
2026-04-27 08:08:51 [auto1.fr] INFO: Scrape type for RZ77484: 2
2026-04-27 08:08:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c0aed2e-9e70-5a33-b26b-2066e386c1f8 with identifier: RZ77484
2026-04-27 08:08:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c0aed2e-9e70-5a33-b26b-2066e386c1f8 with scrape type 2
2026-04-27 08:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3c0aed2e-9e70-5a33-b26b-2066e386c1f8 with scrape type 2
2026-04-27 08:08:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3c0aed2e-9e70-5a33-b26b-2066e386c1f8, identifier: RZ77484
2026-04-27 08:08:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3c0aed2e-9e70-5a33-b26b-2066e386c1f8 with identifier: RZ77484
2026-04-27 08:08:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3c0aed2e-9e70-5a33-b26b-2066e386c1f8 with identifier: RZ77484
2026-04-27 08:08:52 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 3c0aed2e-9e70-5a33-b26b-2066e386c1f8 with identifier: RZ77484 to the API
2026-04-27 08:08:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:52 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 85,
 'expiration_date': '2026-04-28T15:27:23Z',
 'fuel_type': 'petrol',
 'id': '3c0aed2e-9e70-5a33-b26b-2066e386c1f8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RZ77484',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Audi',
 'model': 'A1',
 'odometer': 114146,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2012-10-31',
 'seller_name': None,
 'title': 'Audi A1 1.2 TFSI Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2012}
2026-04-27 08:08:52 [auto1.fr] INFO: Saving data for RZ77484: {'auction_closing_time': 1777390043.0, 'created_time': 1777021717.367198, 'has_photos': True, 'last_price_update_time': 1777277332.269508}
2026-04-27 08:08:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/b4/08b4787c931be30de336bf8c3fe73703/pa/PN57067_f3b8f0a2fda7aaf05a01f436a58fa221.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:52 [auto1.fr] INFO: Found listing with ID: ZZ56347
2026-04-27 08:08:52 [auto1.fr] INFO: Scrape type for ZZ56347: 2
2026-04-27 08:08:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 985a757f-67ca-5c65-84d5-2203b8220c9d with identifier: ZZ56347
2026-04-27 08:08:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 985a757f-67ca-5c65-84d5-2203b8220c9d with scrape type 2
2026-04-27 08:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 985a757f-67ca-5c65-84d5-2203b8220c9d with scrape type 2
2026-04-27 08:08:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 985a757f-67ca-5c65-84d5-2203b8220c9d, identifier: ZZ56347
2026-04-27 08:08:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 985a757f-67ca-5c65-84d5-2203b8220c9d with identifier: ZZ56347
2026-04-27 08:08:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 985a757f-67ca-5c65-84d5-2203b8220c9d with identifier: ZZ56347
2026-04-27 08:08:52 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 985a757f-67ca-5c65-84d5-2203b8220c9d with identifier: ZZ56347 to the API
2026-04-27 08:08:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:52 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-04-28T15:40:16Z',
 'fuel_type': 'diesel',
 'id': '985a757f-67ca-5c65-84d5-2203b8220c9d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ56347',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 229756,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2021-06-22',
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2021}
2026-04-27 08:08:52 [auto1.fr] INFO: Saving data for ZZ56347: {'auction_closing_time': 1777390816.0, 'created_time': 1777022080.463279, 'has_photos': True, 'last_price_update_time': 1777277332.688439}
2026-04-27 08:08:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XR47331> (referer: https://www.auto1.com/v1/car-details-view/XR47331/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:52 [auto1.fr] INFO: Found listing with ID: US96093
2026-04-27 08:08:52 [auto1.fr] INFO: Scrape type for US96093: 2
2026-04-27 08:08:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd2169e5-7833-5438-9dc8-919dfcd79577 with identifier: US96093
2026-04-27 08:08:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd2169e5-7833-5438-9dc8-919dfcd79577 with scrape type 2
2026-04-27 08:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd2169e5-7833-5438-9dc8-919dfcd79577 with scrape type 2
2026-04-27 08:08:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: fd2169e5-7833-5438-9dc8-919dfcd79577, identifier: US96093
2026-04-27 08:08:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: fd2169e5-7833-5438-9dc8-919dfcd79577 with identifier: US96093
2026-04-27 08:08:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: fd2169e5-7833-5438-9dc8-919dfcd79577 with identifier: US96093
2026-04-27 08:08:52 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: fd2169e5-7833-5438-9dc8-919dfcd79577 with identifier: US96093 to the API
2026-04-27 08:08:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:52 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-04-28T15:04:29Z',
 'fuel_type': 'diesel',
 'id': 'fd2169e5-7833-5438-9dc8-919dfcd79577',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/US96093',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Peugeot',
 'model': '308',
 'odometer': 160902,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2009-02-25',
 'seller_name': None,
 'title': 'Peugeot 308 1.6 HDi Premium',
 'transmission': 'manual',
 'trim': 'Premium',
 'year': 2009}
2026-04-27 08:08:53 [auto1.fr] INFO: Saving data for US96093: {'auction_closing_time': 1777388669.0, 'created_time': 1777020534.089256, 'has_photos': True, 'last_price_update_time': 1777277333.0603}
2026-04-27 08:08:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438eb7610>
2026-04-27 08:08:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64adcd84-27e0-5b2d-8220-81be987bdd54/64adcd84-27e0-5b2d-8220-81be987bdd54_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/b4/08b4787c931be30de336bf8c3fe73703/pa/PN57067_f3b8f0a2fda7aaf05a01f436a58fa221.jpg saved to cache
2026-04-27 08:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 64adcd84-27e0-5b2d-8220-81be987bdd54
2026-04-27 08:08:53 [auto1.fr] INFO: Found listing with ID: MC81159
2026-04-27 08:08:53 [auto1.fr] INFO: Scrape type for MC81159: 2
2026-04-27 08:08:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21d0d324-6117-5fd4-95c1-c6d381a4ed21 with identifier: MC81159
2026-04-27 08:08:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21d0d324-6117-5fd4-95c1-c6d381a4ed21 with scrape type 2
2026-04-27 08:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 21d0d324-6117-5fd4-95c1-c6d381a4ed21 with scrape type 2
2026-04-27 08:08:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 21d0d324-6117-5fd4-95c1-c6d381a4ed21, identifier: MC81159
2026-04-27 08:08:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 21d0d324-6117-5fd4-95c1-c6d381a4ed21 with identifier: MC81159
2026-04-27 08:08:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 21d0d324-6117-5fd4-95c1-c6d381a4ed21 with identifier: MC81159
2026-04-27 08:08:53 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 21d0d324-6117-5fd4-95c1-c6d381a4ed21 with identifier: MC81159 to the API
2026-04-27 08:08:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:53 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-04-28T15:41:09Z',
 'fuel_type': 'diesel',
 'id': '21d0d324-6117-5fd4-95c1-c6d381a4ed21',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MC81159',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Opel',
 'model': 'Mokka X',
 'odometer': 174560,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2019-03-18',
 'seller_name': None,
 'title': 'Opel Mokka X 1.6 CDTI Black Edition Start/Stop',
 'transmission': 'manual',
 'trim': 'Black Edition Start/Stop',
 'year': 2019}
2026-04-27 08:08:53 [auto1.fr] INFO: Saving data for MC81159: {'auction_closing_time': 1777390869.0, 'created_time': 1777020287.266197, 'has_photos': True, 'last_price_update_time': 1777277333.503537}
2026-04-27 08:08:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10aef3f5-ae3d-58dd-bac4-4b9392146c1f with identifier: XR47331
2026-04-27 08:08:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10aef3f5-ae3d-58dd-bac4-4b9392146c1f with scrape type 1
2026-04-27 08:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 10aef3f5-ae3d-58dd-bac4-4b9392146c1f
2026-04-27 08:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/a0/f1a0a470c64d98e7ae14c4a36096d058/pa/XR47331_bb8aedfb92b3ea4ff483f09f5d9df538.jpg not downloaded yet
2026-04-27 08:08:53 [auto1.fr] INFO: Found listing with ID: GH74001
2026-04-27 08:08:53 [auto1.fr] INFO: Scrape type for GH74001: 2
2026-04-27 08:08:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ccc22040-78e3-5652-be70-bb2308c9343f with identifier: GH74001
2026-04-27 08:08:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ccc22040-78e3-5652-be70-bb2308c9343f with scrape type 2
2026-04-27 08:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ccc22040-78e3-5652-be70-bb2308c9343f with scrape type 2
2026-04-27 08:08:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ccc22040-78e3-5652-be70-bb2308c9343f, identifier: GH74001
2026-04-27 08:08:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ccc22040-78e3-5652-be70-bb2308c9343f with identifier: GH74001
2026-04-27 08:08:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ccc22040-78e3-5652-be70-bb2308c9343f with identifier: GH74001
2026-04-27 08:08:53 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ccc22040-78e3-5652-be70-bb2308c9343f with identifier: GH74001 to the API
2026-04-27 08:08:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:53 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-04-28T15:42:12Z',
 'fuel_type': 'diesel',
 'id': 'ccc22040-78e3-5652-be70-bb2308c9343f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GH74001',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 231402,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2015-12-03',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 220 Shooting Brake 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2015}
2026-04-27 08:08:53 [auto1.fr] INFO: Saving data for GH74001: {'auction_closing_time': 1777390932.0, 'created_time': 1777022807.723892, 'has_photos': True, 'last_price_update_time': 1777277333.9326}
2026-04-27 08:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/a0/f1a0a470c64d98e7ae14c4a36096d058/pa/XR47331_2d498da9a8f279d64ebbf420e20fc40b.jpg not downloaded yet
2026-04-27 08:08:53 [auto1.fr] INFO: Found listing with ID: UK60667
2026-04-27 08:08:53 [auto1.fr] INFO: Scrape type for UK60667: 1
2026-04-27 08:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/a0/f1a0a470c64d98e7ae14c4a36096d058/pa/XR47331_78626797495ac1578eb1f4181bbf3b1e.jpg not downloaded yet
2026-04-27 08:08:53 [auto1.fr] INFO: Found listing with ID: HE19526
2026-04-27 08:08:54 [auto1.fr] INFO: Scrape type for HE19526: 1
2026-04-27 08:08:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/a0/f1a0a470c64d98e7ae14c4a36096d058/pa/XR47331_7b57705ed8cdf739447fb85a3db67ca5.jpg not downloaded yet
2026-04-27 08:08:54 [auto1.fr] INFO: Found listing with ID: LE80114
2026-04-27 08:08:54 [auto1.fr] INFO: Scrape type for LE80114: 1
2026-04-27 08:08:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/a0/f1a0a470c64d98e7ae14c4a36096d058/pa/XR47331_dda3d4a849c693c4e0047a6f32c918a5.jpg not downloaded yet
2026-04-27 08:08:54 [auto1.fr] INFO: Found listing with ID: BA47143
2026-04-27 08:08:54 [auto1.fr] INFO: Scrape type for BA47143: 1
2026-04-27 08:08:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/a0/f1a0a470c64d98e7ae14c4a36096d058/pa/XR47331_7d8da10dd630e6daa06fc1ef131cab7f.jpg not downloaded yet
2026-04-27 08:08:54 [auto1.fr] INFO: Found listing with ID: XR15789
2026-04-27 08:08:54 [auto1.fr] INFO: Scrape type for XR15789: 1
2026-04-27 08:08:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/a0/f1a0a470c64d98e7ae14c4a36096d058/pa/XR47331_dd89dbfc0b5de39054ce5b8e7f01e6c3.jpg not downloaded yet
2026-04-27 08:08:54 [auto1.fr] INFO: Found listing with ID: FH97187
2026-04-27 08:08:54 [auto1.fr] INFO: Scrape type for FH97187: 2
2026-04-27 08:08:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce25f68d-cfbf-5f24-a442-0e3de37a38ab with identifier: FH97187
2026-04-27 08:08:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce25f68d-cfbf-5f24-a442-0e3de37a38ab with scrape type 2
2026-04-27 08:08:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce25f68d-cfbf-5f24-a442-0e3de37a38ab with scrape type 2
2026-04-27 08:08:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ce25f68d-cfbf-5f24-a442-0e3de37a38ab, identifier: FH97187
2026-04-27 08:08:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ce25f68d-cfbf-5f24-a442-0e3de37a38ab with identifier: FH97187
2026-04-27 08:08:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ce25f68d-cfbf-5f24-a442-0e3de37a38ab with identifier: FH97187
2026-04-27 08:08:54 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ce25f68d-cfbf-5f24-a442-0e3de37a38ab with identifier: FH97187 to the API
2026-04-27 08:08:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:54 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-04-28T15:54:28Z',
 'fuel_type': 'diesel',
 'id': 'ce25f68d-cfbf-5f24-a442-0e3de37a38ab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FH97187',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 362007,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2012-10-25',
 'seller_name': None,
 'title': 'Ford S-Max 2.0 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2012}
2026-04-27 08:08:54 [auto1.fr] INFO: Saving data for FH97187: {'auction_closing_time': 1777391668.0, 'created_time': 1777018715.326775, 'has_photos': True, 'last_price_update_time': 1777277334.509919}
2026-04-27 08:08:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/a0/f1a0a470c64d98e7ae14c4a36096d058/pa/XR47331_494c528f2dd481a72cf26e3f878d2389.jpg not downloaded yet
2026-04-27 08:08:54 [auto1.fr] INFO: Found listing with ID: BY48360
2026-04-27 08:08:54 [auto1.fr] INFO: Scrape type for BY48360: 1
2026-04-27 08:08:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/a0/f1a0a470c64d98e7ae14c4a36096d058/pa/XR47331_3d75b2de8b7d6c413060247240b8b2d1.jpg not downloaded yet
2026-04-27 08:08:54 [auto1.fr] INFO: Found listing with ID: MG58458
2026-04-27 08:08:54 [auto1.fr] INFO: Scrape type for MG58458: 1
2026-04-27 08:08:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/a0/f1a0a470c64d98e7ae14c4a36096d058/pa/XR47331_b28870b3e440d90d988d2c14d4969953.jpg not downloaded yet
2026-04-27 08:08:54 [auto1.fr] INFO: Found listing with ID: EN04257
2026-04-27 08:08:54 [auto1.fr] INFO: Scrape type for EN04257: 2
2026-04-27 08:08:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0fd7644c-0c2e-5e1e-a3f5-25e5cb303c2c with identifier: EN04257
2026-04-27 08:08:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0fd7644c-0c2e-5e1e-a3f5-25e5cb303c2c with scrape type 2
2026-04-27 08:08:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0fd7644c-0c2e-5e1e-a3f5-25e5cb303c2c with scrape type 2
2026-04-27 08:08:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0fd7644c-0c2e-5e1e-a3f5-25e5cb303c2c, identifier: EN04257
2026-04-27 08:08:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0fd7644c-0c2e-5e1e-a3f5-25e5cb303c2c with identifier: EN04257
2026-04-27 08:08:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0fd7644c-0c2e-5e1e-a3f5-25e5cb303c2c with identifier: EN04257
2026-04-27 08:08:54 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 0fd7644c-0c2e-5e1e-a3f5-25e5cb303c2c with identifier: EN04257 to the API
2026-04-27 08:08:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:54 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-04-28T15:01:18Z',
 'fuel_type': 'petrol',
 'id': '0fd7644c-0c2e-5e1e-a3f5-25e5cb303c2c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EN04257',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Citroen',
 'model': 'C4 Cactus',
 'odometer': 142685,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2014-09-28',
 'seller_name': None,
 'title': 'Citroen C4 Cactus 1.2 VTi Start',
 'transmission': 'manual',
 'trim': 'Start',
 'year': 2014}
2026-04-27 08:08:55 [auto1.fr] INFO: Saving data for EN04257: {'auction_closing_time': 1777388478.0, 'created_time': 1777023049.750189, 'has_photos': True, 'last_price_update_time': 1777277335.047039}
2026-04-27 08:08:55 [auto1.fr] INFO: Found listing with ID: BD48530
2026-04-27 08:08:55 [auto1.fr] INFO: Scrape type for BD48530: 1
2026-04-27 08:08:55 [auto1.fr] INFO: Found listing with ID: KJ04962
2026-04-27 08:08:55 [auto1.fr] INFO: Scrape type for KJ04962: 1
2026-04-27 08:08:55 [auto1.fr] INFO: Found listing with ID: BZ29759
2026-04-27 08:08:55 [auto1.fr] INFO: Scrape type for BZ29759: 1
2026-04-27 08:08:55 [auto1.fr] INFO: Found listing with ID: TF32739
2026-04-27 08:08:55 [auto1.fr] INFO: Scrape type for TF32739: 1
2026-04-27 08:08:55 [auto1.fr] INFO: Found listing with ID: NU54953
2026-04-27 08:08:55 [auto1.fr] INFO: Scrape type for NU54953: 1
2026-04-27 08:08:55 [auto1.fr] INFO: Found listing with ID: BD26378
2026-04-27 08:08:55 [auto1.fr] INFO: Scrape type for BD26378: 1
2026-04-27 08:08:55 [auto1.fr] INFO: Found listing with ID: HT02570
2026-04-27 08:08:55 [auto1.fr] INFO: Scrape type for HT02570: 2
2026-04-27 08:08:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6140eca-e8f2-5fcb-9001-ef2cc8b4f99f with identifier: HT02570
2026-04-27 08:08:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6140eca-e8f2-5fcb-9001-ef2cc8b4f99f with scrape type 2
2026-04-27 08:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b6140eca-e8f2-5fcb-9001-ef2cc8b4f99f with scrape type 2
2026-04-27 08:08:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b6140eca-e8f2-5fcb-9001-ef2cc8b4f99f, identifier: HT02570
2026-04-27 08:08:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b6140eca-e8f2-5fcb-9001-ef2cc8b4f99f with identifier: HT02570
2026-04-27 08:08:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b6140eca-e8f2-5fcb-9001-ef2cc8b4f99f with identifier: HT02570
2026-04-27 08:08:55 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b6140eca-e8f2-5fcb-9001-ef2cc8b4f99f with identifier: HT02570 to the API
2026-04-27 08:08:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:55 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-04-28T15:33:56Z',
 'fuel_type': 'petrol',
 'id': 'b6140eca-e8f2-5fcb-9001-ef2cc8b4f99f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HT02570',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Lancia',
 'model': 'Ypsilon',
 'odometer': 245615,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2012-03-22',
 'seller_name': None,
 'title': 'Lancia Ypsilon 0.9 TwinAir Gold',
 'transmission': 'manual',
 'trim': 'Gold',
 'year': 2012}
2026-04-27 08:08:55 [auto1.fr] INFO: Saving data for HT02570: {'auction_closing_time': 1777390436.0, 'created_time': 1777021333.620431, 'has_photos': True, 'last_price_update_time': 1777277335.555863}
2026-04-27 08:08:55 [auto1.fr] INFO: Found listing with ID: HL76122
2026-04-27 08:08:55 [auto1.fr] INFO: Scrape type for HL76122: 1
2026-04-27 08:08:55 [auto1.fr] INFO: Found listing with ID: BU48412
2026-04-27 08:08:55 [auto1.fr] INFO: Scrape type for BU48412: 1
2026-04-27 08:08:55 [auto1.fr] INFO: Found listing with ID: PW61387
2026-04-27 08:08:55 [auto1.fr] INFO: Scrape type for PW61387: 1
2026-04-27 08:08:55 [auto1.fr] INFO: Found listing with ID: KT65439
2026-04-27 08:08:55 [auto1.fr] INFO: Scrape type for KT65439: 1
2026-04-27 08:08:55 [auto1.fr] INFO: Found listing with ID: TT31449
2026-04-27 08:08:55 [auto1.fr] INFO: Scrape type for TT31449: 1
2026-04-27 08:08:55 [auto1.fr] INFO: Found listing with ID: WT97389
2026-04-27 08:08:55 [auto1.fr] INFO: Scrape type for WT97389: 1
2026-04-27 08:08:55 [auto1.fr] INFO: Found listing with ID: HN57459
2026-04-27 08:08:55 [auto1.fr] INFO: Scrape type for HN57459: 1
2026-04-27 08:08:55 [auto1.fr] INFO: Found listing with ID: SV11482
2026-04-27 08:08:55 [auto1.fr] INFO: Scrape type for SV11482: 1
2026-04-27 08:08:55 [auto1.fr] INFO: Found listing with ID: KF17256
2026-04-27 08:08:55 [auto1.fr] INFO: Scrape type for KF17256: 0
2026-04-27 08:08:55 [auto1.fr] INFO: Found listing with ID: SG40218
2026-04-27 08:08:55 [auto1.fr] INFO: Scrape type for SG40218: 1
2026-04-27 08:08:55 [auto1.fr] INFO: Found listing with ID: LZ08309
2026-04-27 08:08:55 [auto1.fr] INFO: Scrape type for LZ08309: 1
2026-04-27 08:08:55 [auto1.fr] INFO: Found listing with ID: XP86049
2026-04-27 08:08:55 [auto1.fr] INFO: Scrape type for XP86049: 1
2026-04-27 08:08:55 [auto1.fr] INFO: Found listing with ID: YN19563
2026-04-27 08:08:55 [auto1.fr] INFO: Scrape type for YN19563: 2
2026-04-27 08:08:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 736bc80c-a6bd-50b5-b07d-9f7927d6b1b9 with identifier: YN19563
2026-04-27 08:08:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 736bc80c-a6bd-50b5-b07d-9f7927d6b1b9 with scrape type 2
2026-04-27 08:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 736bc80c-a6bd-50b5-b07d-9f7927d6b1b9 with scrape type 2
2026-04-27 08:08:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 736bc80c-a6bd-50b5-b07d-9f7927d6b1b9, identifier: YN19563
2026-04-27 08:08:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 736bc80c-a6bd-50b5-b07d-9f7927d6b1b9 with identifier: YN19563
2026-04-27 08:08:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 736bc80c-a6bd-50b5-b07d-9f7927d6b1b9 with identifier: YN19563
2026-04-27 08:08:55 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 736bc80c-a6bd-50b5-b07d-9f7927d6b1b9 with identifier: YN19563 to the API
2026-04-27 08:08:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:56 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 60,
 'expiration_date': '2026-04-28T15:40:28Z',
 'fuel_type': 'petrol',
 'id': '736bc80c-a6bd-50b5-b07d-9f7927d6b1b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YN19563',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 61147,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2017-07-05',
 'seller_name': None,
 'title': 'Skoda Fabia 1.0 MPI Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2017}
2026-04-27 08:08:56 [auto1.fr] INFO: Saving data for YN19563: {'auction_closing_time': 1777390828.0, 'created_time': 1777020361.698398, 'has_photos': True, 'last_price_update_time': 1777277336.145826}
2026-04-27 08:08:56 [auto1.fr] INFO: Found listing with ID: XY15688
2026-04-27 08:08:56 [auto1.fr] INFO: Scrape type for XY15688: 1
2026-04-27 08:08:56 [auto1.fr] INFO: Found listing with ID: VE26914
2026-04-27 08:08:56 [auto1.fr] INFO: Scrape type for VE26914: 1
2026-04-27 08:08:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UC15316> (referer: https://www.auto1.com/v1/car-details-view/UC15316/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:56 [auto1.fr] INFO: Found listing with ID: TY72648
2026-04-27 08:08:56 [auto1.fr] INFO: Scrape type for TY72648: 1
2026-04-27 08:08:56 [auto1.fr] INFO: Found listing with ID: BK47003
2026-04-27 08:08:56 [auto1.fr] INFO: Scrape type for BK47003: 1
2026-04-27 08:08:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: abca6d68-5d1f-5342-8760-ace521e47146 with identifier: UC15316
2026-04-27 08:08:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abca6d68-5d1f-5342-8760-ace521e47146 with scrape type 1
2026-04-27 08:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item abca6d68-5d1f-5342-8760-ace521e47146
2026-04-27 08:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/23/3623d3607d5aa17889e2f60fe4e04e51/pa/UC15316_facf15616ba6c232a9846191bb78c449.jpg not downloaded yet
2026-04-27 08:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/23/3623d3607d5aa17889e2f60fe4e04e51/pa/UC15316_4290ec9489248e975b24a47b320a58e2.jpg not downloaded yet
2026-04-27 08:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/23/3623d3607d5aa17889e2f60fe4e04e51/pa/UC15316_c339fbbdbe74f68d2066baba437f8f26.jpg not downloaded yet
2026-04-27 08:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/23/3623d3607d5aa17889e2f60fe4e04e51/pa/UC15316_60011d437b51c182f8363219a4a56f18.jpg not downloaded yet
2026-04-27 08:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/23/3623d3607d5aa17889e2f60fe4e04e51/pa/UC15316_e44f2db759ed9f0ef8b6529151e354ca.jpg not downloaded yet
2026-04-27 08:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/23/3623d3607d5aa17889e2f60fe4e04e51/pa/UC15316_3325e209d8a3df37613dd2bc7dbcdcfa.jpg not downloaded yet
2026-04-27 08:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/23/3623d3607d5aa17889e2f60fe4e04e51/pa/UC15316_006fc7f47e452b5e89d1471a46846ea6.jpg not downloaded yet
2026-04-27 08:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/23/3623d3607d5aa17889e2f60fe4e04e51/pa/UC15316_11466d07963493288cf33c2fc5a2bc05.jpg not downloaded yet
2026-04-27 08:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/23/3623d3607d5aa17889e2f60fe4e04e51/pa/UC15316_b0b822dd8287f78450b079e2a21002de.jpg not downloaded yet
2026-04-27 08:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/23/3623d3607d5aa17889e2f60fe4e04e51/pa/UC15316_32c171cac6c7f9fbc3b6ea86d1183bb3.jpg not downloaded yet
2026-04-27 08:08:59 [scrapy.extensions.logstats] INFO: Crawled 486 pages (at 34 pages/min), scraped 435 items (at 27 items/min)
2026-04-27 08:08:59 [scrapy.extensions.memusage] INFO: Peak memory usage is 373MiB
2026-04-27 08:09:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LZ28528> (referer: https://www.auto1.com/v1/car-details-view/LZ28528/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:09:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:09:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/23/3623d3607d5aa17889e2f60fe4e04e51/pa/UC15316_32c171cac6c7f9fbc3b6ea86d1183bb3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 692e6a68-5267-53d8-a502-948f6c450342 with identifier: LZ28528
2026-04-27 08:09:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 692e6a68-5267-53d8-a502-948f6c450342 with scrape type 1
2026-04-27 08:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 692e6a68-5267-53d8-a502-948f6c450342
2026-04-27 08:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/00/cf004b4547e72d021cc642bb42380056/pa/LZ28528_1ac756268f319fe6ef7dfca94639024e.jpg not downloaded yet
2026-04-27 08:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/00/cf004b4547e72d021cc642bb42380056/pa/LZ28528_780c4d63f77ce45f74d71ce8f63675dc.jpg not downloaded yet
2026-04-27 08:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/00/cf004b4547e72d021cc642bb42380056/pa/LZ28528_26f40da9a9d843fc30857522dfee5a90.jpg not downloaded yet
2026-04-27 08:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/00/cf004b4547e72d021cc642bb42380056/pa/LZ28528_656635f1e5a4dd1260de21e0f6fb691d.jpg not downloaded yet
2026-04-27 08:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/00/cf004b4547e72d021cc642bb42380056/pa/LZ28528_b66e2d0acb577c42053976991b674d5f.jpg not downloaded yet
2026-04-27 08:09:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380a5310>
2026-04-27 08:09:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_abca6d68-5d1f-5342-8760-ace521e47146/abca6d68-5d1f-5342-8760-ace521e47146_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/23/3623d3607d5aa17889e2f60fe4e04e51/pa/UC15316_32c171cac6c7f9fbc3b6ea86d1183bb3.jpg saved to cache
2026-04-27 08:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item abca6d68-5d1f-5342-8760-ace521e47146
2026-04-27 08:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/00/cf004b4547e72d021cc642bb42380056/pa/LZ28528_7d9ecd189771c97969f81fb93f17562e.jpg not downloaded yet
2026-04-27 08:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/00/cf004b4547e72d021cc642bb42380056/pa/LZ28528_741bbac315d7c29713e7a6516682aed8.jpg not downloaded yet
2026-04-27 08:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/00/cf004b4547e72d021cc642bb42380056/pa/LZ28528_5798504ff1e522bbd070e212988b5ecf.jpg not downloaded yet
2026-04-27 08:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/00/cf004b4547e72d021cc642bb42380056/pa/LZ28528_8648291b3ab721353721e7403b7db11f.jpg not downloaded yet
2026-04-27 08:09:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/23/3623d3607d5aa17889e2f60fe4e04e51/pa/UC15316_b0b822dd8287f78450b079e2a21002de.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/00/cf004b4547e72d021cc642bb42380056/pa/LZ28528_9b4de66989584d51e3583110decabbcc.jpg not downloaded yet
2026-04-27 08:09:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/00/cf004b4547e72d021cc642bb42380056/pa/LZ28528_8648291b3ab721353721e7403b7db11f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d937d0>
2026-04-27 08:09:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_abca6d68-5d1f-5342-8760-ace521e47146/abca6d68-5d1f-5342-8760-ace521e47146_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/23/3623d3607d5aa17889e2f60fe4e04e51/pa/UC15316_b0b822dd8287f78450b079e2a21002de.jpg saved to cache
2026-04-27 08:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item abca6d68-5d1f-5342-8760-ace521e47146
2026-04-27 08:09:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/00/cf004b4547e72d021cc642bb42380056/pa/LZ28528_9b4de66989584d51e3583110decabbcc.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438fced50>
2026-04-27 08:09:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_692e6a68-5267-53d8-a502-948f6c450342/692e6a68-5267-53d8-a502-948f6c450342_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/00/cf004b4547e72d021cc642bb42380056/pa/LZ28528_8648291b3ab721353721e7403b7db11f.jpg saved to cache
2026-04-27 08:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 692e6a68-5267-53d8-a502-948f6c450342
2026-04-27 08:09:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/00/cf004b4547e72d021cc642bb42380056/pa/LZ28528_5798504ff1e522bbd070e212988b5ecf.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/00/cf004b4547e72d021cc642bb42380056/pa/LZ28528_741bbac315d7c29713e7a6516682aed8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438cbbb50>
2026-04-27 08:09:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_692e6a68-5267-53d8-a502-948f6c450342/692e6a68-5267-53d8-a502-948f6c450342_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/00/cf004b4547e72d021cc642bb42380056/pa/LZ28528_9b4de66989584d51e3583110decabbcc.jpg saved to cache
2026-04-27 08:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 692e6a68-5267-53d8-a502-948f6c450342
2026-04-27 08:09:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/00/cf004b4547e72d021cc642bb42380056/pa/LZ28528_7d9ecd189771c97969f81fb93f17562e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bffe310>
2026-04-27 08:09:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_692e6a68-5267-53d8-a502-948f6c450342/692e6a68-5267-53d8-a502-948f6c450342_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/00/cf004b4547e72d021cc642bb42380056/pa/LZ28528_5798504ff1e522bbd070e212988b5ecf.jpg saved to cache
2026-04-27 08:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 692e6a68-5267-53d8-a502-948f6c450342
2026-04-27 08:09:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/00/cf004b4547e72d021cc642bb42380056/pa/LZ28528_b66e2d0acb577c42053976991b674d5f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d45490>
2026-04-27 08:09:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_692e6a68-5267-53d8-a502-948f6c450342/692e6a68-5267-53d8-a502-948f6c450342_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/00/cf004b4547e72d021cc642bb42380056/pa/LZ28528_741bbac315d7c29713e7a6516682aed8.jpg saved to cache
2026-04-27 08:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 692e6a68-5267-53d8-a502-948f6c450342
2026-04-27 08:09:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/00/cf004b4547e72d021cc642bb42380056/pa/LZ28528_656635f1e5a4dd1260de21e0f6fb691d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BS21555/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:09:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:09:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438bc4f10>
2026-04-27 08:09:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_692e6a68-5267-53d8-a502-948f6c450342/692e6a68-5267-53d8-a502-948f6c450342_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/00/cf004b4547e72d021cc642bb42380056/pa/LZ28528_7d9ecd189771c97969f81fb93f17562e.jpg saved to cache
2026-04-27 08:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 692e6a68-5267-53d8-a502-948f6c450342
2026-04-27 08:09:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/00/cf004b4547e72d021cc642bb42380056/pa/LZ28528_26f40da9a9d843fc30857522dfee5a90.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/00/cf004b4547e72d021cc642bb42380056/pa/LZ28528_780c4d63f77ce45f74d71ce8f63675dc.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380b8190>
2026-04-27 08:09:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_692e6a68-5267-53d8-a502-948f6c450342/692e6a68-5267-53d8-a502-948f6c450342_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/00/cf004b4547e72d021cc642bb42380056/pa/LZ28528_b66e2d0acb577c42053976991b674d5f.jpg saved to cache
2026-04-27 08:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 692e6a68-5267-53d8-a502-948f6c450342
2026-04-27 08:09:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/00/cf004b4547e72d021cc642bb42380056/pa/LZ28528_1ac756268f319fe6ef7dfca94639024e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/23/3623d3607d5aa17889e2f60fe4e04e51/pa/UC15316_11466d07963493288cf33c2fc5a2bc05.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438f82650>
2026-04-27 08:09:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_692e6a68-5267-53d8-a502-948f6c450342/692e6a68-5267-53d8-a502-948f6c450342_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/00/cf004b4547e72d021cc642bb42380056/pa/LZ28528_656635f1e5a4dd1260de21e0f6fb691d.jpg saved to cache
2026-04-27 08:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 692e6a68-5267-53d8-a502-948f6c450342
2026-04-27 08:09:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/23/3623d3607d5aa17889e2f60fe4e04e51/pa/UC15316_3325e209d8a3df37613dd2bc7dbcdcfa.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/23/3623d3607d5aa17889e2f60fe4e04e51/pa/UC15316_006fc7f47e452b5e89d1471a46846ea6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438fb11d0>
2026-04-27 08:09:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_692e6a68-5267-53d8-a502-948f6c450342/692e6a68-5267-53d8-a502-948f6c450342_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/00/cf004b4547e72d021cc642bb42380056/pa/LZ28528_26f40da9a9d843fc30857522dfee5a90.jpg saved to cache
2026-04-27 08:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 692e6a68-5267-53d8-a502-948f6c450342
2026-04-27 08:09:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438cb7650>
2026-04-27 08:09:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_692e6a68-5267-53d8-a502-948f6c450342/692e6a68-5267-53d8-a502-948f6c450342_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/00/cf004b4547e72d021cc642bb42380056/pa/LZ28528_780c4d63f77ce45f74d71ce8f63675dc.jpg saved to cache
2026-04-27 08:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 692e6a68-5267-53d8-a502-948f6c450342
2026-04-27 08:09:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142be04d50>
2026-04-27 08:09:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_692e6a68-5267-53d8-a502-948f6c450342/692e6a68-5267-53d8-a502-948f6c450342_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/00/cf004b4547e72d021cc642bb42380056/pa/LZ28528_1ac756268f319fe6ef7dfca94639024e.jpg saved to cache
2026-04-27 08:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 692e6a68-5267-53d8-a502-948f6c450342
2026-04-27 08:09:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 692e6a68-5267-53d8-a502-948f6c450342, skipping ID generation
2026-04-27 08:09:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 692e6a68-5267-53d8-a502-948f6c450342 with scrape type 1
2026-04-27 08:09:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 692e6a68-5267-53d8-a502-948f6c450342 sending to next pipeline
2026-04-27 08:09:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 692e6a68-5267-53d8-a502-948f6c450342, identifier: LZ28528
2026-04-27 08:09:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143809f1d0>
2026-04-27 08:09:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_abca6d68-5d1f-5342-8760-ace521e47146/abca6d68-5d1f-5342-8760-ace521e47146_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/23/3623d3607d5aa17889e2f60fe4e04e51/pa/UC15316_11466d07963493288cf33c2fc5a2bc05.jpg saved to cache
2026-04-27 08:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item abca6d68-5d1f-5342-8760-ace521e47146
2026-04-27 08:09:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 692e6a68-5267-53d8-a502-948f6c450342 with identifier: LZ28528
2026-04-27 08:09:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 692e6a68-5267-53d8-a502-948f6c450342 with identifier: LZ28528
2026-04-27 08:09:01 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:09:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 692e6a68-5267-53d8-a502-948f6c450342 with identifier: LZ28528 to the API
2026-04-27 08:09:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:09:02 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:09:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgcf/00/cf004b4547e72d021cc642bb42380056/pa/LZ28528_1ac756268f319fe6ef7dfca94639024e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'category': None,
 'city': 'Beaucaire',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 160,
 'expiration_date': '2026-04-28T15:06:33Z',
 'fuel_type': 'diesel',
 'id': '692e6a68-5267-53d8-a502-948f6c450342',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 43.8081,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LZ28528',
 'listing': 'auction',
 'location': 'FR, Beaucaire',
 'location_confidence': 'geocoded',
 'longitude': 4.6442,
 'make': 'Renault',
 'model': 'Espace',
 'odometer': 184363,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_692e6a68-5267-53d8-a502-948f6c450342/692e6a68-5267-53d8-a502-948f6c450342_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86989,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/00/cf004b4547e72d021cc642bb42380056/pa/LZ28528_1ac756268f319fe6ef7dfca94639024e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_692e6a68-5267-53d8-a502-948f6c450342/692e6a68-5267-53d8-a502-948f6c450342_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90246,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/00/cf004b4547e72d021cc642bb42380056/pa/LZ28528_780c4d63f77ce45f74d71ce8f63675dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_692e6a68-5267-53d8-a502-948f6c450342/692e6a68-5267-53d8-a502-948f6c450342_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73904,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/00/cf004b4547e72d021cc642bb42380056/pa/LZ28528_26f40da9a9d843fc30857522dfee5a90.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_692e6a68-5267-53d8-a502-948f6c450342/692e6a68-5267-53d8-a502-948f6c450342_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74711,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/00/cf004b4547e72d021cc642bb42380056/pa/LZ28528_656635f1e5a4dd1260de21e0f6fb691d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_692e6a68-5267-53d8-a502-948f6c450342/692e6a68-5267-53d8-a502-948f6c450342_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74841,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/00/cf004b4547e72d021cc642bb42380056/pa/LZ28528_b66e2d0acb577c42053976991b674d5f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_692e6a68-5267-53d8-a502-948f6c450342/692e6a68-5267-53d8-a502-948f6c450342_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70290,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/00/cf004b4547e72d021cc642bb42380056/pa/LZ28528_7d9ecd189771c97969f81fb93f17562e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_692e6a68-5267-53d8-a502-948f6c450342/692e6a68-5267-53d8-a502-948f6c450342_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70463,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/00/cf004b4547e72d021cc642bb42380056/pa/LZ28528_741bbac315d7c29713e7a6516682aed8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_692e6a68-5267-53d8-a502-948f6c450342/692e6a68-5267-53d8-a502-948f6c450342_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76720,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/00/cf004b4547e72d021cc642bb42380056/pa/LZ28528_5798504ff1e522bbd070e212988b5ecf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_692e6a68-5267-53d8-a502-948f6c450342/692e6a68-5267-53d8-a502-948f6c450342_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82258,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/00/cf004b4547e72d021cc642bb42380056/pa/LZ28528_8648291b3ab721353721e7403b7db11f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_692e6a68-5267-53d8-a502-948f6c450342/692e6a68-5267-53d8-a502-948f6c450342_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86537,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/00/cf004b4547e72d021cc642bb42380056/pa/LZ28528_9b4de66989584d51e3583110decabbcc.jpg',
             'Width': 800}],
 'postal_code': '30300',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Gard',
 'province_code': 'FR-30',
 'region': 'Occitanie',
 'region_code': 'FR-76',
 'registration_date': '2018-03-06',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Renault Espace 1.6 dCi Energy Intens',
 'transmission': 'automatic',
 'trim': 'Intens',
 'year': 2018}
2026-04-27 08:09:02 [auto1.fr] INFO: Saving data for LZ28528: {'created_time': 1777277342.65944, 'last_price_update_time': 1777277342.659449, 'has_photos': True, 'auction_closing_time': 1777388793.0}
2026-04-27 08:09:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/23/3623d3607d5aa17889e2f60fe4e04e51/pa/UC15316_60011d437b51c182f8363219a4a56f18.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/23/3623d3607d5aa17889e2f60fe4e04e51/pa/UC15316_e44f2db759ed9f0ef8b6529151e354ca.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438182750>
2026-04-27 08:09:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_abca6d68-5d1f-5342-8760-ace521e47146/abca6d68-5d1f-5342-8760-ace521e47146_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/23/3623d3607d5aa17889e2f60fe4e04e51/pa/UC15316_3325e209d8a3df37613dd2bc7dbcdcfa.jpg saved to cache
2026-04-27 08:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item abca6d68-5d1f-5342-8760-ace521e47146
2026-04-27 08:09:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a5b810>
2026-04-27 08:09:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_abca6d68-5d1f-5342-8760-ace521e47146/abca6d68-5d1f-5342-8760-ace521e47146_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/23/3623d3607d5aa17889e2f60fe4e04e51/pa/UC15316_006fc7f47e452b5e89d1471a46846ea6.jpg saved to cache
2026-04-27 08:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item abca6d68-5d1f-5342-8760-ace521e47146
2026-04-27 08:09:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d24650>
2026-04-27 08:09:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_abca6d68-5d1f-5342-8760-ace521e47146/abca6d68-5d1f-5342-8760-ace521e47146_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/23/3623d3607d5aa17889e2f60fe4e04e51/pa/UC15316_60011d437b51c182f8363219a4a56f18.jpg saved to cache
2026-04-27 08:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item abca6d68-5d1f-5342-8760-ace521e47146
2026-04-27 08:09:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143812d9d0>
2026-04-27 08:09:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_abca6d68-5d1f-5342-8760-ace521e47146/abca6d68-5d1f-5342-8760-ace521e47146_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/23/3623d3607d5aa17889e2f60fe4e04e51/pa/UC15316_e44f2db759ed9f0ef8b6529151e354ca.jpg saved to cache
2026-04-27 08:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item abca6d68-5d1f-5342-8760-ace521e47146
2026-04-27 08:09:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/23/3623d3607d5aa17889e2f60fe4e04e51/pa/UC15316_c339fbbdbe74f68d2066baba437f8f26.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/23/3623d3607d5aa17889e2f60fe4e04e51/pa/UC15316_4290ec9489248e975b24a47b320a58e2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438e37510>
2026-04-27 08:09:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_abca6d68-5d1f-5342-8760-ace521e47146/abca6d68-5d1f-5342-8760-ace521e47146_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/23/3623d3607d5aa17889e2f60fe4e04e51/pa/UC15316_c339fbbdbe74f68d2066baba437f8f26.jpg saved to cache
2026-04-27 08:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item abca6d68-5d1f-5342-8760-ace521e47146
2026-04-27 08:09:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438fb27d0>
2026-04-27 08:09:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_abca6d68-5d1f-5342-8760-ace521e47146/abca6d68-5d1f-5342-8760-ace521e47146_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/23/3623d3607d5aa17889e2f60fe4e04e51/pa/UC15316_4290ec9489248e975b24a47b320a58e2.jpg saved to cache
2026-04-27 08:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item abca6d68-5d1f-5342-8760-ace521e47146
2026-04-27 08:09:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SN62809/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:09:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:09:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/23/3623d3607d5aa17889e2f60fe4e04e51/pa/UC15316_facf15616ba6c232a9846191bb78c449.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c84590>
2026-04-27 08:09:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_abca6d68-5d1f-5342-8760-ace521e47146/abca6d68-5d1f-5342-8760-ace521e47146_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/23/3623d3607d5aa17889e2f60fe4e04e51/pa/UC15316_facf15616ba6c232a9846191bb78c449.jpg saved to cache
2026-04-27 08:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item abca6d68-5d1f-5342-8760-ace521e47146
2026-04-27 08:09:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: abca6d68-5d1f-5342-8760-ace521e47146, skipping ID generation
2026-04-27 08:09:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abca6d68-5d1f-5342-8760-ace521e47146 with scrape type 1
2026-04-27 08:09:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item abca6d68-5d1f-5342-8760-ace521e47146 sending to next pipeline
2026-04-27 08:09:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: abca6d68-5d1f-5342-8760-ace521e47146, identifier: UC15316
2026-04-27 08:09:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: abca6d68-5d1f-5342-8760-ace521e47146 with identifier: UC15316
2026-04-27 08:09:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: abca6d68-5d1f-5342-8760-ace521e47146 with identifier: UC15316
2026-04-27 08:09:03 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:09:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: abca6d68-5d1f-5342-8760-ace521e47146 with identifier: UC15316 to the API
2026-04-27 08:09:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:09:03 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:09:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img36/23/3623d3607d5aa17889e2f60fe4e04e51/pa/UC15316_facf15616ba6c232a9846191bb78c449.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'city': 'Allennes-les-Marais',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 163,
 'expiration_date': '2026-04-28T15:45:10Z',
 'fuel_type': 'diesel',
 'id': 'abca6d68-5d1f-5342-8760-ace521e47146',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 50.5375,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UC15316',
 'listing': 'auction',
 'location': 'FR, Allennes-les-Marais',
 'location_confidence': 'geocoded',
 'longitude': 2.9536,
 'make': 'Citroen',
 'model': 'C5',
 'odometer': 130322,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_abca6d68-5d1f-5342-8760-ace521e47146/abca6d68-5d1f-5342-8760-ace521e47146_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94871,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/23/3623d3607d5aa17889e2f60fe4e04e51/pa/UC15316_facf15616ba6c232a9846191bb78c449.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_abca6d68-5d1f-5342-8760-ace521e47146/abca6d68-5d1f-5342-8760-ace521e47146_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95067,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/23/3623d3607d5aa17889e2f60fe4e04e51/pa/UC15316_4290ec9489248e975b24a47b320a58e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_abca6d68-5d1f-5342-8760-ace521e47146/abca6d68-5d1f-5342-8760-ace521e47146_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90263,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/23/3623d3607d5aa17889e2f60fe4e04e51/pa/UC15316_c339fbbdbe74f68d2066baba437f8f26.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_abca6d68-5d1f-5342-8760-ace521e47146/abca6d68-5d1f-5342-8760-ace521e47146_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78549,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/23/3623d3607d5aa17889e2f60fe4e04e51/pa/UC15316_60011d437b51c182f8363219a4a56f18.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_abca6d68-5d1f-5342-8760-ace521e47146/abca6d68-5d1f-5342-8760-ace521e47146_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84534,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/23/3623d3607d5aa17889e2f60fe4e04e51/pa/UC15316_e44f2db759ed9f0ef8b6529151e354ca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_abca6d68-5d1f-5342-8760-ace521e47146/abca6d68-5d1f-5342-8760-ace521e47146_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93792,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/23/3623d3607d5aa17889e2f60fe4e04e51/pa/UC15316_3325e209d8a3df37613dd2bc7dbcdcfa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_abca6d68-5d1f-5342-8760-ace521e47146/abca6d68-5d1f-5342-8760-ace521e47146_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98562,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/23/3623d3607d5aa17889e2f60fe4e04e51/pa/UC15316_006fc7f47e452b5e89d1471a46846ea6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_abca6d68-5d1f-5342-8760-ace521e47146/abca6d68-5d1f-5342-8760-ace521e47146_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80013,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/23/3623d3607d5aa17889e2f60fe4e04e51/pa/UC15316_11466d07963493288cf33c2fc5a2bc05.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_abca6d68-5d1f-5342-8760-ace521e47146/abca6d68-5d1f-5342-8760-ace521e47146_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47563,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/23/3623d3607d5aa17889e2f60fe4e04e51/pa/UC15316_b0b822dd8287f78450b079e2a21002de.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_abca6d68-5d1f-5342-8760-ace521e47146/abca6d68-5d1f-5342-8760-ace521e47146_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71215,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/23/3623d3607d5aa17889e2f60fe4e04e51/pa/UC15316_32c171cac6c7f9fbc3b6ea86d1183bb3.jpg',
             'Width': 800}],
 'postal_code': '59251',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Nord',
 'province_code': 'FR-59',
 'region': 'Hauts-de-France',
 'region_code': 'FR-32',
 'registration_date': '2013-06-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C5 2.0 HDi Exclusive',
 'transmission': 'manual',
 'trim': 'Exclusive',
 'year': 2013}
2026-04-27 08:09:03 [auto1.fr] INFO: Saving data for UC15316: {'created_time': 1777277343.791405, 'last_price_update_time': 1777277343.791414, 'has_photos': True, 'auction_closing_time': 1777391110.0}
2026-04-27 08:09:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YT50329/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:09:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TD30440/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:09:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:09:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:09:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AV43022> (referer: https://www.auto1.com/v1/car-details-view/AV43022/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:09:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:09:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 408ff264-fc80-5875-88ce-1d0744ac1986 with identifier: AV43022
2026-04-27 08:09:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 408ff264-fc80-5875-88ce-1d0744ac1986 with scrape type 1
2026-04-27 08:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 408ff264-fc80-5875-88ce-1d0744ac1986
2026-04-27 08:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/a2/59a22ebe83d008043d55dddd9c8ed6da/pa/AV43022_c3bac3c081bdbd121835f1ee9db5b9e4.jpg not downloaded yet
2026-04-27 08:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/a2/59a22ebe83d008043d55dddd9c8ed6da/pa/AV43022_d280c9a4d573a105d82a36ce6f22312b.jpg not downloaded yet
2026-04-27 08:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/a2/59a22ebe83d008043d55dddd9c8ed6da/pa/AV43022_1f90a7c49f026180bd6c6b333ee8b45c.jpg not downloaded yet
2026-04-27 08:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/a2/59a22ebe83d008043d55dddd9c8ed6da/pa/AV43022_074f0128a7823d2add0b5ecef5d0d5de.jpg not downloaded yet
2026-04-27 08:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/a2/59a22ebe83d008043d55dddd9c8ed6da/pa/AV43022_93d8a380dc2689e9540468c3e6921e15.jpg not downloaded yet
2026-04-27 08:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/a2/59a22ebe83d008043d55dddd9c8ed6da/pa/AV43022_d34dffd0b6ec59f34db796a1c800af5a.jpg not downloaded yet
2026-04-27 08:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/a2/59a22ebe83d008043d55dddd9c8ed6da/pa/AV43022_4e4174bcfea507bb98ad0d51f4372a05.jpg not downloaded yet
2026-04-27 08:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/a2/59a22ebe83d008043d55dddd9c8ed6da/pa/AV43022_f92bfb5320ca351b6baf86b29ca24501.jpg not downloaded yet
2026-04-27 08:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/a2/59a22ebe83d008043d55dddd9c8ed6da/pa/AV43022_dd9de640688735b15e0cde7a33b43a8d.jpg not downloaded yet
2026-04-27 08:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/a2/59a22ebe83d008043d55dddd9c8ed6da/pa/AV43022_04b2e2f82db70949615f9ad71e96686c.jpg not downloaded yet
2026-04-27 08:09:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PA65311/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:09:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:09:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/a2/59a22ebe83d008043d55dddd9c8ed6da/pa/AV43022_04b2e2f82db70949615f9ad71e96686c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/a2/59a22ebe83d008043d55dddd9c8ed6da/pa/AV43022_dd9de640688735b15e0cde7a33b43a8d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438173710>
2026-04-27 08:09:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_408ff264-fc80-5875-88ce-1d0744ac1986/408ff264-fc80-5875-88ce-1d0744ac1986_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/a2/59a22ebe83d008043d55dddd9c8ed6da/pa/AV43022_04b2e2f82db70949615f9ad71e96686c.jpg saved to cache
2026-04-27 08:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 408ff264-fc80-5875-88ce-1d0744ac1986
2026-04-27 08:09:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438fb6b90>
2026-04-27 08:09:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_408ff264-fc80-5875-88ce-1d0744ac1986/408ff264-fc80-5875-88ce-1d0744ac1986_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/a2/59a22ebe83d008043d55dddd9c8ed6da/pa/AV43022_dd9de640688735b15e0cde7a33b43a8d.jpg saved to cache
2026-04-27 08:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 408ff264-fc80-5875-88ce-1d0744ac1986
2026-04-27 08:09:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YZ25603> (referer: https://www.auto1.com/v1/car-details-view/YZ25603/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:09:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:09:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/a2/59a22ebe83d008043d55dddd9c8ed6da/pa/AV43022_f92bfb5320ca351b6baf86b29ca24501.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 173ff8b2-c788-5bc5-92ca-3cdce3337585 with identifier: YZ25603
2026-04-27 08:09:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 173ff8b2-c788-5bc5-92ca-3cdce3337585 with scrape type 1
2026-04-27 08:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 173ff8b2-c788-5bc5-92ca-3cdce3337585
2026-04-27 08:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/d5/6ed558cc8bdccadd549b29ad474d1f14/pa/YZ25603_9d9d3817e37ecf905445ca3be29b57be.jpg not downloaded yet
2026-04-27 08:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/d5/6ed558cc8bdccadd549b29ad474d1f14/pa/YZ25603_67fd56a09b01cf0ffb632fbe6a5cf8b9.jpg not downloaded yet
2026-04-27 08:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/d5/6ed558cc8bdccadd549b29ad474d1f14/pa/YZ25603_3c965ee799c1b0fd5fe6d472b2394146.jpg not downloaded yet
2026-04-27 08:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/d5/6ed558cc8bdccadd549b29ad474d1f14/pa/YZ25603_507656a0fef74937743a928c62094b7e.jpg not downloaded yet
2026-04-27 08:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/d5/6ed558cc8bdccadd549b29ad474d1f14/pa/YZ25603_7ff70aeadcb4cefba9905ea9ec837a48.jpg not downloaded yet
2026-04-27 08:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/d5/6ed558cc8bdccadd549b29ad474d1f14/pa/YZ25603_286f6eb915a94b30848b1f17ea69c92d.jpg not downloaded yet
2026-04-27 08:09:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d27650>
2026-04-27 08:09:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_408ff264-fc80-5875-88ce-1d0744ac1986/408ff264-fc80-5875-88ce-1d0744ac1986_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/a2/59a22ebe83d008043d55dddd9c8ed6da/pa/AV43022_f92bfb5320ca351b6baf86b29ca24501.jpg saved to cache
2026-04-27 08:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 408ff264-fc80-5875-88ce-1d0744ac1986
2026-04-27 08:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/d5/6ed558cc8bdccadd549b29ad474d1f14/pa/YZ25603_763219edc9fb5392e0fb63c1e3a4470c.jpg not downloaded yet
2026-04-27 08:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/d5/6ed558cc8bdccadd549b29ad474d1f14/pa/YZ25603_3f7e62ca042092b0e166e4e26f6b765d.jpg not downloaded yet
2026-04-27 08:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/d5/6ed558cc8bdccadd549b29ad474d1f14/pa/YZ25603_3a767b1c2ad81fdcb2a3c80dd96dcabe.jpg not downloaded yet
2026-04-27 08:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/d5/6ed558cc8bdccadd549b29ad474d1f14/pa/YZ25603_7c956175ae74535ec7c0c16766784e14.jpg not downloaded yet
2026-04-27 08:09:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/a2/59a22ebe83d008043d55dddd9c8ed6da/pa/AV43022_4e4174bcfea507bb98ad0d51f4372a05.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/d5/6ed558cc8bdccadd549b29ad474d1f14/pa/YZ25603_7c956175ae74535ec7c0c16766784e14.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380e0e10>
2026-04-27 08:09:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_408ff264-fc80-5875-88ce-1d0744ac1986/408ff264-fc80-5875-88ce-1d0744ac1986_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/a2/59a22ebe83d008043d55dddd9c8ed6da/pa/AV43022_4e4174bcfea507bb98ad0d51f4372a05.jpg saved to cache
2026-04-27 08:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 408ff264-fc80-5875-88ce-1d0744ac1986
2026-04-27 08:09:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/d5/6ed558cc8bdccadd549b29ad474d1f14/pa/YZ25603_3a767b1c2ad81fdcb2a3c80dd96dcabe.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f144750c190>
2026-04-27 08:09:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_173ff8b2-c788-5bc5-92ca-3cdce3337585/173ff8b2-c788-5bc5-92ca-3cdce3337585_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/d5/6ed558cc8bdccadd549b29ad474d1f14/pa/YZ25603_7c956175ae74535ec7c0c16766784e14.jpg saved to cache
2026-04-27 08:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 173ff8b2-c788-5bc5-92ca-3cdce3337585
2026-04-27 08:09:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380b9c50>
2026-04-27 08:09:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_173ff8b2-c788-5bc5-92ca-3cdce3337585/173ff8b2-c788-5bc5-92ca-3cdce3337585_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/d5/6ed558cc8bdccadd549b29ad474d1f14/pa/YZ25603_3a767b1c2ad81fdcb2a3c80dd96dcabe.jpg saved to cache
2026-04-27 08:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 173ff8b2-c788-5bc5-92ca-3cdce3337585
2026-04-27 08:09:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/d5/6ed558cc8bdccadd549b29ad474d1f14/pa/YZ25603_3f7e62ca042092b0e166e4e26f6b765d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438fb2090>
2026-04-27 08:09:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_173ff8b2-c788-5bc5-92ca-3cdce3337585/173ff8b2-c788-5bc5-92ca-3cdce3337585_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/d5/6ed558cc8bdccadd549b29ad474d1f14/pa/YZ25603_3f7e62ca042092b0e166e4e26f6b765d.jpg saved to cache
2026-04-27 08:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 173ff8b2-c788-5bc5-92ca-3cdce3337585
2026-04-27 08:09:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/d5/6ed558cc8bdccadd549b29ad474d1f14/pa/YZ25603_763219edc9fb5392e0fb63c1e3a4470c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/d5/6ed558cc8bdccadd549b29ad474d1f14/pa/YZ25603_286f6eb915a94b30848b1f17ea69c92d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438edb390>
2026-04-27 08:09:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_173ff8b2-c788-5bc5-92ca-3cdce3337585/173ff8b2-c788-5bc5-92ca-3cdce3337585_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/d5/6ed558cc8bdccadd549b29ad474d1f14/pa/YZ25603_763219edc9fb5392e0fb63c1e3a4470c.jpg saved to cache
2026-04-27 08:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 173ff8b2-c788-5bc5-92ca-3cdce3337585
2026-04-27 08:09:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/d5/6ed558cc8bdccadd549b29ad474d1f14/pa/YZ25603_7ff70aeadcb4cefba9905ea9ec837a48.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438172010>
2026-04-27 08:09:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_173ff8b2-c788-5bc5-92ca-3cdce3337585/173ff8b2-c788-5bc5-92ca-3cdce3337585_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/d5/6ed558cc8bdccadd549b29ad474d1f14/pa/YZ25603_286f6eb915a94b30848b1f17ea69c92d.jpg saved to cache
2026-04-27 08:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 173ff8b2-c788-5bc5-92ca-3cdce3337585
2026-04-27 08:09:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/d5/6ed558cc8bdccadd549b29ad474d1f14/pa/YZ25603_507656a0fef74937743a928c62094b7e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d90f50>
2026-04-27 08:09:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_173ff8b2-c788-5bc5-92ca-3cdce3337585/173ff8b2-c788-5bc5-92ca-3cdce3337585_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/d5/6ed558cc8bdccadd549b29ad474d1f14/pa/YZ25603_7ff70aeadcb4cefba9905ea9ec837a48.jpg saved to cache
2026-04-27 08:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 173ff8b2-c788-5bc5-92ca-3cdce3337585
2026-04-27 08:09:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/d5/6ed558cc8bdccadd549b29ad474d1f14/pa/YZ25603_3c965ee799c1b0fd5fe6d472b2394146.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438adcbd0>
2026-04-27 08:09:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_173ff8b2-c788-5bc5-92ca-3cdce3337585/173ff8b2-c788-5bc5-92ca-3cdce3337585_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/d5/6ed558cc8bdccadd549b29ad474d1f14/pa/YZ25603_507656a0fef74937743a928c62094b7e.jpg saved to cache
2026-04-27 08:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 173ff8b2-c788-5bc5-92ca-3cdce3337585
2026-04-27 08:09:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/d5/6ed558cc8bdccadd549b29ad474d1f14/pa/YZ25603_67fd56a09b01cf0ffb632fbe6a5cf8b9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438e09150>
2026-04-27 08:09:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_173ff8b2-c788-5bc5-92ca-3cdce3337585/173ff8b2-c788-5bc5-92ca-3cdce3337585_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/d5/6ed558cc8bdccadd549b29ad474d1f14/pa/YZ25603_3c965ee799c1b0fd5fe6d472b2394146.jpg saved to cache
2026-04-27 08:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 173ff8b2-c788-5bc5-92ca-3cdce3337585
2026-04-27 08:09:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/d5/6ed558cc8bdccadd549b29ad474d1f14/pa/YZ25603_9d9d3817e37ecf905445ca3be29b57be.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bfbb7d0>
2026-04-27 08:09:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_173ff8b2-c788-5bc5-92ca-3cdce3337585/173ff8b2-c788-5bc5-92ca-3cdce3337585_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/d5/6ed558cc8bdccadd549b29ad474d1f14/pa/YZ25603_67fd56a09b01cf0ffb632fbe6a5cf8b9.jpg saved to cache
2026-04-27 08:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 173ff8b2-c788-5bc5-92ca-3cdce3337585
2026-04-27 08:09:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/a2/59a22ebe83d008043d55dddd9c8ed6da/pa/AV43022_d34dffd0b6ec59f34db796a1c800af5a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d26a90>
2026-04-27 08:09:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_173ff8b2-c788-5bc5-92ca-3cdce3337585/173ff8b2-c788-5bc5-92ca-3cdce3337585_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/d5/6ed558cc8bdccadd549b29ad474d1f14/pa/YZ25603_9d9d3817e37ecf905445ca3be29b57be.jpg saved to cache
2026-04-27 08:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 173ff8b2-c788-5bc5-92ca-3cdce3337585
2026-04-27 08:09:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 173ff8b2-c788-5bc5-92ca-3cdce3337585, skipping ID generation
2026-04-27 08:09:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 173ff8b2-c788-5bc5-92ca-3cdce3337585 with scrape type 1
2026-04-27 08:09:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 173ff8b2-c788-5bc5-92ca-3cdce3337585 sending to next pipeline
2026-04-27 08:09:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 173ff8b2-c788-5bc5-92ca-3cdce3337585, identifier: YZ25603
2026-04-27 08:09:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 173ff8b2-c788-5bc5-92ca-3cdce3337585 with identifier: YZ25603
2026-04-27 08:09:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 173ff8b2-c788-5bc5-92ca-3cdce3337585 with identifier: YZ25603
2026-04-27 08:09:09 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:09:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 173ff8b2-c788-5bc5-92ca-3cdce3337585 with identifier: YZ25603 to the API
2026-04-27 08:09:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:09:09 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:09:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6e/d5/6ed558cc8bdccadd549b29ad474d1f14/pa/YZ25603_9d9d3817e37ecf905445ca3be29b57be.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 177,
 'category': None,
 'city': 'Bruz',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.9L',
 'engine_horse_power': 245,
 'expiration_date': '2026-04-28T15:58:40Z',
 'fuel_type': 'diesel',
 'id': '173ff8b2-c788-5bc5-92ca-3cdce3337585',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.0246,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YZ25603',
 'listing': 'auction',
 'location': 'FR, Bruz',
 'location_confidence': 'geocoded',
 'longitude': -1.7471,
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 142844,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_173ff8b2-c788-5bc5-92ca-3cdce3337585/173ff8b2-c788-5bc5-92ca-3cdce3337585_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64316,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/d5/6ed558cc8bdccadd549b29ad474d1f14/pa/YZ25603_9d9d3817e37ecf905445ca3be29b57be.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_173ff8b2-c788-5bc5-92ca-3cdce3337585/173ff8b2-c788-5bc5-92ca-3cdce3337585_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57543,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/d5/6ed558cc8bdccadd549b29ad474d1f14/pa/YZ25603_67fd56a09b01cf0ffb632fbe6a5cf8b9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_173ff8b2-c788-5bc5-92ca-3cdce3337585/173ff8b2-c788-5bc5-92ca-3cdce3337585_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64116,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/d5/6ed558cc8bdccadd549b29ad474d1f14/pa/YZ25603_3c965ee799c1b0fd5fe6d472b2394146.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_173ff8b2-c788-5bc5-92ca-3cdce3337585/173ff8b2-c788-5bc5-92ca-3cdce3337585_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56541,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/d5/6ed558cc8bdccadd549b29ad474d1f14/pa/YZ25603_507656a0fef74937743a928c62094b7e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_173ff8b2-c788-5bc5-92ca-3cdce3337585/173ff8b2-c788-5bc5-92ca-3cdce3337585_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64518,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/d5/6ed558cc8bdccadd549b29ad474d1f14/pa/YZ25603_7ff70aeadcb4cefba9905ea9ec837a48.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_173ff8b2-c788-5bc5-92ca-3cdce3337585/173ff8b2-c788-5bc5-92ca-3cdce3337585_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71869,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/d5/6ed558cc8bdccadd549b29ad474d1f14/pa/YZ25603_286f6eb915a94b30848b1f17ea69c92d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_173ff8b2-c788-5bc5-92ca-3cdce3337585/173ff8b2-c788-5bc5-92ca-3cdce3337585_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44198,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/d5/6ed558cc8bdccadd549b29ad474d1f14/pa/YZ25603_763219edc9fb5392e0fb63c1e3a4470c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_173ff8b2-c788-5bc5-92ca-3cdce3337585/173ff8b2-c788-5bc5-92ca-3cdce3337585_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53766,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/d5/6ed558cc8bdccadd549b29ad474d1f14/pa/YZ25603_3f7e62ca042092b0e166e4e26f6b765d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_173ff8b2-c788-5bc5-92ca-3cdce3337585/173ff8b2-c788-5bc5-92ca-3cdce3337585_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66412,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/d5/6ed558cc8bdccadd549b29ad474d1f14/pa/YZ25603_3a767b1c2ad81fdcb2a3c80dd96dcabe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_173ff8b2-c788-5bc5-92ca-3cdce3337585/173ff8b2-c788-5bc5-92ca-3cdce3337585_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65555,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/d5/6ed558cc8bdccadd549b29ad474d1f14/pa/YZ25603_7c956175ae74535ec7c0c16766784e14.jpg',
             'Width': 800}],
 'postal_code': '35170',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Ille-et-Vilaine',
 'province_code': 'FR-35',
 'region': 'Bretagne',
 'region_code': 'FR-53',
 'registration_date': '2020-06-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 300 d 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2020}
2026-04-27 08:09:09 [auto1.fr] INFO: Saving data for YZ25603: {'created_time': 1777277349.500406, 'last_price_update_time': 1777277349.500414, 'has_photos': True, 'auction_closing_time': 1777391920.0}
2026-04-27 08:09:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/a2/59a22ebe83d008043d55dddd9c8ed6da/pa/AV43022_93d8a380dc2689e9540468c3e6921e15.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UL15311/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:09:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438045b90>
2026-04-27 08:09:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_408ff264-fc80-5875-88ce-1d0744ac1986/408ff264-fc80-5875-88ce-1d0744ac1986_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/a2/59a22ebe83d008043d55dddd9c8ed6da/pa/AV43022_d34dffd0b6ec59f34db796a1c800af5a.jpg saved to cache
2026-04-27 08:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 408ff264-fc80-5875-88ce-1d0744ac1986
2026-04-27 08:09:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:09:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438edb7d0>
2026-04-27 08:09:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_408ff264-fc80-5875-88ce-1d0744ac1986/408ff264-fc80-5875-88ce-1d0744ac1986_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/a2/59a22ebe83d008043d55dddd9c8ed6da/pa/AV43022_93d8a380dc2689e9540468c3e6921e15.jpg saved to cache
2026-04-27 08:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 408ff264-fc80-5875-88ce-1d0744ac1986
2026-04-27 08:09:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/a2/59a22ebe83d008043d55dddd9c8ed6da/pa/AV43022_1f90a7c49f026180bd6c6b333ee8b45c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/a2/59a22ebe83d008043d55dddd9c8ed6da/pa/AV43022_074f0128a7823d2add0b5ecef5d0d5de.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XD98518> (referer: https://www.auto1.com/v1/car-details-view/XD98518/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:09:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:09:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/a2/59a22ebe83d008043d55dddd9c8ed6da/pa/AV43022_c3bac3c081bdbd121835f1ee9db5b9e4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/a2/59a22ebe83d008043d55dddd9c8ed6da/pa/AV43022_d280c9a4d573a105d82a36ce6f22312b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438e7d610>
2026-04-27 08:09:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_408ff264-fc80-5875-88ce-1d0744ac1986/408ff264-fc80-5875-88ce-1d0744ac1986_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/a2/59a22ebe83d008043d55dddd9c8ed6da/pa/AV43022_1f90a7c49f026180bd6c6b333ee8b45c.jpg saved to cache
2026-04-27 08:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 408ff264-fc80-5875-88ce-1d0744ac1986
2026-04-27 08:09:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bfb4750>
2026-04-27 08:09:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_408ff264-fc80-5875-88ce-1d0744ac1986/408ff264-fc80-5875-88ce-1d0744ac1986_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/a2/59a22ebe83d008043d55dddd9c8ed6da/pa/AV43022_074f0128a7823d2add0b5ecef5d0d5de.jpg saved to cache
2026-04-27 08:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 408ff264-fc80-5875-88ce-1d0744ac1986
2026-04-27 08:09:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c24de4dd-a49c-5c48-9e23-90795748bc98 with identifier: XD98518
2026-04-27 08:09:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c24de4dd-a49c-5c48-9e23-90795748bc98 with scrape type 1
2026-04-27 08:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c24de4dd-a49c-5c48-9e23-90795748bc98
2026-04-27 08:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/aa/afaaa45191c7168cee9ecbbed39c58fa/pa/XD98518_6d5bfed8536b431d436b50b6711a2758.jpg not downloaded yet
2026-04-27 08:09:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438046350>
2026-04-27 08:09:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_408ff264-fc80-5875-88ce-1d0744ac1986/408ff264-fc80-5875-88ce-1d0744ac1986_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/a2/59a22ebe83d008043d55dddd9c8ed6da/pa/AV43022_c3bac3c081bdbd121835f1ee9db5b9e4.jpg saved to cache
2026-04-27 08:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 408ff264-fc80-5875-88ce-1d0744ac1986
2026-04-27 08:09:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143812d9d0>
2026-04-27 08:09:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_408ff264-fc80-5875-88ce-1d0744ac1986/408ff264-fc80-5875-88ce-1d0744ac1986_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/a2/59a22ebe83d008043d55dddd9c8ed6da/pa/AV43022_d280c9a4d573a105d82a36ce6f22312b.jpg saved to cache
2026-04-27 08:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 408ff264-fc80-5875-88ce-1d0744ac1986
2026-04-27 08:09:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 408ff264-fc80-5875-88ce-1d0744ac1986, skipping ID generation
2026-04-27 08:09:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 408ff264-fc80-5875-88ce-1d0744ac1986 with scrape type 1
2026-04-27 08:09:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 408ff264-fc80-5875-88ce-1d0744ac1986 sending to next pipeline
2026-04-27 08:09:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 408ff264-fc80-5875-88ce-1d0744ac1986, identifier: AV43022
2026-04-27 08:09:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 408ff264-fc80-5875-88ce-1d0744ac1986 with identifier: AV43022
2026-04-27 08:09:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 408ff264-fc80-5875-88ce-1d0744ac1986 with identifier: AV43022
2026-04-27 08:09:10 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:09:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 408ff264-fc80-5875-88ce-1d0744ac1986 with identifier: AV43022 to the API
2026-04-27 08:09:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:09:11 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:09:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img59/a2/59a22ebe83d008043d55dddd9c8ed6da/pa/AV43022_d280c9a4d573a105d82a36ce6f22312b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 89,
 'category': None,
 'city': 'Le Havre',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.8L',
 'engine_horse_power': 136,
 'expiration_date': '2026-04-28T15:34:48Z',
 'fuel_type': 'hybrid',
 'id': '408ff264-fc80-5875-88ce-1d0744ac1986',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 49.4935,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AV43022',
 'listing': 'auction',
 'location': 'FR, LE HAVRE',
 'location_confidence': 'geocoded',
 'longitude': 0.1079,
 'make': 'Toyota',
 'model': 'Prius',
 'odometer': 257240,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_408ff264-fc80-5875-88ce-1d0744ac1986/408ff264-fc80-5875-88ce-1d0744ac1986_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69271,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/a2/59a22ebe83d008043d55dddd9c8ed6da/pa/AV43022_c3bac3c081bdbd121835f1ee9db5b9e4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_408ff264-fc80-5875-88ce-1d0744ac1986/408ff264-fc80-5875-88ce-1d0744ac1986_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64468,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/a2/59a22ebe83d008043d55dddd9c8ed6da/pa/AV43022_d280c9a4d573a105d82a36ce6f22312b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_408ff264-fc80-5875-88ce-1d0744ac1986/408ff264-fc80-5875-88ce-1d0744ac1986_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80849,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/a2/59a22ebe83d008043d55dddd9c8ed6da/pa/AV43022_1f90a7c49f026180bd6c6b333ee8b45c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_408ff264-fc80-5875-88ce-1d0744ac1986/408ff264-fc80-5875-88ce-1d0744ac1986_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55886,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/a2/59a22ebe83d008043d55dddd9c8ed6da/pa/AV43022_074f0128a7823d2add0b5ecef5d0d5de.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_408ff264-fc80-5875-88ce-1d0744ac1986/408ff264-fc80-5875-88ce-1d0744ac1986_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69450,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/a2/59a22ebe83d008043d55dddd9c8ed6da/pa/AV43022_93d8a380dc2689e9540468c3e6921e15.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_408ff264-fc80-5875-88ce-1d0744ac1986/408ff264-fc80-5875-88ce-1d0744ac1986_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68631,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/a2/59a22ebe83d008043d55dddd9c8ed6da/pa/AV43022_d34dffd0b6ec59f34db796a1c800af5a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_408ff264-fc80-5875-88ce-1d0744ac1986/408ff264-fc80-5875-88ce-1d0744ac1986_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43712,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/a2/59a22ebe83d008043d55dddd9c8ed6da/pa/AV43022_4e4174bcfea507bb98ad0d51f4372a05.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_408ff264-fc80-5875-88ce-1d0744ac1986/408ff264-fc80-5875-88ce-1d0744ac1986_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57000,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/a2/59a22ebe83d008043d55dddd9c8ed6da/pa/AV43022_f92bfb5320ca351b6baf86b29ca24501.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_408ff264-fc80-5875-88ce-1d0744ac1986/408ff264-fc80-5875-88ce-1d0744ac1986_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55241,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/a2/59a22ebe83d008043d55dddd9c8ed6da/pa/AV43022_dd9de640688735b15e0cde7a33b43a8d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_408ff264-fc80-5875-88ce-1d0744ac1986/408ff264-fc80-5875-88ce-1d0744ac1986_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65830,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/a2/59a22ebe83d008043d55dddd9c8ed6da/pa/AV43022_04b2e2f82db70949615f9ad71e96686c.jpg',
             'Width': 800}],
 'postal_code': '76050 CEDEX',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Seine-Maritime',
 'province_code': 'FR-76',
 'region': 'Normandie',
 'region_code': 'FR-28',
 'registration_date': '2012-10-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Prius 1.8 Executive',
 'transmission': 'automatic',
 'trim': 'Executive',
 'year': 2012}
2026-04-27 08:09:11 [auto1.fr] INFO: Saving data for AV43022: {'created_time': 1777277351.961517, 'last_price_update_time': 1777277351.961526, 'has_photos': True, 'auction_closing_time': 1777390488.0}
2026-04-27 08:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/aa/afaaa45191c7168cee9ecbbed39c58fa/pa/XD98518_7d58c59e9347a2505bd01b2616b2e6e5.jpg not downloaded yet
2026-04-27 08:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/aa/afaaa45191c7168cee9ecbbed39c58fa/pa/XD98518_376563630c90cae9af3a05b4d391a1de.jpg not downloaded yet
2026-04-27 08:09:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZD48015> (referer: https://www.auto1.com/v1/car-details-view/ZD48015/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:09:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/aa/afaaa45191c7168cee9ecbbed39c58fa/pa/XD98518_c76e6932f794311f38baf2bdb34279db.jpg not downloaded yet
2026-04-27 08:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/aa/afaaa45191c7168cee9ecbbed39c58fa/pa/XD98518_155f5a36dcff4552d5e533101d1ab752.jpg not downloaded yet
2026-04-27 08:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/aa/afaaa45191c7168cee9ecbbed39c58fa/pa/XD98518_c52c71e27f7deaeb112608f60f40230f.jpg not downloaded yet
2026-04-27 08:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/aa/afaaa45191c7168cee9ecbbed39c58fa/pa/XD98518_fb20dda9c07cc17b1ff7d2963fb163a9.jpg not downloaded yet
2026-04-27 08:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/aa/afaaa45191c7168cee9ecbbed39c58fa/pa/XD98518_917c454c53f38e58a5b7bca0715ceeb9.jpg not downloaded yet
2026-04-27 08:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/aa/afaaa45191c7168cee9ecbbed39c58fa/pa/XD98518_6afaf2710b734ddc4bfa1dc71892e94e.jpg not downloaded yet
2026-04-27 08:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/aa/afaaa45191c7168cee9ecbbed39c58fa/pa/XD98518_7ab2f51436c34c2f0e7ab21c33c8ce29.jpg not downloaded yet
2026-04-27 08:09:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 275c41e6-040a-5315-af1a-f4905cc0485e with identifier: ZD48015
2026-04-27 08:09:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 275c41e6-040a-5315-af1a-f4905cc0485e with scrape type 1
2026-04-27 08:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 275c41e6-040a-5315-af1a-f4905cc0485e
2026-04-27 08:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/85/7985e963a3181e1fabcea1fb07612242/pa/ZD48015_7fcecc1194e66b791b5fb8c8cc52de23.jpg not downloaded yet
2026-04-27 08:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/85/7985e963a3181e1fabcea1fb07612242/pa/ZD48015_022dfbc8e0fed2a45aa0eacd238ecbc6.jpg not downloaded yet
2026-04-27 08:09:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/aa/afaaa45191c7168cee9ecbbed39c58fa/pa/XD98518_7d58c59e9347a2505bd01b2616b2e6e5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/85/7985e963a3181e1fabcea1fb07612242/pa/ZD48015_5dc49741890b1c0e0d90ea4bd4ea771d.jpg not downloaded yet
2026-04-27 08:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/85/7985e963a3181e1fabcea1fb07612242/pa/ZD48015_b5d4ab750205079a46189c3cb73a44f2.jpg not downloaded yet
2026-04-27 08:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/85/7985e963a3181e1fabcea1fb07612242/pa/ZD48015_4321146897bbeaa41b0a0981b0ec1ee1.jpg not downloaded yet
2026-04-27 08:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/85/7985e963a3181e1fabcea1fb07612242/pa/ZD48015_e75c1bd1dc9851079dfb1c127b773cc6.jpg not downloaded yet
2026-04-27 08:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/85/7985e963a3181e1fabcea1fb07612242/pa/ZD48015_7672cf0243ce401dea1ab3f8f9a7d5c4.jpg not downloaded yet
2026-04-27 08:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/85/7985e963a3181e1fabcea1fb07612242/pa/ZD48015_4b4d802e1d4cdba3cd52b1f593888877.jpg not downloaded yet
2026-04-27 08:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/85/7985e963a3181e1fabcea1fb07612242/pa/ZD48015_10d3f63544cd45049ff2332e937aa81b.jpg not downloaded yet
2026-04-27 08:09:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/85/7985e963a3181e1fabcea1fb07612242/pa/ZD48015_022dfbc8e0fed2a45aa0eacd238ecbc6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/85/7985e963a3181e1fabcea1fb07612242/pa/ZD48015_8ce351e1fcc5e435268f591c85e10a23.jpg not downloaded yet
2026-04-27 08:09:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d736d0>
2026-04-27 08:09:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c24de4dd-a49c-5c48-9e23-90795748bc98/c24de4dd-a49c-5c48-9e23-90795748bc98_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/aa/afaaa45191c7168cee9ecbbed39c58fa/pa/XD98518_7d58c59e9347a2505bd01b2616b2e6e5.jpg saved to cache
2026-04-27 08:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c24de4dd-a49c-5c48-9e23-90795748bc98
2026-04-27 08:09:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438cb6250>
2026-04-27 08:09:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_275c41e6-040a-5315-af1a-f4905cc0485e/275c41e6-040a-5315-af1a-f4905cc0485e_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/85/7985e963a3181e1fabcea1fb07612242/pa/ZD48015_022dfbc8e0fed2a45aa0eacd238ecbc6.jpg saved to cache
2026-04-27 08:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 275c41e6-040a-5315-af1a-f4905cc0485e
2026-04-27 08:09:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/85/7985e963a3181e1fabcea1fb07612242/pa/ZD48015_10d3f63544cd45049ff2332e937aa81b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/85/7985e963a3181e1fabcea1fb07612242/pa/ZD48015_8ce351e1fcc5e435268f591c85e10a23.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/85/7985e963a3181e1fabcea1fb07612242/pa/ZD48015_4b4d802e1d4cdba3cd52b1f593888877.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bfba410>
2026-04-27 08:09:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_275c41e6-040a-5315-af1a-f4905cc0485e/275c41e6-040a-5315-af1a-f4905cc0485e_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/85/7985e963a3181e1fabcea1fb07612242/pa/ZD48015_10d3f63544cd45049ff2332e937aa81b.jpg saved to cache
2026-04-27 08:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 275c41e6-040a-5315-af1a-f4905cc0485e
2026-04-27 08:09:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c2a050>
2026-04-27 08:09:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_275c41e6-040a-5315-af1a-f4905cc0485e/275c41e6-040a-5315-af1a-f4905cc0485e_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/85/7985e963a3181e1fabcea1fb07612242/pa/ZD48015_8ce351e1fcc5e435268f591c85e10a23.jpg saved to cache
2026-04-27 08:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 275c41e6-040a-5315-af1a-f4905cc0485e
2026-04-27 08:09:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438cb5150>
2026-04-27 08:09:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_275c41e6-040a-5315-af1a-f4905cc0485e/275c41e6-040a-5315-af1a-f4905cc0485e_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/85/7985e963a3181e1fabcea1fb07612242/pa/ZD48015_4b4d802e1d4cdba3cd52b1f593888877.jpg saved to cache
2026-04-27 08:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 275c41e6-040a-5315-af1a-f4905cc0485e
2026-04-27 08:09:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/85/7985e963a3181e1fabcea1fb07612242/pa/ZD48015_7672cf0243ce401dea1ab3f8f9a7d5c4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TH45766/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:09:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:09:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438dcaa90>
2026-04-27 08:09:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_275c41e6-040a-5315-af1a-f4905cc0485e/275c41e6-040a-5315-af1a-f4905cc0485e_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/85/7985e963a3181e1fabcea1fb07612242/pa/ZD48015_7672cf0243ce401dea1ab3f8f9a7d5c4.jpg saved to cache
2026-04-27 08:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 275c41e6-040a-5315-af1a-f4905cc0485e
2026-04-27 08:09:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/85/7985e963a3181e1fabcea1fb07612242/pa/ZD48015_4321146897bbeaa41b0a0981b0ec1ee1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/85/7985e963a3181e1fabcea1fb07612242/pa/ZD48015_b5d4ab750205079a46189c3cb73a44f2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143809e410>
2026-04-27 08:09:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_275c41e6-040a-5315-af1a-f4905cc0485e/275c41e6-040a-5315-af1a-f4905cc0485e_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/85/7985e963a3181e1fabcea1fb07612242/pa/ZD48015_4321146897bbeaa41b0a0981b0ec1ee1.jpg saved to cache
2026-04-27 08:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 275c41e6-040a-5315-af1a-f4905cc0485e
2026-04-27 08:09:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/85/7985e963a3181e1fabcea1fb07612242/pa/ZD48015_e75c1bd1dc9851079dfb1c127b773cc6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438cb5410>
2026-04-27 08:09:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_275c41e6-040a-5315-af1a-f4905cc0485e/275c41e6-040a-5315-af1a-f4905cc0485e_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/85/7985e963a3181e1fabcea1fb07612242/pa/ZD48015_b5d4ab750205079a46189c3cb73a44f2.jpg saved to cache
2026-04-27 08:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 275c41e6-040a-5315-af1a-f4905cc0485e
2026-04-27 08:09:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/85/7985e963a3181e1fabcea1fb07612242/pa/ZD48015_5dc49741890b1c0e0d90ea4bd4ea771d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/85/7985e963a3181e1fabcea1fb07612242/pa/ZD48015_7fcecc1194e66b791b5fb8c8cc52de23.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d90e50>
2026-04-27 08:09:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_275c41e6-040a-5315-af1a-f4905cc0485e/275c41e6-040a-5315-af1a-f4905cc0485e_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/85/7985e963a3181e1fabcea1fb07612242/pa/ZD48015_e75c1bd1dc9851079dfb1c127b773cc6.jpg saved to cache
2026-04-27 08:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 275c41e6-040a-5315-af1a-f4905cc0485e
2026-04-27 08:09:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438045250>
2026-04-27 08:09:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_275c41e6-040a-5315-af1a-f4905cc0485e/275c41e6-040a-5315-af1a-f4905cc0485e_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/85/7985e963a3181e1fabcea1fb07612242/pa/ZD48015_5dc49741890b1c0e0d90ea4bd4ea771d.jpg saved to cache
2026-04-27 08:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 275c41e6-040a-5315-af1a-f4905cc0485e
2026-04-27 08:09:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d2f290>
2026-04-27 08:09:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_275c41e6-040a-5315-af1a-f4905cc0485e/275c41e6-040a-5315-af1a-f4905cc0485e_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/85/7985e963a3181e1fabcea1fb07612242/pa/ZD48015_7fcecc1194e66b791b5fb8c8cc52de23.jpg saved to cache
2026-04-27 08:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 275c41e6-040a-5315-af1a-f4905cc0485e
2026-04-27 08:09:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 275c41e6-040a-5315-af1a-f4905cc0485e, skipping ID generation
2026-04-27 08:09:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 275c41e6-040a-5315-af1a-f4905cc0485e with scrape type 1
2026-04-27 08:09:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 275c41e6-040a-5315-af1a-f4905cc0485e sending to next pipeline
2026-04-27 08:09:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 275c41e6-040a-5315-af1a-f4905cc0485e, identifier: ZD48015
2026-04-27 08:09:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 275c41e6-040a-5315-af1a-f4905cc0485e with identifier: ZD48015
2026-04-27 08:09:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 275c41e6-040a-5315-af1a-f4905cc0485e with identifier: ZD48015
2026-04-27 08:09:13 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:09:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 275c41e6-040a-5315-af1a-f4905cc0485e with identifier: ZD48015 to the API
2026-04-27 08:09:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:09:13 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:09:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img79/85/7985e963a3181e1fabcea1fb07612242/pa/ZD48015_7fcecc1194e66b791b5fb8c8cc52de23.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'city': 'Creutzwald',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 180,
 'expiration_date': '2026-04-28T15:41:51Z',
 'fuel_type': 'diesel',
 'id': '275c41e6-040a-5315-af1a-f4905cc0485e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 49.2053,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZD48015',
 'listing': 'auction',
 'location': 'FR, Creutzwald',
 'location_confidence': 'geocoded',
 'longitude': 6.6967,
 'make': 'Peugeot',
 'model': '508',
 'odometer': 205825,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_275c41e6-040a-5315-af1a-f4905cc0485e/275c41e6-040a-5315-af1a-f4905cc0485e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111825,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/85/7985e963a3181e1fabcea1fb07612242/pa/ZD48015_7fcecc1194e66b791b5fb8c8cc52de23.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_275c41e6-040a-5315-af1a-f4905cc0485e/275c41e6-040a-5315-af1a-f4905cc0485e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113055,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/85/7985e963a3181e1fabcea1fb07612242/pa/ZD48015_022dfbc8e0fed2a45aa0eacd238ecbc6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_275c41e6-040a-5315-af1a-f4905cc0485e/275c41e6-040a-5315-af1a-f4905cc0485e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100606,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/85/7985e963a3181e1fabcea1fb07612242/pa/ZD48015_5dc49741890b1c0e0d90ea4bd4ea771d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_275c41e6-040a-5315-af1a-f4905cc0485e/275c41e6-040a-5315-af1a-f4905cc0485e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84528,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/85/7985e963a3181e1fabcea1fb07612242/pa/ZD48015_b5d4ab750205079a46189c3cb73a44f2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_275c41e6-040a-5315-af1a-f4905cc0485e/275c41e6-040a-5315-af1a-f4905cc0485e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90180,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/85/7985e963a3181e1fabcea1fb07612242/pa/ZD48015_4321146897bbeaa41b0a0981b0ec1ee1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_275c41e6-040a-5315-af1a-f4905cc0485e/275c41e6-040a-5315-af1a-f4905cc0485e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76472,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/85/7985e963a3181e1fabcea1fb07612242/pa/ZD48015_e75c1bd1dc9851079dfb1c127b773cc6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_275c41e6-040a-5315-af1a-f4905cc0485e/275c41e6-040a-5315-af1a-f4905cc0485e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85666,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/85/7985e963a3181e1fabcea1fb07612242/pa/ZD48015_7672cf0243ce401dea1ab3f8f9a7d5c4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_275c41e6-040a-5315-af1a-f4905cc0485e/275c41e6-040a-5315-af1a-f4905cc0485e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83158,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/85/7985e963a3181e1fabcea1fb07612242/pa/ZD48015_4b4d802e1d4cdba3cd52b1f593888877.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_275c41e6-040a-5315-af1a-f4905cc0485e/275c41e6-040a-5315-af1a-f4905cc0485e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100767,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/85/7985e963a3181e1fabcea1fb07612242/pa/ZD48015_10d3f63544cd45049ff2332e937aa81b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_275c41e6-040a-5315-af1a-f4905cc0485e/275c41e6-040a-5315-af1a-f4905cc0485e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86450,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/85/7985e963a3181e1fabcea1fb07612242/pa/ZD48015_8ce351e1fcc5e435268f591c85e10a23.jpg',
             'Width': 800}],
 'postal_code': '57150',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Moselle',
 'province_code': 'FR-57',
 'region': 'Grand Est',
 'region_code': 'FR-44',
 'registration_date': '2015-07-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 508 2.0 Blue-HDi RXH',
 'transmission': 'automatic',
 'trim': 'RXH',
 'year': 2015}
2026-04-27 08:09:13 [auto1.fr] INFO: Saving data for ZD48015: {'created_time': 1777277353.899221, 'last_price_update_time': 1777277353.899232, 'has_photos': True, 'auction_closing_time': 1777390911.0}
2026-04-27 08:09:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/aa/afaaa45191c7168cee9ecbbed39c58fa/pa/XD98518_7ab2f51436c34c2f0e7ab21c33c8ce29.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bfb4f90>
2026-04-27 08:09:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c24de4dd-a49c-5c48-9e23-90795748bc98/c24de4dd-a49c-5c48-9e23-90795748bc98_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/aa/afaaa45191c7168cee9ecbbed39c58fa/pa/XD98518_7ab2f51436c34c2f0e7ab21c33c8ce29.jpg saved to cache
2026-04-27 08:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c24de4dd-a49c-5c48-9e23-90795748bc98
2026-04-27 08:09:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/aa/afaaa45191c7168cee9ecbbed39c58fa/pa/XD98518_6afaf2710b734ddc4bfa1dc71892e94e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380a4450>
2026-04-27 08:09:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c24de4dd-a49c-5c48-9e23-90795748bc98/c24de4dd-a49c-5c48-9e23-90795748bc98_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/aa/afaaa45191c7168cee9ecbbed39c58fa/pa/XD98518_6afaf2710b734ddc4bfa1dc71892e94e.jpg saved to cache
2026-04-27 08:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c24de4dd-a49c-5c48-9e23-90795748bc98
2026-04-27 08:09:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/aa/afaaa45191c7168cee9ecbbed39c58fa/pa/XD98518_917c454c53f38e58a5b7bca0715ceeb9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a61450>
2026-04-27 08:09:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c24de4dd-a49c-5c48-9e23-90795748bc98/c24de4dd-a49c-5c48-9e23-90795748bc98_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/aa/afaaa45191c7168cee9ecbbed39c58fa/pa/XD98518_917c454c53f38e58a5b7bca0715ceeb9.jpg saved to cache
2026-04-27 08:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c24de4dd-a49c-5c48-9e23-90795748bc98
2026-04-27 08:09:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/aa/afaaa45191c7168cee9ecbbed39c58fa/pa/XD98518_fb20dda9c07cc17b1ff7d2963fb163a9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380ba110>
2026-04-27 08:09:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c24de4dd-a49c-5c48-9e23-90795748bc98/c24de4dd-a49c-5c48-9e23-90795748bc98_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/aa/afaaa45191c7168cee9ecbbed39c58fa/pa/XD98518_fb20dda9c07cc17b1ff7d2963fb163a9.jpg saved to cache
2026-04-27 08:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c24de4dd-a49c-5c48-9e23-90795748bc98
2026-04-27 08:09:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/aa/afaaa45191c7168cee9ecbbed39c58fa/pa/XD98518_c52c71e27f7deaeb112608f60f40230f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c39150>
2026-04-27 08:09:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c24de4dd-a49c-5c48-9e23-90795748bc98/c24de4dd-a49c-5c48-9e23-90795748bc98_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/aa/afaaa45191c7168cee9ecbbed39c58fa/pa/XD98518_c52c71e27f7deaeb112608f60f40230f.jpg saved to cache
2026-04-27 08:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c24de4dd-a49c-5c48-9e23-90795748bc98
2026-04-27 08:09:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/aa/afaaa45191c7168cee9ecbbed39c58fa/pa/XD98518_155f5a36dcff4552d5e533101d1ab752.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c86310>
2026-04-27 08:09:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c24de4dd-a49c-5c48-9e23-90795748bc98/c24de4dd-a49c-5c48-9e23-90795748bc98_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/aa/afaaa45191c7168cee9ecbbed39c58fa/pa/XD98518_155f5a36dcff4552d5e533101d1ab752.jpg saved to cache
2026-04-27 08:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c24de4dd-a49c-5c48-9e23-90795748bc98
2026-04-27 08:09:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/aa/afaaa45191c7168cee9ecbbed39c58fa/pa/XD98518_c76e6932f794311f38baf2bdb34279db.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438183550>
2026-04-27 08:09:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c24de4dd-a49c-5c48-9e23-90795748bc98/c24de4dd-a49c-5c48-9e23-90795748bc98_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/aa/afaaa45191c7168cee9ecbbed39c58fa/pa/XD98518_c76e6932f794311f38baf2bdb34279db.jpg saved to cache
2026-04-27 08:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c24de4dd-a49c-5c48-9e23-90795748bc98
2026-04-27 08:09:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/aa/afaaa45191c7168cee9ecbbed39c58fa/pa/XD98518_376563630c90cae9af3a05b4d391a1de.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/aa/afaaa45191c7168cee9ecbbed39c58fa/pa/XD98518_6d5bfed8536b431d436b50b6711a2758.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XY15688/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:09:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:09:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a607d0>
2026-04-27 08:09:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c24de4dd-a49c-5c48-9e23-90795748bc98/c24de4dd-a49c-5c48-9e23-90795748bc98_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/aa/afaaa45191c7168cee9ecbbed39c58fa/pa/XD98518_376563630c90cae9af3a05b4d391a1de.jpg saved to cache
2026-04-27 08:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c24de4dd-a49c-5c48-9e23-90795748bc98
2026-04-27 08:09:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438e7cb10>
2026-04-27 08:09:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c24de4dd-a49c-5c48-9e23-90795748bc98/c24de4dd-a49c-5c48-9e23-90795748bc98_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/aa/afaaa45191c7168cee9ecbbed39c58fa/pa/XD98518_6d5bfed8536b431d436b50b6711a2758.jpg saved to cache
2026-04-27 08:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c24de4dd-a49c-5c48-9e23-90795748bc98
2026-04-27 08:09:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c24de4dd-a49c-5c48-9e23-90795748bc98, skipping ID generation
2026-04-27 08:09:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c24de4dd-a49c-5c48-9e23-90795748bc98 with scrape type 1
2026-04-27 08:09:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c24de4dd-a49c-5c48-9e23-90795748bc98 sending to next pipeline
2026-04-27 08:09:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c24de4dd-a49c-5c48-9e23-90795748bc98, identifier: XD98518
2026-04-27 08:09:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c24de4dd-a49c-5c48-9e23-90795748bc98 with identifier: XD98518
2026-04-27 08:09:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c24de4dd-a49c-5c48-9e23-90795748bc98 with identifier: XD98518
2026-04-27 08:09:15 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:09:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c24de4dd-a49c-5c48-9e23-90795748bc98 with identifier: XD98518 to the API
2026-04-27 08:09:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:09:15 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:09:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgaf/aa/afaaa45191c7168cee9ecbbed39c58fa/pa/XD98518_6d5bfed8536b431d436b50b6711a2758.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'category': None,
 'city': 'Villenoy',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 120,
 'expiration_date': '2026-04-28T15:56:18Z',
 'fuel_type': 'diesel',
 'id': 'c24de4dd-a49c-5c48-9e23-90795748bc98',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.9411,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XD98518',
 'listing': 'auction',
 'location': 'FR, Villenoy',
 'location_confidence': 'geocoded',
 'longitude': 2.8602,
 'make': 'Ford',
 'model': 'C-Max',
 'odometer': 176723,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c24de4dd-a49c-5c48-9e23-90795748bc98/c24de4dd-a49c-5c48-9e23-90795748bc98_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75727,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/aa/afaaa45191c7168cee9ecbbed39c58fa/pa/XD98518_6d5bfed8536b431d436b50b6711a2758.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c24de4dd-a49c-5c48-9e23-90795748bc98/c24de4dd-a49c-5c48-9e23-90795748bc98_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78755,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/aa/afaaa45191c7168cee9ecbbed39c58fa/pa/XD98518_7d58c59e9347a2505bd01b2616b2e6e5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c24de4dd-a49c-5c48-9e23-90795748bc98/c24de4dd-a49c-5c48-9e23-90795748bc98_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72038,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/aa/afaaa45191c7168cee9ecbbed39c58fa/pa/XD98518_376563630c90cae9af3a05b4d391a1de.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c24de4dd-a49c-5c48-9e23-90795748bc98/c24de4dd-a49c-5c48-9e23-90795748bc98_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64452,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/aa/afaaa45191c7168cee9ecbbed39c58fa/pa/XD98518_c76e6932f794311f38baf2bdb34279db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c24de4dd-a49c-5c48-9e23-90795748bc98/c24de4dd-a49c-5c48-9e23-90795748bc98_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68397,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/aa/afaaa45191c7168cee9ecbbed39c58fa/pa/XD98518_155f5a36dcff4552d5e533101d1ab752.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c24de4dd-a49c-5c48-9e23-90795748bc98/c24de4dd-a49c-5c48-9e23-90795748bc98_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68350,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/aa/afaaa45191c7168cee9ecbbed39c58fa/pa/XD98518_c52c71e27f7deaeb112608f60f40230f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c24de4dd-a49c-5c48-9e23-90795748bc98/c24de4dd-a49c-5c48-9e23-90795748bc98_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63021,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/aa/afaaa45191c7168cee9ecbbed39c58fa/pa/XD98518_fb20dda9c07cc17b1ff7d2963fb163a9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c24de4dd-a49c-5c48-9e23-90795748bc98/c24de4dd-a49c-5c48-9e23-90795748bc98_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81305,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/aa/afaaa45191c7168cee9ecbbed39c58fa/pa/XD98518_917c454c53f38e58a5b7bca0715ceeb9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c24de4dd-a49c-5c48-9e23-90795748bc98/c24de4dd-a49c-5c48-9e23-90795748bc98_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75173,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/aa/afaaa45191c7168cee9ecbbed39c58fa/pa/XD98518_6afaf2710b734ddc4bfa1dc71892e94e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c24de4dd-a49c-5c48-9e23-90795748bc98/c24de4dd-a49c-5c48-9e23-90795748bc98_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62344,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/aa/afaaa45191c7168cee9ecbbed39c58fa/pa/XD98518_7ab2f51436c34c2f0e7ab21c33c8ce29.jpg',
             'Width': 800}],
 'postal_code': '77124',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Seine-et-Marne',
 'province_code': 'FR-77',
 'region': 'Île-de-France',
 'region_code': 'FR-11',
 'registration_date': '2016-05-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford C-Max 1.5 TDCi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2016}
2026-04-27 08:09:15 [auto1.fr] INFO: Saving data for XD98518: {'created_time': 1777277355.962043, 'last_price_update_time': 1777277355.962053, 'has_photos': True, 'auction_closing_time': 1777391778.0}
2026-04-27 08:09:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SN62809> (referer: https://www.auto1.com/v1/car-details-view/SN62809/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:09:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:09:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9a1b3d4-0c83-5288-8a3c-7d18be962e8a with identifier: SN62809
2026-04-27 08:09:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9a1b3d4-0c83-5288-8a3c-7d18be962e8a with scrape type 1
2026-04-27 08:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item a9a1b3d4-0c83-5288-8a3c-7d18be962e8a
2026-04-27 08:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/2b/912b0e545e46906be06c247441ab07c5/pa/SN62809_08c9d0771295f296bd7a8ee34f68a52b.jpg not downloaded yet
2026-04-27 08:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/2b/912b0e545e46906be06c247441ab07c5/pa/SN62809_37d272cb68ce2ab1bdab9bba2f6ca415.jpg not downloaded yet
2026-04-27 08:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/2b/912b0e545e46906be06c247441ab07c5/pa/SN62809_630a468caceae3af2dca724afbde7644.jpg not downloaded yet
2026-04-27 08:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/2b/912b0e545e46906be06c247441ab07c5/pa/SN62809_1820d6c12950a71f392c1a313f2c2a2e.jpg not downloaded yet
2026-04-27 08:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/2b/912b0e545e46906be06c247441ab07c5/pa/SN62809_096ba4006bf432e6f6fed99bd9df570c.jpg not downloaded yet
2026-04-27 08:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/2b/912b0e545e46906be06c247441ab07c5/pa/SN62809_ca82591e0b24504b1d15ee78997462fe.jpg not downloaded yet
2026-04-27 08:09:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TD30440> (referer: https://www.auto1.com/v1/car-details-view/TD30440/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:09:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:09:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cff9d14e-7ea5-56c9-93e6-eefe6964b81d with identifier: TD30440
2026-04-27 08:09:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cff9d14e-7ea5-56c9-93e6-eefe6964b81d with scrape type 1
2026-04-27 08:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item cff9d14e-7ea5-56c9-93e6-eefe6964b81d
2026-04-27 08:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/cb/a5cbc6346390b3899f9593d31e1355e9/pa/TD30440_85a17f240f53dab1838f8d8602419224.jpg not downloaded yet
2026-04-27 08:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/cb/a5cbc6346390b3899f9593d31e1355e9/pa/TD30440_15cb4963385efb5a8f4e5901f1b7f719.jpg not downloaded yet
2026-04-27 08:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/cb/a5cbc6346390b3899f9593d31e1355e9/pa/TD30440_fd8c75549ce33423dd1deefe56d318bc.jpg not downloaded yet
2026-04-27 08:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/cb/a5cbc6346390b3899f9593d31e1355e9/pa/TD30440_7a8be5bc43a060b7201595f74b5f78b1.jpg not downloaded yet
2026-04-27 08:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/cb/a5cbc6346390b3899f9593d31e1355e9/pa/TD30440_356fb0cae40e4157d56dd7f1f4c0f0fc.jpg not downloaded yet
2026-04-27 08:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/cb/a5cbc6346390b3899f9593d31e1355e9/pa/TD30440_5ed772a5cd726fa498d1154b21d53bd0.jpg not downloaded yet
2026-04-27 08:09:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/2b/912b0e545e46906be06c247441ab07c5/pa/SN62809_ca82591e0b24504b1d15ee78997462fe.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438e17e90>
2026-04-27 08:09:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9a1b3d4-0c83-5288-8a3c-7d18be962e8a/a9a1b3d4-0c83-5288-8a3c-7d18be962e8a_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/2b/912b0e545e46906be06c247441ab07c5/pa/SN62809_ca82591e0b24504b1d15ee78997462fe.jpg saved to cache
2026-04-27 08:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a9a1b3d4-0c83-5288-8a3c-7d18be962e8a
2026-04-27 08:09:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/cb/a5cbc6346390b3899f9593d31e1355e9/pa/TD30440_356fb0cae40e4157d56dd7f1f4c0f0fc.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143818b050>
2026-04-27 08:09:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cff9d14e-7ea5-56c9-93e6-eefe6964b81d/cff9d14e-7ea5-56c9-93e6-eefe6964b81d_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/cb/a5cbc6346390b3899f9593d31e1355e9/pa/TD30440_356fb0cae40e4157d56dd7f1f4c0f0fc.jpg saved to cache
2026-04-27 08:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cff9d14e-7ea5-56c9-93e6-eefe6964b81d
2026-04-27 08:09:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/cb/a5cbc6346390b3899f9593d31e1355e9/pa/TD30440_5ed772a5cd726fa498d1154b21d53bd0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/cb/a5cbc6346390b3899f9593d31e1355e9/pa/TD30440_7a8be5bc43a060b7201595f74b5f78b1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bfd3a50>
2026-04-27 08:09:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cff9d14e-7ea5-56c9-93e6-eefe6964b81d/cff9d14e-7ea5-56c9-93e6-eefe6964b81d_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/cb/a5cbc6346390b3899f9593d31e1355e9/pa/TD30440_5ed772a5cd726fa498d1154b21d53bd0.jpg saved to cache
2026-04-27 08:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cff9d14e-7ea5-56c9-93e6-eefe6964b81d
2026-04-27 08:09:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/cb/a5cbc6346390b3899f9593d31e1355e9/pa/TD30440_fd8c75549ce33423dd1deefe56d318bc.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c56110>
2026-04-27 08:09:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cff9d14e-7ea5-56c9-93e6-eefe6964b81d/cff9d14e-7ea5-56c9-93e6-eefe6964b81d_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/cb/a5cbc6346390b3899f9593d31e1355e9/pa/TD30440_7a8be5bc43a060b7201595f74b5f78b1.jpg saved to cache
2026-04-27 08:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cff9d14e-7ea5-56c9-93e6-eefe6964b81d
2026-04-27 08:09:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/cb/a5cbc6346390b3899f9593d31e1355e9/pa/TD30440_15cb4963385efb5a8f4e5901f1b7f719.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/cb/a5cbc6346390b3899f9593d31e1355e9/pa/TD30440_85a17f240f53dab1838f8d8602419224.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438e7f410>
2026-04-27 08:09:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cff9d14e-7ea5-56c9-93e6-eefe6964b81d/cff9d14e-7ea5-56c9-93e6-eefe6964b81d_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/cb/a5cbc6346390b3899f9593d31e1355e9/pa/TD30440_fd8c75549ce33423dd1deefe56d318bc.jpg saved to cache
2026-04-27 08:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cff9d14e-7ea5-56c9-93e6-eefe6964b81d
2026-04-27 08:09:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/2b/912b0e545e46906be06c247441ab07c5/pa/SN62809_096ba4006bf432e6f6fed99bd9df570c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bfd3150>
2026-04-27 08:09:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cff9d14e-7ea5-56c9-93e6-eefe6964b81d/cff9d14e-7ea5-56c9-93e6-eefe6964b81d_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/cb/a5cbc6346390b3899f9593d31e1355e9/pa/TD30440_15cb4963385efb5a8f4e5901f1b7f719.jpg saved to cache
2026-04-27 08:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cff9d14e-7ea5-56c9-93e6-eefe6964b81d
2026-04-27 08:09:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c98590>
2026-04-27 08:09:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cff9d14e-7ea5-56c9-93e6-eefe6964b81d/cff9d14e-7ea5-56c9-93e6-eefe6964b81d_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/cb/a5cbc6346390b3899f9593d31e1355e9/pa/TD30440_85a17f240f53dab1838f8d8602419224.jpg saved to cache
2026-04-27 08:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cff9d14e-7ea5-56c9-93e6-eefe6964b81d
2026-04-27 08:09:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cff9d14e-7ea5-56c9-93e6-eefe6964b81d, skipping ID generation
2026-04-27 08:09:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cff9d14e-7ea5-56c9-93e6-eefe6964b81d with scrape type 1
2026-04-27 08:09:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cff9d14e-7ea5-56c9-93e6-eefe6964b81d sending to next pipeline
2026-04-27 08:09:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: cff9d14e-7ea5-56c9-93e6-eefe6964b81d, identifier: TD30440
2026-04-27 08:09:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: cff9d14e-7ea5-56c9-93e6-eefe6964b81d with identifier: TD30440
2026-04-27 08:09:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: cff9d14e-7ea5-56c9-93e6-eefe6964b81d with identifier: TD30440
2026-04-27 08:09:21 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:09:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: cff9d14e-7ea5-56c9-93e6-eefe6964b81d with identifier: TD30440 to the API
2026-04-27 08:09:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:09:21 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:09:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga5/cb/a5cbc6346390b3899f9593d31e1355e9/pa/TD30440_85a17f240f53dab1838f8d8602419224.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'category': None,
 'city': 'Marseille',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.5L',
 'engine_horse_power': 110,
 'expiration_date': '2026-04-28T15:31:39Z',
 'fuel_type': 'diesel',
 'id': 'cff9d14e-7ea5-56c9-93e6-eefe6964b81d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 43.2969,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TD30440',
 'listing': 'auction',
 'location': 'FR, Marseille',
 'location_confidence': 'geocoded',
 'longitude': 5.3811,
 'make': 'Renault',
 'model': 'Scenic',
 'odometer': 234302,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cff9d14e-7ea5-56c9-93e6-eefe6964b81d/cff9d14e-7ea5-56c9-93e6-eefe6964b81d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87096,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/cb/a5cbc6346390b3899f9593d31e1355e9/pa/TD30440_85a17f240f53dab1838f8d8602419224.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cff9d14e-7ea5-56c9-93e6-eefe6964b81d/cff9d14e-7ea5-56c9-93e6-eefe6964b81d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94891,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/cb/a5cbc6346390b3899f9593d31e1355e9/pa/TD30440_15cb4963385efb5a8f4e5901f1b7f719.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cff9d14e-7ea5-56c9-93e6-eefe6964b81d/cff9d14e-7ea5-56c9-93e6-eefe6964b81d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86167,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/cb/a5cbc6346390b3899f9593d31e1355e9/pa/TD30440_fd8c75549ce33423dd1deefe56d318bc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cff9d14e-7ea5-56c9-93e6-eefe6964b81d/cff9d14e-7ea5-56c9-93e6-eefe6964b81d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54307,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/cb/a5cbc6346390b3899f9593d31e1355e9/pa/TD30440_7a8be5bc43a060b7201595f74b5f78b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cff9d14e-7ea5-56c9-93e6-eefe6964b81d/cff9d14e-7ea5-56c9-93e6-eefe6964b81d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76140,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/cb/a5cbc6346390b3899f9593d31e1355e9/pa/TD30440_356fb0cae40e4157d56dd7f1f4c0f0fc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cff9d14e-7ea5-56c9-93e6-eefe6964b81d/cff9d14e-7ea5-56c9-93e6-eefe6964b81d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41555,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/cb/a5cbc6346390b3899f9593d31e1355e9/pa/TD30440_5ed772a5cd726fa498d1154b21d53bd0.jpg',
             'Width': 800}],
 'postal_code': '13000',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Bouches-du-Rhône',
 'province_code': 'FR-13',
 'region': "Provence-Alpes-Côte d'Azur",
 'region_code': 'FR-93',
 'registration_date': '2013-10-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Scenic 1.5 dCi Zen',
 'transmission': 'manual',
 'trim': 'Zen',
 'year': 2013}
2026-04-27 08:09:21 [auto1.fr] INFO: Saving data for TD30440: {'created_time': 1777277361.965518, 'last_price_update_time': 1777277361.965529, 'has_photos': True, 'auction_closing_time': 1777390299.0}
2026-04-27 08:09:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438182890>
2026-04-27 08:09:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9a1b3d4-0c83-5288-8a3c-7d18be962e8a/a9a1b3d4-0c83-5288-8a3c-7d18be962e8a_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/2b/912b0e545e46906be06c247441ab07c5/pa/SN62809_096ba4006bf432e6f6fed99bd9df570c.jpg saved to cache
2026-04-27 08:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a9a1b3d4-0c83-5288-8a3c-7d18be962e8a
2026-04-27 08:09:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/2b/912b0e545e46906be06c247441ab07c5/pa/SN62809_1820d6c12950a71f392c1a313f2c2a2e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c86f90>
2026-04-27 08:09:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9a1b3d4-0c83-5288-8a3c-7d18be962e8a/a9a1b3d4-0c83-5288-8a3c-7d18be962e8a_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/2b/912b0e545e46906be06c247441ab07c5/pa/SN62809_1820d6c12950a71f392c1a313f2c2a2e.jpg saved to cache
2026-04-27 08:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a9a1b3d4-0c83-5288-8a3c-7d18be962e8a
2026-04-27 08:09:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/2b/912b0e545e46906be06c247441ab07c5/pa/SN62809_630a468caceae3af2dca724afbde7644.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438fb7f50>
2026-04-27 08:09:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9a1b3d4-0c83-5288-8a3c-7d18be962e8a/a9a1b3d4-0c83-5288-8a3c-7d18be962e8a_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/2b/912b0e545e46906be06c247441ab07c5/pa/SN62809_630a468caceae3af2dca724afbde7644.jpg saved to cache
2026-04-27 08:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a9a1b3d4-0c83-5288-8a3c-7d18be962e8a
2026-04-27 08:09:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/2b/912b0e545e46906be06c247441ab07c5/pa/SN62809_37d272cb68ce2ab1bdab9bba2f6ca415.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/2b/912b0e545e46906be06c247441ab07c5/pa/SN62809_08c9d0771295f296bd7a8ee34f68a52b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14478c2810>
2026-04-27 08:09:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9a1b3d4-0c83-5288-8a3c-7d18be962e8a/a9a1b3d4-0c83-5288-8a3c-7d18be962e8a_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/2b/912b0e545e46906be06c247441ab07c5/pa/SN62809_37d272cb68ce2ab1bdab9bba2f6ca415.jpg saved to cache
2026-04-27 08:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a9a1b3d4-0c83-5288-8a3c-7d18be962e8a
2026-04-27 08:09:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14381837d0>
2026-04-27 08:09:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9a1b3d4-0c83-5288-8a3c-7d18be962e8a/a9a1b3d4-0c83-5288-8a3c-7d18be962e8a_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/2b/912b0e545e46906be06c247441ab07c5/pa/SN62809_08c9d0771295f296bd7a8ee34f68a52b.jpg saved to cache
2026-04-27 08:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a9a1b3d4-0c83-5288-8a3c-7d18be962e8a
2026-04-27 08:09:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a9a1b3d4-0c83-5288-8a3c-7d18be962e8a, skipping ID generation
2026-04-27 08:09:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9a1b3d4-0c83-5288-8a3c-7d18be962e8a with scrape type 1
2026-04-27 08:09:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a9a1b3d4-0c83-5288-8a3c-7d18be962e8a sending to next pipeline
2026-04-27 08:09:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a9a1b3d4-0c83-5288-8a3c-7d18be962e8a, identifier: SN62809
2026-04-27 08:09:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a9a1b3d4-0c83-5288-8a3c-7d18be962e8a with identifier: SN62809
2026-04-27 08:09:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a9a1b3d4-0c83-5288-8a3c-7d18be962e8a with identifier: SN62809
2026-04-27 08:09:22 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:09:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a9a1b3d4-0c83-5288-8a3c-7d18be962e8a with identifier: SN62809 to the API
2026-04-27 08:09:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:09:22 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:09:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img91/2b/912b0e545e46906be06c247441ab07c5/pa/SN62809_08c9d0771295f296bd7a8ee34f68a52b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 205,
 'category': None,
 'city': 'Beaucaire',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 3',
 'engine': '2.0L',
 'engine_horse_power': 110,
 'expiration_date': '2026-04-28T15:09:58Z',
 'fuel_type': 'diesel',
 'id': 'a9a1b3d4-0c83-5288-8a3c-7d18be962e8a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 43.8081,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SN62809',
 'listing': 'auction',
 'location': 'FR, Beaucaire',
 'location_confidence': 'geocoded',
 'longitude': 4.6442,
 'make': 'Land Rover',
 'model': 'Freelander',
 'odometer': 278557,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a9a1b3d4-0c83-5288-8a3c-7d18be962e8a/a9a1b3d4-0c83-5288-8a3c-7d18be962e8a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71248,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/2b/912b0e545e46906be06c247441ab07c5/pa/SN62809_08c9d0771295f296bd7a8ee34f68a52b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a9a1b3d4-0c83-5288-8a3c-7d18be962e8a/a9a1b3d4-0c83-5288-8a3c-7d18be962e8a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79936,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/2b/912b0e545e46906be06c247441ab07c5/pa/SN62809_37d272cb68ce2ab1bdab9bba2f6ca415.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a9a1b3d4-0c83-5288-8a3c-7d18be962e8a/a9a1b3d4-0c83-5288-8a3c-7d18be962e8a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60009,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/2b/912b0e545e46906be06c247441ab07c5/pa/SN62809_630a468caceae3af2dca724afbde7644.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a9a1b3d4-0c83-5288-8a3c-7d18be962e8a/a9a1b3d4-0c83-5288-8a3c-7d18be962e8a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63410,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/2b/912b0e545e46906be06c247441ab07c5/pa/SN62809_1820d6c12950a71f392c1a313f2c2a2e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a9a1b3d4-0c83-5288-8a3c-7d18be962e8a/a9a1b3d4-0c83-5288-8a3c-7d18be962e8a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92698,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/2b/912b0e545e46906be06c247441ab07c5/pa/SN62809_096ba4006bf432e6f6fed99bd9df570c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a9a1b3d4-0c83-5288-8a3c-7d18be962e8a/a9a1b3d4-0c83-5288-8a3c-7d18be962e8a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39459,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/2b/912b0e545e46906be06c247441ab07c5/pa/SN62809_ca82591e0b24504b1d15ee78997462fe.jpg',
             'Width': 800}],
 'postal_code': '30300',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Gard',
 'province_code': 'FR-30',
 'region': 'Occitanie',
 'region_code': 'FR-76',
 'registration_date': '2002-07-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Freelander 2.0 Td4 HSE Familiar',
 'transmission': 'manual',
 'trim': 'HSE Familiar',
 'year': 2002}
2026-04-27 08:09:23 [auto1.fr] INFO: Saving data for SN62809: {'created_time': 1777277363.056406, 'last_price_update_time': 1777277363.056416, 'has_photos': True, 'auction_closing_time': 1777388998.0}
2026-04-27 08:09:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TY72648/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:09:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:09:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YT50329> (referer: https://www.auto1.com/v1/car-details-view/YT50329/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:09:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:09:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43e6b338-6d1e-5d02-b6db-5d195da86e6c with identifier: YT50329
2026-04-27 08:09:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43e6b338-6d1e-5d02-b6db-5d195da86e6c with scrape type 1
2026-04-27 08:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 43e6b338-6d1e-5d02-b6db-5d195da86e6c
2026-04-27 08:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/ed/04ed06ed2cc4a52c91d8e8b8ed89a240/pa/YT50329_7a68dbfadc4a13894345caccce2eb76c.jpg not downloaded yet
2026-04-27 08:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/ed/04ed06ed2cc4a52c91d8e8b8ed89a240/pa/YT50329_4c6176fdaf24be3354d1aef759c8e5c5.jpg not downloaded yet
2026-04-27 08:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/ed/04ed06ed2cc4a52c91d8e8b8ed89a240/pa/YT50329_70615151e82fdca351f848b2b7006ce7.jpg not downloaded yet
2026-04-27 08:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/ed/04ed06ed2cc4a52c91d8e8b8ed89a240/pa/YT50329_fb4aba41ac1feff6dd707e5e3411c624.jpg not downloaded yet
2026-04-27 08:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/ed/04ed06ed2cc4a52c91d8e8b8ed89a240/pa/YT50329_8da7f4b42830aac2268bf8e3d2e6b170.jpg not downloaded yet
2026-04-27 08:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/ed/04ed06ed2cc4a52c91d8e8b8ed89a240/pa/YT50329_7e6ab41cb32c74106193a1e7acc19b65.jpg not downloaded yet
2026-04-27 08:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/ed/04ed06ed2cc4a52c91d8e8b8ed89a240/pa/YT50329_5c962e6d6af6def4f605d506a5841603.jpg not downloaded yet
2026-04-27 08:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/ed/04ed06ed2cc4a52c91d8e8b8ed89a240/pa/YT50329_60c9fd4ab6ef7b7854afa64e1f7ef814.jpg not downloaded yet
2026-04-27 08:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/ed/04ed06ed2cc4a52c91d8e8b8ed89a240/pa/YT50329_05980fa99dca9b7499e66e8fa04fd247.jpg not downloaded yet
2026-04-27 08:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/ed/04ed06ed2cc4a52c91d8e8b8ed89a240/pa/YT50329_9efdbd1bbb31eb113a4f71fac807927d.jpg not downloaded yet
2026-04-27 08:09:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:09:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:09:25 [auto1.fr] INFO: Channel: 24h | Page: 18 | totalHits: 4775 | hits on page: 40
2026-04-27 08:09:25 [auto1.fr] INFO: Found listing with ID: XY15688
2026-04-27 08:09:25 [auto1.fr] INFO: Found listing with ID: VE26914
2026-04-27 08:09:25 [auto1.fr] INFO: Found listing with ID: TY72648
2026-04-27 08:09:25 [auto1.fr] INFO: Found listing with ID: BK47003
2026-04-27 08:09:25 [auto1.fr] INFO: Found listing with ID: KM50585
2026-04-27 08:09:25 [auto1.fr] INFO: Scrape type for KM50585: 1
2026-04-27 08:09:25 [auto1.fr] INFO: Found listing with ID: VT02723
2026-04-27 08:09:25 [auto1.fr] INFO: Scrape type for VT02723: 1
2026-04-27 08:09:25 [auto1.fr] INFO: Found listing with ID: RY60991
2026-04-27 08:09:25 [auto1.fr] INFO: Scrape type for RY60991: 1
2026-04-27 08:09:25 [auto1.fr] INFO: Found listing with ID: ND89234
2026-04-27 08:09:25 [auto1.fr] INFO: Scrape type for ND89234: 2
2026-04-27 08:09:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6f63da9-2faa-58ce-bd47-32dc693abe94 with identifier: ND89234
2026-04-27 08:09:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6f63da9-2faa-58ce-bd47-32dc693abe94 with scrape type 2
2026-04-27 08:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c6f63da9-2faa-58ce-bd47-32dc693abe94 with scrape type 2
2026-04-27 08:09:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c6f63da9-2faa-58ce-bd47-32dc693abe94, identifier: ND89234
2026-04-27 08:09:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c6f63da9-2faa-58ce-bd47-32dc693abe94 with identifier: ND89234
2026-04-27 08:09:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c6f63da9-2faa-58ce-bd47-32dc693abe94 with identifier: ND89234
2026-04-27 08:09:26 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:09:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c6f63da9-2faa-58ce-bd47-32dc693abe94 with identifier: ND89234 to the API
2026-04-27 08:09:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:09:26 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:09:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-04-28T15:17:21Z',
 'fuel_type': 'diesel',
 'id': 'c6f63da9-2faa-58ce-bd47-32dc693abe94',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ND89234',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 187098,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2018-11-29',
 'seller_name': None,
 'title': 'Peugeot 5008 1.5 Blue-HDi Allure Business',
 'transmission': 'automatic',
 'trim': 'Allure Business',
 'year': 2018}
2026-04-27 08:09:26 [auto1.fr] INFO: Saving data for ND89234: {'auction_closing_time': 1777389441.0, 'created_time': 1777024847.922559, 'has_photos': True, 'last_price_update_time': 1777277366.25092}
2026-04-27 08:09:26 [auto1.fr] INFO: Found listing with ID: FL69972
2026-04-27 08:09:26 [auto1.fr] INFO: Scrape type for FL69972: 1
2026-04-27 08:09:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/ed/04ed06ed2cc4a52c91d8e8b8ed89a240/pa/YT50329_9efdbd1bbb31eb113a4f71fac807927d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:26 [auto1.fr] INFO: Found listing with ID: KT96622
2026-04-27 08:09:26 [auto1.fr] INFO: Scrape type for KT96622: 2
2026-04-27 08:09:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6668c901-0143-554b-a39e-a041e5d1c10d with identifier: KT96622
2026-04-27 08:09:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6668c901-0143-554b-a39e-a041e5d1c10d with scrape type 2
2026-04-27 08:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6668c901-0143-554b-a39e-a041e5d1c10d with scrape type 2
2026-04-27 08:09:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6668c901-0143-554b-a39e-a041e5d1c10d, identifier: KT96622
2026-04-27 08:09:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6668c901-0143-554b-a39e-a041e5d1c10d with identifier: KT96622
2026-04-27 08:09:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6668c901-0143-554b-a39e-a041e5d1c10d with identifier: KT96622
2026-04-27 08:09:26 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:09:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6668c901-0143-554b-a39e-a041e5d1c10d with identifier: KT96622 to the API
2026-04-27 08:09:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:09:26 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:09:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 92,
 'expiration_date': '2026-04-28T15:19:31Z',
 'fuel_type': 'diesel',
 'id': '6668c901-0143-554b-a39e-a041e5d1c10d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KT96622',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Citroen',
 'model': 'C3 Picasso',
 'odometer': 225651,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2014-08-20',
 'seller_name': None,
 'title': 'Citroen C3 Picasso 1.6 HDi Collection',
 'transmission': 'manual',
 'trim': 'Collection',
 'year': 2014}
2026-04-27 08:09:26 [auto1.fr] INFO: Saving data for KT96622: {'auction_closing_time': 1777389571.0, 'created_time': 1777017969.653082, 'has_photos': True, 'last_price_update_time': 1777277366.668266}
2026-04-27 08:09:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UL15311> (referer: https://www.auto1.com/v1/car-details-view/UL15311/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:09:26 [auto1.fr] INFO: Found listing with ID: BH82136
2026-04-27 08:09:26 [auto1.fr] INFO: Scrape type for BH82136: 1
2026-04-27 08:09:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:09:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438cb4550>
2026-04-27 08:09:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43e6b338-6d1e-5d02-b6db-5d195da86e6c/43e6b338-6d1e-5d02-b6db-5d195da86e6c_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/ed/04ed06ed2cc4a52c91d8e8b8ed89a240/pa/YT50329_9efdbd1bbb31eb113a4f71fac807927d.jpg saved to cache
2026-04-27 08:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 43e6b338-6d1e-5d02-b6db-5d195da86e6c
2026-04-27 08:09:26 [auto1.fr] INFO: Found listing with ID: VP85790
2026-04-27 08:09:26 [auto1.fr] INFO: Scrape type for VP85790: 1
2026-04-27 08:09:26 [auto1.fr] INFO: Found listing with ID: DY52645
2026-04-27 08:09:26 [auto1.fr] INFO: Scrape type for DY52645: 2
2026-04-27 08:09:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69704c73-becf-5bb4-b0fb-944a4f5de1b6 with identifier: DY52645
2026-04-27 08:09:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69704c73-becf-5bb4-b0fb-944a4f5de1b6 with scrape type 2
2026-04-27 08:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 69704c73-becf-5bb4-b0fb-944a4f5de1b6 with scrape type 2
2026-04-27 08:09:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 69704c73-becf-5bb4-b0fb-944a4f5de1b6, identifier: DY52645
2026-04-27 08:09:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 69704c73-becf-5bb4-b0fb-944a4f5de1b6 with identifier: DY52645
2026-04-27 08:09:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 69704c73-becf-5bb4-b0fb-944a4f5de1b6 with identifier: DY52645
2026-04-27 08:09:26 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:09:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 69704c73-becf-5bb4-b0fb-944a4f5de1b6 with identifier: DY52645 to the API
2026-04-27 08:09:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:09:27 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:09:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-04-28T15:18:36Z',
 'fuel_type': 'diesel',
 'id': '69704c73-becf-5bb4-b0fb-944a4f5de1b6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DY52645',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Fiat',
 'model': 'Punto Evo',
 'odometer': 222192,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2010-07-21',
 'seller_name': None,
 'title': 'Fiat Punto Evo 1.3 JTD Dynamic',
 'transmission': 'manual',
 'trim': 'Dynamic',
 'year': 2010}
2026-04-27 08:09:27 [auto1.fr] INFO: Saving data for DY52645: {'auction_closing_time': 1777389516.0, 'created_time': 1777023687.321345, 'has_photos': True, 'last_price_update_time': 1777277367.170142}
2026-04-27 08:09:27 [auto1.fr] INFO: Found listing with ID: NB55721
2026-04-27 08:09:27 [auto1.fr] INFO: Scrape type for NB55721: 1
2026-04-27 08:09:27 [auto1.fr] INFO: Found listing with ID: CJ23217
2026-04-27 08:09:27 [auto1.fr] INFO: Scrape type for CJ23217: 1
2026-04-27 08:09:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d3afceb-2f4b-549b-a16f-1332bec71b52 with identifier: UL15311
2026-04-27 08:09:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d3afceb-2f4b-549b-a16f-1332bec71b52 with scrape type 1
2026-04-27 08:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 3d3afceb-2f4b-549b-a16f-1332bec71b52
2026-04-27 08:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/88/3c885fda6716040f9cfbbada49e597dc/pa/UL15311_98ede919da32dd43c47bc8f9a947a74c.jpg not downloaded yet
2026-04-27 08:09:27 [auto1.fr] INFO: Found listing with ID: GG86597
2026-04-27 08:09:27 [auto1.fr] INFO: Scrape type for GG86597: 1
2026-04-27 08:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/88/3c885fda6716040f9cfbbada49e597dc/pa/UL15311_3ad45bb549f9bc4fb8491988cb8da119.jpg not downloaded yet
2026-04-27 08:09:27 [auto1.fr] INFO: Found listing with ID: RB61201
2026-04-27 08:09:27 [auto1.fr] INFO: Scrape type for RB61201: 1
2026-04-27 08:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/88/3c885fda6716040f9cfbbada49e597dc/pa/UL15311_5f60267bf0a7ba88dbe5ced9f9fa5e43.jpg not downloaded yet
2026-04-27 08:09:27 [auto1.fr] INFO: Found listing with ID: HX54936
2026-04-27 08:09:27 [auto1.fr] INFO: Scrape type for HX54936: 1
2026-04-27 08:09:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XP86049/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/88/3c885fda6716040f9cfbbada49e597dc/pa/UL15311_8e207875845f190ed6204ecf58db017e.jpg not downloaded yet
2026-04-27 08:09:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:09:27 [auto1.fr] INFO: Found listing with ID: XM15885
2026-04-27 08:09:27 [auto1.fr] INFO: Scrape type for XM15885: 1
2026-04-27 08:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/88/3c885fda6716040f9cfbbada49e597dc/pa/UL15311_20eba53eab2da5fcd6b8e21bf797b9cc.jpg not downloaded yet
2026-04-27 08:09:27 [auto1.fr] INFO: Found listing with ID: CA21668
2026-04-27 08:09:27 [auto1.fr] INFO: Scrape type for CA21668: 1
2026-04-27 08:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/88/3c885fda6716040f9cfbbada49e597dc/pa/UL15311_6ac7942292ffdfda00134a2f9baea0a7.jpg not downloaded yet
2026-04-27 08:09:27 [auto1.fr] INFO: Found listing with ID: FK01060
2026-04-27 08:09:27 [auto1.fr] INFO: Scrape type for FK01060: 1
2026-04-27 08:09:27 [auto1.fr] INFO: Found listing with ID: HK37982
2026-04-27 08:09:27 [auto1.fr] INFO: Scrape type for HK37982: 1
2026-04-27 08:09:27 [auto1.fr] INFO: Found listing with ID: PU18987
2026-04-27 08:09:27 [auto1.fr] INFO: Scrape type for PU18987: 1
2026-04-27 08:09:27 [auto1.fr] INFO: Found listing with ID: FJ22847
2026-04-27 08:09:27 [auto1.fr] INFO: Scrape type for FJ22847: 1
2026-04-27 08:09:27 [auto1.fr] INFO: Found listing with ID: CS29845
2026-04-27 08:09:27 [auto1.fr] INFO: Scrape type for CS29845: 2
2026-04-27 08:09:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac8cd426-35eb-5529-89a9-71b94ad66e00 with identifier: CS29845
2026-04-27 08:09:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac8cd426-35eb-5529-89a9-71b94ad66e00 with scrape type 2
2026-04-27 08:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ac8cd426-35eb-5529-89a9-71b94ad66e00 with scrape type 2
2026-04-27 08:09:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ac8cd426-35eb-5529-89a9-71b94ad66e00, identifier: CS29845
2026-04-27 08:09:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ac8cd426-35eb-5529-89a9-71b94ad66e00 with identifier: CS29845
2026-04-27 08:09:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ac8cd426-35eb-5529-89a9-71b94ad66e00 with identifier: CS29845
2026-04-27 08:09:27 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:09:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ac8cd426-35eb-5529-89a9-71b94ad66e00 with identifier: CS29845 to the API
2026-04-27 08:09:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:09:27 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:09:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-04-28T15:48:10Z',
 'fuel_type': 'petrol',
 'id': 'ac8cd426-35eb-5529-89a9-71b94ad66e00',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CS29845',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 72878,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2020-11-19',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 1.5 eTSI ACT R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2020}
2026-04-27 08:09:28 [auto1.fr] INFO: Saving data for CS29845: {'auction_closing_time': 1777391290.0, 'created_time': 1777024452.34843, 'has_photos': True, 'last_price_update_time': 1777277368.007458}
2026-04-27 08:09:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VE26914/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:09:28 [auto1.fr] INFO: Found listing with ID: YL63768
2026-04-27 08:09:28 [auto1.fr] INFO: Scrape type for YL63768: 1
2026-04-27 08:09:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:09:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/88/3c885fda6716040f9cfbbada49e597dc/pa/UL15311_5f60267bf0a7ba88dbe5ced9f9fa5e43.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:28 [auto1.fr] INFO: Found listing with ID: UF12899
2026-04-27 08:09:28 [auto1.fr] INFO: Scrape type for UF12899: 1
2026-04-27 08:09:28 [auto1.fr] INFO: Found listing with ID: MJ97326
2026-04-27 08:09:28 [auto1.fr] INFO: Scrape type for MJ97326: 1
2026-04-27 08:09:28 [auto1.fr] INFO: Found listing with ID: DR17814
2026-04-27 08:09:28 [auto1.fr] INFO: Scrape type for DR17814: 2
2026-04-27 08:09:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c2bb1cf-c3e6-5214-8699-211cb66c49b5 with identifier: DR17814
2026-04-27 08:09:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c2bb1cf-c3e6-5214-8699-211cb66c49b5 with scrape type 2
2026-04-27 08:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4c2bb1cf-c3e6-5214-8699-211cb66c49b5 with scrape type 2
2026-04-27 08:09:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4c2bb1cf-c3e6-5214-8699-211cb66c49b5, identifier: DR17814
2026-04-27 08:09:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4c2bb1cf-c3e6-5214-8699-211cb66c49b5 with identifier: DR17814
2026-04-27 08:09:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4c2bb1cf-c3e6-5214-8699-211cb66c49b5 with identifier: DR17814
2026-04-27 08:09:28 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:09:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 4c2bb1cf-c3e6-5214-8699-211cb66c49b5 with identifier: DR17814 to the API
2026-04-27 08:09:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:09:28 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:09:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-04-28T15:01:23Z',
 'fuel_type': 'diesel',
 'id': '4c2bb1cf-c3e6-5214-8699-211cb66c49b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DR17814',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Mercedes-Benz',
 'model': 'GLE-Klasse',
 'odometer': 139777,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2016-02-08',
 'seller_name': None,
 'title': 'Mercedes-Benz GLE-Klasse GLE 350 d 4Matic Exclusive',
 'transmission': 'automatic',
 'trim': '4Matic Exclusive',
 'year': 2016}
2026-04-27 08:09:28 [auto1.fr] INFO: Saving data for DR17814: {'auction_closing_time': 1777388483.0, 'created_time': 1777021409.045128, 'has_photos': True, 'last_price_update_time': 1777277368.586915}
2026-04-27 08:09:28 [auto1.fr] INFO: Found listing with ID: PP37364
2026-04-27 08:09:28 [auto1.fr] INFO: Scrape type for PP37364: 2
2026-04-27 08:09:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d299f54-3999-56dd-9b68-fd166b72c4ca with identifier: PP37364
2026-04-27 08:09:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d299f54-3999-56dd-9b68-fd166b72c4ca with scrape type 2
2026-04-27 08:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d299f54-3999-56dd-9b68-fd166b72c4ca with scrape type 2
2026-04-27 08:09:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8d299f54-3999-56dd-9b68-fd166b72c4ca, identifier: PP37364
2026-04-27 08:09:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8d299f54-3999-56dd-9b68-fd166b72c4ca with identifier: PP37364
2026-04-27 08:09:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8d299f54-3999-56dd-9b68-fd166b72c4ca with identifier: PP37364
2026-04-27 08:09:28 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:09:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 8d299f54-3999-56dd-9b68-fd166b72c4ca with identifier: PP37364 to the API
2026-04-27 08:09:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:09:28 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:09:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-04-28T15:38:24Z',
 'fuel_type': 'diesel',
 'id': '8d299f54-3999-56dd-9b68-fd166b72c4ca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PP37364',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Citroen',
 'model': 'C5',
 'odometer': 213506,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2015-05-31',
 'seller_name': None,
 'title': 'Citroen C5 2.0 HDi Exclusive',
 'transmission': 'manual',
 'trim': 'Exclusive',
 'year': 2015}
2026-04-27 08:09:29 [auto1.fr] INFO: Saving data for PP37364: {'auction_closing_time': 1777390704.0, 'created_time': 1777018985.768858, 'has_photos': True, 'last_price_update_time': 1777277369.109016}
2026-04-27 08:09:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142be0df90>
2026-04-27 08:09:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d3afceb-2f4b-549b-a16f-1332bec71b52/3d3afceb-2f4b-549b-a16f-1332bec71b52_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/88/3c885fda6716040f9cfbbada49e597dc/pa/UL15311_5f60267bf0a7ba88dbe5ced9f9fa5e43.jpg saved to cache
2026-04-27 08:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3d3afceb-2f4b-549b-a16f-1332bec71b52
2026-04-27 08:09:29 [auto1.fr] INFO: Found listing with ID: RN15222
2026-04-27 08:09:29 [auto1.fr] INFO: Scrape type for RN15222: 1
2026-04-27 08:09:29 [auto1.fr] INFO: Found listing with ID: XX57600
2026-04-27 08:09:29 [auto1.fr] INFO: Scrape type for XX57600: 1
2026-04-27 08:09:29 [auto1.fr] INFO: Found listing with ID: WH02443
2026-04-27 08:09:29 [auto1.fr] INFO: Scrape type for WH02443: 1
2026-04-27 08:09:29 [auto1.fr] INFO: Found listing with ID: YV37253
2026-04-27 08:09:29 [auto1.fr] INFO: Scrape type for YV37253: 1
2026-04-27 08:09:29 [auto1.fr] INFO: Found listing with ID: XU74860
2026-04-27 08:09:29 [auto1.fr] INFO: Scrape type for XU74860: 1
2026-04-27 08:09:29 [auto1.fr] INFO: Found listing with ID: EG39801
2026-04-27 08:09:29 [auto1.fr] INFO: Scrape type for EG39801: 1
2026-04-27 08:09:29 [auto1.fr] INFO: Found listing with ID: JL62454
2026-04-27 08:09:29 [auto1.fr] INFO: Scrape type for JL62454: 1
2026-04-27 08:09:29 [auto1.fr] INFO: Found listing with ID: ZV54610
2026-04-27 08:09:29 [auto1.fr] INFO: Scrape type for ZV54610: 2
2026-04-27 08:09:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38fb45ca-fc1d-5549-8b20-20af3103d76a with identifier: ZV54610
2026-04-27 08:09:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38fb45ca-fc1d-5549-8b20-20af3103d76a with scrape type 2
2026-04-27 08:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 38fb45ca-fc1d-5549-8b20-20af3103d76a with scrape type 2
2026-04-27 08:09:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 38fb45ca-fc1d-5549-8b20-20af3103d76a, identifier: ZV54610
2026-04-27 08:09:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 38fb45ca-fc1d-5549-8b20-20af3103d76a with identifier: ZV54610
2026-04-27 08:09:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 38fb45ca-fc1d-5549-8b20-20af3103d76a with identifier: ZV54610
2026-04-27 08:09:29 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:09:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 38fb45ca-fc1d-5549-8b20-20af3103d76a with identifier: ZV54610 to the API
2026-04-27 08:09:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:09:29 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:09:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 107,
 'expiration_date': '2026-04-28T15:37:54Z',
 'fuel_type': 'diesel',
 'id': '38fb45ca-fc1d-5549-8b20-20af3103d76a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZV54610',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 282472,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2013-10-27',
 'seller_name': None,
 'title': 'Dacia Duster 1.5 dCi Prestige Plus 4x2',
 'transmission': 'manual',
 'trim': 'Prestige Plus 4x2',
 'year': 2013}
2026-04-27 08:09:29 [auto1.fr] INFO: Saving data for ZV54610: {'auction_closing_time': 1777390674.0, 'created_time': 1777024351.437681, 'has_photos': True, 'last_price_update_time': 1777277369.662215}
2026-04-27 08:09:29 [auto1.fr] INFO: Found listing with ID: AT94183
2026-04-27 08:09:29 [auto1.fr] INFO: Scrape type for AT94183: 1
2026-04-27 08:09:29 [auto1.fr] INFO: Found listing with ID: PB17191
2026-04-27 08:09:29 [auto1.fr] INFO: Scrape type for PB17191: 1
2026-04-27 08:09:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LZ08309/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:09:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:09:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SG40218/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:09:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:09:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SV11482/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:09:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:09:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XY15688> (referer: https://www.auto1.com/v1/car-details-view/XY15688/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:09:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:09:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf60747a-d795-5cc3-b10a-4800606a6026 with identifier: XY15688
2026-04-27 08:09:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf60747a-d795-5cc3-b10a-4800606a6026 with scrape type 1
2026-04-27 08:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bf60747a-d795-5cc3-b10a-4800606a6026
2026-04-27 08:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/b4/c2b457c3a5adb2093e8a81b65a7f0a53/pa/XY15688_5bb3fd44dcec155dff39b0d53bfd8b29.jpg not downloaded yet
2026-04-27 08:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/b4/c2b457c3a5adb2093e8a81b65a7f0a53/pa/XY15688_badacaa4686e59f9910c3ce921848784.jpg not downloaded yet
2026-04-27 08:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/b4/c2b457c3a5adb2093e8a81b65a7f0a53/pa/XY15688_05ff8b5d0e85b5313be3284771559ae3.jpg not downloaded yet
2026-04-27 08:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/b4/c2b457c3a5adb2093e8a81b65a7f0a53/pa/XY15688_13789846dc6b20906116d11acee94389.jpg not downloaded yet
2026-04-27 08:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/b4/c2b457c3a5adb2093e8a81b65a7f0a53/pa/XY15688_e1e85d1f18ea5158e23ac7f23d477676.jpg not downloaded yet
2026-04-27 08:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/b4/c2b457c3a5adb2093e8a81b65a7f0a53/pa/XY15688_1bf79ae2f45c332446218aaa892ade3b.jpg not downloaded yet
2026-04-27 08:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/b4/c2b457c3a5adb2093e8a81b65a7f0a53/pa/XY15688_d8466ec8c47925e465cc77eb204d8179.jpg not downloaded yet
2026-04-27 08:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/b4/c2b457c3a5adb2093e8a81b65a7f0a53/pa/XY15688_906c566f1628ddd97215f413f27c666e.jpg not downloaded yet
2026-04-27 08:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/b4/c2b457c3a5adb2093e8a81b65a7f0a53/pa/XY15688_3f1f88a14de06731df5c2f282094fc85.jpg not downloaded yet
2026-04-27 08:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/b4/c2b457c3a5adb2093e8a81b65a7f0a53/pa/XY15688_eb75e1cfc7795f3daf31c7fda38ba844.jpg not downloaded yet
2026-04-27 08:09:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PA65311> (referer: https://www.auto1.com/v1/car-details-view/PA65311/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:09:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:09:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f885f3b8-5862-550a-9c41-82b20d014013 with identifier: PA65311
2026-04-27 08:09:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f885f3b8-5862-550a-9c41-82b20d014013 with scrape type 1
2026-04-27 08:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f885f3b8-5862-550a-9c41-82b20d014013
2026-04-27 08:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/80/98800cf5b2d407b018028c566392e019/pa/PA65311_2f070f4748ecc33a363c588163ea5cf3.jpg not downloaded yet
2026-04-27 08:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/80/98800cf5b2d407b018028c566392e019/pa/PA65311_50a49d3e4a60113b73237b5718f63d5b.jpg not downloaded yet
2026-04-27 08:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/80/98800cf5b2d407b018028c566392e019/pa/PA65311_4979fc9e685d50f5776747cbe7e3b87f.jpg not downloaded yet
2026-04-27 08:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/80/98800cf5b2d407b018028c566392e019/pa/PA65311_965fa836dc30e69956519616dd0e9227.jpg not downloaded yet
2026-04-27 08:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/80/98800cf5b2d407b018028c566392e019/pa/PA65311_7e20e29fb9c1fea6eb1d41da1485e831.jpg not downloaded yet
2026-04-27 08:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/80/98800cf5b2d407b018028c566392e019/pa/PA65311_fa2e3f01045d7fb75330bb6c107da74d.jpg not downloaded yet
2026-04-27 08:09:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/b4/c2b457c3a5adb2093e8a81b65a7f0a53/pa/XY15688_eb75e1cfc7795f3daf31c7fda38ba844.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/80/98800cf5b2d407b018028c566392e019/pa/PA65311_68ec8b830730bbe6849895e66fab848e.jpg not downloaded yet
2026-04-27 08:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/80/98800cf5b2d407b018028c566392e019/pa/PA65311_6b6e8ba2afc26edbcad960c98c96f9ef.jpg not downloaded yet
2026-04-27 08:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/80/98800cf5b2d407b018028c566392e019/pa/PA65311_be05dce3ecab2899e8c7556cd640a4e3.jpg not downloaded yet
2026-04-27 08:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/80/98800cf5b2d407b018028c566392e019/pa/PA65311_1a41edca2693937d69c9139545da78f4.jpg not downloaded yet
2026-04-27 08:09:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438026cd0>
2026-04-27 08:09:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf60747a-d795-5cc3-b10a-4800606a6026/bf60747a-d795-5cc3-b10a-4800606a6026_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/b4/c2b457c3a5adb2093e8a81b65a7f0a53/pa/XY15688_eb75e1cfc7795f3daf31c7fda38ba844.jpg saved to cache
2026-04-27 08:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bf60747a-d795-5cc3-b10a-4800606a6026
2026-04-27 08:09:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/80/98800cf5b2d407b018028c566392e019/pa/PA65311_fa2e3f01045d7fb75330bb6c107da74d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438eb5590>
2026-04-27 08:09:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f885f3b8-5862-550a-9c41-82b20d014013/f885f3b8-5862-550a-9c41-82b20d014013_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/80/98800cf5b2d407b018028c566392e019/pa/PA65311_fa2e3f01045d7fb75330bb6c107da74d.jpg saved to cache
2026-04-27 08:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f885f3b8-5862-550a-9c41-82b20d014013
2026-04-27 08:09:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/80/98800cf5b2d407b018028c566392e019/pa/PA65311_1a41edca2693937d69c9139545da78f4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/80/98800cf5b2d407b018028c566392e019/pa/PA65311_be05dce3ecab2899e8c7556cd640a4e3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/80/98800cf5b2d407b018028c566392e019/pa/PA65311_6b6e8ba2afc26edbcad960c98c96f9ef.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c2abd0>
2026-04-27 08:09:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f885f3b8-5862-550a-9c41-82b20d014013/f885f3b8-5862-550a-9c41-82b20d014013_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/80/98800cf5b2d407b018028c566392e019/pa/PA65311_1a41edca2693937d69c9139545da78f4.jpg saved to cache
2026-04-27 08:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f885f3b8-5862-550a-9c41-82b20d014013
2026-04-27 08:09:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143818a190>
2026-04-27 08:09:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f885f3b8-5862-550a-9c41-82b20d014013/f885f3b8-5862-550a-9c41-82b20d014013_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/80/98800cf5b2d407b018028c566392e019/pa/PA65311_be05dce3ecab2899e8c7556cd640a4e3.jpg saved to cache
2026-04-27 08:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f885f3b8-5862-550a-9c41-82b20d014013
2026-04-27 08:09:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d2d450>
2026-04-27 08:09:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f885f3b8-5862-550a-9c41-82b20d014013/f885f3b8-5862-550a-9c41-82b20d014013_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/80/98800cf5b2d407b018028c566392e019/pa/PA65311_6b6e8ba2afc26edbcad960c98c96f9ef.jpg saved to cache
2026-04-27 08:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f885f3b8-5862-550a-9c41-82b20d014013
2026-04-27 08:09:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/80/98800cf5b2d407b018028c566392e019/pa/PA65311_68ec8b830730bbe6849895e66fab848e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438024d90>
2026-04-27 08:09:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f885f3b8-5862-550a-9c41-82b20d014013/f885f3b8-5862-550a-9c41-82b20d014013_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/80/98800cf5b2d407b018028c566392e019/pa/PA65311_68ec8b830730bbe6849895e66fab848e.jpg saved to cache
2026-04-27 08:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f885f3b8-5862-550a-9c41-82b20d014013
2026-04-27 08:09:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/80/98800cf5b2d407b018028c566392e019/pa/PA65311_7e20e29fb9c1fea6eb1d41da1485e831.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/80/98800cf5b2d407b018028c566392e019/pa/PA65311_965fa836dc30e69956519616dd0e9227.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a60450>
2026-04-27 08:09:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f885f3b8-5862-550a-9c41-82b20d014013/f885f3b8-5862-550a-9c41-82b20d014013_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/80/98800cf5b2d407b018028c566392e019/pa/PA65311_7e20e29fb9c1fea6eb1d41da1485e831.jpg saved to cache
2026-04-27 08:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f885f3b8-5862-550a-9c41-82b20d014013
2026-04-27 08:09:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c39d10>
2026-04-27 08:09:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f885f3b8-5862-550a-9c41-82b20d014013/f885f3b8-5862-550a-9c41-82b20d014013_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/80/98800cf5b2d407b018028c566392e019/pa/PA65311_965fa836dc30e69956519616dd0e9227.jpg saved to cache
2026-04-27 08:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f885f3b8-5862-550a-9c41-82b20d014013
2026-04-27 08:09:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/80/98800cf5b2d407b018028c566392e019/pa/PA65311_4979fc9e685d50f5776747cbe7e3b87f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/80/98800cf5b2d407b018028c566392e019/pa/PA65311_50a49d3e4a60113b73237b5718f63d5b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/80/98800cf5b2d407b018028c566392e019/pa/PA65311_2f070f4748ecc33a363c588163ea5cf3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438fb9c10>
2026-04-27 08:09:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f885f3b8-5862-550a-9c41-82b20d014013/f885f3b8-5862-550a-9c41-82b20d014013_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/80/98800cf5b2d407b018028c566392e019/pa/PA65311_4979fc9e685d50f5776747cbe7e3b87f.jpg saved to cache
2026-04-27 08:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f885f3b8-5862-550a-9c41-82b20d014013
2026-04-27 08:09:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/b4/c2b457c3a5adb2093e8a81b65a7f0a53/pa/XY15688_3f1f88a14de06731df5c2f282094fc85.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d91910>
2026-04-27 08:09:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f885f3b8-5862-550a-9c41-82b20d014013/f885f3b8-5862-550a-9c41-82b20d014013_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/80/98800cf5b2d407b018028c566392e019/pa/PA65311_50a49d3e4a60113b73237b5718f63d5b.jpg saved to cache
2026-04-27 08:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f885f3b8-5862-550a-9c41-82b20d014013
2026-04-27 08:09:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/b4/c2b457c3a5adb2093e8a81b65a7f0a53/pa/XY15688_906c566f1628ddd97215f413f27c666e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438e17b10>
2026-04-27 08:09:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f885f3b8-5862-550a-9c41-82b20d014013/f885f3b8-5862-550a-9c41-82b20d014013_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/80/98800cf5b2d407b018028c566392e019/pa/PA65311_2f070f4748ecc33a363c588163ea5cf3.jpg saved to cache
2026-04-27 08:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f885f3b8-5862-550a-9c41-82b20d014013
2026-04-27 08:09:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f885f3b8-5862-550a-9c41-82b20d014013, skipping ID generation
2026-04-27 08:09:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f885f3b8-5862-550a-9c41-82b20d014013 with scrape type 1
2026-04-27 08:09:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f885f3b8-5862-550a-9c41-82b20d014013 sending to next pipeline
2026-04-27 08:09:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f885f3b8-5862-550a-9c41-82b20d014013, identifier: PA65311
2026-04-27 08:09:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f885f3b8-5862-550a-9c41-82b20d014013 with identifier: PA65311
2026-04-27 08:09:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f885f3b8-5862-550a-9c41-82b20d014013 with identifier: PA65311
2026-04-27 08:09:57 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:09:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f885f3b8-5862-550a-9c41-82b20d014013 with identifier: PA65311 to the API
2026-04-27 08:09:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:09:57 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:09:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img98/80/98800cf5b2d407b018028c566392e019/pa/PA65311_2f070f4748ecc33a363c588163ea5cf3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'category': None,
 'city': 'Beaucaire',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 90,
 'expiration_date': '2026-04-28T15:47:12Z',
 'fuel_type': 'diesel',
 'id': 'f885f3b8-5862-550a-9c41-82b20d014013',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 43.8081,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PA65311',
 'listing': 'auction',
 'location': 'FR, Beaucaire',
 'location_confidence': 'geocoded',
 'longitude': 4.6442,
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 148251,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f885f3b8-5862-550a-9c41-82b20d014013/f885f3b8-5862-550a-9c41-82b20d014013_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79923,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/80/98800cf5b2d407b018028c566392e019/pa/PA65311_2f070f4748ecc33a363c588163ea5cf3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f885f3b8-5862-550a-9c41-82b20d014013/f885f3b8-5862-550a-9c41-82b20d014013_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81053,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/80/98800cf5b2d407b018028c566392e019/pa/PA65311_50a49d3e4a60113b73237b5718f63d5b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f885f3b8-5862-550a-9c41-82b20d014013/f885f3b8-5862-550a-9c41-82b20d014013_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76846,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/80/98800cf5b2d407b018028c566392e019/pa/PA65311_4979fc9e685d50f5776747cbe7e3b87f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f885f3b8-5862-550a-9c41-82b20d014013/f885f3b8-5862-550a-9c41-82b20d014013_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54713,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/80/98800cf5b2d407b018028c566392e019/pa/PA65311_965fa836dc30e69956519616dd0e9227.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f885f3b8-5862-550a-9c41-82b20d014013/f885f3b8-5862-550a-9c41-82b20d014013_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68945,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/80/98800cf5b2d407b018028c566392e019/pa/PA65311_7e20e29fb9c1fea6eb1d41da1485e831.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f885f3b8-5862-550a-9c41-82b20d014013/f885f3b8-5862-550a-9c41-82b20d014013_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72805,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/80/98800cf5b2d407b018028c566392e019/pa/PA65311_fa2e3f01045d7fb75330bb6c107da74d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f885f3b8-5862-550a-9c41-82b20d014013/f885f3b8-5862-550a-9c41-82b20d014013_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63543,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/80/98800cf5b2d407b018028c566392e019/pa/PA65311_68ec8b830730bbe6849895e66fab848e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f885f3b8-5862-550a-9c41-82b20d014013/f885f3b8-5862-550a-9c41-82b20d014013_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69340,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/80/98800cf5b2d407b018028c566392e019/pa/PA65311_6b6e8ba2afc26edbcad960c98c96f9ef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f885f3b8-5862-550a-9c41-82b20d014013/f885f3b8-5862-550a-9c41-82b20d014013_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70520,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/80/98800cf5b2d407b018028c566392e019/pa/PA65311_be05dce3ecab2899e8c7556cd640a4e3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f885f3b8-5862-550a-9c41-82b20d014013/f885f3b8-5862-550a-9c41-82b20d014013_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68667,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/80/98800cf5b2d407b018028c566392e019/pa/PA65311_1a41edca2693937d69c9139545da78f4.jpg',
             'Width': 800}],
 'postal_code': '30300',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Gard',
 'province_code': 'FR-30',
 'region': 'Occitanie',
 'region_code': 'FR-76',
 'registration_date': '2016-02-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Captur 1.5 dCi Energy Business',
 'transmission': 'automatic',
 'trim': 'Business',
 'year': 2016}
2026-04-27 08:09:57 [auto1.fr] INFO: Saving data for PA65311: {'created_time': 1777277397.958576, 'last_price_update_time': 1777277397.958586, 'has_photos': True, 'auction_closing_time': 1777391232.0}
2026-04-27 08:09:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/b4/c2b457c3a5adb2093e8a81b65a7f0a53/pa/XY15688_d8466ec8c47925e465cc77eb204d8179.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438189790>
2026-04-27 08:09:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf60747a-d795-5cc3-b10a-4800606a6026/bf60747a-d795-5cc3-b10a-4800606a6026_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/b4/c2b457c3a5adb2093e8a81b65a7f0a53/pa/XY15688_3f1f88a14de06731df5c2f282094fc85.jpg saved to cache
2026-04-27 08:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bf60747a-d795-5cc3-b10a-4800606a6026
2026-04-27 08:09:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438fb8810>
2026-04-27 08:09:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf60747a-d795-5cc3-b10a-4800606a6026/bf60747a-d795-5cc3-b10a-4800606a6026_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/b4/c2b457c3a5adb2093e8a81b65a7f0a53/pa/XY15688_906c566f1628ddd97215f413f27c666e.jpg saved to cache
2026-04-27 08:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bf60747a-d795-5cc3-b10a-4800606a6026
2026-04-27 08:09:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f144751d150>
2026-04-27 08:09:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf60747a-d795-5cc3-b10a-4800606a6026/bf60747a-d795-5cc3-b10a-4800606a6026_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/b4/c2b457c3a5adb2093e8a81b65a7f0a53/pa/XY15688_d8466ec8c47925e465cc77eb204d8179.jpg saved to cache
2026-04-27 08:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bf60747a-d795-5cc3-b10a-4800606a6026
2026-04-27 08:09:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/b4/c2b457c3a5adb2093e8a81b65a7f0a53/pa/XY15688_1bf79ae2f45c332446218aaa892ade3b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380a7910>
2026-04-27 08:09:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf60747a-d795-5cc3-b10a-4800606a6026/bf60747a-d795-5cc3-b10a-4800606a6026_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/b4/c2b457c3a5adb2093e8a81b65a7f0a53/pa/XY15688_1bf79ae2f45c332446218aaa892ade3b.jpg saved to cache
2026-04-27 08:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bf60747a-d795-5cc3-b10a-4800606a6026
2026-04-27 08:09:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/b4/c2b457c3a5adb2093e8a81b65a7f0a53/pa/XY15688_e1e85d1f18ea5158e23ac7f23d477676.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438188890>
2026-04-27 08:09:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf60747a-d795-5cc3-b10a-4800606a6026/bf60747a-d795-5cc3-b10a-4800606a6026_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/b4/c2b457c3a5adb2093e8a81b65a7f0a53/pa/XY15688_e1e85d1f18ea5158e23ac7f23d477676.jpg saved to cache
2026-04-27 08:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bf60747a-d795-5cc3-b10a-4800606a6026
2026-04-27 08:09:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/b4/c2b457c3a5adb2093e8a81b65a7f0a53/pa/XY15688_13789846dc6b20906116d11acee94389.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d2ec10>
2026-04-27 08:09:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf60747a-d795-5cc3-b10a-4800606a6026/bf60747a-d795-5cc3-b10a-4800606a6026_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/b4/c2b457c3a5adb2093e8a81b65a7f0a53/pa/XY15688_13789846dc6b20906116d11acee94389.jpg saved to cache
2026-04-27 08:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bf60747a-d795-5cc3-b10a-4800606a6026
2026-04-27 08:09:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/b4/c2b457c3a5adb2093e8a81b65a7f0a53/pa/XY15688_05ff8b5d0e85b5313be3284771559ae3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/b4/c2b457c3a5adb2093e8a81b65a7f0a53/pa/XY15688_badacaa4686e59f9910c3ce921848784.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/b4/c2b457c3a5adb2093e8a81b65a7f0a53/pa/XY15688_5bb3fd44dcec155dff39b0d53bfd8b29.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c9b610>
2026-04-27 08:09:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf60747a-d795-5cc3-b10a-4800606a6026/bf60747a-d795-5cc3-b10a-4800606a6026_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/b4/c2b457c3a5adb2093e8a81b65a7f0a53/pa/XY15688_05ff8b5d0e85b5313be3284771559ae3.jpg saved to cache
2026-04-27 08:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bf60747a-d795-5cc3-b10a-4800606a6026
2026-04-27 08:09:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14381c9e50>
2026-04-27 08:09:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf60747a-d795-5cc3-b10a-4800606a6026/bf60747a-d795-5cc3-b10a-4800606a6026_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/b4/c2b457c3a5adb2093e8a81b65a7f0a53/pa/XY15688_badacaa4686e59f9910c3ce921848784.jpg saved to cache
2026-04-27 08:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bf60747a-d795-5cc3-b10a-4800606a6026
2026-04-27 08:09:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438f90510>
2026-04-27 08:09:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf60747a-d795-5cc3-b10a-4800606a6026/bf60747a-d795-5cc3-b10a-4800606a6026_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/b4/c2b457c3a5adb2093e8a81b65a7f0a53/pa/XY15688_5bb3fd44dcec155dff39b0d53bfd8b29.jpg saved to cache
2026-04-27 08:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bf60747a-d795-5cc3-b10a-4800606a6026
2026-04-27 08:09:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bf60747a-d795-5cc3-b10a-4800606a6026, skipping ID generation
2026-04-27 08:09:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf60747a-d795-5cc3-b10a-4800606a6026 with scrape type 1
2026-04-27 08:09:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bf60747a-d795-5cc3-b10a-4800606a6026 sending to next pipeline
2026-04-27 08:09:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: bf60747a-d795-5cc3-b10a-4800606a6026, identifier: XY15688
2026-04-27 08:09:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: bf60747a-d795-5cc3-b10a-4800606a6026 with identifier: XY15688
2026-04-27 08:09:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: bf60747a-d795-5cc3-b10a-4800606a6026 with identifier: XY15688
2026-04-27 08:09:59 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:09:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: bf60747a-d795-5cc3-b10a-4800606a6026 with identifier: XY15688 to the API
2026-04-27 08:09:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:09:59 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:09:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc2/b4/c2b457c3a5adb2093e8a81b65a7f0a53/pa/XY15688_5bb3fd44dcec155dff39b0d53bfd8b29.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 95,
 'category': None,
 'city': 'Marseille',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 90,
 'expiration_date': '2026-04-28T15:27:22Z',
 'fuel_type': 'diesel',
 'id': 'bf60747a-d795-5cc3-b10a-4800606a6026',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 43.2969,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XY15688',
 'listing': 'auction',
 'location': 'FR, Marseille',
 'location_confidence': 'geocoded',
 'longitude': 5.3811,
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 135511,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bf60747a-d795-5cc3-b10a-4800606a6026/bf60747a-d795-5cc3-b10a-4800606a6026_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59358,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/b4/c2b457c3a5adb2093e8a81b65a7f0a53/pa/XY15688_5bb3fd44dcec155dff39b0d53bfd8b29.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bf60747a-d795-5cc3-b10a-4800606a6026/bf60747a-d795-5cc3-b10a-4800606a6026_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55182,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/b4/c2b457c3a5adb2093e8a81b65a7f0a53/pa/XY15688_badacaa4686e59f9910c3ce921848784.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bf60747a-d795-5cc3-b10a-4800606a6026/bf60747a-d795-5cc3-b10a-4800606a6026_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58036,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/b4/c2b457c3a5adb2093e8a81b65a7f0a53/pa/XY15688_05ff8b5d0e85b5313be3284771559ae3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bf60747a-d795-5cc3-b10a-4800606a6026/bf60747a-d795-5cc3-b10a-4800606a6026_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55615,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/b4/c2b457c3a5adb2093e8a81b65a7f0a53/pa/XY15688_13789846dc6b20906116d11acee94389.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bf60747a-d795-5cc3-b10a-4800606a6026/bf60747a-d795-5cc3-b10a-4800606a6026_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52982,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/b4/c2b457c3a5adb2093e8a81b65a7f0a53/pa/XY15688_e1e85d1f18ea5158e23ac7f23d477676.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bf60747a-d795-5cc3-b10a-4800606a6026/bf60747a-d795-5cc3-b10a-4800606a6026_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63033,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/b4/c2b457c3a5adb2093e8a81b65a7f0a53/pa/XY15688_1bf79ae2f45c332446218aaa892ade3b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bf60747a-d795-5cc3-b10a-4800606a6026/bf60747a-d795-5cc3-b10a-4800606a6026_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54372,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/b4/c2b457c3a5adb2093e8a81b65a7f0a53/pa/XY15688_d8466ec8c47925e465cc77eb204d8179.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bf60747a-d795-5cc3-b10a-4800606a6026/bf60747a-d795-5cc3-b10a-4800606a6026_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59433,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/b4/c2b457c3a5adb2093e8a81b65a7f0a53/pa/XY15688_906c566f1628ddd97215f413f27c666e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bf60747a-d795-5cc3-b10a-4800606a6026/bf60747a-d795-5cc3-b10a-4800606a6026_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60402,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/b4/c2b457c3a5adb2093e8a81b65a7f0a53/pa/XY15688_3f1f88a14de06731df5c2f282094fc85.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bf60747a-d795-5cc3-b10a-4800606a6026/bf60747a-d795-5cc3-b10a-4800606a6026_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52426,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/b4/c2b457c3a5adb2093e8a81b65a7f0a53/pa/XY15688_eb75e1cfc7795f3daf31c7fda38ba844.jpg',
             'Width': 800}],
 'postal_code': '13000',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Bouches-du-Rhône',
 'province_code': 'FR-13',
 'region': "Provence-Alpes-Côte d'Azur",
 'region_code': 'FR-93',
 'registration_date': '2017-05-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Captur 1.5 dCi Energy Intens',
 'transmission': 'manual',
 'trim': 'Intens',
 'year': 2017}
2026-04-27 08:09:59 [auto1.fr] INFO: Saving data for XY15688: {'created_time': 1777277399.333881, 'last_price_update_time': 1777277399.333893, 'has_photos': True, 'auction_closing_time': 1777390042.0}
2026-04-27 08:09:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TH45766> (referer: https://www.auto1.com/v1/car-details-view/TH45766/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:09:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:09:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a0ea292-f8d0-5a35-8b5c-192442b0d509 with identifier: TH45766
2026-04-27 08:09:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a0ea292-f8d0-5a35-8b5c-192442b0d509 with scrape type 1
2026-04-27 08:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2a0ea292-f8d0-5a35-8b5c-192442b0d509
2026-04-27 08:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/b1/9cb1fab098a1e4d89337650ae38b801f/pa/TH45766_fa0d97412ee5f163b5d14b54d9a384a7.jpg not downloaded yet
2026-04-27 08:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/b1/9cb1fab098a1e4d89337650ae38b801f/pa/TH45766_5e5551f279d3811ce9f0edc80e691b8d.jpg not downloaded yet
2026-04-27 08:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/b1/9cb1fab098a1e4d89337650ae38b801f/pa/TH45766_0e14355f4339081bb5c6fc5003deca9d.jpg not downloaded yet
2026-04-27 08:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/b1/9cb1fab098a1e4d89337650ae38b801f/pa/TH45766_2d7c1dad5bf824d72e819ce2dac50e97.jpg not downloaded yet
2026-04-27 08:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/b1/9cb1fab098a1e4d89337650ae38b801f/pa/TH45766_171b5118f48ec09a604397a045a0acd1.jpg not downloaded yet
2026-04-27 08:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/b1/9cb1fab098a1e4d89337650ae38b801f/pa/TH45766_0f409a7a1d5e702e199fd3f7f1948d8e.jpg not downloaded yet
2026-04-27 08:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/b1/9cb1fab098a1e4d89337650ae38b801f/pa/TH45766_fe1c0f3cccf5fdc44629727c618086b3.jpg not downloaded yet
2026-04-27 08:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/b1/9cb1fab098a1e4d89337650ae38b801f/pa/TH45766_4ee372f1f83cf9927c302295535a2cd6.jpg not downloaded yet
2026-04-27 08:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/b1/9cb1fab098a1e4d89337650ae38b801f/pa/TH45766_bc0c6892c583557c1e3e6d04796eca70.jpg not downloaded yet
2026-04-27 08:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/b1/9cb1fab098a1e4d89337650ae38b801f/pa/TH45766_86890b174c263babe6ebedb7b6f24f7f.jpg not downloaded yet
2026-04-27 08:09:59 [scrapy.extensions.logstats] INFO: Crawled 513 pages (at 27 pages/min), scraped 452 items (at 17 items/min)
2026-04-27 08:09:59 [scrapy.extensions.memusage] INFO: Peak memory usage is 373MiB
2026-04-27 08:10:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FL69972/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:10:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:10:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/b1/9cb1fab098a1e4d89337650ae38b801f/pa/TH45766_86890b174c263babe6ebedb7b6f24f7f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/b1/9cb1fab098a1e4d89337650ae38b801f/pa/TH45766_bc0c6892c583557c1e3e6d04796eca70.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438045650>
2026-04-27 08:10:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a0ea292-f8d0-5a35-8b5c-192442b0d509/2a0ea292-f8d0-5a35-8b5c-192442b0d509_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:10:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/b1/9cb1fab098a1e4d89337650ae38b801f/pa/TH45766_86890b174c263babe6ebedb7b6f24f7f.jpg saved to cache
2026-04-27 08:10:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2a0ea292-f8d0-5a35-8b5c-192442b0d509
2026-04-27 08:10:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c98e50>
2026-04-27 08:10:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a0ea292-f8d0-5a35-8b5c-192442b0d509/2a0ea292-f8d0-5a35-8b5c-192442b0d509_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:10:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/b1/9cb1fab098a1e4d89337650ae38b801f/pa/TH45766_bc0c6892c583557c1e3e6d04796eca70.jpg saved to cache
2026-04-27 08:10:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2a0ea292-f8d0-5a35-8b5c-192442b0d509
2026-04-27 08:10:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RY60991/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:10:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:10:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/b1/9cb1fab098a1e4d89337650ae38b801f/pa/TH45766_4ee372f1f83cf9927c302295535a2cd6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/b1/9cb1fab098a1e4d89337650ae38b801f/pa/TH45766_fe1c0f3cccf5fdc44629727c618086b3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438180290>
2026-04-27 08:10:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a0ea292-f8d0-5a35-8b5c-192442b0d509/2a0ea292-f8d0-5a35-8b5c-192442b0d509_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/b1/9cb1fab098a1e4d89337650ae38b801f/pa/TH45766_4ee372f1f83cf9927c302295535a2cd6.jpg saved to cache
2026-04-27 08:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2a0ea292-f8d0-5a35-8b5c-192442b0d509
2026-04-27 08:10:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bffd7d0>
2026-04-27 08:10:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a0ea292-f8d0-5a35-8b5c-192442b0d509/2a0ea292-f8d0-5a35-8b5c-192442b0d509_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/b1/9cb1fab098a1e4d89337650ae38b801f/pa/TH45766_fe1c0f3cccf5fdc44629727c618086b3.jpg saved to cache
2026-04-27 08:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2a0ea292-f8d0-5a35-8b5c-192442b0d509
2026-04-27 08:10:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FJ22847/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:10:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:10:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/b1/9cb1fab098a1e4d89337650ae38b801f/pa/TH45766_0f409a7a1d5e702e199fd3f7f1948d8e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/b1/9cb1fab098a1e4d89337650ae38b801f/pa/TH45766_171b5118f48ec09a604397a045a0acd1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ce9850>
2026-04-27 08:10:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a0ea292-f8d0-5a35-8b5c-192442b0d509/2a0ea292-f8d0-5a35-8b5c-192442b0d509_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:10:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/b1/9cb1fab098a1e4d89337650ae38b801f/pa/TH45766_0f409a7a1d5e702e199fd3f7f1948d8e.jpg saved to cache
2026-04-27 08:10:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2a0ea292-f8d0-5a35-8b5c-192442b0d509
2026-04-27 08:10:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d93b90>
2026-04-27 08:10:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a0ea292-f8d0-5a35-8b5c-192442b0d509/2a0ea292-f8d0-5a35-8b5c-192442b0d509_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:10:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/b1/9cb1fab098a1e4d89337650ae38b801f/pa/TH45766_171b5118f48ec09a604397a045a0acd1.jpg saved to cache
2026-04-27 08:10:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2a0ea292-f8d0-5a35-8b5c-192442b0d509
2026-04-27 08:10:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YL63768/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:10:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:10:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/b1/9cb1fab098a1e4d89337650ae38b801f/pa/TH45766_2d7c1dad5bf824d72e819ce2dac50e97.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c39590>
2026-04-27 08:10:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a0ea292-f8d0-5a35-8b5c-192442b0d509/2a0ea292-f8d0-5a35-8b5c-192442b0d509_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:10:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/b1/9cb1fab098a1e4d89337650ae38b801f/pa/TH45766_2d7c1dad5bf824d72e819ce2dac50e97.jpg saved to cache
2026-04-27 08:10:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2a0ea292-f8d0-5a35-8b5c-192442b0d509
2026-04-27 08:10:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/b1/9cb1fab098a1e4d89337650ae38b801f/pa/TH45766_0e14355f4339081bb5c6fc5003deca9d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d2dd90>
2026-04-27 08:10:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a0ea292-f8d0-5a35-8b5c-192442b0d509/2a0ea292-f8d0-5a35-8b5c-192442b0d509_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:10:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/b1/9cb1fab098a1e4d89337650ae38b801f/pa/TH45766_0e14355f4339081bb5c6fc5003deca9d.jpg saved to cache
2026-04-27 08:10:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2a0ea292-f8d0-5a35-8b5c-192442b0d509
2026-04-27 08:10:15 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 265.540(s), this was the 2nd time calling it.
2026-04-27 08:10:15 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 8.224388755050875 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:10:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LZ08309> (referer: https://www.auto1.com/v1/car-details-view/LZ08309/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:10:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:10:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9fbae3a0-ca30-5eaf-9518-875297e18ba7 with identifier: LZ08309
2026-04-27 08:10:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9fbae3a0-ca30-5eaf-9518-875297e18ba7 with scrape type 1
2026-04-27 08:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 9fbae3a0-ca30-5eaf-9518-875297e18ba7
2026-04-27 08:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/37/5c37eee2cec6fa5112485d4dc9d9e01e/pa/LZ08309_672f2cf2f79fe8d6ecb94bf27d732517.jpg not downloaded yet
2026-04-27 08:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/37/5c37eee2cec6fa5112485d4dc9d9e01e/pa/LZ08309_e0be4ccbbf249c5602494bef735a61c3.jpg not downloaded yet
2026-04-27 08:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/37/5c37eee2cec6fa5112485d4dc9d9e01e/pa/LZ08309_ce032a473db1fe9e8631a8cd560598cb.jpg not downloaded yet
2026-04-27 08:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/37/5c37eee2cec6fa5112485d4dc9d9e01e/pa/LZ08309_2978080e6d8947b52ceeddebff53a8cf.jpg not downloaded yet
2026-04-27 08:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/37/5c37eee2cec6fa5112485d4dc9d9e01e/pa/LZ08309_9e837c1b68441981aa2ebd2cf61ce997.jpg not downloaded yet
2026-04-27 08:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/37/5c37eee2cec6fa5112485d4dc9d9e01e/pa/LZ08309_716e2cec61ed28ff7af1947ca34e1c3e.jpg not downloaded yet
2026-04-27 08:10:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/b1/9cb1fab098a1e4d89337650ae38b801f/pa/TH45766_5e5551f279d3811ce9f0edc80e691b8d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c9a690>
2026-04-27 08:10:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a0ea292-f8d0-5a35-8b5c-192442b0d509/2a0ea292-f8d0-5a35-8b5c-192442b0d509_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/b1/9cb1fab098a1e4d89337650ae38b801f/pa/TH45766_5e5551f279d3811ce9f0edc80e691b8d.jpg saved to cache
2026-04-27 08:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2a0ea292-f8d0-5a35-8b5c-192442b0d509
2026-04-27 08:10:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/37/5c37eee2cec6fa5112485d4dc9d9e01e/pa/LZ08309_716e2cec61ed28ff7af1947ca34e1c3e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438eb7890>
2026-04-27 08:10:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9fbae3a0-ca30-5eaf-9518-875297e18ba7/9fbae3a0-ca30-5eaf-9518-875297e18ba7_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/37/5c37eee2cec6fa5112485d4dc9d9e01e/pa/LZ08309_716e2cec61ed28ff7af1947ca34e1c3e.jpg saved to cache
2026-04-27 08:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9fbae3a0-ca30-5eaf-9518-875297e18ba7
2026-04-27 08:10:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/37/5c37eee2cec6fa5112485d4dc9d9e01e/pa/LZ08309_9e837c1b68441981aa2ebd2cf61ce997.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438fb4990>
2026-04-27 08:10:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9fbae3a0-ca30-5eaf-9518-875297e18ba7/9fbae3a0-ca30-5eaf-9518-875297e18ba7_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/37/5c37eee2cec6fa5112485d4dc9d9e01e/pa/LZ08309_9e837c1b68441981aa2ebd2cf61ce997.jpg saved to cache
2026-04-27 08:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9fbae3a0-ca30-5eaf-9518-875297e18ba7
2026-04-27 08:10:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/37/5c37eee2cec6fa5112485d4dc9d9e01e/pa/LZ08309_2978080e6d8947b52ceeddebff53a8cf.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143820fe50>
2026-04-27 08:10:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9fbae3a0-ca30-5eaf-9518-875297e18ba7/9fbae3a0-ca30-5eaf-9518-875297e18ba7_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/37/5c37eee2cec6fa5112485d4dc9d9e01e/pa/LZ08309_2978080e6d8947b52ceeddebff53a8cf.jpg saved to cache
2026-04-27 08:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9fbae3a0-ca30-5eaf-9518-875297e18ba7
2026-04-27 08:10:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/37/5c37eee2cec6fa5112485d4dc9d9e01e/pa/LZ08309_ce032a473db1fe9e8631a8cd560598cb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143818b610>
2026-04-27 08:10:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9fbae3a0-ca30-5eaf-9518-875297e18ba7/9fbae3a0-ca30-5eaf-9518-875297e18ba7_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/37/5c37eee2cec6fa5112485d4dc9d9e01e/pa/LZ08309_ce032a473db1fe9e8631a8cd560598cb.jpg saved to cache
2026-04-27 08:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9fbae3a0-ca30-5eaf-9518-875297e18ba7
2026-04-27 08:10:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/37/5c37eee2cec6fa5112485d4dc9d9e01e/pa/LZ08309_e0be4ccbbf249c5602494bef735a61c3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/37/5c37eee2cec6fa5112485d4dc9d9e01e/pa/LZ08309_672f2cf2f79fe8d6ecb94bf27d732517.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/b1/9cb1fab098a1e4d89337650ae38b801f/pa/TH45766_fa0d97412ee5f163b5d14b54d9a384a7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438eb6c50>
2026-04-27 08:10:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9fbae3a0-ca30-5eaf-9518-875297e18ba7/9fbae3a0-ca30-5eaf-9518-875297e18ba7_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/37/5c37eee2cec6fa5112485d4dc9d9e01e/pa/LZ08309_e0be4ccbbf249c5602494bef735a61c3.jpg saved to cache
2026-04-27 08:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9fbae3a0-ca30-5eaf-9518-875297e18ba7
2026-04-27 08:10:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d2c450>
2026-04-27 08:10:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9fbae3a0-ca30-5eaf-9518-875297e18ba7/9fbae3a0-ca30-5eaf-9518-875297e18ba7_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/37/5c37eee2cec6fa5112485d4dc9d9e01e/pa/LZ08309_672f2cf2f79fe8d6ecb94bf27d732517.jpg saved to cache
2026-04-27 08:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9fbae3a0-ca30-5eaf-9518-875297e18ba7
2026-04-27 08:10:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9fbae3a0-ca30-5eaf-9518-875297e18ba7, skipping ID generation
2026-04-27 08:10:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9fbae3a0-ca30-5eaf-9518-875297e18ba7 with scrape type 1
2026-04-27 08:10:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9fbae3a0-ca30-5eaf-9518-875297e18ba7 sending to next pipeline
2026-04-27 08:10:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 9fbae3a0-ca30-5eaf-9518-875297e18ba7, identifier: LZ08309
2026-04-27 08:10:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 9fbae3a0-ca30-5eaf-9518-875297e18ba7 with identifier: LZ08309
2026-04-27 08:10:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 9fbae3a0-ca30-5eaf-9518-875297e18ba7 with identifier: LZ08309
2026-04-27 08:10:21 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:10:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 9fbae3a0-ca30-5eaf-9518-875297e18ba7 with identifier: LZ08309 to the API
2026-04-27 08:10:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:10:21 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:10:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5c/37/5c37eee2cec6fa5112485d4dc9d9e01e/pa/LZ08309_672f2cf2f79fe8d6ecb94bf27d732517.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 94,
 'category': None,
 'city': 'Villefranche-sur-Saône',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 95,
 'expiration_date': '2026-04-28T15:45:15Z',
 'fuel_type': 'diesel',
 'id': '9fbae3a0-ca30-5eaf-9518-875297e18ba7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 45.9897,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LZ08309',
 'listing': 'auction',
 'location': 'FR, Villefranche-sur-Saône',
 'location_confidence': 'geocoded',
 'longitude': 4.7196,
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 218630,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9fbae3a0-ca30-5eaf-9518-875297e18ba7/9fbae3a0-ca30-5eaf-9518-875297e18ba7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73707,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/37/5c37eee2cec6fa5112485d4dc9d9e01e/pa/LZ08309_672f2cf2f79fe8d6ecb94bf27d732517.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9fbae3a0-ca30-5eaf-9518-875297e18ba7/9fbae3a0-ca30-5eaf-9518-875297e18ba7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79972,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/37/5c37eee2cec6fa5112485d4dc9d9e01e/pa/LZ08309_e0be4ccbbf249c5602494bef735a61c3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9fbae3a0-ca30-5eaf-9518-875297e18ba7/9fbae3a0-ca30-5eaf-9518-875297e18ba7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75610,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/37/5c37eee2cec6fa5112485d4dc9d9e01e/pa/LZ08309_ce032a473db1fe9e8631a8cd560598cb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9fbae3a0-ca30-5eaf-9518-875297e18ba7/9fbae3a0-ca30-5eaf-9518-875297e18ba7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69069,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/37/5c37eee2cec6fa5112485d4dc9d9e01e/pa/LZ08309_2978080e6d8947b52ceeddebff53a8cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9fbae3a0-ca30-5eaf-9518-875297e18ba7/9fbae3a0-ca30-5eaf-9518-875297e18ba7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 129607,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/37/5c37eee2cec6fa5112485d4dc9d9e01e/pa/LZ08309_9e837c1b68441981aa2ebd2cf61ce997.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9fbae3a0-ca30-5eaf-9518-875297e18ba7/9fbae3a0-ca30-5eaf-9518-875297e18ba7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84014,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/37/5c37eee2cec6fa5112485d4dc9d9e01e/pa/LZ08309_716e2cec61ed28ff7af1947ca34e1c3e.jpg',
             'Width': 800}],
 'postal_code': '69400',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Rhône',
 'province_code': 'FR-69',
 'region': 'Auvergne-Rhône-Alpes',
 'region_code': 'FR-84',
 'registration_date': '2012-07-17',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Opel Corsa 1.3 CDTI CMon',
 'transmission': 'manual',
 'trim': 'CMon',
 'year': 2012}
2026-04-27 08:10:21 [auto1.fr] INFO: Saving data for LZ08309: {'created_time': 1777277421.817937, 'last_price_update_time': 1777277421.817948, 'has_photos': True, 'auction_closing_time': 1777391115.0}
2026-04-27 08:10:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SG40218> (referer: https://www.auto1.com/v1/car-details-view/SG40218/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:10:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:10:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438eb6650>
2026-04-27 08:10:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a0ea292-f8d0-5a35-8b5c-192442b0d509/2a0ea292-f8d0-5a35-8b5c-192442b0d509_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/b1/9cb1fab098a1e4d89337650ae38b801f/pa/TH45766_fa0d97412ee5f163b5d14b54d9a384a7.jpg saved to cache
2026-04-27 08:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2a0ea292-f8d0-5a35-8b5c-192442b0d509
2026-04-27 08:10:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2a0ea292-f8d0-5a35-8b5c-192442b0d509, skipping ID generation
2026-04-27 08:10:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a0ea292-f8d0-5a35-8b5c-192442b0d509 with scrape type 1
2026-04-27 08:10:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2a0ea292-f8d0-5a35-8b5c-192442b0d509 sending to next pipeline
2026-04-27 08:10:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2a0ea292-f8d0-5a35-8b5c-192442b0d509, identifier: TH45766
2026-04-27 08:10:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2a0ea292-f8d0-5a35-8b5c-192442b0d509 with identifier: TH45766
2026-04-27 08:10:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2a0ea292-f8d0-5a35-8b5c-192442b0d509 with identifier: TH45766
2026-04-27 08:10:22 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:10:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2a0ea292-f8d0-5a35-8b5c-192442b0d509 with identifier: TH45766 to the API
2026-04-27 08:10:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:10:22 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:10:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img9c/b1/9cb1fab098a1e4d89337650ae38b801f/pa/TH45766_fa0d97412ee5f163b5d14b54d9a384a7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 1,
 'category': None,
 'city': 'Nanteuil-le-Haudouin',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 95,
 'expiration_date': '2026-04-28T15:08:39Z',
 'fuel_type': 'diesel',
 'id': '2a0ea292-f8d0-5a35-8b5c-192442b0d509',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'latitude': 49.1408,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TH45766',
 'listing': 'auction',
 'location': 'FR, Nanteuil-le-Haudouin',
 'location_confidence': 'geocoded',
 'longitude': 2.8114,
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 213165,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2a0ea292-f8d0-5a35-8b5c-192442b0d509/2a0ea292-f8d0-5a35-8b5c-192442b0d509_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62863,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/b1/9cb1fab098a1e4d89337650ae38b801f/pa/TH45766_fa0d97412ee5f163b5d14b54d9a384a7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2a0ea292-f8d0-5a35-8b5c-192442b0d509/2a0ea292-f8d0-5a35-8b5c-192442b0d509_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57389,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/b1/9cb1fab098a1e4d89337650ae38b801f/pa/TH45766_5e5551f279d3811ce9f0edc80e691b8d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2a0ea292-f8d0-5a35-8b5c-192442b0d509/2a0ea292-f8d0-5a35-8b5c-192442b0d509_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61396,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/b1/9cb1fab098a1e4d89337650ae38b801f/pa/TH45766_0e14355f4339081bb5c6fc5003deca9d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2a0ea292-f8d0-5a35-8b5c-192442b0d509/2a0ea292-f8d0-5a35-8b5c-192442b0d509_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65870,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/b1/9cb1fab098a1e4d89337650ae38b801f/pa/TH45766_2d7c1dad5bf824d72e819ce2dac50e97.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2a0ea292-f8d0-5a35-8b5c-192442b0d509/2a0ea292-f8d0-5a35-8b5c-192442b0d509_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56472,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/b1/9cb1fab098a1e4d89337650ae38b801f/pa/TH45766_171b5118f48ec09a604397a045a0acd1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2a0ea292-f8d0-5a35-8b5c-192442b0d509/2a0ea292-f8d0-5a35-8b5c-192442b0d509_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64092,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/b1/9cb1fab098a1e4d89337650ae38b801f/pa/TH45766_0f409a7a1d5e702e199fd3f7f1948d8e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2a0ea292-f8d0-5a35-8b5c-192442b0d509/2a0ea292-f8d0-5a35-8b5c-192442b0d509_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79887,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/b1/9cb1fab098a1e4d89337650ae38b801f/pa/TH45766_fe1c0f3cccf5fdc44629727c618086b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2a0ea292-f8d0-5a35-8b5c-192442b0d509/2a0ea292-f8d0-5a35-8b5c-192442b0d509_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64118,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/b1/9cb1fab098a1e4d89337650ae38b801f/pa/TH45766_4ee372f1f83cf9927c302295535a2cd6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2a0ea292-f8d0-5a35-8b5c-192442b0d509/2a0ea292-f8d0-5a35-8b5c-192442b0d509_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58887,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/b1/9cb1fab098a1e4d89337650ae38b801f/pa/TH45766_bc0c6892c583557c1e3e6d04796eca70.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2a0ea292-f8d0-5a35-8b5c-192442b0d509/2a0ea292-f8d0-5a35-8b5c-192442b0d509_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56025,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/b1/9cb1fab098a1e4d89337650ae38b801f/pa/TH45766_86890b174c263babe6ebedb7b6f24f7f.jpg',
             'Width': 800}],
 'postal_code': '60440',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Oise',
 'province_code': 'FR-60',
 'region': 'Hauts-de-France',
 'region_code': 'FR-32',
 'registration_date': '2019-09-26',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Renault Megane 1.5 BLUE dCi Société Air Nav Reversible',
 'transmission': 'manual',
 'trim': 'Société Air Nav Reversible',
 'year': 2019}
2026-04-27 08:10:22 [auto1.fr] INFO: Saving data for TH45766: {'created_time': 1777277422.351831, 'last_price_update_time': 1777277422.35184, 'has_photos': True, 'auction_closing_time': 1777388919.0}
2026-04-27 08:10:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 680d524e-a076-5a63-93b9-9544f468c579 with identifier: SG40218
2026-04-27 08:10:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 680d524e-a076-5a63-93b9-9544f468c579 with scrape type 1
2026-04-27 08:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 680d524e-a076-5a63-93b9-9544f468c579
2026-04-27 08:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/e0/b6e079b631e03524acb3eddb2423a680/pa/SG40218_ef5b15e4633859173f5abb0ffe850d1a.jpg not downloaded yet
2026-04-27 08:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/e0/b6e079b631e03524acb3eddb2423a680/pa/SG40218_ce9d8bdd8223cdf86203027cd310c6bb.jpg not downloaded yet
2026-04-27 08:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/e0/b6e079b631e03524acb3eddb2423a680/pa/SG40218_efa9bf2f787634e94588b5688c0d6433.jpg not downloaded yet
2026-04-27 08:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/e0/b6e079b631e03524acb3eddb2423a680/pa/SG40218_0dcf4a0c3850a9b2a8142727980bd13b.jpg not downloaded yet
2026-04-27 08:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/e0/b6e079b631e03524acb3eddb2423a680/pa/SG40218_bec035e0ac88954547c7dd73b58489df.jpg not downloaded yet
2026-04-27 08:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/e0/b6e079b631e03524acb3eddb2423a680/pa/SG40218_46336bce619a14963898ffffe0d47911.jpg not downloaded yet
2026-04-27 08:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/e0/b6e079b631e03524acb3eddb2423a680/pa/SG40218_eab4d626e2fa30518942a27347da0172.jpg not downloaded yet
2026-04-27 08:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/e0/b6e079b631e03524acb3eddb2423a680/pa/SG40218_9ca7f06810ba06d07775e17929212ae3.jpg not downloaded yet
2026-04-27 08:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/e0/b6e079b631e03524acb3eddb2423a680/pa/SG40218_cbb1b727073831a29f98c585111cdf72.jpg not downloaded yet
2026-04-27 08:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/e0/b6e079b631e03524acb3eddb2423a680/pa/SG40218_664f1f8e1e9d692b34050817ee214f9e.jpg not downloaded yet
2026-04-27 08:10:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PB17191/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:10:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:10:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/e0/b6e079b631e03524acb3eddb2423a680/pa/SG40218_664f1f8e1e9d692b34050817ee214f9e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438e16ad0>
2026-04-27 08:10:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_680d524e-a076-5a63-93b9-9544f468c579/680d524e-a076-5a63-93b9-9544f468c579_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/e0/b6e079b631e03524acb3eddb2423a680/pa/SG40218_664f1f8e1e9d692b34050817ee214f9e.jpg saved to cache
2026-04-27 08:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 680d524e-a076-5a63-93b9-9544f468c579
2026-04-27 08:10:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AT94183/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:10:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:10:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/e0/b6e079b631e03524acb3eddb2423a680/pa/SG40218_cbb1b727073831a29f98c585111cdf72.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/e0/b6e079b631e03524acb3eddb2423a680/pa/SG40218_9ca7f06810ba06d07775e17929212ae3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143818bf10>
2026-04-27 08:10:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_680d524e-a076-5a63-93b9-9544f468c579/680d524e-a076-5a63-93b9-9544f468c579_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/e0/b6e079b631e03524acb3eddb2423a680/pa/SG40218_cbb1b727073831a29f98c585111cdf72.jpg saved to cache
2026-04-27 08:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 680d524e-a076-5a63-93b9-9544f468c579
2026-04-27 08:10:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d91750>
2026-04-27 08:10:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_680d524e-a076-5a63-93b9-9544f468c579/680d524e-a076-5a63-93b9-9544f468c579_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/e0/b6e079b631e03524acb3eddb2423a680/pa/SG40218_9ca7f06810ba06d07775e17929212ae3.jpg saved to cache
2026-04-27 08:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 680d524e-a076-5a63-93b9-9544f468c579
2026-04-27 08:10:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-04-27 08:10:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JL62454/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:10:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:10:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/e0/b6e079b631e03524acb3eddb2423a680/pa/SG40218_eab4d626e2fa30518942a27347da0172.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/e0/b6e079b631e03524acb3eddb2423a680/pa/SG40218_46336bce619a14963898ffffe0d47911.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380e3f10>
2026-04-27 08:10:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_680d524e-a076-5a63-93b9-9544f468c579/680d524e-a076-5a63-93b9-9544f468c579_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/e0/b6e079b631e03524acb3eddb2423a680/pa/SG40218_eab4d626e2fa30518942a27347da0172.jpg saved to cache
2026-04-27 08:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 680d524e-a076-5a63-93b9-9544f468c579
2026-04-27 08:10:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143805f350>
2026-04-27 08:10:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_680d524e-a076-5a63-93b9-9544f468c579/680d524e-a076-5a63-93b9-9544f468c579_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/e0/b6e079b631e03524acb3eddb2423a680/pa/SG40218_46336bce619a14963898ffffe0d47911.jpg saved to cache
2026-04-27 08:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 680d524e-a076-5a63-93b9-9544f468c579
2026-04-27 08:10:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FL69972> (referer: https://www.auto1.com/v1/car-details-view/FL69972/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:10:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:10:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73a52e14-8664-5462-9994-98e38172764e with identifier: FL69972
2026-04-27 08:10:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73a52e14-8664-5462-9994-98e38172764e with scrape type 1
2026-04-27 08:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 73a52e14-8664-5462-9994-98e38172764e
2026-04-27 08:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/34/c334bb7cde177c3343d9022bb3bd43e4/pa/FL69972_9776b035367c3bd5a4db0141f2a1d06a.jpg not downloaded yet
2026-04-27 08:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/34/c334bb7cde177c3343d9022bb3bd43e4/pa/FL69972_2de97145aeec42a9890de53895cbe467.jpg not downloaded yet
2026-04-27 08:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/34/c334bb7cde177c3343d9022bb3bd43e4/pa/FL69972_e6e68258b40ad5674a733e7420de9f84.jpg not downloaded yet
2026-04-27 08:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/34/c334bb7cde177c3343d9022bb3bd43e4/pa/FL69972_9fc487cc18bee8b498d3432094e290a7.jpg not downloaded yet
2026-04-27 08:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/34/c334bb7cde177c3343d9022bb3bd43e4/pa/FL69972_a698bd9dc649e990ce7ccdd2ceb8693d.jpg not downloaded yet
2026-04-27 08:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/34/c334bb7cde177c3343d9022bb3bd43e4/pa/FL69972_19a9f0cf2489799e5660b394d251839a.jpg not downloaded yet
2026-04-27 08:10:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/e0/b6e079b631e03524acb3eddb2423a680/pa/SG40218_bec035e0ac88954547c7dd73b58489df.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380ba550>
2026-04-27 08:10:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_680d524e-a076-5a63-93b9-9544f468c579/680d524e-a076-5a63-93b9-9544f468c579_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/e0/b6e079b631e03524acb3eddb2423a680/pa/SG40218_bec035e0ac88954547c7dd73b58489df.jpg saved to cache
2026-04-27 08:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 680d524e-a076-5a63-93b9-9544f468c579
2026-04-27 08:10:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/34/c334bb7cde177c3343d9022bb3bd43e4/pa/FL69972_19a9f0cf2489799e5660b394d251839a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ce94d0>
2026-04-27 08:10:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73a52e14-8664-5462-9994-98e38172764e/73a52e14-8664-5462-9994-98e38172764e_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/34/c334bb7cde177c3343d9022bb3bd43e4/pa/FL69972_19a9f0cf2489799e5660b394d251839a.jpg saved to cache
2026-04-27 08:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 73a52e14-8664-5462-9994-98e38172764e
2026-04-27 08:10:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/34/c334bb7cde177c3343d9022bb3bd43e4/pa/FL69972_a698bd9dc649e990ce7ccdd2ceb8693d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XZ61201> (referer: https://www.auto1.com/v1/car-details-view/XZ61201/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:10:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:10:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438addad0>
2026-04-27 08:10:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73a52e14-8664-5462-9994-98e38172764e/73a52e14-8664-5462-9994-98e38172764e_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/34/c334bb7cde177c3343d9022bb3bd43e4/pa/FL69972_a698bd9dc649e990ce7ccdd2ceb8693d.jpg saved to cache
2026-04-27 08:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 73a52e14-8664-5462-9994-98e38172764e
2026-04-27 08:10:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5f7f823-7f4b-5d01-adda-5f375b7469c6 with identifier: XZ61201
2026-04-27 08:10:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5f7f823-7f4b-5d01-adda-5f375b7469c6 with scrape type 1
2026-04-27 08:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c5f7f823-7f4b-5d01-adda-5f375b7469c6
2026-04-27 08:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/ad/adade44742872323cb27938762c1c7f3/pa/XZ61201_81d1ac06b417eccbff7c0d1a6a0b7192.jpg not downloaded yet
2026-04-27 08:10:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/34/c334bb7cde177c3343d9022bb3bd43e4/pa/FL69972_9fc487cc18bee8b498d3432094e290a7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/ad/adade44742872323cb27938762c1c7f3/pa/XZ61201_dc56660b6c644f3c648cf7970aba5820.jpg not downloaded yet
2026-04-27 08:10:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/34/c334bb7cde177c3343d9022bb3bd43e4/pa/FL69972_e6e68258b40ad5674a733e7420de9f84.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/ad/adade44742872323cb27938762c1c7f3/pa/XZ61201_9ba5c4029cbb309d1db891271ee634dd.jpg not downloaded yet
2026-04-27 08:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/ad/adade44742872323cb27938762c1c7f3/pa/XZ61201_684aff85a06ca0f8e70cd040647d5ae4.jpg not downloaded yet
2026-04-27 08:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/ad/adade44742872323cb27938762c1c7f3/pa/XZ61201_4b5475370af2a222958b6ee65d928a55.jpg not downloaded yet
2026-04-27 08:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/ad/adade44742872323cb27938762c1c7f3/pa/XZ61201_186d04a15ad2aa75800263e61ee492ca.jpg not downloaded yet
2026-04-27 08:10:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/ad/adade44742872323cb27938762c1c7f3/pa/XZ61201_81d1ac06b417eccbff7c0d1a6a0b7192.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/ad/adade44742872323cb27938762c1c7f3/pa/XZ61201_06660f482533678bf386fb05f0f7aaac.jpg not downloaded yet
2026-04-27 08:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/ad/adade44742872323cb27938762c1c7f3/pa/XZ61201_4fff1537b7590b95fe1540af04ef6b1d.jpg not downloaded yet
2026-04-27 08:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/ad/adade44742872323cb27938762c1c7f3/pa/XZ61201_3f4455b50f02aca9f596d7ca6f2edef7.jpg not downloaded yet
2026-04-27 08:10:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bfba110>
2026-04-27 08:10:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73a52e14-8664-5462-9994-98e38172764e/73a52e14-8664-5462-9994-98e38172764e_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/34/c334bb7cde177c3343d9022bb3bd43e4/pa/FL69972_9fc487cc18bee8b498d3432094e290a7.jpg saved to cache
2026-04-27 08:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 73a52e14-8664-5462-9994-98e38172764e
2026-04-27 08:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/ad/adade44742872323cb27938762c1c7f3/pa/XZ61201_a0a47669d5ba6e7c22bb9a786a52b122.jpg not downloaded yet
2026-04-27 08:10:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438025250>
2026-04-27 08:10:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73a52e14-8664-5462-9994-98e38172764e/73a52e14-8664-5462-9994-98e38172764e_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/34/c334bb7cde177c3343d9022bb3bd43e4/pa/FL69972_e6e68258b40ad5674a733e7420de9f84.jpg saved to cache
2026-04-27 08:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 73a52e14-8664-5462-9994-98e38172764e
2026-04-27 08:10:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RY60991> (referer: https://www.auto1.com/v1/car-details-view/RY60991/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:10:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:10:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380b99d0>
2026-04-27 08:10:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5f7f823-7f4b-5d01-adda-5f375b7469c6/c5f7f823-7f4b-5d01-adda-5f375b7469c6_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/ad/adade44742872323cb27938762c1c7f3/pa/XZ61201_81d1ac06b417eccbff7c0d1a6a0b7192.jpg saved to cache
2026-04-27 08:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c5f7f823-7f4b-5d01-adda-5f375b7469c6
2026-04-27 08:10:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/34/c334bb7cde177c3343d9022bb3bd43e4/pa/FL69972_2de97145aeec42a9890de53895cbe467.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/ad/adade44742872323cb27938762c1c7f3/pa/XZ61201_4b5475370af2a222958b6ee65d928a55.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e007cf5-7242-5d6c-9c08-8765c156f77f with identifier: RY60991
2026-04-27 08:10:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e007cf5-7242-5d6c-9c08-8765c156f77f with scrape type 1
2026-04-27 08:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 7e007cf5-7242-5d6c-9c08-8765c156f77f
2026-04-27 08:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/30/fb309f75471a545b1fb0f7cbe0223b97/pa/RY60991_f044fbad0fcc9927bfbf62fd6f94a89e.jpg not downloaded yet
2026-04-27 08:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/30/fb309f75471a545b1fb0f7cbe0223b97/pa/RY60991_cdab7e8bf7b482002a7e0cf22d0f646e.jpg not downloaded yet
2026-04-27 08:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/30/fb309f75471a545b1fb0f7cbe0223b97/pa/RY60991_eb2aea780512fab96aac7a0d3ae67701.jpg not downloaded yet
2026-04-27 08:10:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ce9ed0>
2026-04-27 08:10:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73a52e14-8664-5462-9994-98e38172764e/73a52e14-8664-5462-9994-98e38172764e_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/34/c334bb7cde177c3343d9022bb3bd43e4/pa/FL69972_2de97145aeec42a9890de53895cbe467.jpg saved to cache
2026-04-27 08:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 73a52e14-8664-5462-9994-98e38172764e
2026-04-27 08:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/30/fb309f75471a545b1fb0f7cbe0223b97/pa/RY60991_62d0d5f2d76d2edb748b35148929485c.jpg not downloaded yet
2026-04-27 08:10:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/ad/adade44742872323cb27938762c1c7f3/pa/XZ61201_3f4455b50f02aca9f596d7ca6f2edef7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/30/fb309f75471a545b1fb0f7cbe0223b97/pa/RY60991_7cb5fa8456d5ad85bf10eaf161c76b9c.jpg not downloaded yet
2026-04-27 08:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/30/fb309f75471a545b1fb0f7cbe0223b97/pa/RY60991_c233c5a65b67e393e61d4349c9ba197e.jpg not downloaded yet
2026-04-27 08:10:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438078b90>
2026-04-27 08:10:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5f7f823-7f4b-5d01-adda-5f375b7469c6/c5f7f823-7f4b-5d01-adda-5f375b7469c6_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/ad/adade44742872323cb27938762c1c7f3/pa/XZ61201_4b5475370af2a222958b6ee65d928a55.jpg saved to cache
2026-04-27 08:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c5f7f823-7f4b-5d01-adda-5f375b7469c6
2026-04-27 08:10:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/30/fb309f75471a545b1fb0f7cbe0223b97/pa/RY60991_eb2aea780512fab96aac7a0d3ae67701.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/ad/adade44742872323cb27938762c1c7f3/pa/XZ61201_4fff1537b7590b95fe1540af04ef6b1d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d2f390>
2026-04-27 08:10:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5f7f823-7f4b-5d01-adda-5f375b7469c6/c5f7f823-7f4b-5d01-adda-5f375b7469c6_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/ad/adade44742872323cb27938762c1c7f3/pa/XZ61201_3f4455b50f02aca9f596d7ca6f2edef7.jpg saved to cache
2026-04-27 08:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c5f7f823-7f4b-5d01-adda-5f375b7469c6
2026-04-27 08:10:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/30/fb309f75471a545b1fb0f7cbe0223b97/pa/RY60991_c233c5a65b67e393e61d4349c9ba197e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/30/fb309f75471a545b1fb0f7cbe0223b97/pa/RY60991_7cb5fa8456d5ad85bf10eaf161c76b9c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/30/fb309f75471a545b1fb0f7cbe0223b97/pa/RY60991_62d0d5f2d76d2edb748b35148929485c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143801db10>
2026-04-27 08:10:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e007cf5-7242-5d6c-9c08-8765c156f77f/7e007cf5-7242-5d6c-9c08-8765c156f77f_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/30/fb309f75471a545b1fb0f7cbe0223b97/pa/RY60991_eb2aea780512fab96aac7a0d3ae67701.jpg saved to cache
2026-04-27 08:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7e007cf5-7242-5d6c-9c08-8765c156f77f
2026-04-27 08:10:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/30/fb309f75471a545b1fb0f7cbe0223b97/pa/RY60991_cdab7e8bf7b482002a7e0cf22d0f646e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143809e850>
2026-04-27 08:10:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5f7f823-7f4b-5d01-adda-5f375b7469c6/c5f7f823-7f4b-5d01-adda-5f375b7469c6_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/ad/adade44742872323cb27938762c1c7f3/pa/XZ61201_4fff1537b7590b95fe1540af04ef6b1d.jpg saved to cache
2026-04-27 08:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c5f7f823-7f4b-5d01-adda-5f375b7469c6
2026-04-27 08:10:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438076410>
2026-04-27 08:10:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e007cf5-7242-5d6c-9c08-8765c156f77f/7e007cf5-7242-5d6c-9c08-8765c156f77f_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/30/fb309f75471a545b1fb0f7cbe0223b97/pa/RY60991_c233c5a65b67e393e61d4349c9ba197e.jpg saved to cache
2026-04-27 08:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7e007cf5-7242-5d6c-9c08-8765c156f77f
2026-04-27 08:10:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438fbfbd0>
2026-04-27 08:10:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e007cf5-7242-5d6c-9c08-8765c156f77f/7e007cf5-7242-5d6c-9c08-8765c156f77f_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/30/fb309f75471a545b1fb0f7cbe0223b97/pa/RY60991_7cb5fa8456d5ad85bf10eaf161c76b9c.jpg saved to cache
2026-04-27 08:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7e007cf5-7242-5d6c-9c08-8765c156f77f
2026-04-27 08:10:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/30/fb309f75471a545b1fb0f7cbe0223b97/pa/RY60991_f044fbad0fcc9927bfbf62fd6f94a89e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438173ad0>
2026-04-27 08:10:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e007cf5-7242-5d6c-9c08-8765c156f77f/7e007cf5-7242-5d6c-9c08-8765c156f77f_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/30/fb309f75471a545b1fb0f7cbe0223b97/pa/RY60991_62d0d5f2d76d2edb748b35148929485c.jpg saved to cache
2026-04-27 08:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7e007cf5-7242-5d6c-9c08-8765c156f77f
2026-04-27 08:10:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438cb4b90>
2026-04-27 08:10:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e007cf5-7242-5d6c-9c08-8765c156f77f/7e007cf5-7242-5d6c-9c08-8765c156f77f_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/30/fb309f75471a545b1fb0f7cbe0223b97/pa/RY60991_cdab7e8bf7b482002a7e0cf22d0f646e.jpg saved to cache
2026-04-27 08:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7e007cf5-7242-5d6c-9c08-8765c156f77f
2026-04-27 08:10:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143817f690>
2026-04-27 08:10:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e007cf5-7242-5d6c-9c08-8765c156f77f/7e007cf5-7242-5d6c-9c08-8765c156f77f_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/30/fb309f75471a545b1fb0f7cbe0223b97/pa/RY60991_f044fbad0fcc9927bfbf62fd6f94a89e.jpg saved to cache
2026-04-27 08:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7e007cf5-7242-5d6c-9c08-8765c156f77f
2026-04-27 08:10:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7e007cf5-7242-5d6c-9c08-8765c156f77f, skipping ID generation
2026-04-27 08:10:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e007cf5-7242-5d6c-9c08-8765c156f77f with scrape type 1
2026-04-27 08:10:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7e007cf5-7242-5d6c-9c08-8765c156f77f sending to next pipeline
2026-04-27 08:10:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7e007cf5-7242-5d6c-9c08-8765c156f77f, identifier: RY60991
2026-04-27 08:10:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7e007cf5-7242-5d6c-9c08-8765c156f77f with identifier: RY60991
2026-04-27 08:10:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7e007cf5-7242-5d6c-9c08-8765c156f77f with identifier: RY60991
2026-04-27 08:10:28 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:10:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 7e007cf5-7242-5d6c-9c08-8765c156f77f with identifier: RY60991 to the API
2026-04-27 08:10:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:10:29 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:10:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgfb/30/fb309f75471a545b1fb0f7cbe0223b97/pa/RY60991_f044fbad0fcc9927bfbf62fd6f94a89e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'city': 'Saint Aignan de Grandlieu',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 122,
 'expiration_date': '2026-04-28T15:36:01Z',
 'fuel_type': 'petrol',
 'id': '7e007cf5-7242-5d6c-9c08-8765c156f77f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 47.1237,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RY60991',
 'listing': 'auction',
 'location': 'FR, Saint Aignan de Grandlieu',
 'location_confidence': 'geocoded',
 'longitude': -1.6308,
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 284592,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7e007cf5-7242-5d6c-9c08-8765c156f77f/7e007cf5-7242-5d6c-9c08-8765c156f77f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80114,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/30/fb309f75471a545b1fb0f7cbe0223b97/pa/RY60991_f044fbad0fcc9927bfbf62fd6f94a89e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7e007cf5-7242-5d6c-9c08-8765c156f77f/7e007cf5-7242-5d6c-9c08-8765c156f77f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84846,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/30/fb309f75471a545b1fb0f7cbe0223b97/pa/RY60991_cdab7e8bf7b482002a7e0cf22d0f646e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7e007cf5-7242-5d6c-9c08-8765c156f77f/7e007cf5-7242-5d6c-9c08-8765c156f77f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85904,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/30/fb309f75471a545b1fb0f7cbe0223b97/pa/RY60991_eb2aea780512fab96aac7a0d3ae67701.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7e007cf5-7242-5d6c-9c08-8765c156f77f/7e007cf5-7242-5d6c-9c08-8765c156f77f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73528,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/30/fb309f75471a545b1fb0f7cbe0223b97/pa/RY60991_62d0d5f2d76d2edb748b35148929485c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7e007cf5-7242-5d6c-9c08-8765c156f77f/7e007cf5-7242-5d6c-9c08-8765c156f77f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101844,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/30/fb309f75471a545b1fb0f7cbe0223b97/pa/RY60991_7cb5fa8456d5ad85bf10eaf161c76b9c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7e007cf5-7242-5d6c-9c08-8765c156f77f/7e007cf5-7242-5d6c-9c08-8765c156f77f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40234,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/30/fb309f75471a545b1fb0f7cbe0223b97/pa/RY60991_c233c5a65b67e393e61d4349c9ba197e.jpg',
             'Width': 800}],
 'postal_code': '44860',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Loire-Atlantique',
 'province_code': 'FR-44',
 'region': 'Pays de la Loire',
 'region_code': 'FR-52',
 'registration_date': '2010-06-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 TSI Comfortline',
 'transmission': 'automatic',
 'trim': 'Comfortline',
 'year': 2010}
2026-04-27 08:10:29 [auto1.fr] INFO: Saving data for RY60991: {'created_time': 1777277429.157148, 'last_price_update_time': 1777277429.157161, 'has_photos': True, 'auction_closing_time': 1777390561.0}
2026-04-27 08:10:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/ad/adade44742872323cb27938762c1c7f3/pa/XZ61201_06660f482533678bf386fb05f0f7aaac.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/ad/adade44742872323cb27938762c1c7f3/pa/XZ61201_186d04a15ad2aa75800263e61ee492ca.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:29 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item c5f7f823-7f4b-5d01-adda-5f375b7469c6 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:10:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143807b0d0>
2026-04-27 08:10:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5f7f823-7f4b-5d01-adda-5f375b7469c6/c5f7f823-7f4b-5d01-adda-5f375b7469c6_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/ad/adade44742872323cb27938762c1c7f3/pa/XZ61201_06660f482533678bf386fb05f0f7aaac.jpg saved to cache
2026-04-27 08:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c5f7f823-7f4b-5d01-adda-5f375b7469c6
2026-04-27 08:10:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14381255d0>
2026-04-27 08:10:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5f7f823-7f4b-5d01-adda-5f375b7469c6/c5f7f823-7f4b-5d01-adda-5f375b7469c6_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/ad/adade44742872323cb27938762c1c7f3/pa/XZ61201_186d04a15ad2aa75800263e61ee492ca.jpg saved to cache
2026-04-27 08:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c5f7f823-7f4b-5d01-adda-5f375b7469c6
2026-04-27 08:10:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/ad/adade44742872323cb27938762c1c7f3/pa/XZ61201_9ba5c4029cbb309d1db891271ee634dd.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/34/c334bb7cde177c3343d9022bb3bd43e4/pa/FL69972_9776b035367c3bd5a4db0141f2a1d06a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/e0/b6e079b631e03524acb3eddb2423a680/pa/SG40218_0dcf4a0c3850a9b2a8142727980bd13b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bffdc10>
2026-04-27 08:10:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5f7f823-7f4b-5d01-adda-5f375b7469c6/c5f7f823-7f4b-5d01-adda-5f375b7469c6_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/ad/adade44742872323cb27938762c1c7f3/pa/XZ61201_9ba5c4029cbb309d1db891271ee634dd.jpg saved to cache
2026-04-27 08:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c5f7f823-7f4b-5d01-adda-5f375b7469c6
2026-04-27 08:10:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/ad/adade44742872323cb27938762c1c7f3/pa/XZ61201_684aff85a06ca0f8e70cd040647d5ae4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438df8890>
2026-04-27 08:10:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73a52e14-8664-5462-9994-98e38172764e/73a52e14-8664-5462-9994-98e38172764e_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/34/c334bb7cde177c3343d9022bb3bd43e4/pa/FL69972_9776b035367c3bd5a4db0141f2a1d06a.jpg saved to cache
2026-04-27 08:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 73a52e14-8664-5462-9994-98e38172764e
2026-04-27 08:10:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 73a52e14-8664-5462-9994-98e38172764e, skipping ID generation
2026-04-27 08:10:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73a52e14-8664-5462-9994-98e38172764e with scrape type 1
2026-04-27 08:10:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 73a52e14-8664-5462-9994-98e38172764e sending to next pipeline
2026-04-27 08:10:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 73a52e14-8664-5462-9994-98e38172764e, identifier: FL69972
2026-04-27 08:10:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 73a52e14-8664-5462-9994-98e38172764e with identifier: FL69972
2026-04-27 08:10:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 73a52e14-8664-5462-9994-98e38172764e with identifier: FL69972
2026-04-27 08:10:29 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:10:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 73a52e14-8664-5462-9994-98e38172764e with identifier: FL69972 to the API
2026-04-27 08:10:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:10:30 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:10:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc3/34/c334bb7cde177c3343d9022bb3bd43e4/pa/FL69972_9776b035367c3bd5a4db0141f2a1d06a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 199,
 'category': None,
 'city': 'Vezin-le-Coquet',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 3',
 'engine': '2.2L',
 'engine_horse_power': 128,
 'expiration_date': '2026-04-28T15:11:53Z',
 'fuel_type': 'diesel',
 'id': '73a52e14-8664-5462-9994-98e38172764e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.119,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FL69972',
 'listing': 'auction',
 'location': 'FR, Vezin-le-Coquet',
 'location_confidence': 'geocoded',
 'longitude': -1.7563,
 'make': 'Peugeot',
 'model': '807',
 'odometer': 330838,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_73a52e14-8664-5462-9994-98e38172764e/73a52e14-8664-5462-9994-98e38172764e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96398,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/34/c334bb7cde177c3343d9022bb3bd43e4/pa/FL69972_9776b035367c3bd5a4db0141f2a1d06a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_73a52e14-8664-5462-9994-98e38172764e/73a52e14-8664-5462-9994-98e38172764e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97631,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/34/c334bb7cde177c3343d9022bb3bd43e4/pa/FL69972_2de97145aeec42a9890de53895cbe467.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_73a52e14-8664-5462-9994-98e38172764e/73a52e14-8664-5462-9994-98e38172764e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88293,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/34/c334bb7cde177c3343d9022bb3bd43e4/pa/FL69972_e6e68258b40ad5674a733e7420de9f84.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_73a52e14-8664-5462-9994-98e38172764e/73a52e14-8664-5462-9994-98e38172764e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73197,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/34/c334bb7cde177c3343d9022bb3bd43e4/pa/FL69972_9fc487cc18bee8b498d3432094e290a7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_73a52e14-8664-5462-9994-98e38172764e/73a52e14-8664-5462-9994-98e38172764e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82001,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/34/c334bb7cde177c3343d9022bb3bd43e4/pa/FL69972_a698bd9dc649e990ce7ccdd2ceb8693d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_73a52e14-8664-5462-9994-98e38172764e/73a52e14-8664-5462-9994-98e38172764e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41262,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/34/c334bb7cde177c3343d9022bb3bd43e4/pa/FL69972_19a9f0cf2489799e5660b394d251839a.jpg',
             'Width': 800}],
 'postal_code': '35132',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Ille-et-Vilaine',
 'province_code': 'FR-35',
 'region': 'Bretagne',
 'region_code': 'FR-53',
 'registration_date': '2003-06-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 807 2.2 HDi ST',
 'transmission': 'manual',
 'trim': 'ST',
 'year': 2003}
2026-04-27 08:10:30 [auto1.fr] INFO: Saving data for FL69972: {'created_time': 1777277430.27122, 'last_price_update_time': 1777277430.271231, 'has_photos': True, 'auction_closing_time': 1777389113.0}
2026-04-27 08:10:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/e0/b6e079b631e03524acb3eddb2423a680/pa/SG40218_ce9d8bdd8223cdf86203027cd310c6bb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/e0/b6e079b631e03524acb3eddb2423a680/pa/SG40218_efa9bf2f787634e94588b5688c0d6433.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YL63768> (referer: https://www.auto1.com/v1/car-details-view/YL63768/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:10:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c2a990>
2026-04-27 08:10:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_680d524e-a076-5a63-93b9-9544f468c579/680d524e-a076-5a63-93b9-9544f468c579_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/e0/b6e079b631e03524acb3eddb2423a680/pa/SG40218_0dcf4a0c3850a9b2a8142727980bd13b.jpg saved to cache
2026-04-27 08:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 680d524e-a076-5a63-93b9-9544f468c579
2026-04-27 08:10:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438addbd0>
2026-04-27 08:10:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5f7f823-7f4b-5d01-adda-5f375b7469c6/c5f7f823-7f4b-5d01-adda-5f375b7469c6_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/ad/adade44742872323cb27938762c1c7f3/pa/XZ61201_684aff85a06ca0f8e70cd040647d5ae4.jpg saved to cache
2026-04-27 08:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c5f7f823-7f4b-5d01-adda-5f375b7469c6
2026-04-27 08:10:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:10:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c5f7f823-7f4b-5d01-adda-5f375b7469c6 with identifier: XZ61201
2026-04-27 08:10:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c5f7f823-7f4b-5d01-adda-5f375b7469c6 with identifier: XZ61201
2026-04-27 08:10:30 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:10:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c5f7f823-7f4b-5d01-adda-5f375b7469c6 with identifier: XZ61201 to the API
2026-04-27 08:10:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:10:30 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:10:30 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'city': 'Allennes-les-Marais',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO N\\/A',
 'engine': '1.4L',
 'engine_horse_power': 68,
 'expiration_date': '2026-04-28T15:26:13Z',
 'fuel_type': 'diesel',
 'id': 'c5f7f823-7f4b-5d01-adda-5f375b7469c6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 50.5375,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XZ61201',
 'listing': 'auction',
 'location': 'FR, Allennes-les-Marais',
 'location_confidence': 'geocoded',
 'longitude': 2.9536,
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 174400,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 21,
 'photo_urls': ['https://img-pa.auto1.com/imgad/ad/adade44742872323cb27938762c1c7f3/pa/XZ61201_81d1ac06b417eccbff7c0d1a6a0b7192.jpg',
                'https://img-pa.auto1.com/imgad/ad/adade44742872323cb27938762c1c7f3/pa/XZ61201_dc56660b6c644f3c648cf7970aba5820.jpg',
                'https://img-pa.auto1.com/imgad/ad/adade44742872323cb27938762c1c7f3/pa/XZ61201_9ba5c4029cbb309d1db891271ee634dd.jpg',
                'https://img-pa.auto1.com/imgad/ad/adade44742872323cb27938762c1c7f3/pa/XZ61201_684aff85a06ca0f8e70cd040647d5ae4.jpg',
                'https://img-pa.auto1.com/imgad/ad/adade44742872323cb27938762c1c7f3/pa/XZ61201_4b5475370af2a222958b6ee65d928a55.jpg',
                'https://img-pa.auto1.com/imgad/ad/adade44742872323cb27938762c1c7f3/pa/XZ61201_186d04a15ad2aa75800263e61ee492ca.jpg',
                'https://img-pa.auto1.com/imgad/ad/adade44742872323cb27938762c1c7f3/pa/XZ61201_06660f482533678bf386fb05f0f7aaac.jpg',
                'https://img-pa.auto1.com/imgad/ad/adade44742872323cb27938762c1c7f3/pa/XZ61201_4fff1537b7590b95fe1540af04ef6b1d.jpg',
                'https://img-pa.auto1.com/imgad/ad/adade44742872323cb27938762c1c7f3/pa/XZ61201_3f4455b50f02aca9f596d7ca6f2edef7.jpg',
                'https://img-pa.auto1.com/imgad/ad/adade44742872323cb27938762c1c7f3/pa/XZ61201_a0a47669d5ba6e7c22bb9a786a52b122.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c5f7f823-7f4b-5d01-adda-5f375b7469c6/c5f7f823-7f4b-5d01-adda-5f375b7469c6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 128557,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/ad/adade44742872323cb27938762c1c7f3/pa/XZ61201_81d1ac06b417eccbff7c0d1a6a0b7192.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c5f7f823-7f4b-5d01-adda-5f375b7469c6/c5f7f823-7f4b-5d01-adda-5f375b7469c6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116517,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/ad/adade44742872323cb27938762c1c7f3/pa/XZ61201_9ba5c4029cbb309d1db891271ee634dd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c5f7f823-7f4b-5d01-adda-5f375b7469c6/c5f7f823-7f4b-5d01-adda-5f375b7469c6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117073,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/ad/adade44742872323cb27938762c1c7f3/pa/XZ61201_684aff85a06ca0f8e70cd040647d5ae4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c5f7f823-7f4b-5d01-adda-5f375b7469c6/c5f7f823-7f4b-5d01-adda-5f375b7469c6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97784,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/ad/adade44742872323cb27938762c1c7f3/pa/XZ61201_4b5475370af2a222958b6ee65d928a55.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c5f7f823-7f4b-5d01-adda-5f375b7469c6/c5f7f823-7f4b-5d01-adda-5f375b7469c6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98958,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/ad/adade44742872323cb27938762c1c7f3/pa/XZ61201_186d04a15ad2aa75800263e61ee492ca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c5f7f823-7f4b-5d01-adda-5f375b7469c6/c5f7f823-7f4b-5d01-adda-5f375b7469c6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108360,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/ad/adade44742872323cb27938762c1c7f3/pa/XZ61201_06660f482533678bf386fb05f0f7aaac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c5f7f823-7f4b-5d01-adda-5f375b7469c6/c5f7f823-7f4b-5d01-adda-5f375b7469c6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109834,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/ad/adade44742872323cb27938762c1c7f3/pa/XZ61201_4fff1537b7590b95fe1540af04ef6b1d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c5f7f823-7f4b-5d01-adda-5f375b7469c6/c5f7f823-7f4b-5d01-adda-5f375b7469c6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60889,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/ad/adade44742872323cb27938762c1c7f3/pa/XZ61201_3f4455b50f02aca9f596d7ca6f2edef7.jpg',
             'Width': 800}],
 'postal_code': '59251',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Nord',
 'province_code': 'FR-59',
 'region': 'Hauts-de-France',
 'region_code': 'FR-32',
 'registration_date': '2005-07-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 1.4 HDi Exclusive',
 'transmission': 'manual',
 'trim': 'Exclusive',
 'year': 2005}
2026-04-27 08:10:30 [auto1.fr] INFO: Saving data for XZ61201: {'created_time': 1777277430.787838, 'last_price_update_time': 1777277430.787848, 'has_photos': True, 'auction_closing_time': 1777389973.0}
2026-04-27 08:10:30 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item c5f7f823-7f4b-5d01-adda-5f375b7469c6 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:10:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/e0/b6e079b631e03524acb3eddb2423a680/pa/SG40218_ef5b15e4633859173f5abb0ffe850d1a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438fb2510>
2026-04-27 08:10:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_680d524e-a076-5a63-93b9-9544f468c579/680d524e-a076-5a63-93b9-9544f468c579_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/e0/b6e079b631e03524acb3eddb2423a680/pa/SG40218_ce9d8bdd8223cdf86203027cd310c6bb.jpg saved to cache
2026-04-27 08:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 680d524e-a076-5a63-93b9-9544f468c579
2026-04-27 08:10:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438208890>
2026-04-27 08:10:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_680d524e-a076-5a63-93b9-9544f468c579/680d524e-a076-5a63-93b9-9544f468c579_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/e0/b6e079b631e03524acb3eddb2423a680/pa/SG40218_efa9bf2f787634e94588b5688c0d6433.jpg saved to cache
2026-04-27 08:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 680d524e-a076-5a63-93b9-9544f468c579
2026-04-27 08:10:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 935baf38-f54a-5ff1-908e-152f41e4319e with identifier: YL63768
2026-04-27 08:10:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 935baf38-f54a-5ff1-908e-152f41e4319e with scrape type 1
2026-04-27 08:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 935baf38-f54a-5ff1-908e-152f41e4319e
2026-04-27 08:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/6b/936bc62292c2769070c63655bb95e194/pa/YL63768_ab58e62a6f61176ee8486c44b69d9664.jpg not downloaded yet
2026-04-27 08:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/6b/936bc62292c2769070c63655bb95e194/pa/YL63768_c243822987e6ad61ed7851afd0a6db0e.jpg not downloaded yet
2026-04-27 08:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/6b/936bc62292c2769070c63655bb95e194/pa/YL63768_312c7c3c923f06dd3842677112f7df8f.jpg not downloaded yet
2026-04-27 08:10:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f144781c650>
2026-04-27 08:10:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_680d524e-a076-5a63-93b9-9544f468c579/680d524e-a076-5a63-93b9-9544f468c579_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/e0/b6e079b631e03524acb3eddb2423a680/pa/SG40218_ef5b15e4633859173f5abb0ffe850d1a.jpg saved to cache
2026-04-27 08:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 680d524e-a076-5a63-93b9-9544f468c579
2026-04-27 08:10:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 680d524e-a076-5a63-93b9-9544f468c579, skipping ID generation
2026-04-27 08:10:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 680d524e-a076-5a63-93b9-9544f468c579 with scrape type 1
2026-04-27 08:10:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 680d524e-a076-5a63-93b9-9544f468c579 sending to next pipeline
2026-04-27 08:10:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 680d524e-a076-5a63-93b9-9544f468c579, identifier: SG40218
2026-04-27 08:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/6b/936bc62292c2769070c63655bb95e194/pa/YL63768_cc193aaf6fdcb88f0e230bf61fd41929.jpg not downloaded yet
2026-04-27 08:10:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 680d524e-a076-5a63-93b9-9544f468c579 with identifier: SG40218
2026-04-27 08:10:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 680d524e-a076-5a63-93b9-9544f468c579 with identifier: SG40218
2026-04-27 08:10:31 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:10:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 680d524e-a076-5a63-93b9-9544f468c579 with identifier: SG40218 to the API
2026-04-27 08:10:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:10:31 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:10:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb6/e0/b6e079b631e03524acb3eddb2423a680/pa/SG40218_ef5b15e4633859173f5abb0ffe850d1a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 108,
 'category': None,
 'city': 'Tarnos',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 115,
 'expiration_date': '2026-04-28T15:58:41Z',
 'fuel_type': 'diesel',
 'id': '680d524e-a076-5a63-93b9-9544f468c579',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 43.5417,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG40218',
 'listing': 'auction',
 'location': 'FR, Tarnos',
 'location_confidence': 'geocoded',
 'longitude': -1.4628,
 'make': 'BMW',
 'model': '2er',
 'odometer': 302050,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_680d524e-a076-5a63-93b9-9544f468c579/680d524e-a076-5a63-93b9-9544f468c579_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86569,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/e0/b6e079b631e03524acb3eddb2423a680/pa/SG40218_ef5b15e4633859173f5abb0ffe850d1a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_680d524e-a076-5a63-93b9-9544f468c579/680d524e-a076-5a63-93b9-9544f468c579_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86301,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/e0/b6e079b631e03524acb3eddb2423a680/pa/SG40218_ce9d8bdd8223cdf86203027cd310c6bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_680d524e-a076-5a63-93b9-9544f468c579/680d524e-a076-5a63-93b9-9544f468c579_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90050,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/e0/b6e079b631e03524acb3eddb2423a680/pa/SG40218_efa9bf2f787634e94588b5688c0d6433.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_680d524e-a076-5a63-93b9-9544f468c579/680d524e-a076-5a63-93b9-9544f468c579_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71763,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/e0/b6e079b631e03524acb3eddb2423a680/pa/SG40218_0dcf4a0c3850a9b2a8142727980bd13b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_680d524e-a076-5a63-93b9-9544f468c579/680d524e-a076-5a63-93b9-9544f468c579_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93425,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/e0/b6e079b631e03524acb3eddb2423a680/pa/SG40218_bec035e0ac88954547c7dd73b58489df.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_680d524e-a076-5a63-93b9-9544f468c579/680d524e-a076-5a63-93b9-9544f468c579_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87945,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/e0/b6e079b631e03524acb3eddb2423a680/pa/SG40218_46336bce619a14963898ffffe0d47911.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_680d524e-a076-5a63-93b9-9544f468c579/680d524e-a076-5a63-93b9-9544f468c579_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79995,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/e0/b6e079b631e03524acb3eddb2423a680/pa/SG40218_eab4d626e2fa30518942a27347da0172.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_680d524e-a076-5a63-93b9-9544f468c579/680d524e-a076-5a63-93b9-9544f468c579_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92786,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/e0/b6e079b631e03524acb3eddb2423a680/pa/SG40218_9ca7f06810ba06d07775e17929212ae3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_680d524e-a076-5a63-93b9-9544f468c579/680d524e-a076-5a63-93b9-9544f468c579_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75103,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/e0/b6e079b631e03524acb3eddb2423a680/pa/SG40218_cbb1b727073831a29f98c585111cdf72.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_680d524e-a076-5a63-93b9-9544f468c579/680d524e-a076-5a63-93b9-9544f468c579_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83820,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/e0/b6e079b631e03524acb3eddb2423a680/pa/SG40218_664f1f8e1e9d692b34050817ee214f9e.jpg',
             'Width': 800}],
 'postal_code': '40220',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Landes',
 'province_code': 'FR-40',
 'region': 'Nouvelle-Aquitaine',
 'region_code': 'FR-75',
 'registration_date': '2015-12-30',
 'seats_number': 7,
 'seller_name': None,
 'title': 'BMW 2er 216d Gran Tourer Sport Line',
 'transmission': 'manual',
 'trim': 'Sport Line',
 'year': 2015}
2026-04-27 08:10:32 [auto1.fr] INFO: Saving data for SG40218: {'created_time': 1777277432.140056, 'last_price_update_time': 1777277432.140069, 'has_photos': True, 'auction_closing_time': 1777391921.0}
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/6b/936bc62292c2769070c63655bb95e194/pa/YL63768_06bda6cb8fefa402ccbcfc180561d3e9.jpg not downloaded yet
2026-04-27 08:10:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SV11482> (referer: https://www.auto1.com/v1/car-details-view/SV11482/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:10:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/6b/936bc62292c2769070c63655bb95e194/pa/YL63768_62a32f078dc49fe6ef61b7ca9c870ac9.jpg not downloaded yet
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/6b/936bc62292c2769070c63655bb95e194/pa/YL63768_b2f37691847caab17faf17a931647952.jpg not downloaded yet
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/6b/936bc62292c2769070c63655bb95e194/pa/YL63768_a38daaf222294d80dca8f73e5d387806.jpg not downloaded yet
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/6b/936bc62292c2769070c63655bb95e194/pa/YL63768_9bf6b8b7b23ab78f541ed97135fe673b.jpg not downloaded yet
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/6b/936bc62292c2769070c63655bb95e194/pa/YL63768_484be8604d1c53c946381d56d7368cec.jpg not downloaded yet
2026-04-27 08:10:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/6b/936bc62292c2769070c63655bb95e194/pa/YL63768_cc193aaf6fdcb88f0e230bf61fd41929.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25b77593-f45e-549d-97f7-fcd0569ffa17 with identifier: SV11482
2026-04-27 08:10:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25b77593-f45e-549d-97f7-fcd0569ffa17 with scrape type 1
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 25b77593-f45e-549d-97f7-fcd0569ffa17
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/a0/5ba017db3d8403f74cef2e142f71fcba/pa/SV11482_484d7214e6377c7cd767848f04fe54e3.jpg not downloaded yet
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/a0/5ba017db3d8403f74cef2e142f71fcba/pa/SV11482_1c9420f53793bdd7c4627f0eb697afab.jpg not downloaded yet
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/a0/5ba017db3d8403f74cef2e142f71fcba/pa/SV11482_99c46687ba00fb9ea8819dac5e760a1e.jpg not downloaded yet
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/a0/5ba017db3d8403f74cef2e142f71fcba/pa/SV11482_6027e2764cf8857bd9b8141db2664899.jpg not downloaded yet
2026-04-27 08:10:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/6b/936bc62292c2769070c63655bb95e194/pa/YL63768_484be8604d1c53c946381d56d7368cec.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/a0/5ba017db3d8403f74cef2e142f71fcba/pa/SV11482_d1882c00c2a1b7cb87b11e6dadeaecbb.jpg not downloaded yet
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/a0/5ba017db3d8403f74cef2e142f71fcba/pa/SV11482_811a001e28d618bf281c218b01c3a456.jpg not downloaded yet
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/a0/5ba017db3d8403f74cef2e142f71fcba/pa/SV11482_7c4c2b11a707c424849d67f55339b6ea.jpg not downloaded yet
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/a0/5ba017db3d8403f74cef2e142f71fcba/pa/SV11482_c6358a333b968bee6cb76d20995505d0.jpg not downloaded yet
2026-04-27 08:10:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14381de990>
2026-04-27 08:10:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_935baf38-f54a-5ff1-908e-152f41e4319e/935baf38-f54a-5ff1-908e-152f41e4319e_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/6b/936bc62292c2769070c63655bb95e194/pa/YL63768_cc193aaf6fdcb88f0e230bf61fd41929.jpg saved to cache
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 935baf38-f54a-5ff1-908e-152f41e4319e
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/a0/5ba017db3d8403f74cef2e142f71fcba/pa/SV11482_d0c1beb9c82a58dd83356cccaedb10b6.jpg not downloaded yet
2026-04-27 08:10:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/a0/5ba017db3d8403f74cef2e142f71fcba/pa/SV11482_6027e2764cf8857bd9b8141db2664899.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/a0/5ba017db3d8403f74cef2e142f71fcba/pa/SV11482_8d611e0c5ff1467d5d4c75136fa78432.jpg not downloaded yet
2026-04-27 08:10:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d61610>
2026-04-27 08:10:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_935baf38-f54a-5ff1-908e-152f41e4319e/935baf38-f54a-5ff1-908e-152f41e4319e_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/6b/936bc62292c2769070c63655bb95e194/pa/YL63768_484be8604d1c53c946381d56d7368cec.jpg saved to cache
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 935baf38-f54a-5ff1-908e-152f41e4319e
2026-04-27 08:10:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d93110>
2026-04-27 08:10:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25b77593-f45e-549d-97f7-fcd0569ffa17/25b77593-f45e-549d-97f7-fcd0569ffa17_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/a0/5ba017db3d8403f74cef2e142f71fcba/pa/SV11482_6027e2764cf8857bd9b8141db2664899.jpg saved to cache
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 25b77593-f45e-549d-97f7-fcd0569ffa17
2026-04-27 08:10:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/a0/5ba017db3d8403f74cef2e142f71fcba/pa/SV11482_d0c1beb9c82a58dd83356cccaedb10b6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/a0/5ba017db3d8403f74cef2e142f71fcba/pa/SV11482_8d611e0c5ff1467d5d4c75136fa78432.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/a0/5ba017db3d8403f74cef2e142f71fcba/pa/SV11482_c6358a333b968bee6cb76d20995505d0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d725d0>
2026-04-27 08:10:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25b77593-f45e-549d-97f7-fcd0569ffa17/25b77593-f45e-549d-97f7-fcd0569ffa17_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/a0/5ba017db3d8403f74cef2e142f71fcba/pa/SV11482_d0c1beb9c82a58dd83356cccaedb10b6.jpg saved to cache
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 25b77593-f45e-549d-97f7-fcd0569ffa17
2026-04-27 08:10:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/a0/5ba017db3d8403f74cef2e142f71fcba/pa/SV11482_7c4c2b11a707c424849d67f55339b6ea.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438075090>
2026-04-27 08:10:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25b77593-f45e-549d-97f7-fcd0569ffa17/25b77593-f45e-549d-97f7-fcd0569ffa17_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/a0/5ba017db3d8403f74cef2e142f71fcba/pa/SV11482_8d611e0c5ff1467d5d4c75136fa78432.jpg saved to cache
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 25b77593-f45e-549d-97f7-fcd0569ffa17
2026-04-27 08:10:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/a0/5ba017db3d8403f74cef2e142f71fcba/pa/SV11482_811a001e28d618bf281c218b01c3a456.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380462d0>
2026-04-27 08:10:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25b77593-f45e-549d-97f7-fcd0569ffa17/25b77593-f45e-549d-97f7-fcd0569ffa17_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/a0/5ba017db3d8403f74cef2e142f71fcba/pa/SV11482_c6358a333b968bee6cb76d20995505d0.jpg saved to cache
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 25b77593-f45e-549d-97f7-fcd0569ffa17
2026-04-27 08:10:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/a0/5ba017db3d8403f74cef2e142f71fcba/pa/SV11482_d1882c00c2a1b7cb87b11e6dadeaecbb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438dfa4d0>
2026-04-27 08:10:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25b77593-f45e-549d-97f7-fcd0569ffa17/25b77593-f45e-549d-97f7-fcd0569ffa17_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/a0/5ba017db3d8403f74cef2e142f71fcba/pa/SV11482_7c4c2b11a707c424849d67f55339b6ea.jpg saved to cache
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 25b77593-f45e-549d-97f7-fcd0569ffa17
2026-04-27 08:10:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/a0/5ba017db3d8403f74cef2e142f71fcba/pa/SV11482_99c46687ba00fb9ea8819dac5e760a1e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438dcbf10>
2026-04-27 08:10:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25b77593-f45e-549d-97f7-fcd0569ffa17/25b77593-f45e-549d-97f7-fcd0569ffa17_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/a0/5ba017db3d8403f74cef2e142f71fcba/pa/SV11482_811a001e28d618bf281c218b01c3a456.jpg saved to cache
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 25b77593-f45e-549d-97f7-fcd0569ffa17
2026-04-27 08:10:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/a0/5ba017db3d8403f74cef2e142f71fcba/pa/SV11482_1c9420f53793bdd7c4627f0eb697afab.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438cb5c90>
2026-04-27 08:10:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25b77593-f45e-549d-97f7-fcd0569ffa17/25b77593-f45e-549d-97f7-fcd0569ffa17_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/a0/5ba017db3d8403f74cef2e142f71fcba/pa/SV11482_d1882c00c2a1b7cb87b11e6dadeaecbb.jpg saved to cache
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 25b77593-f45e-549d-97f7-fcd0569ffa17
2026-04-27 08:10:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/a0/5ba017db3d8403f74cef2e142f71fcba/pa/SV11482_484d7214e6377c7cd767848f04fe54e3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143820cd90>
2026-04-27 08:10:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25b77593-f45e-549d-97f7-fcd0569ffa17/25b77593-f45e-549d-97f7-fcd0569ffa17_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/a0/5ba017db3d8403f74cef2e142f71fcba/pa/SV11482_99c46687ba00fb9ea8819dac5e760a1e.jpg saved to cache
2026-04-27 08:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 25b77593-f45e-549d-97f7-fcd0569ffa17
2026-04-27 08:10:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/6b/936bc62292c2769070c63655bb95e194/pa/YL63768_9bf6b8b7b23ab78f541ed97135fe673b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438cb6cd0>
2026-04-27 08:10:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25b77593-f45e-549d-97f7-fcd0569ffa17/25b77593-f45e-549d-97f7-fcd0569ffa17_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/a0/5ba017db3d8403f74cef2e142f71fcba/pa/SV11482_1c9420f53793bdd7c4627f0eb697afab.jpg saved to cache
2026-04-27 08:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 25b77593-f45e-549d-97f7-fcd0569ffa17
2026-04-27 08:10:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438eb6290>
2026-04-27 08:10:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25b77593-f45e-549d-97f7-fcd0569ffa17/25b77593-f45e-549d-97f7-fcd0569ffa17_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/a0/5ba017db3d8403f74cef2e142f71fcba/pa/SV11482_484d7214e6377c7cd767848f04fe54e3.jpg saved to cache
2026-04-27 08:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 25b77593-f45e-549d-97f7-fcd0569ffa17
2026-04-27 08:10:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 25b77593-f45e-549d-97f7-fcd0569ffa17, skipping ID generation
2026-04-27 08:10:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25b77593-f45e-549d-97f7-fcd0569ffa17 with scrape type 1
2026-04-27 08:10:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 25b77593-f45e-549d-97f7-fcd0569ffa17 sending to next pipeline
2026-04-27 08:10:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 25b77593-f45e-549d-97f7-fcd0569ffa17, identifier: SV11482
2026-04-27 08:10:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 25b77593-f45e-549d-97f7-fcd0569ffa17 with identifier: SV11482
2026-04-27 08:10:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 25b77593-f45e-549d-97f7-fcd0569ffa17 with identifier: SV11482
2026-04-27 08:10:33 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:10:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 25b77593-f45e-549d-97f7-fcd0569ffa17 with identifier: SV11482 to the API
2026-04-27 08:10:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:10:33 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:10:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5b/a0/5ba017db3d8403f74cef2e142f71fcba/pa/SV11482_484d7214e6377c7cd767848f04fe54e3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': None,
 'city': 'Bruz',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 143,
 'expiration_date': '2026-04-28T15:38:25Z',
 'fuel_type': 'diesel',
 'id': '25b77593-f45e-549d-97f7-fcd0569ffa17',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.0246,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV11482',
 'listing': 'auction',
 'location': 'FR, Bruz',
 'location_confidence': 'geocoded',
 'longitude': -1.7471,
 'make': 'Toyota',
 'model': 'RAV 4',
 'odometer': 152142,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_25b77593-f45e-549d-97f7-fcd0569ffa17/25b77593-f45e-549d-97f7-fcd0569ffa17_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81149,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/a0/5ba017db3d8403f74cef2e142f71fcba/pa/SV11482_484d7214e6377c7cd767848f04fe54e3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_25b77593-f45e-549d-97f7-fcd0569ffa17/25b77593-f45e-549d-97f7-fcd0569ffa17_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86715,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/a0/5ba017db3d8403f74cef2e142f71fcba/pa/SV11482_1c9420f53793bdd7c4627f0eb697afab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_25b77593-f45e-549d-97f7-fcd0569ffa17/25b77593-f45e-549d-97f7-fcd0569ffa17_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90555,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/a0/5ba017db3d8403f74cef2e142f71fcba/pa/SV11482_99c46687ba00fb9ea8819dac5e760a1e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_25b77593-f45e-549d-97f7-fcd0569ffa17/25b77593-f45e-549d-97f7-fcd0569ffa17_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86099,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/a0/5ba017db3d8403f74cef2e142f71fcba/pa/SV11482_6027e2764cf8857bd9b8141db2664899.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_25b77593-f45e-549d-97f7-fcd0569ffa17/25b77593-f45e-549d-97f7-fcd0569ffa17_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80187,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/a0/5ba017db3d8403f74cef2e142f71fcba/pa/SV11482_d1882c00c2a1b7cb87b11e6dadeaecbb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_25b77593-f45e-549d-97f7-fcd0569ffa17/25b77593-f45e-549d-97f7-fcd0569ffa17_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78153,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/a0/5ba017db3d8403f74cef2e142f71fcba/pa/SV11482_811a001e28d618bf281c218b01c3a456.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_25b77593-f45e-549d-97f7-fcd0569ffa17/25b77593-f45e-549d-97f7-fcd0569ffa17_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61514,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/a0/5ba017db3d8403f74cef2e142f71fcba/pa/SV11482_7c4c2b11a707c424849d67f55339b6ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_25b77593-f45e-549d-97f7-fcd0569ffa17/25b77593-f45e-549d-97f7-fcd0569ffa17_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72830,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/a0/5ba017db3d8403f74cef2e142f71fcba/pa/SV11482_c6358a333b968bee6cb76d20995505d0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_25b77593-f45e-549d-97f7-fcd0569ffa17/25b77593-f45e-549d-97f7-fcd0569ffa17_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66786,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/a0/5ba017db3d8403f74cef2e142f71fcba/pa/SV11482_d0c1beb9c82a58dd83356cccaedb10b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_25b77593-f45e-549d-97f7-fcd0569ffa17/25b77593-f45e-549d-97f7-fcd0569ffa17_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82807,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/a0/5ba017db3d8403f74cef2e142f71fcba/pa/SV11482_8d611e0c5ff1467d5d4c75136fa78432.jpg',
             'Width': 800}],
 'postal_code': '35170',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Ille-et-Vilaine',
 'province_code': 'FR-35',
 'region': 'Bretagne',
 'region_code': 'FR-53',
 'registration_date': '2015-12-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota RAV 4 2.0 D-4D Dynamic Business',
 'transmission': 'manual',
 'trim': 'Dynamic Business',
 'year': 2015}
2026-04-27 08:10:33 [auto1.fr] INFO: Saving data for SV11482: {'created_time': 1777277433.701797, 'last_price_update_time': 1777277433.701806, 'has_photos': True, 'auction_closing_time': 1777390705.0}
2026-04-27 08:10:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/6b/936bc62292c2769070c63655bb95e194/pa/YL63768_a38daaf222294d80dca8f73e5d387806.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EG39801/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:10:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:10:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438fcd810>
2026-04-27 08:10:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_935baf38-f54a-5ff1-908e-152f41e4319e/935baf38-f54a-5ff1-908e-152f41e4319e_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/6b/936bc62292c2769070c63655bb95e194/pa/YL63768_9bf6b8b7b23ab78f541ed97135fe673b.jpg saved to cache
2026-04-27 08:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 935baf38-f54a-5ff1-908e-152f41e4319e
2026-04-27 08:10:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438dcb0d0>
2026-04-27 08:10:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_935baf38-f54a-5ff1-908e-152f41e4319e/935baf38-f54a-5ff1-908e-152f41e4319e_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/6b/936bc62292c2769070c63655bb95e194/pa/YL63768_a38daaf222294d80dca8f73e5d387806.jpg saved to cache
2026-04-27 08:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 935baf38-f54a-5ff1-908e-152f41e4319e
2026-04-27 08:10:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/6b/936bc62292c2769070c63655bb95e194/pa/YL63768_62a32f078dc49fe6ef61b7ca9c870ac9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/6b/936bc62292c2769070c63655bb95e194/pa/YL63768_b2f37691847caab17faf17a931647952.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/6b/936bc62292c2769070c63655bb95e194/pa/YL63768_06bda6cb8fefa402ccbcfc180561d3e9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438075110>
2026-04-27 08:10:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_935baf38-f54a-5ff1-908e-152f41e4319e/935baf38-f54a-5ff1-908e-152f41e4319e_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/6b/936bc62292c2769070c63655bb95e194/pa/YL63768_62a32f078dc49fe6ef61b7ca9c870ac9.jpg saved to cache
2026-04-27 08:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 935baf38-f54a-5ff1-908e-152f41e4319e
2026-04-27 08:10:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bfd0a10>
2026-04-27 08:10:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_935baf38-f54a-5ff1-908e-152f41e4319e/935baf38-f54a-5ff1-908e-152f41e4319e_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/6b/936bc62292c2769070c63655bb95e194/pa/YL63768_b2f37691847caab17faf17a931647952.jpg saved to cache
2026-04-27 08:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 935baf38-f54a-5ff1-908e-152f41e4319e
2026-04-27 08:10:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d7ca90>
2026-04-27 08:10:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_935baf38-f54a-5ff1-908e-152f41e4319e/935baf38-f54a-5ff1-908e-152f41e4319e_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/6b/936bc62292c2769070c63655bb95e194/pa/YL63768_06bda6cb8fefa402ccbcfc180561d3e9.jpg saved to cache
2026-04-27 08:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 935baf38-f54a-5ff1-908e-152f41e4319e
2026-04-27 08:10:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/6b/936bc62292c2769070c63655bb95e194/pa/YL63768_312c7c3c923f06dd3842677112f7df8f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/6b/936bc62292c2769070c63655bb95e194/pa/YL63768_c243822987e6ad61ed7851afd0a6db0e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/6b/936bc62292c2769070c63655bb95e194/pa/YL63768_ab58e62a6f61176ee8486c44b69d9664.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438dc9010>
2026-04-27 08:10:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_935baf38-f54a-5ff1-908e-152f41e4319e/935baf38-f54a-5ff1-908e-152f41e4319e_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/6b/936bc62292c2769070c63655bb95e194/pa/YL63768_312c7c3c923f06dd3842677112f7df8f.jpg saved to cache
2026-04-27 08:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 935baf38-f54a-5ff1-908e-152f41e4319e
2026-04-27 08:10:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c29190>
2026-04-27 08:10:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_935baf38-f54a-5ff1-908e-152f41e4319e/935baf38-f54a-5ff1-908e-152f41e4319e_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/6b/936bc62292c2769070c63655bb95e194/pa/YL63768_c243822987e6ad61ed7851afd0a6db0e.jpg saved to cache
2026-04-27 08:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 935baf38-f54a-5ff1-908e-152f41e4319e
2026-04-27 08:10:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438079e10>
2026-04-27 08:10:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_935baf38-f54a-5ff1-908e-152f41e4319e/935baf38-f54a-5ff1-908e-152f41e4319e_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/6b/936bc62292c2769070c63655bb95e194/pa/YL63768_ab58e62a6f61176ee8486c44b69d9664.jpg saved to cache
2026-04-27 08:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 935baf38-f54a-5ff1-908e-152f41e4319e
2026-04-27 08:10:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 935baf38-f54a-5ff1-908e-152f41e4319e, skipping ID generation
2026-04-27 08:10:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 935baf38-f54a-5ff1-908e-152f41e4319e with scrape type 1
2026-04-27 08:10:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 935baf38-f54a-5ff1-908e-152f41e4319e sending to next pipeline
2026-04-27 08:10:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 935baf38-f54a-5ff1-908e-152f41e4319e, identifier: YL63768
2026-04-27 08:10:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 935baf38-f54a-5ff1-908e-152f41e4319e with identifier: YL63768
2026-04-27 08:10:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 935baf38-f54a-5ff1-908e-152f41e4319e with identifier: YL63768
2026-04-27 08:10:34 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:10:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 935baf38-f54a-5ff1-908e-152f41e4319e with identifier: YL63768 to the API
2026-04-27 08:10:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:10:34 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:10:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img93/6b/936bc62292c2769070c63655bb95e194/pa/YL63768_ab58e62a6f61176ee8486c44b69d9664.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'city': 'Marly-la-Ville',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-04-28T15:29:51Z',
 'fuel_type': 'diesel',
 'id': '935baf38-f54a-5ff1-908e-152f41e4319e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 49.082,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YL63768',
 'listing': 'auction',
 'location': 'FR, Marly-la-ville',
 'location_confidence': 'geocoded',
 'longitude': 2.5035,
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 129395,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_935baf38-f54a-5ff1-908e-152f41e4319e/935baf38-f54a-5ff1-908e-152f41e4319e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99491,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/6b/936bc62292c2769070c63655bb95e194/pa/YL63768_ab58e62a6f61176ee8486c44b69d9664.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_935baf38-f54a-5ff1-908e-152f41e4319e/935baf38-f54a-5ff1-908e-152f41e4319e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100310,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/6b/936bc62292c2769070c63655bb95e194/pa/YL63768_c243822987e6ad61ed7851afd0a6db0e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_935baf38-f54a-5ff1-908e-152f41e4319e/935baf38-f54a-5ff1-908e-152f41e4319e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105260,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/6b/936bc62292c2769070c63655bb95e194/pa/YL63768_312c7c3c923f06dd3842677112f7df8f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_935baf38-f54a-5ff1-908e-152f41e4319e/935baf38-f54a-5ff1-908e-152f41e4319e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86963,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/6b/936bc62292c2769070c63655bb95e194/pa/YL63768_cc193aaf6fdcb88f0e230bf61fd41929.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_935baf38-f54a-5ff1-908e-152f41e4319e/935baf38-f54a-5ff1-908e-152f41e4319e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96638,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/6b/936bc62292c2769070c63655bb95e194/pa/YL63768_06bda6cb8fefa402ccbcfc180561d3e9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_935baf38-f54a-5ff1-908e-152f41e4319e/935baf38-f54a-5ff1-908e-152f41e4319e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109730,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/6b/936bc62292c2769070c63655bb95e194/pa/YL63768_62a32f078dc49fe6ef61b7ca9c870ac9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_935baf38-f54a-5ff1-908e-152f41e4319e/935baf38-f54a-5ff1-908e-152f41e4319e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92440,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/6b/936bc62292c2769070c63655bb95e194/pa/YL63768_b2f37691847caab17faf17a931647952.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_935baf38-f54a-5ff1-908e-152f41e4319e/935baf38-f54a-5ff1-908e-152f41e4319e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94331,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/6b/936bc62292c2769070c63655bb95e194/pa/YL63768_a38daaf222294d80dca8f73e5d387806.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_935baf38-f54a-5ff1-908e-152f41e4319e/935baf38-f54a-5ff1-908e-152f41e4319e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78913,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/6b/936bc62292c2769070c63655bb95e194/pa/YL63768_9bf6b8b7b23ab78f541ed97135fe673b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_935baf38-f54a-5ff1-908e-152f41e4319e/935baf38-f54a-5ff1-908e-152f41e4319e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96321,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/6b/936bc62292c2769070c63655bb95e194/pa/YL63768_484be8604d1c53c946381d56d7368cec.jpg',
             'Width': 800}],
 'postal_code': '95670',
 'price': 0,
 'price_includes_vat': True,
 'province': "Val-d'Oise",
 'province_code': 'FR-95',
 'region': 'Île-de-France',
 'region_code': 'FR-11',
 'registration_date': '2017-03-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Highline 4Motion BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion BlueMotion Tech',
 'year': 2017}
2026-04-27 08:10:34 [auto1.fr] INFO: Saving data for YL63768: {'created_time': 1777277434.928415, 'last_price_update_time': 1777277434.928427, 'has_photos': True, 'auction_closing_time': 1777390191.0}
2026-04-27 08:10:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XU74860/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:10:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:10:59 [scrapy.extensions.logstats] INFO: Crawled 529 pages (at 16 pages/min), scraped 460 items (at 8 items/min)
2026-04-27 08:10:59 [scrapy.extensions.memusage] INFO: Peak memory usage is 373MiB
2026-04-27 08:11:02 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.024(s), this was the 1st time calling it.
2026-04-27 08:11:02 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.142408813155895 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:11:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:11:19 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.458(s), this was the 1st time calling it.
2026-04-27 08:11:19 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.498418243763843 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:11:19 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.562(s), this was the 1st time calling it.
2026-04-27 08:11:19 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.419731217294512 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:11:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:11:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:11:49 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.177(s), this was the 1st time calling it.
2026-04-27 08:11:49 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.941803091940843 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:11:49 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.697(s), this was the 1st time calling it.
2026-04-27 08:11:49 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.169927275380585 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:11:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:11:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:11:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HN57459/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:11:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:11:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JL62454> (referer: https://www.auto1.com/v1/car-details-view/JL62454/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:11:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:11:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b951bf04-4b02-5715-80dd-82b5cd4ff291 with identifier: JL62454
2026-04-27 08:11:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b951bf04-4b02-5715-80dd-82b5cd4ff291 with scrape type 1
2026-04-27 08:11:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b951bf04-4b02-5715-80dd-82b5cd4ff291
2026-04-27 08:11:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/60/be60ecf0d4daaa7502fceeb1acd23b0a/pa/JL62454_d3aac4f0eac104ea22d855a52d24943c.jpg not downloaded yet
2026-04-27 08:11:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/60/be60ecf0d4daaa7502fceeb1acd23b0a/pa/JL62454_09f2f864d91c5ddd53a15fcbe20796cf.jpg not downloaded yet
2026-04-27 08:11:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/60/be60ecf0d4daaa7502fceeb1acd23b0a/pa/JL62454_98b1cd0205b83404a5e0520ab1df0323.jpg not downloaded yet
2026-04-27 08:11:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/60/be60ecf0d4daaa7502fceeb1acd23b0a/pa/JL62454_8b7ca44f25922e1f4ce735f4981827fa.jpg not downloaded yet
2026-04-27 08:11:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/60/be60ecf0d4daaa7502fceeb1acd23b0a/pa/JL62454_e67fc4a607ec11d3467cbc64291132c7.jpg not downloaded yet
2026-04-27 08:11:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/60/be60ecf0d4daaa7502fceeb1acd23b0a/pa/JL62454_ffba585a44357306aad5d050d07e9b79.jpg not downloaded yet
2026-04-27 08:11:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/60/be60ecf0d4daaa7502fceeb1acd23b0a/pa/JL62454_1ec8251d4c39288639dbfd3435b6f0f9.jpg not downloaded yet
2026-04-27 08:11:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/60/be60ecf0d4daaa7502fceeb1acd23b0a/pa/JL62454_72ec320eefcc2907494789ec00a5f94e.jpg not downloaded yet
2026-04-27 08:11:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/60/be60ecf0d4daaa7502fceeb1acd23b0a/pa/JL62454_b981650aa99b4d98863ad992e01632f9.jpg not downloaded yet
2026-04-27 08:11:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/60/be60ecf0d4daaa7502fceeb1acd23b0a/pa/JL62454_0eaeb658aac145d0c060598d76a37985.jpg not downloaded yet
2026-04-27 08:11:59 [scrapy.extensions.logstats] INFO: Crawled 531 pages (at 2 pages/min), scraped 460 items (at 0 items/min)
2026-04-27 08:11:59 [scrapy.extensions.memusage] INFO: Peak memory usage is 373MiB
2026-04-27 08:12:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BS21555> (referer: https://www.auto1.com/v1/car-details-view/BS21555/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e809ad95-e055-5b29-a190-37933b6bfe99 with identifier: BS21555
2026-04-27 08:12:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e809ad95-e055-5b29-a190-37933b6bfe99 with scrape type 1
2026-04-27 08:12:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item e809ad95-e055-5b29-a190-37933b6bfe99
2026-04-27 08:12:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/ff/85ff8d242d2db64774c4fabd3505c603/pa/BS21555_c3304d38cfe8999259b30db0466aeee0.jpg not downloaded yet
2026-04-27 08:12:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/ff/85ff8d242d2db64774c4fabd3505c603/pa/BS21555_b3245a45b67501c9460e8d7ad03b42c8.jpg not downloaded yet
2026-04-27 08:12:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/ff/85ff8d242d2db64774c4fabd3505c603/pa/BS21555_5942d23b8ec78bff1e4a805ab8337e21.jpg not downloaded yet
2026-04-27 08:12:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/ff/85ff8d242d2db64774c4fabd3505c603/pa/BS21555_f0df79eae782d54442aeeb5d3dece228.jpg not downloaded yet
2026-04-27 08:12:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/ff/85ff8d242d2db64774c4fabd3505c603/pa/BS21555_aee9bd1e190fa1549a56cfee4116d58a.jpg not downloaded yet
2026-04-27 08:12:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/ff/85ff8d242d2db64774c4fabd3505c603/pa/BS21555_4ab56d86eb910c1b1cf8b259211e9c91.jpg not downloaded yet
2026-04-27 08:12:01 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item b951bf04-4b02-5715-80dd-82b5cd4ff291 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WH02443/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:02 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item e809ad95-e055-5b29-a190-37933b6bfe99 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:03 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item e809ad95-e055-5b29-a190-37933b6bfe99 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:03 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item e809ad95-e055-5b29-a190-37933b6bfe99 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:04 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item e809ad95-e055-5b29-a190-37933b6bfe99 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TY72648> (referer: https://www.auto1.com/v1/car-details-view/TY72648/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57ac8ba4-ffa4-5a57-a1a8-1e9f41b81395 with identifier: TY72648
2026-04-27 08:12:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57ac8ba4-ffa4-5a57-a1a8-1e9f41b81395 with scrape type 1
2026-04-27 08:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 57ac8ba4-ffa4-5a57-a1a8-1e9f41b81395
2026-04-27 08:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/78/fe7866b322948252c81828ff1a83fd04/pa/TY72648_46bab7f2fba3e04ced027370a8fede7f.jpg not downloaded yet
2026-04-27 08:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/78/fe7866b322948252c81828ff1a83fd04/pa/TY72648_c4f5c783fcfe9ff50bade29723d19e04.jpg not downloaded yet
2026-04-27 08:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/78/fe7866b322948252c81828ff1a83fd04/pa/TY72648_99e1f0c7f39aee7fe32b0244ae3af374.jpg not downloaded yet
2026-04-27 08:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/78/fe7866b322948252c81828ff1a83fd04/pa/TY72648_e08fc71bde08d88e1a5399f8a88dcc0e.jpg not downloaded yet
2026-04-27 08:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/78/fe7866b322948252c81828ff1a83fd04/pa/TY72648_4453db4bd82c92d7b8d4a8ab527b53fa.jpg not downloaded yet
2026-04-27 08:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/78/fe7866b322948252c81828ff1a83fd04/pa/TY72648_2c1cd816d8dfb7b9e793a3be7ea67433.jpg not downloaded yet
2026-04-27 08:12:05 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item e809ad95-e055-5b29-a190-37933b6bfe99 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e809ad95-e055-5b29-a190-37933b6bfe99 with identifier: BS21555
2026-04-27 08:12:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e809ad95-e055-5b29-a190-37933b6bfe99 with identifier: BS21555
2026-04-27 08:12:06 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:12:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e809ad95-e055-5b29-a190-37933b6bfe99 with identifier: BS21555 to the API
2026-04-27 08:12:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:12:06 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:12:06 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'category': None,
 'city': 'Le Cellier',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 105,
 'expiration_date': '2026-04-28T15:12:07Z',
 'fuel_type': 'diesel',
 'id': 'e809ad95-e055-5b29-a190-37933b6bfe99',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 47.3196,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BS21555',
 'listing': 'auction',
 'location': 'FR, Le Cellier',
 'location_confidence': 'geocoded',
 'longitude': -1.3472,
 'make': 'Fiat',
 'model': '500L',
 'odometer': 270865,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/img85/ff/85ff8d242d2db64774c4fabd3505c603/pa/BS21555_c3304d38cfe8999259b30db0466aeee0.jpg',
                'https://img-pa.auto1.com/img85/ff/85ff8d242d2db64774c4fabd3505c603/pa/BS21555_b3245a45b67501c9460e8d7ad03b42c8.jpg',
                'https://img-pa.auto1.com/img85/ff/85ff8d242d2db64774c4fabd3505c603/pa/BS21555_5942d23b8ec78bff1e4a805ab8337e21.jpg',
                'https://img-pa.auto1.com/img85/ff/85ff8d242d2db64774c4fabd3505c603/pa/BS21555_f0df79eae782d54442aeeb5d3dece228.jpg',
                'https://img-pa.auto1.com/img85/ff/85ff8d242d2db64774c4fabd3505c603/pa/BS21555_aee9bd1e190fa1549a56cfee4116d58a.jpg',
                'https://img-pa.auto1.com/img85/ff/85ff8d242d2db64774c4fabd3505c603/pa/BS21555_4ab56d86eb910c1b1cf8b259211e9c91.jpg'],
 'photos': [],
 'postal_code': '44850',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Loire-Atlantique',
 'province_code': 'FR-44',
 'region': 'Pays de la Loire',
 'region_code': 'FR-52',
 'registration_date': '2014-06-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat 500L 1.6 JTDM Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2014}
2026-04-27 08:12:06 [auto1.fr] INFO: Saving data for BS21555: {'created_time': 1777277526.580777, 'last_price_update_time': 1777277526.580787, 'has_photos': False, 'auction_closing_time': 1777389127.0}
2026-04-27 08:12:06 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item e809ad95-e055-5b29-a190-37933b6bfe99 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RN15222/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:06 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item 57ac8ba4-ffa4-5a57-a1a8-1e9f41b81395 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:07 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 57ac8ba4-ffa4-5a57-a1a8-1e9f41b81395 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:07 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item 57ac8ba4-ffa4-5a57-a1a8-1e9f41b81395 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:07 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item 57ac8ba4-ffa4-5a57-a1a8-1e9f41b81395 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EG39801> (referer: https://www.auto1.com/v1/car-details-view/EG39801/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15a38de9-496d-52d9-9248-2f28b4284a23 with identifier: EG39801
2026-04-27 08:12:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15a38de9-496d-52d9-9248-2f28b4284a23 with scrape type 1
2026-04-27 08:12:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 15a38de9-496d-52d9-9248-2f28b4284a23
2026-04-27 08:12:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/3b/3f3bd441e7517182a368ca07534998a9/pa/EG39801_651db316a3e4275a870e800dc963151d.jpg not downloaded yet
2026-04-27 08:12:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/3b/3f3bd441e7517182a368ca07534998a9/pa/EG39801_76079d771981a8ba83737df5c087a174.jpg not downloaded yet
2026-04-27 08:12:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/3b/3f3bd441e7517182a368ca07534998a9/pa/EG39801_2146f0eaad3bc4f821c94bd87fe27607.jpg not downloaded yet
2026-04-27 08:12:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/3b/3f3bd441e7517182a368ca07534998a9/pa/EG39801_d15789276408832b9ff85061e33748c0.jpg not downloaded yet
2026-04-27 08:12:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/3b/3f3bd441e7517182a368ca07534998a9/pa/EG39801_ad4f1e9c9533890199d3436d6b99186c.jpg not downloaded yet
2026-04-27 08:12:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/3b/3f3bd441e7517182a368ca07534998a9/pa/EG39801_a5f1bad3c48dbc0ed0ce74a6b80b7c83.jpg not downloaded yet
2026-04-27 08:12:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/3b/3f3bd441e7517182a368ca07534998a9/pa/EG39801_053c93bb645e6f9d3bed142f00fa7a9e.jpg not downloaded yet
2026-04-27 08:12:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/3b/3f3bd441e7517182a368ca07534998a9/pa/EG39801_cec20e724704223e4a156a27caf07e87.jpg not downloaded yet
2026-04-27 08:12:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/3b/3f3bd441e7517182a368ca07534998a9/pa/EG39801_86fc2c75708bda8a28f3ba369f6e4da4.jpg not downloaded yet
2026-04-27 08:12:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/3b/3f3bd441e7517182a368ca07534998a9/pa/EG39801_09c224c24c460551b3106fc1b84b4f23.jpg not downloaded yet
2026-04-27 08:12:08 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 57ac8ba4-ffa4-5a57-a1a8-1e9f41b81395 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 57ac8ba4-ffa4-5a57-a1a8-1e9f41b81395 with identifier: TY72648
2026-04-27 08:12:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 57ac8ba4-ffa4-5a57-a1a8-1e9f41b81395 with identifier: TY72648
2026-04-27 08:12:08 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:12:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 57ac8ba4-ffa4-5a57-a1a8-1e9f41b81395 with identifier: TY72648 to the API
2026-04-27 08:12:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:12:08 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:12:09 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'category': None,
 'city': 'Échirolles',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 3',
 'engine': '2.0L',
 'engine_horse_power': 130,
 'expiration_date': '2026-04-28T15:58:31Z',
 'fuel_type': 'diesel',
 'id': '57ac8ba4-ffa4-5a57-a1a8-1e9f41b81395',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 45.146,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TY72648',
 'listing': 'auction',
 'location': 'FR, Échirolles',
 'location_confidence': 'geocoded',
 'longitude': 5.7144,
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 232781,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/imgfe/78/fe7866b322948252c81828ff1a83fd04/pa/TY72648_46bab7f2fba3e04ced027370a8fede7f.jpg',
                'https://img-pa.auto1.com/imgfe/78/fe7866b322948252c81828ff1a83fd04/pa/TY72648_c4f5c783fcfe9ff50bade29723d19e04.jpg',
                'https://img-pa.auto1.com/imgfe/78/fe7866b322948252c81828ff1a83fd04/pa/TY72648_99e1f0c7f39aee7fe32b0244ae3af374.jpg',
                'https://img-pa.auto1.com/imgfe/78/fe7866b322948252c81828ff1a83fd04/pa/TY72648_e08fc71bde08d88e1a5399f8a88dcc0e.jpg',
                'https://img-pa.auto1.com/imgfe/78/fe7866b322948252c81828ff1a83fd04/pa/TY72648_4453db4bd82c92d7b8d4a8ab527b53fa.jpg',
                'https://img-pa.auto1.com/imgfe/78/fe7866b322948252c81828ff1a83fd04/pa/TY72648_2c1cd816d8dfb7b9e793a3be7ea67433.jpg'],
 'photos': [],
 'postal_code': '38130',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Isère',
 'province_code': 'FR-38',
 'region': 'Auvergne-Rhône-Alpes',
 'region_code': 'FR-84',
 'registration_date': '2005-08-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Mondeo 2.0 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2005}
2026-04-27 08:12:09 [auto1.fr] INFO: Saving data for TY72648: {'created_time': 1777277529.072738, 'last_price_update_time': 1777277529.072748, 'has_photos': False, 'auction_closing_time': 1777391911.0}
2026-04-27 08:12:09 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 57ac8ba4-ffa4-5a57-a1a8-1e9f41b81395 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:09 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item b951bf04-4b02-5715-80dd-82b5cd4ff291 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:09 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 15a38de9-496d-52d9-9248-2f28b4284a23 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:09 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 15a38de9-496d-52d9-9248-2f28b4284a23 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:10 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 15a38de9-496d-52d9-9248-2f28b4284a23 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:10 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 15a38de9-496d-52d9-9248-2f28b4284a23 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:10 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item 15a38de9-496d-52d9-9248-2f28b4284a23 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:11 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 15a38de9-496d-52d9-9248-2f28b4284a23 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:11 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item 15a38de9-496d-52d9-9248-2f28b4284a23 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:11 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item 15a38de9-496d-52d9-9248-2f28b4284a23 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:12 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 15a38de9-496d-52d9-9248-2f28b4284a23 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 15a38de9-496d-52d9-9248-2f28b4284a23 with identifier: EG39801
2026-04-27 08:12:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 15a38de9-496d-52d9-9248-2f28b4284a23 with identifier: EG39801
2026-04-27 08:12:12 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:12:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 15a38de9-496d-52d9-9248-2f28b4284a23 with identifier: EG39801 to the API
2026-04-27 08:12:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:12:13 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:12:13 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': None,
 'city': 'Beaucaire',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 180,
 'expiration_date': '2026-04-28T15:40:42Z',
 'fuel_type': 'diesel',
 'id': '15a38de9-496d-52d9-9248-2f28b4284a23',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 43.8081,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EG39801',
 'listing': 'auction',
 'location': 'FR, Beaucaire',
 'location_confidence': 'geocoded',
 'longitude': 4.6442,
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 231214,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img3f/3b/3f3bd441e7517182a368ca07534998a9/pa/EG39801_651db316a3e4275a870e800dc963151d.jpg',
                'https://img-pa.auto1.com/img3f/3b/3f3bd441e7517182a368ca07534998a9/pa/EG39801_76079d771981a8ba83737df5c087a174.jpg',
                'https://img-pa.auto1.com/img3f/3b/3f3bd441e7517182a368ca07534998a9/pa/EG39801_2146f0eaad3bc4f821c94bd87fe27607.jpg',
                'https://img-pa.auto1.com/img3f/3b/3f3bd441e7517182a368ca07534998a9/pa/EG39801_d15789276408832b9ff85061e33748c0.jpg',
                'https://img-pa.auto1.com/img3f/3b/3f3bd441e7517182a368ca07534998a9/pa/EG39801_ad4f1e9c9533890199d3436d6b99186c.jpg',
                'https://img-pa.auto1.com/img3f/3b/3f3bd441e7517182a368ca07534998a9/pa/EG39801_a5f1bad3c48dbc0ed0ce74a6b80b7c83.jpg',
                'https://img-pa.auto1.com/img3f/3b/3f3bd441e7517182a368ca07534998a9/pa/EG39801_053c93bb645e6f9d3bed142f00fa7a9e.jpg',
                'https://img-pa.auto1.com/img3f/3b/3f3bd441e7517182a368ca07534998a9/pa/EG39801_cec20e724704223e4a156a27caf07e87.jpg',
                'https://img-pa.auto1.com/img3f/3b/3f3bd441e7517182a368ca07534998a9/pa/EG39801_86fc2c75708bda8a28f3ba369f6e4da4.jpg',
                'https://img-pa.auto1.com/img3f/3b/3f3bd441e7517182a368ca07534998a9/pa/EG39801_09c224c24c460551b3106fc1b84b4f23.jpg'],
 'photos': [],
 'postal_code': '30300',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Gard',
 'province_code': 'FR-30',
 'region': 'Occitanie',
 'region_code': 'FR-76',
 'registration_date': '2014-06-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo XC60 2.0 D4 Momentum Drive',
 'transmission': 'automatic',
 'trim': 'Momentum Drive',
 'year': 2014}
2026-04-27 08:12:13 [auto1.fr] INFO: Saving data for EG39801: {'created_time': 1777277533.194829, 'last_price_update_time': 1777277533.194841, 'has_photos': False, 'auction_closing_time': 1777390842.0}
2026-04-27 08:12:13 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 15a38de9-496d-52d9-9248-2f28b4284a23 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:13 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item b951bf04-4b02-5715-80dd-82b5cd4ff291 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VE26914> (referer: https://www.auto1.com/v1/car-details-view/VE26914/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fff71712-9189-503f-90e8-622bd6770014 with identifier: VE26914
2026-04-27 08:12:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fff71712-9189-503f-90e8-622bd6770014 with scrape type 1
2026-04-27 08:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fff71712-9189-503f-90e8-622bd6770014
2026-04-27 08:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/4f/4f4f2f2f0990fcf58932853506df1030/pa/VE26914_9108392cda0931694b358cd42355a32c.jpg not downloaded yet
2026-04-27 08:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/4f/4f4f2f2f0990fcf58932853506df1030/pa/VE26914_d375695763718aac334fe2f2a947e882.jpg not downloaded yet
2026-04-27 08:12:13 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item b951bf04-4b02-5715-80dd-82b5cd4ff291 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/4f/4f4f2f2f0990fcf58932853506df1030/pa/VE26914_06271473d2f28ac3a5724fba0302aaca.jpg not downloaded yet
2026-04-27 08:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/4f/4f4f2f2f0990fcf58932853506df1030/pa/VE26914_ed39e4e1d39cdaf7e9ea42c00432e4aa.jpg not downloaded yet
2026-04-27 08:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/4f/4f4f2f2f0990fcf58932853506df1030/pa/VE26914_becd2ec4afabb9d0eaf2b5870a47b63d.jpg not downloaded yet
2026-04-27 08:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/4f/4f4f2f2f0990fcf58932853506df1030/pa/VE26914_27c7f405386e62d33ed55a1d080b4b19.jpg not downloaded yet
2026-04-27 08:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/4f/4f4f2f2f0990fcf58932853506df1030/pa/VE26914_e846fcb6a5feda2c07914564afcd48b2.jpg not downloaded yet
2026-04-27 08:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/4f/4f4f2f2f0990fcf58932853506df1030/pa/VE26914_4d90b08dd04a148f8233d5e545a7fedf.jpg not downloaded yet
2026-04-27 08:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/4f/4f4f2f2f0990fcf58932853506df1030/pa/VE26914_0ed88864905180e1c362c8e14e9aa6ba.jpg not downloaded yet
2026-04-27 08:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/4f/4f4f2f2f0990fcf58932853506df1030/pa/VE26914_1342d2920740abb7303b6c7a06f314d6.jpg not downloaded yet
2026-04-27 08:12:13 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item b951bf04-4b02-5715-80dd-82b5cd4ff291 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:13 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item b951bf04-4b02-5715-80dd-82b5cd4ff291 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:14 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item b951bf04-4b02-5715-80dd-82b5cd4ff291 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:14 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item b951bf04-4b02-5715-80dd-82b5cd4ff291 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:14 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item fff71712-9189-503f-90e8-622bd6770014 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:14 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item fff71712-9189-503f-90e8-622bd6770014 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:15 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item fff71712-9189-503f-90e8-622bd6770014 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:15 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item fff71712-9189-503f-90e8-622bd6770014 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BH32555> (referer: https://www.auto1.com/v1/car-details-view/BH32555/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e5ec510-12cc-5c38-ba18-b8aafc159ea4 with identifier: BH32555
2026-04-27 08:12:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e5ec510-12cc-5c38-ba18-b8aafc159ea4 with scrape type 1
2026-04-27 08:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 7e5ec510-12cc-5c38-ba18-b8aafc159ea4
2026-04-27 08:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/9c/a39c67f8c448f9249245d22f9f3a8134/pa/BH32555_ddeda02f44788fdc3404048a33c925fe.jpg not downloaded yet
2026-04-27 08:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/9c/a39c67f8c448f9249245d22f9f3a8134/pa/BH32555_62973639922141cfd0160b5460fd2d9d.jpg not downloaded yet
2026-04-27 08:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/9c/a39c67f8c448f9249245d22f9f3a8134/pa/BH32555_ba60d28bba698dd641fbbbc2ec50cd03.jpg not downloaded yet
2026-04-27 08:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/9c/a39c67f8c448f9249245d22f9f3a8134/pa/BH32555_ff9f43e926a3b14c56e7ff3bbfa32c01.jpg not downloaded yet
2026-04-27 08:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/9c/a39c67f8c448f9249245d22f9f3a8134/pa/BH32555_1e8d852433c7fec06e99ec279b681f58.jpg not downloaded yet
2026-04-27 08:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/9c/a39c67f8c448f9249245d22f9f3a8134/pa/BH32555_6bedecacd92f952da80d0b25153c0bad.jpg not downloaded yet
2026-04-27 08:12:15 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item fff71712-9189-503f-90e8-622bd6770014 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:15 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item fff71712-9189-503f-90e8-622bd6770014 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:16 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item fff71712-9189-503f-90e8-622bd6770014 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:16 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item fff71712-9189-503f-90e8-622bd6770014 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:16 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item fff71712-9189-503f-90e8-622bd6770014 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:17 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item 7e5ec510-12cc-5c38-ba18-b8aafc159ea4 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:17 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 7e5ec510-12cc-5c38-ba18-b8aafc159ea4 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MJ97326/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:17 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item 7e5ec510-12cc-5c38-ba18-b8aafc159ea4 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:17 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item 7e5ec510-12cc-5c38-ba18-b8aafc159ea4 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:17 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 7e5ec510-12cc-5c38-ba18-b8aafc159ea4 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XU74860> (referer: https://www.auto1.com/v1/car-details-view/XU74860/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b807f2a-6f9b-5f3e-861d-b590b8932c7f with identifier: XU74860
2026-04-27 08:12:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b807f2a-6f9b-5f3e-861d-b590b8932c7f with scrape type 1
2026-04-27 08:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0b807f2a-6f9b-5f3e-861d-b590b8932c7f
2026-04-27 08:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/81/4781f5ea31330f07553a3e8f13bac5d1/pa/XU74860_4ac98b58793925dbefb0b432a656bb0f.jpg not downloaded yet
2026-04-27 08:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/81/4781f5ea31330f07553a3e8f13bac5d1/pa/XU74860_1355213e8f46026314a37632c2595804.jpg not downloaded yet
2026-04-27 08:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/81/4781f5ea31330f07553a3e8f13bac5d1/pa/XU74860_405ee83caf58f436b1bbc4cc32c22016.jpg not downloaded yet
2026-04-27 08:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/81/4781f5ea31330f07553a3e8f13bac5d1/pa/XU74860_3a1ed82ea468e21f6c259781d9557227.jpg not downloaded yet
2026-04-27 08:12:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7e5ec510-12cc-5c38-ba18-b8aafc159ea4 with identifier: BH32555
2026-04-27 08:12:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7e5ec510-12cc-5c38-ba18-b8aafc159ea4 with identifier: BH32555
2026-04-27 08:12:18 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:12:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 7e5ec510-12cc-5c38-ba18-b8aafc159ea4 with identifier: BH32555 to the API
2026-04-27 08:12:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:12:18 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:12:18 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'category': None,
 'city': 'Creutzwald',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.0L',
 'engine_horse_power': 68,
 'expiration_date': '2026-04-28T15:20:49Z',
 'fuel_type': 'petrol',
 'id': '7e5ec510-12cc-5c38-ba18-b8aafc159ea4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 49.2053,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BH32555',
 'listing': 'auction',
 'location': 'FR, Creutzwald',
 'location_confidence': 'geocoded',
 'longitude': 6.6967,
 'make': 'Citroen',
 'model': 'C1',
 'odometer': 140440,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/imga3/9c/a39c67f8c448f9249245d22f9f3a8134/pa/BH32555_ddeda02f44788fdc3404048a33c925fe.jpg',
                'https://img-pa.auto1.com/imga3/9c/a39c67f8c448f9249245d22f9f3a8134/pa/BH32555_62973639922141cfd0160b5460fd2d9d.jpg',
                'https://img-pa.auto1.com/imga3/9c/a39c67f8c448f9249245d22f9f3a8134/pa/BH32555_ba60d28bba698dd641fbbbc2ec50cd03.jpg',
                'https://img-pa.auto1.com/imga3/9c/a39c67f8c448f9249245d22f9f3a8134/pa/BH32555_ff9f43e926a3b14c56e7ff3bbfa32c01.jpg',
                'https://img-pa.auto1.com/imga3/9c/a39c67f8c448f9249245d22f9f3a8134/pa/BH32555_1e8d852433c7fec06e99ec279b681f58.jpg',
                'https://img-pa.auto1.com/imga3/9c/a39c67f8c448f9249245d22f9f3a8134/pa/BH32555_6bedecacd92f952da80d0b25153c0bad.jpg'],
 'photos': [],
 'postal_code': '57150',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Moselle',
 'province_code': 'FR-57',
 'region': 'Grand Est',
 'region_code': 'FR-44',
 'registration_date': '2009-05-03',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Citroen C1 1.0 Confort',
 'transmission': 'manual',
 'trim': 'Confort',
 'year': 2009}
2026-04-27 08:12:18 [auto1.fr] INFO: Saving data for BH32555: {'created_time': 1777277538.411063, 'last_price_update_time': 1777277538.411075, 'has_photos': False, 'auction_closing_time': 1777389649.0}
2026-04-27 08:12:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: fff71712-9189-503f-90e8-622bd6770014 with identifier: VE26914
2026-04-27 08:12:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: fff71712-9189-503f-90e8-622bd6770014 with identifier: VE26914
2026-04-27 08:12:18 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:12:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: fff71712-9189-503f-90e8-622bd6770014 with identifier: VE26914 to the API
2026-04-27 08:12:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:12:18 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:12:18 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': 98,
 'category': None,
 'city': 'Creutzwald',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 109,
 'expiration_date': '2026-04-28T15:24:34Z',
 'fuel_type': 'diesel',
 'id': 'fff71712-9189-503f-90e8-622bd6770014',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 49.2053,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VE26914',
 'listing': 'auction',
 'location': 'FR, Creutzwald',
 'location_confidence': 'geocoded',
 'longitude': 6.6967,
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 166980,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img4f/4f/4f4f2f2f0990fcf58932853506df1030/pa/VE26914_9108392cda0931694b358cd42355a32c.jpg',
                'https://img-pa.auto1.com/img4f/4f/4f4f2f2f0990fcf58932853506df1030/pa/VE26914_d375695763718aac334fe2f2a947e882.jpg',
                'https://img-pa.auto1.com/img4f/4f/4f4f2f2f0990fcf58932853506df1030/pa/VE26914_06271473d2f28ac3a5724fba0302aaca.jpg',
                'https://img-pa.auto1.com/img4f/4f/4f4f2f2f0990fcf58932853506df1030/pa/VE26914_ed39e4e1d39cdaf7e9ea42c00432e4aa.jpg',
                'https://img-pa.auto1.com/img4f/4f/4f4f2f2f0990fcf58932853506df1030/pa/VE26914_becd2ec4afabb9d0eaf2b5870a47b63d.jpg',
                'https://img-pa.auto1.com/img4f/4f/4f4f2f2f0990fcf58932853506df1030/pa/VE26914_27c7f405386e62d33ed55a1d080b4b19.jpg',
                'https://img-pa.auto1.com/img4f/4f/4f4f2f2f0990fcf58932853506df1030/pa/VE26914_e846fcb6a5feda2c07914564afcd48b2.jpg',
                'https://img-pa.auto1.com/img4f/4f/4f4f2f2f0990fcf58932853506df1030/pa/VE26914_4d90b08dd04a148f8233d5e545a7fedf.jpg',
                'https://img-pa.auto1.com/img4f/4f/4f4f2f2f0990fcf58932853506df1030/pa/VE26914_0ed88864905180e1c362c8e14e9aa6ba.jpg',
                'https://img-pa.auto1.com/img4f/4f/4f4f2f2f0990fcf58932853506df1030/pa/VE26914_1342d2920740abb7303b6c7a06f314d6.jpg'],
 'photos': [],
 'postal_code': '57150',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Moselle',
 'province_code': 'FR-57',
 'region': 'Grand Est',
 'region_code': 'FR-44',
 'registration_date': '2017-12-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 d Edition Sport',
 'transmission': 'manual',
 'trim': 'Edition Sport',
 'year': 2017}
2026-04-27 08:12:18 [auto1.fr] INFO: Saving data for VE26914: {'created_time': 1777277538.762643, 'last_price_update_time': 1777277538.762654, 'has_photos': False, 'auction_closing_time': 1777389874.0}
2026-04-27 08:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/81/4781f5ea31330f07553a3e8f13bac5d1/pa/XU74860_53d230a9fed9a23687c84b3a07c88c6e.jpg not downloaded yet
2026-04-27 08:12:18 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 7e5ec510-12cc-5c38-ba18-b8aafc159ea4 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:18 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item fff71712-9189-503f-90e8-622bd6770014 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/81/4781f5ea31330f07553a3e8f13bac5d1/pa/XU74860_61223d6aba7d3388b86c89950c528678.jpg not downloaded yet
2026-04-27 08:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/81/4781f5ea31330f07553a3e8f13bac5d1/pa/XU74860_dc37f4ffb442219901ae2b0a1b05f822.jpg not downloaded yet
2026-04-27 08:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/81/4781f5ea31330f07553a3e8f13bac5d1/pa/XU74860_52ea5538a7c1d08b9f334bb8ad86743a.jpg not downloaded yet
2026-04-27 08:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/81/4781f5ea31330f07553a3e8f13bac5d1/pa/XU74860_6c93fa56004e7cf4ceae534e957a15ba.jpg not downloaded yet
2026-04-27 08:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/81/4781f5ea31330f07553a3e8f13bac5d1/pa/XU74860_55471c291e95db730c860719e07ec611.jpg not downloaded yet
2026-04-27 08:12:18 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item b951bf04-4b02-5715-80dd-82b5cd4ff291 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b951bf04-4b02-5715-80dd-82b5cd4ff291 with identifier: JL62454
2026-04-27 08:12:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b951bf04-4b02-5715-80dd-82b5cd4ff291 with identifier: JL62454
2026-04-27 08:12:19 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:12:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b951bf04-4b02-5715-80dd-82b5cd4ff291 with identifier: JL62454 to the API
2026-04-27 08:12:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:12:19 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:12:19 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'category': None,
 'city': 'LA CHAPELLE LONGUEVILLE',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 181,
 'expiration_date': '2026-04-28T15:07:49Z',
 'fuel_type': 'petrol',
 'id': 'b951bf04-4b02-5715-80dd-82b5cd4ff291',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JL62454',
 'listing': 'auction',
 'location': 'FR, LA CHAPELLE LONGUEVILLE',
 'location_confidence': None,
 'longitude': None,
 'make': 'Citroen',
 'model': 'C5 Aircross',
 'odometer': 130669,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgbe/60/be60ecf0d4daaa7502fceeb1acd23b0a/pa/JL62454_d3aac4f0eac104ea22d855a52d24943c.jpg',
                'https://img-pa.auto1.com/imgbe/60/be60ecf0d4daaa7502fceeb1acd23b0a/pa/JL62454_09f2f864d91c5ddd53a15fcbe20796cf.jpg',
                'https://img-pa.auto1.com/imgbe/60/be60ecf0d4daaa7502fceeb1acd23b0a/pa/JL62454_98b1cd0205b83404a5e0520ab1df0323.jpg',
                'https://img-pa.auto1.com/imgbe/60/be60ecf0d4daaa7502fceeb1acd23b0a/pa/JL62454_8b7ca44f25922e1f4ce735f4981827fa.jpg',
                'https://img-pa.auto1.com/imgbe/60/be60ecf0d4daaa7502fceeb1acd23b0a/pa/JL62454_e67fc4a607ec11d3467cbc64291132c7.jpg',
                'https://img-pa.auto1.com/imgbe/60/be60ecf0d4daaa7502fceeb1acd23b0a/pa/JL62454_ffba585a44357306aad5d050d07e9b79.jpg',
                'https://img-pa.auto1.com/imgbe/60/be60ecf0d4daaa7502fceeb1acd23b0a/pa/JL62454_1ec8251d4c39288639dbfd3435b6f0f9.jpg',
                'https://img-pa.auto1.com/imgbe/60/be60ecf0d4daaa7502fceeb1acd23b0a/pa/JL62454_72ec320eefcc2907494789ec00a5f94e.jpg',
                'https://img-pa.auto1.com/imgbe/60/be60ecf0d4daaa7502fceeb1acd23b0a/pa/JL62454_b981650aa99b4d98863ad992e01632f9.jpg',
                'https://img-pa.auto1.com/imgbe/60/be60ecf0d4daaa7502fceeb1acd23b0a/pa/JL62454_0eaeb658aac145d0c060598d76a37985.jpg'],
 'photos': [],
 'postal_code': None,
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2019-03-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C5 Aircross 1.6 PureTech Feel',
 'transmission': 'automatic',
 'trim': 'Feel',
 'year': 2019}
2026-04-27 08:12:19 [auto1.fr] INFO: Saving data for JL62454: {'created_time': 1777277539.237319, 'last_price_update_time': 1777277539.237335, 'has_photos': False, 'auction_closing_time': 1777388869.0}
2026-04-27 08:12:19 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item b951bf04-4b02-5715-80dd-82b5cd4ff291 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WH02443> (referer: https://www.auto1.com/v1/car-details-view/WH02443/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:19 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item 0b807f2a-6f9b-5f3e-861d-b590b8932c7f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:19 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item 0b807f2a-6f9b-5f3e-861d-b590b8932c7f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f9f8acf-bec9-55e9-a0f2-179eb26de769 with identifier: WH02443
2026-04-27 08:12:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f9f8acf-bec9-55e9-a0f2-179eb26de769 with scrape type 1
2026-04-27 08:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2f9f8acf-bec9-55e9-a0f2-179eb26de769
2026-04-27 08:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/b1/14b191231247f7c868c4c80a129e6bfe/pa/WH02443_e05b2e2799a2ba018a25905573295745.jpg not downloaded yet
2026-04-27 08:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/b1/14b191231247f7c868c4c80a129e6bfe/pa/WH02443_0d1ab2097f1fcd6f8bcb7299ef47968f.jpg not downloaded yet
2026-04-27 08:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/b1/14b191231247f7c868c4c80a129e6bfe/pa/WH02443_87ba6d2785c0c7e7e1545a0743f702f8.jpg not downloaded yet
2026-04-27 08:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/b1/14b191231247f7c868c4c80a129e6bfe/pa/WH02443_8f2b7908d149158b0273142ca739e5f5.jpg not downloaded yet
2026-04-27 08:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/b1/14b191231247f7c868c4c80a129e6bfe/pa/WH02443_84936d2fb5cfa76e94c55a9c34928342.jpg not downloaded yet
2026-04-27 08:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/b1/14b191231247f7c868c4c80a129e6bfe/pa/WH02443_3dcbf8cee42ab2def9ae78d58e2794f4.jpg not downloaded yet
2026-04-27 08:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/b1/14b191231247f7c868c4c80a129e6bfe/pa/WH02443_3505ed97f935f3f5e4b92d2164195e0c.jpg not downloaded yet
2026-04-27 08:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/b1/14b191231247f7c868c4c80a129e6bfe/pa/WH02443_6fe682d14c19cadc0551493d5ad7b961.jpg not downloaded yet
2026-04-27 08:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/b1/14b191231247f7c868c4c80a129e6bfe/pa/WH02443_ecbec646084e42f8a51c14040e5fcc27.jpg not downloaded yet
2026-04-27 08:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/b1/14b191231247f7c868c4c80a129e6bfe/pa/WH02443_5c93afe279eb0c52a719aea178ce98a3.jpg not downloaded yet
2026-04-27 08:12:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XX57600/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:20 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 0b807f2a-6f9b-5f3e-861d-b590b8932c7f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:20 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 0b807f2a-6f9b-5f3e-861d-b590b8932c7f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:21 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 0b807f2a-6f9b-5f3e-861d-b590b8932c7f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:21 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 2f9f8acf-bec9-55e9-a0f2-179eb26de769 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:22 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 2f9f8acf-bec9-55e9-a0f2-179eb26de769 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:22 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 2f9f8acf-bec9-55e9-a0f2-179eb26de769 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RN15222> (referer: https://www.auto1.com/v1/car-details-view/RN15222/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00c7534d-cfed-51eb-bafa-d1948cbfd739 with identifier: RN15222
2026-04-27 08:12:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00c7534d-cfed-51eb-bafa-d1948cbfd739 with scrape type 1
2026-04-27 08:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 00c7534d-cfed-51eb-bafa-d1948cbfd739
2026-04-27 08:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/40/b940a6c8a1734b95e3c6271edcd18946/pa/RN15222_cdf8e3e910acfc5c94afd1028cb6b8f0.jpg not downloaded yet
2026-04-27 08:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/40/b940a6c8a1734b95e3c6271edcd18946/pa/RN15222_e64f98bf4f832edb0677e940955c309f.jpg not downloaded yet
2026-04-27 08:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/40/b940a6c8a1734b95e3c6271edcd18946/pa/RN15222_8aaec7e627e3ea2d4f4f001aa627c380.jpg not downloaded yet
2026-04-27 08:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/40/b940a6c8a1734b95e3c6271edcd18946/pa/RN15222_91c4c4dc7478493a56a968c759f76668.jpg not downloaded yet
2026-04-27 08:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/40/b940a6c8a1734b95e3c6271edcd18946/pa/RN15222_d95e09ee4bb2fcbc31323e59a3ddd17d.jpg not downloaded yet
2026-04-27 08:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/40/b940a6c8a1734b95e3c6271edcd18946/pa/RN15222_ce1b0d012bc2ea2bf423330278d56f04.jpg not downloaded yet
2026-04-27 08:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/40/b940a6c8a1734b95e3c6271edcd18946/pa/RN15222_51e148961be39c99c36f33ecacb0bb2e.jpg not downloaded yet
2026-04-27 08:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/40/b940a6c8a1734b95e3c6271edcd18946/pa/RN15222_f8fd19653888fc61796a55c3678533e2.jpg not downloaded yet
2026-04-27 08:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/40/b940a6c8a1734b95e3c6271edcd18946/pa/RN15222_b19a39d613a4d7072eafb5deb7c7f77e.jpg not downloaded yet
2026-04-27 08:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/40/b940a6c8a1734b95e3c6271edcd18946/pa/RN15222_9cc3d6e4a7a492afe96cf8704b2c8758.jpg not downloaded yet
2026-04-27 08:12:22 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 2f9f8acf-bec9-55e9-a0f2-179eb26de769 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:23 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item 2f9f8acf-bec9-55e9-a0f2-179eb26de769 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:23 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 2f9f8acf-bec9-55e9-a0f2-179eb26de769 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:23 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item 2f9f8acf-bec9-55e9-a0f2-179eb26de769 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:23 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item 00c7534d-cfed-51eb-bafa-d1948cbfd739 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:24 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 00c7534d-cfed-51eb-bafa-d1948cbfd739 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:24 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 00c7534d-cfed-51eb-bafa-d1948cbfd739 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:24 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 00c7534d-cfed-51eb-bafa-d1948cbfd739 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:24 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 00c7534d-cfed-51eb-bafa-d1948cbfd739 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MJ97326> (referer: https://www.auto1.com/v1/car-details-view/MJ97326/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8466de91-3066-5d5e-934c-c156bee16975 with identifier: MJ97326
2026-04-27 08:12:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8466de91-3066-5d5e-934c-c156bee16975 with scrape type 1
2026-04-27 08:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8466de91-3066-5d5e-934c-c156bee16975
2026-04-27 08:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/23/7523b21a4db72b05e52768fb2c2f891a/pa/MJ97326_cd7a06f9e830d790503a61933e8382b1.jpg not downloaded yet
2026-04-27 08:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/23/7523b21a4db72b05e52768fb2c2f891a/pa/MJ97326_9d6c2f68e92f7a6c3cfcd4f7d7c9ffd8.jpg not downloaded yet
2026-04-27 08:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/23/7523b21a4db72b05e52768fb2c2f891a/pa/MJ97326_902e41507a17f8d2aa556cff9fb43b5e.jpg not downloaded yet
2026-04-27 08:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/23/7523b21a4db72b05e52768fb2c2f891a/pa/MJ97326_9969d114d3ca0c61d7ecbbdb0ddffd10.jpg not downloaded yet
2026-04-27 08:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/23/7523b21a4db72b05e52768fb2c2f891a/pa/MJ97326_5c7407f0060f2ea3263b02477920e2a9.jpg not downloaded yet
2026-04-27 08:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/23/7523b21a4db72b05e52768fb2c2f891a/pa/MJ97326_ce7d8bbfdfcad7ff2d98820d029a28e0.jpg not downloaded yet
2026-04-27 08:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/23/7523b21a4db72b05e52768fb2c2f891a/pa/MJ97326_5effe8c34466966388125547d6ee1117.jpg not downloaded yet
2026-04-27 08:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/23/7523b21a4db72b05e52768fb2c2f891a/pa/MJ97326_5a0f7954bb813f7add8d588fcbc7d745.jpg not downloaded yet
2026-04-27 08:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/23/7523b21a4db72b05e52768fb2c2f891a/pa/MJ97326_da07909e12a117b10ce4e3d56b21a6b0.jpg not downloaded yet
2026-04-27 08:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/23/7523b21a4db72b05e52768fb2c2f891a/pa/MJ97326_4d3eed37881ee363348789bece73a9f5.jpg not downloaded yet
2026-04-27 08:12:25 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 00c7534d-cfed-51eb-bafa-d1948cbfd739 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:25 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item 00c7534d-cfed-51eb-bafa-d1948cbfd739 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:25 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item 00c7534d-cfed-51eb-bafa-d1948cbfd739 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:25 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 00c7534d-cfed-51eb-bafa-d1948cbfd739 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 00c7534d-cfed-51eb-bafa-d1948cbfd739 with identifier: RN15222
2026-04-27 08:12:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 00c7534d-cfed-51eb-bafa-d1948cbfd739 with identifier: RN15222
2026-04-27 08:12:25 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:12:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 00c7534d-cfed-51eb-bafa-d1948cbfd739 with identifier: RN15222 to the API
2026-04-27 08:12:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:12:25 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:12:26 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'category': None,
 'city': 'Le Havre',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 120,
 'expiration_date': '2026-04-28T15:53:07Z',
 'fuel_type': 'diesel',
 'id': '00c7534d-cfed-51eb-bafa-d1948cbfd739',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 49.4935,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RN15222',
 'listing': 'auction',
 'location': 'FR, LE HAVRE',
 'location_confidence': 'geocoded',
 'longitude': 0.1079,
 'make': 'Citroen',
 'model': 'C3 Aircross',
 'odometer': 167108,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgb9/40/b940a6c8a1734b95e3c6271edcd18946/pa/RN15222_cdf8e3e910acfc5c94afd1028cb6b8f0.jpg',
                'https://img-pa.auto1.com/imgb9/40/b940a6c8a1734b95e3c6271edcd18946/pa/RN15222_e64f98bf4f832edb0677e940955c309f.jpg',
                'https://img-pa.auto1.com/imgb9/40/b940a6c8a1734b95e3c6271edcd18946/pa/RN15222_8aaec7e627e3ea2d4f4f001aa627c380.jpg',
                'https://img-pa.auto1.com/imgb9/40/b940a6c8a1734b95e3c6271edcd18946/pa/RN15222_91c4c4dc7478493a56a968c759f76668.jpg',
                'https://img-pa.auto1.com/imgb9/40/b940a6c8a1734b95e3c6271edcd18946/pa/RN15222_d95e09ee4bb2fcbc31323e59a3ddd17d.jpg',
                'https://img-pa.auto1.com/imgb9/40/b940a6c8a1734b95e3c6271edcd18946/pa/RN15222_ce1b0d012bc2ea2bf423330278d56f04.jpg',
                'https://img-pa.auto1.com/imgb9/40/b940a6c8a1734b95e3c6271edcd18946/pa/RN15222_51e148961be39c99c36f33ecacb0bb2e.jpg',
                'https://img-pa.auto1.com/imgb9/40/b940a6c8a1734b95e3c6271edcd18946/pa/RN15222_f8fd19653888fc61796a55c3678533e2.jpg',
                'https://img-pa.auto1.com/imgb9/40/b940a6c8a1734b95e3c6271edcd18946/pa/RN15222_b19a39d613a4d7072eafb5deb7c7f77e.jpg',
                'https://img-pa.auto1.com/imgb9/40/b940a6c8a1734b95e3c6271edcd18946/pa/RN15222_9cc3d6e4a7a492afe96cf8704b2c8758.jpg'],
 'photos': [],
 'postal_code': '76050 CEDEX',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Seine-Maritime',
 'province_code': 'FR-76',
 'region': 'Normandie',
 'region_code': 'FR-28',
 'registration_date': '2020-01-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 Aircross 1.5 Blue-HDi Feel Business',
 'transmission': 'automatic',
 'trim': 'Feel Business',
 'year': 2020}
2026-04-27 08:12:26 [auto1.fr] INFO: Saving data for RN15222: {'created_time': 1777277546.054519, 'last_price_update_time': 1777277546.054529, 'has_photos': False, 'auction_closing_time': 1777391587.0}
2026-04-27 08:12:26 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 00c7534d-cfed-51eb-bafa-d1948cbfd739 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:26 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 8466de91-3066-5d5e-934c-c156bee16975 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:26 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 8466de91-3066-5d5e-934c-c156bee16975 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:26 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 8466de91-3066-5d5e-934c-c156bee16975 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:26 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 8466de91-3066-5d5e-934c-c156bee16975 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:26 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item 8466de91-3066-5d5e-934c-c156bee16975 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:27 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item 8466de91-3066-5d5e-934c-c156bee16975 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:27 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 8466de91-3066-5d5e-934c-c156bee16975 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:27 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item 8466de91-3066-5d5e-934c-c156bee16975 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:27 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 8466de91-3066-5d5e-934c-c156bee16975 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8466de91-3066-5d5e-934c-c156bee16975 with identifier: MJ97326
2026-04-27 08:12:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8466de91-3066-5d5e-934c-c156bee16975 with identifier: MJ97326
2026-04-27 08:12:27 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:12:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 8466de91-3066-5d5e-934c-c156bee16975 with identifier: MJ97326 to the API
2026-04-27 08:12:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:12:28 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:12:28 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'city': 'Marseille',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-04-28T15:17:05Z',
 'fuel_type': 'diesel',
 'id': '8466de91-3066-5d5e-934c-c156bee16975',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 43.2969,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MJ97326',
 'listing': 'auction',
 'location': 'FR, Marseille',
 'location_confidence': 'geocoded',
 'longitude': 5.3811,
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 140531,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img75/23/7523b21a4db72b05e52768fb2c2f891a/pa/MJ97326_cd7a06f9e830d790503a61933e8382b1.jpg',
                'https://img-pa.auto1.com/img75/23/7523b21a4db72b05e52768fb2c2f891a/pa/MJ97326_9d6c2f68e92f7a6c3cfcd4f7d7c9ffd8.jpg',
                'https://img-pa.auto1.com/img75/23/7523b21a4db72b05e52768fb2c2f891a/pa/MJ97326_902e41507a17f8d2aa556cff9fb43b5e.jpg',
                'https://img-pa.auto1.com/img75/23/7523b21a4db72b05e52768fb2c2f891a/pa/MJ97326_9969d114d3ca0c61d7ecbbdb0ddffd10.jpg',
                'https://img-pa.auto1.com/img75/23/7523b21a4db72b05e52768fb2c2f891a/pa/MJ97326_5c7407f0060f2ea3263b02477920e2a9.jpg',
                'https://img-pa.auto1.com/img75/23/7523b21a4db72b05e52768fb2c2f891a/pa/MJ97326_ce7d8bbfdfcad7ff2d98820d029a28e0.jpg',
                'https://img-pa.auto1.com/img75/23/7523b21a4db72b05e52768fb2c2f891a/pa/MJ97326_5effe8c34466966388125547d6ee1117.jpg',
                'https://img-pa.auto1.com/img75/23/7523b21a4db72b05e52768fb2c2f891a/pa/MJ97326_5a0f7954bb813f7add8d588fcbc7d745.jpg',
                'https://img-pa.auto1.com/img75/23/7523b21a4db72b05e52768fb2c2f891a/pa/MJ97326_da07909e12a117b10ce4e3d56b21a6b0.jpg',
                'https://img-pa.auto1.com/img75/23/7523b21a4db72b05e52768fb2c2f891a/pa/MJ97326_4d3eed37881ee363348789bece73a9f5.jpg'],
 'photos': [],
 'postal_code': '13000',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Bouches-du-Rhône',
 'province_code': 'FR-13',
 'region': "Provence-Alpes-Côte d'Azur",
 'region_code': 'FR-93',
 'registration_date': '2012-07-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Sportline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Sportline BlueMotion Tech',
 'year': 2012}
2026-04-27 08:12:28 [auto1.fr] INFO: Saving data for MJ97326: {'created_time': 1777277548.122439, 'last_price_update_time': 1777277548.122452, 'has_photos': False, 'auction_closing_time': 1777389425.0}
2026-04-27 08:12:28 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 8466de91-3066-5d5e-934c-c156bee16975 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UF12899/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:28 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item 2f9f8acf-bec9-55e9-a0f2-179eb26de769 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:28 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 2f9f8acf-bec9-55e9-a0f2-179eb26de769 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2f9f8acf-bec9-55e9-a0f2-179eb26de769 with identifier: WH02443
2026-04-27 08:12:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2f9f8acf-bec9-55e9-a0f2-179eb26de769 with identifier: WH02443
2026-04-27 08:12:28 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:12:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2f9f8acf-bec9-55e9-a0f2-179eb26de769 with identifier: WH02443 to the API
2026-04-27 08:12:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:12:28 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:12:28 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'category': None,
 'city': 'Roncq',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2026-04-28T15:11:20Z',
 'fuel_type': 'petrol',
 'id': '2f9f8acf-bec9-55e9-a0f2-179eb26de769',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 50.7533,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WH02443',
 'listing': 'auction',
 'location': 'FR, Roncq',
 'location_confidence': 'geocoded',
 'longitude': 3.1213,
 'make': 'Citroen',
 'model': 'C3 Aircross',
 'odometer': 87480,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img14/b1/14b191231247f7c868c4c80a129e6bfe/pa/WH02443_e05b2e2799a2ba018a25905573295745.jpg',
                'https://img-pa.auto1.com/img14/b1/14b191231247f7c868c4c80a129e6bfe/pa/WH02443_0d1ab2097f1fcd6f8bcb7299ef47968f.jpg',
                'https://img-pa.auto1.com/img14/b1/14b191231247f7c868c4c80a129e6bfe/pa/WH02443_87ba6d2785c0c7e7e1545a0743f702f8.jpg',
                'https://img-pa.auto1.com/img14/b1/14b191231247f7c868c4c80a129e6bfe/pa/WH02443_8f2b7908d149158b0273142ca739e5f5.jpg',
                'https://img-pa.auto1.com/img14/b1/14b191231247f7c868c4c80a129e6bfe/pa/WH02443_84936d2fb5cfa76e94c55a9c34928342.jpg',
                'https://img-pa.auto1.com/img14/b1/14b191231247f7c868c4c80a129e6bfe/pa/WH02443_3dcbf8cee42ab2def9ae78d58e2794f4.jpg',
                'https://img-pa.auto1.com/img14/b1/14b191231247f7c868c4c80a129e6bfe/pa/WH02443_3505ed97f935f3f5e4b92d2164195e0c.jpg',
                'https://img-pa.auto1.com/img14/b1/14b191231247f7c868c4c80a129e6bfe/pa/WH02443_6fe682d14c19cadc0551493d5ad7b961.jpg',
                'https://img-pa.auto1.com/img14/b1/14b191231247f7c868c4c80a129e6bfe/pa/WH02443_ecbec646084e42f8a51c14040e5fcc27.jpg',
                'https://img-pa.auto1.com/img14/b1/14b191231247f7c868c4c80a129e6bfe/pa/WH02443_5c93afe279eb0c52a719aea178ce98a3.jpg'],
 'photos': [],
 'postal_code': '59223',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Nord',
 'province_code': 'FR-59',
 'region': 'Hauts-de-France',
 'region_code': 'FR-32',
 'registration_date': '2019-03-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 Aircross 1.2 PureTech Shine',
 'transmission': 'manual',
 'trim': 'Shine',
 'year': 2019}
2026-04-27 08:12:28 [auto1.fr] INFO: Saving data for WH02443: {'created_time': 1777277548.691295, 'last_price_update_time': 1777277548.691304, 'has_photos': False, 'auction_closing_time': 1777389080.0}
2026-04-27 08:12:28 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 2f9f8acf-bec9-55e9-a0f2-179eb26de769 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XP86049> (referer: https://www.auto1.com/v1/car-details-view/XP86049/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:28 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 0b807f2a-6f9b-5f3e-861d-b590b8932c7f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1beca648-8bf3-54ab-9584-c1cb2fafce92 with identifier: XP86049
2026-04-27 08:12:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1beca648-8bf3-54ab-9584-c1cb2fafce92 with scrape type 1
2026-04-27 08:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 1beca648-8bf3-54ab-9584-c1cb2fafce92
2026-04-27 08:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/f6/a1f6a1d6fea33d102bc0daf74193721c/pa/XP86049_8b53b8ee9bacae64c0971340c1859620.jpg not downloaded yet
2026-04-27 08:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/f6/a1f6a1d6fea33d102bc0daf74193721c/pa/XP86049_cdfb5073d71d96f229c6b5cbc22ab44f.jpg not downloaded yet
2026-04-27 08:12:28 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item 0b807f2a-6f9b-5f3e-861d-b590b8932c7f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/f6/a1f6a1d6fea33d102bc0daf74193721c/pa/XP86049_d93eb0f3f7c4668decf30d40af30576d.jpg not downloaded yet
2026-04-27 08:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/f6/a1f6a1d6fea33d102bc0daf74193721c/pa/XP86049_f04d7cd1c20d4036ab8bccda357b6c22.jpg not downloaded yet
2026-04-27 08:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/f6/a1f6a1d6fea33d102bc0daf74193721c/pa/XP86049_c2220eca859679893b71713e188761cb.jpg not downloaded yet
2026-04-27 08:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/f6/a1f6a1d6fea33d102bc0daf74193721c/pa/XP86049_c3f94d279aaa8e3163d56baf9ed41014.jpg not downloaded yet
2026-04-27 08:12:29 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 0b807f2a-6f9b-5f3e-861d-b590b8932c7f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:29 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 0b807f2a-6f9b-5f3e-861d-b590b8932c7f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0b807f2a-6f9b-5f3e-861d-b590b8932c7f with identifier: XU74860
2026-04-27 08:12:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0b807f2a-6f9b-5f3e-861d-b590b8932c7f with identifier: XU74860
2026-04-27 08:12:29 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:12:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 0b807f2a-6f9b-5f3e-861d-b590b8932c7f with identifier: XU74860 to the API
2026-04-27 08:12:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:12:29 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:12:29 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'category': None,
 'city': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-04-28T15:22:43Z',
 'fuel_type': 'diesel',
 'id': '0b807f2a-6f9b-5f3e-861d-b590b8932c7f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XU74860',
 'listing': 'auction',
 'location': 'FR',
 'location_confidence': None,
 'longitude': None,
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 220110,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 21,
 'photo_urls': ['https://img-pa.auto1.com/img47/81/4781f5ea31330f07553a3e8f13bac5d1/pa/XU74860_4ac98b58793925dbefb0b432a656bb0f.jpg',
                'https://img-pa.auto1.com/img47/81/4781f5ea31330f07553a3e8f13bac5d1/pa/XU74860_1355213e8f46026314a37632c2595804.jpg',
                'https://img-pa.auto1.com/img47/81/4781f5ea31330f07553a3e8f13bac5d1/pa/XU74860_405ee83caf58f436b1bbc4cc32c22016.jpg',
                'https://img-pa.auto1.com/img47/81/4781f5ea31330f07553a3e8f13bac5d1/pa/XU74860_3a1ed82ea468e21f6c259781d9557227.jpg',
                'https://img-pa.auto1.com/img47/81/4781f5ea31330f07553a3e8f13bac5d1/pa/XU74860_53d230a9fed9a23687c84b3a07c88c6e.jpg',
                'https://img-pa.auto1.com/img47/81/4781f5ea31330f07553a3e8f13bac5d1/pa/XU74860_61223d6aba7d3388b86c89950c528678.jpg',
                'https://img-pa.auto1.com/img47/81/4781f5ea31330f07553a3e8f13bac5d1/pa/XU74860_dc37f4ffb442219901ae2b0a1b05f822.jpg',
                'https://img-pa.auto1.com/img47/81/4781f5ea31330f07553a3e8f13bac5d1/pa/XU74860_52ea5538a7c1d08b9f334bb8ad86743a.jpg',
                'https://img-pa.auto1.com/img47/81/4781f5ea31330f07553a3e8f13bac5d1/pa/XU74860_6c93fa56004e7cf4ceae534e957a15ba.jpg',
                'https://img-pa.auto1.com/img47/81/4781f5ea31330f07553a3e8f13bac5d1/pa/XU74860_55471c291e95db730c860719e07ec611.jpg'],
 'photos': [],
 'postal_code': None,
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2019-10-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo XC40 2.0 D3 Inscription 2WD',
 'transmission': 'automatic',
 'trim': 'Inscription 2WD',
 'year': 2019}
2026-04-27 08:12:29 [auto1.fr] INFO: Saving data for XU74860: {'created_time': 1777277549.603938, 'last_price_update_time': 1777277549.603948, 'has_photos': False, 'auction_closing_time': 1777389763.0}
2026-04-27 08:12:29 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 0b807f2a-6f9b-5f3e-861d-b590b8932c7f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:29 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item 3d3afceb-2f4b-549b-a16f-1332bec71b52 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:30 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 1beca648-8bf3-54ab-9584-c1cb2fafce92 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:30 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item 1beca648-8bf3-54ab-9584-c1cb2fafce92 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:30 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item 1beca648-8bf3-54ab-9584-c1cb2fafce92 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:30 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item 1beca648-8bf3-54ab-9584-c1cb2fafce92 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:31 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 1beca648-8bf3-54ab-9584-c1cb2fafce92 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 1beca648-8bf3-54ab-9584-c1cb2fafce92 with identifier: XP86049
2026-04-27 08:12:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 1beca648-8bf3-54ab-9584-c1cb2fafce92 with identifier: XP86049
2026-04-27 08:12:31 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:12:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 1beca648-8bf3-54ab-9584-c1cb2fafce92 with identifier: XP86049 to the API
2026-04-27 08:12:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:12:31 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:12:31 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'city': 'Loyettes',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 130,
 'expiration_date': '2026-04-28T15:41:37Z',
 'fuel_type': 'petrol',
 'id': '1beca648-8bf3-54ab-9584-c1cb2fafce92',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 45.7766,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XP86049',
 'listing': 'auction',
 'location': 'FR, Loyettes',
 'location_confidence': 'geocoded',
 'longitude': 5.2069,
 'make': 'Citroen',
 'model': 'C4',
 'odometer': 141740,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/imga1/f6/a1f6a1d6fea33d102bc0daf74193721c/pa/XP86049_8b53b8ee9bacae64c0971340c1859620.jpg',
                'https://img-pa.auto1.com/imga1/f6/a1f6a1d6fea33d102bc0daf74193721c/pa/XP86049_cdfb5073d71d96f229c6b5cbc22ab44f.jpg',
                'https://img-pa.auto1.com/imga1/f6/a1f6a1d6fea33d102bc0daf74193721c/pa/XP86049_d93eb0f3f7c4668decf30d40af30576d.jpg',
                'https://img-pa.auto1.com/imga1/f6/a1f6a1d6fea33d102bc0daf74193721c/pa/XP86049_f04d7cd1c20d4036ab8bccda357b6c22.jpg',
                'https://img-pa.auto1.com/imga1/f6/a1f6a1d6fea33d102bc0daf74193721c/pa/XP86049_c2220eca859679893b71713e188761cb.jpg',
                'https://img-pa.auto1.com/imga1/f6/a1f6a1d6fea33d102bc0daf74193721c/pa/XP86049_c3f94d279aaa8e3163d56baf9ed41014.jpg'],
 'photos': [],
 'postal_code': '01360',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Ain',
 'province_code': 'FR-01',
 'region': 'Auvergne-Rhône-Alpes',
 'region_code': 'FR-84',
 'registration_date': '2014-11-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C4 1.2 e-THP Collection',
 'transmission': 'manual',
 'trim': 'Collection',
 'year': 2014}
2026-04-27 08:12:31 [auto1.fr] INFO: Saving data for XP86049: {'created_time': 1777277551.76559, 'last_price_update_time': 1777277551.765603, 'has_photos': False, 'auction_closing_time': 1777390897.0}
2026-04-27 08:12:31 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 3d3afceb-2f4b-549b-a16f-1332bec71b52 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:31 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 1beca648-8bf3-54ab-9584-c1cb2fafce92 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:32 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item 3d3afceb-2f4b-549b-a16f-1332bec71b52 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:33 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 3d3afceb-2f4b-549b-a16f-1332bec71b52 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:36 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.982(s), this was the 1st time calling it.
2026-04-27 08:12:36 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.719865612596038 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:12:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HN57459> (referer: https://www.auto1.com/v1/car-details-view/HN57459/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c385dbf3-f35f-5e20-93c4-32f54bcbb5cb with identifier: HN57459
2026-04-27 08:12:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c385dbf3-f35f-5e20-93c4-32f54bcbb5cb with scrape type 1
2026-04-27 08:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c385dbf3-f35f-5e20-93c4-32f54bcbb5cb
2026-04-27 08:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/bb/38bbf432831300520b01794b1da5cdaa/pa/HN57459_4fce52fec21bc9f6a77af532a77d1d96.jpg not downloaded yet
2026-04-27 08:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/bb/38bbf432831300520b01794b1da5cdaa/pa/HN57459_4d3bfcf4d178951e112f5ec9f1948ab0.jpg not downloaded yet
2026-04-27 08:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/bb/38bbf432831300520b01794b1da5cdaa/pa/HN57459_cb3028a5cc92d832c8eeb5d07e9b0b41.jpg not downloaded yet
2026-04-27 08:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/bb/38bbf432831300520b01794b1da5cdaa/pa/HN57459_a0e0024235220d34e069fdef86227645.jpg not downloaded yet
2026-04-27 08:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/bb/38bbf432831300520b01794b1da5cdaa/pa/HN57459_00904f8f74be98206d98e73765fbf568.jpg not downloaded yet
2026-04-27 08:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/bb/38bbf432831300520b01794b1da5cdaa/pa/HN57459_b82a965796311bd624eb063bafe8aaf8.jpg not downloaded yet
2026-04-27 08:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/bb/38bbf432831300520b01794b1da5cdaa/pa/HN57459_cd1388753c899a59884d76287244c410.jpg not downloaded yet
2026-04-27 08:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/bb/38bbf432831300520b01794b1da5cdaa/pa/HN57459_ddbeead9cbdfecf92329a884ff9aee61.jpg not downloaded yet
2026-04-27 08:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/bb/38bbf432831300520b01794b1da5cdaa/pa/HN57459_0cc22acb93c074df884a88a1e6e20c4a.jpg not downloaded yet
2026-04-27 08:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/bb/38bbf432831300520b01794b1da5cdaa/pa/HN57459_76a497893987fa51e68165b9d386bcc7.jpg not downloaded yet
2026-04-27 08:12:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3d3afceb-2f4b-549b-a16f-1332bec71b52 with identifier: UL15311
2026-04-27 08:12:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3d3afceb-2f4b-549b-a16f-1332bec71b52 with identifier: UL15311
2026-04-27 08:12:38 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:12:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 3d3afceb-2f4b-549b-a16f-1332bec71b52 with identifier: UL15311 to the API
2026-04-27 08:12:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:12:38 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:12:38 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'city': 'Périgny',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 68,
 'expiration_date': '2026-04-28T15:33:11Z',
 'fuel_type': 'diesel',
 'id': '3d3afceb-2f4b-549b-a16f-1332bec71b52',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.6966,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UL15311',
 'listing': 'auction',
 'location': 'FR, Périgny',
 'location_confidence': 'geocoded',
 'longitude': 2.5554,
 'make': 'Mazda',
 'model': '2',
 'odometer': 249285,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/img3c/88/3c885fda6716040f9cfbbada49e597dc/pa/UL15311_98ede919da32dd43c47bc8f9a947a74c.jpg',
                'https://img-pa.auto1.com/img3c/88/3c885fda6716040f9cfbbada49e597dc/pa/UL15311_3ad45bb549f9bc4fb8491988cb8da119.jpg',
                'https://img-pa.auto1.com/img3c/88/3c885fda6716040f9cfbbada49e597dc/pa/UL15311_5f60267bf0a7ba88dbe5ced9f9fa5e43.jpg',
                'https://img-pa.auto1.com/img3c/88/3c885fda6716040f9cfbbada49e597dc/pa/UL15311_8e207875845f190ed6204ecf58db017e.jpg',
                'https://img-pa.auto1.com/img3c/88/3c885fda6716040f9cfbbada49e597dc/pa/UL15311_20eba53eab2da5fcd6b8e21bf797b9cc.jpg',
                'https://img-pa.auto1.com/img3c/88/3c885fda6716040f9cfbbada49e597dc/pa/UL15311_6ac7942292ffdfda00134a2f9baea0a7.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3d3afceb-2f4b-549b-a16f-1332bec71b52/3d3afceb-2f4b-549b-a16f-1332bec71b52_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77940,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/88/3c885fda6716040f9cfbbada49e597dc/pa/UL15311_5f60267bf0a7ba88dbe5ced9f9fa5e43.jpg',
             'Width': 800}],
 'postal_code': '94520',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Val-de-Marne',
 'province_code': 'FR-94',
 'region': 'Île-de-France',
 'region_code': 'FR-11',
 'registration_date': '2006-01-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mazda 2 1.4 Diesel CD',
 'transmission': 'manual',
 'trim': 'CD',
 'year': 2006}
2026-04-27 08:12:38 [auto1.fr] INFO: Saving data for UL15311: {'created_time': 1777277558.573355, 'last_price_update_time': 1777277558.573365, 'has_photos': True, 'auction_closing_time': 1777390391.0}
2026-04-27 08:12:38 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 3d3afceb-2f4b-549b-a16f-1332bec71b52 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:39 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item c385dbf3-f35f-5e20-93c4-32f54bcbb5cb due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:40 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item c385dbf3-f35f-5e20-93c4-32f54bcbb5cb due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XX57600> (referer: https://www.auto1.com/v1/car-details-view/XX57600/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:41 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item c385dbf3-f35f-5e20-93c4-32f54bcbb5cb due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f896c17-66a7-5005-9529-4220fa4df5ef with identifier: XX57600
2026-04-27 08:12:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f896c17-66a7-5005-9529-4220fa4df5ef with scrape type 1
2026-04-27 08:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 1f896c17-66a7-5005-9529-4220fa4df5ef
2026-04-27 08:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/96/1f96b27eb0ae18b8ff5e7651e7099f92/pa/XX57600_71ac21b002d61ab1d02b9dd290ed566c.jpg not downloaded yet
2026-04-27 08:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/96/1f96b27eb0ae18b8ff5e7651e7099f92/pa/XX57600_406e51f89c283fd2bc6384025de09daa.jpg not downloaded yet
2026-04-27 08:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/96/1f96b27eb0ae18b8ff5e7651e7099f92/pa/XX57600_872e8aa0da5243290e6884e1182ddbed.jpg not downloaded yet
2026-04-27 08:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/96/1f96b27eb0ae18b8ff5e7651e7099f92/pa/XX57600_46afece101445697f08f90021c2fc7ef.jpg not downloaded yet
2026-04-27 08:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/96/1f96b27eb0ae18b8ff5e7651e7099f92/pa/XX57600_640bf6444e0621220d451246b0e7655f.jpg not downloaded yet
2026-04-27 08:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/96/1f96b27eb0ae18b8ff5e7651e7099f92/pa/XX57600_7619beb7899b5dd7316b7271dd44c2ed.jpg not downloaded yet
2026-04-27 08:12:42 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item c385dbf3-f35f-5e20-93c4-32f54bcbb5cb due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:42 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item c385dbf3-f35f-5e20-93c4-32f54bcbb5cb due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:43 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.367(s), this was the 1st time calling it.
2026-04-27 08:12:43 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.075621214157287 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:12:43 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item 1f896c17-66a7-5005-9529-4220fa4df5ef due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:43 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 1f896c17-66a7-5005-9529-4220fa4df5ef due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:12:44 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item 1f896c17-66a7-5005-9529-4220fa4df5ef due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:44 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item 1f896c17-66a7-5005-9529-4220fa4df5ef due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HK37982/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:45 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 1f896c17-66a7-5005-9529-4220fa4df5ef due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 1f896c17-66a7-5005-9529-4220fa4df5ef with identifier: XX57600
2026-04-27 08:12:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 1f896c17-66a7-5005-9529-4220fa4df5ef with identifier: XX57600
2026-04-27 08:12:45 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:12:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 1f896c17-66a7-5005-9529-4220fa4df5ef with identifier: XX57600 to the API
2026-04-27 08:12:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:12:45 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:12:45 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': 157,
 'category': None,
 'city': 'Le Havre',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 100,
 'expiration_date': '2026-04-28T15:01:43Z',
 'fuel_type': 'petrol',
 'id': '1f896c17-66a7-5005-9529-4220fa4df5ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 49.4935,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XX57600',
 'listing': 'auction',
 'location': 'FR, LE HAVRE',
 'location_confidence': 'geocoded',
 'longitude': 0.1079,
 'make': 'Ford',
 'model': 'Fusion',
 'odometer': 95512,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/img1f/96/1f96b27eb0ae18b8ff5e7651e7099f92/pa/XX57600_71ac21b002d61ab1d02b9dd290ed566c.jpg',
                'https://img-pa.auto1.com/img1f/96/1f96b27eb0ae18b8ff5e7651e7099f92/pa/XX57600_406e51f89c283fd2bc6384025de09daa.jpg',
                'https://img-pa.auto1.com/img1f/96/1f96b27eb0ae18b8ff5e7651e7099f92/pa/XX57600_872e8aa0da5243290e6884e1182ddbed.jpg',
                'https://img-pa.auto1.com/img1f/96/1f96b27eb0ae18b8ff5e7651e7099f92/pa/XX57600_46afece101445697f08f90021c2fc7ef.jpg',
                'https://img-pa.auto1.com/img1f/96/1f96b27eb0ae18b8ff5e7651e7099f92/pa/XX57600_640bf6444e0621220d451246b0e7655f.jpg',
                'https://img-pa.auto1.com/img1f/96/1f96b27eb0ae18b8ff5e7651e7099f92/pa/XX57600_7619beb7899b5dd7316b7271dd44c2ed.jpg'],
 'photos': [],
 'postal_code': '76050 CEDEX',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Seine-Maritime',
 'province_code': 'FR-76',
 'region': 'Normandie',
 'region_code': 'FR-28',
 'registration_date': '2006-04-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fusion 1.6 Plus',
 'transmission': 'manual',
 'trim': 'Plus',
 'year': 2006}
2026-04-27 08:12:45 [auto1.fr] INFO: Saving data for XX57600: {'created_time': 1777277565.760842, 'last_price_update_time': 1777277565.760851, 'has_photos': False, 'auction_closing_time': 1777388503.0}
2026-04-27 08:12:45 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 1f896c17-66a7-5005-9529-4220fa4df5ef due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:46 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item c385dbf3-f35f-5e20-93c4-32f54bcbb5cb due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:46 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item c385dbf3-f35f-5e20-93c4-32f54bcbb5cb due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:47 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.421(s), this was the 1st time calling it.
2026-04-27 08:12:47 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.05895940688547 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:12:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FK01060/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:47 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item c385dbf3-f35f-5e20-93c4-32f54bcbb5cb due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:47 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item c385dbf3-f35f-5e20-93c4-32f54bcbb5cb due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c385dbf3-f35f-5e20-93c4-32f54bcbb5cb with identifier: HN57459
2026-04-27 08:12:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c385dbf3-f35f-5e20-93c4-32f54bcbb5cb with identifier: HN57459
2026-04-27 08:12:48 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:12:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c385dbf3-f35f-5e20-93c4-32f54bcbb5cb with identifier: HN57459 to the API
2026-04-27 08:12:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:12:48 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:12:48 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': 218,
 'category': None,
 'city': 'Beaucaire',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 6',
 'engine': '3.2L',
 'engine_horse_power': 200,
 'expiration_date': '2026-04-28T15:56:22Z',
 'fuel_type': 'diesel',
 'id': 'c385dbf3-f35f-5e20-93c4-32f54bcbb5cb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'latitude': 43.8081,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HN57459',
 'listing': 'auction',
 'location': 'FR, Beaucaire',
 'location_confidence': 'geocoded',
 'longitude': 4.6442,
 'make': 'Ford',
 'model': 'Ranger',
 'odometer': 277076,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 17,
 'photo_urls': ['https://img-pa.auto1.com/img38/bb/38bbf432831300520b01794b1da5cdaa/pa/HN57459_4fce52fec21bc9f6a77af532a77d1d96.jpg',
                'https://img-pa.auto1.com/img38/bb/38bbf432831300520b01794b1da5cdaa/pa/HN57459_4d3bfcf4d178951e112f5ec9f1948ab0.jpg',
                'https://img-pa.auto1.com/img38/bb/38bbf432831300520b01794b1da5cdaa/pa/HN57459_cb3028a5cc92d832c8eeb5d07e9b0b41.jpg',
                'https://img-pa.auto1.com/img38/bb/38bbf432831300520b01794b1da5cdaa/pa/HN57459_a0e0024235220d34e069fdef86227645.jpg',
                'https://img-pa.auto1.com/img38/bb/38bbf432831300520b01794b1da5cdaa/pa/HN57459_00904f8f74be98206d98e73765fbf568.jpg',
                'https://img-pa.auto1.com/img38/bb/38bbf432831300520b01794b1da5cdaa/pa/HN57459_b82a965796311bd624eb063bafe8aaf8.jpg',
                'https://img-pa.auto1.com/img38/bb/38bbf432831300520b01794b1da5cdaa/pa/HN57459_cd1388753c899a59884d76287244c410.jpg',
                'https://img-pa.auto1.com/img38/bb/38bbf432831300520b01794b1da5cdaa/pa/HN57459_ddbeead9cbdfecf92329a884ff9aee61.jpg',
                'https://img-pa.auto1.com/img38/bb/38bbf432831300520b01794b1da5cdaa/pa/HN57459_0cc22acb93c074df884a88a1e6e20c4a.jpg',
                'https://img-pa.auto1.com/img38/bb/38bbf432831300520b01794b1da5cdaa/pa/HN57459_76a497893987fa51e68165b9d386bcc7.jpg'],
 'photos': [],
 'postal_code': '30300',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Gard',
 'province_code': 'FR-30',
 'region': 'Occitanie',
 'region_code': 'FR-76',
 'registration_date': '2018-06-14',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Ford Ranger 3.2 TDCi Extrakabine 4x4 Wildtrak',
 'transmission': 'manual',
 'trim': 'Extrakabine 4x4 Wildtrak',
 'year': 2018}
2026-04-27 08:12:48 [auto1.fr] INFO: Saving data for HN57459: {'created_time': 1777277568.698731, 'last_price_update_time': 1777277568.698745, 'has_photos': False, 'auction_closing_time': 1777391782.0}
2026-04-27 08:12:48 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item c385dbf3-f35f-5e20-93c4-32f54bcbb5cb due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CA21668/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:12:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FJ22847> (referer: https://www.auto1.com/v1/car-details-view/FJ22847/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4194d53-9dc6-5c4c-9ae3-65ebbc567e07 with identifier: FJ22847
2026-04-27 08:12:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4194d53-9dc6-5c4c-9ae3-65ebbc567e07 with scrape type 1
2026-04-27 08:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c4194d53-9dc6-5c4c-9ae3-65ebbc567e07
2026-04-27 08:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/08/a508d0eb11d84b9cd3a449371c18cb57/pa/FJ22847_64daa4b19d2094a6be3cb15283767064.jpg not downloaded yet
2026-04-27 08:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/08/a508d0eb11d84b9cd3a449371c18cb57/pa/FJ22847_c11bf44ea6b0e659b8ee60ffd4871e98.jpg not downloaded yet
2026-04-27 08:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/08/a508d0eb11d84b9cd3a449371c18cb57/pa/FJ22847_8844cd156c85feb5df853bb8fec9eb7c.jpg not downloaded yet
2026-04-27 08:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/08/a508d0eb11d84b9cd3a449371c18cb57/pa/FJ22847_577b4baca12436c0803f5f09a270b8fd.jpg not downloaded yet
2026-04-27 08:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/08/a508d0eb11d84b9cd3a449371c18cb57/pa/FJ22847_08c89d731f1429ea55f965fad518d140.jpg not downloaded yet
2026-04-27 08:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/08/a508d0eb11d84b9cd3a449371c18cb57/pa/FJ22847_f87ac4d982a4936d9617a973ed9afb78.jpg not downloaded yet
2026-04-27 08:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/08/a508d0eb11d84b9cd3a449371c18cb57/pa/FJ22847_6e66ea4e0167f4ae3fd231b3a2701138.jpg not downloaded yet
2026-04-27 08:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/08/a508d0eb11d84b9cd3a449371c18cb57/pa/FJ22847_a91f4192d5d21e5cc9144d37d6fae0b0.jpg not downloaded yet
2026-04-27 08:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/08/a508d0eb11d84b9cd3a449371c18cb57/pa/FJ22847_5dd53cfe1cdd888046f6df6125e47656.jpg not downloaded yet
2026-04-27 08:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/08/a508d0eb11d84b9cd3a449371c18cb57/pa/FJ22847_929cd6f9ba150a0a073859ccfc59603d.jpg not downloaded yet
2026-04-27 08:12:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:12:59 [scrapy.extensions.logstats] INFO: Crawled 552 pages (at 21 pages/min), scraped 474 items (at 14 items/min)
2026-04-27 08:12:59 [scrapy.extensions.memusage] INFO: Peak memory usage is 373MiB
2026-04-27 08:13:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XM15885/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PU18987/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RB61201/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GG86597/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:03 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item c4194d53-9dc6-5c4c-9ae3-65ebbc567e07 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HK37982> (referer: https://www.auto1.com/v1/car-details-view/HK37982/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7950e0e-3b3e-56bb-a9e6-b063f72c7660 with identifier: HK37982
2026-04-27 08:13:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7950e0e-3b3e-56bb-a9e6-b063f72c7660 with scrape type 1
2026-04-27 08:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item f7950e0e-3b3e-56bb-a9e6-b063f72c7660
2026-04-27 08:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/9e/d99e7f34cc7e0b3f5dc56e44d5bd4975/pa/HK37982_b94550666cf8a997145f56645cb0b364.jpg not downloaded yet
2026-04-27 08:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/9e/d99e7f34cc7e0b3f5dc56e44d5bd4975/pa/HK37982_67d66d8862c5c22fea2773c2692e09f7.jpg not downloaded yet
2026-04-27 08:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/9e/d99e7f34cc7e0b3f5dc56e44d5bd4975/pa/HK37982_5fc49423c2343270bb3cb92797358184.jpg not downloaded yet
2026-04-27 08:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/9e/d99e7f34cc7e0b3f5dc56e44d5bd4975/pa/HK37982_67710fd1443c41ddc7b5c6068adf8925.jpg not downloaded yet
2026-04-27 08:13:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CJ23217/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/9e/d99e7f34cc7e0b3f5dc56e44d5bd4975/pa/HK37982_51b9cc15f4c24353cf42a761e345cbdb.jpg not downloaded yet
2026-04-27 08:13:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/9e/d99e7f34cc7e0b3f5dc56e44d5bd4975/pa/HK37982_7d90f3ea77f868ff9f6ce33bd5ec539e.jpg not downloaded yet
2026-04-27 08:13:05 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item c4194d53-9dc6-5c4c-9ae3-65ebbc567e07 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:05 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item c4194d53-9dc6-5c4c-9ae3-65ebbc567e07 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NB55721/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FK01060> (referer: https://www.auto1.com/v1/car-details-view/FK01060/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ffe7cbf-d82b-535d-9573-42fa9d4468f7 with identifier: FK01060
2026-04-27 08:13:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ffe7cbf-d82b-535d-9573-42fa9d4468f7 with scrape type 1
2026-04-27 08:13:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 9ffe7cbf-d82b-535d-9573-42fa9d4468f7
2026-04-27 08:13:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/23/9a23ff1a7874a12332cc5367c1d57e70/pa/FK01060_da76346fdc01d74afd93fa9489b2fbf3.jpg not downloaded yet
2026-04-27 08:13:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/23/9a23ff1a7874a12332cc5367c1d57e70/pa/FK01060_74c0ae9cdde476ceef12303a387bc07e.jpg not downloaded yet
2026-04-27 08:13:06 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item f7950e0e-3b3e-56bb-a9e6-b063f72c7660 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:06 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item f7950e0e-3b3e-56bb-a9e6-b063f72c7660 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/23/9a23ff1a7874a12332cc5367c1d57e70/pa/FK01060_40e05b7543c1d8dac2c8a657fda64904.jpg not downloaded yet
2026-04-27 08:13:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/23/9a23ff1a7874a12332cc5367c1d57e70/pa/FK01060_6448a4ced5a50c577a20ad0e6794b02a.jpg not downloaded yet
2026-04-27 08:13:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/23/9a23ff1a7874a12332cc5367c1d57e70/pa/FK01060_044ec8f1a2067afb8579e29c153712e2.jpg not downloaded yet
2026-04-27 08:13:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/23/9a23ff1a7874a12332cc5367c1d57e70/pa/FK01060_1cf9fed3401949928be620845fd51958.jpg not downloaded yet
2026-04-27 08:13:07 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item f7950e0e-3b3e-56bb-a9e6-b063f72c7660 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:07 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item f7950e0e-3b3e-56bb-a9e6-b063f72c7660 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:07 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item f7950e0e-3b3e-56bb-a9e6-b063f72c7660 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PB17191> (referer: https://www.auto1.com/v1/car-details-view/PB17191/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 763bbeea-43ed-55c7-bc6a-7d10eb73f7ed with identifier: PB17191
2026-04-27 08:13:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 763bbeea-43ed-55c7-bc6a-7d10eb73f7ed with scrape type 1
2026-04-27 08:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 763bbeea-43ed-55c7-bc6a-7d10eb73f7ed
2026-04-27 08:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/ab/03abd1c7c04d115b07f88c0b3a57ce46/pa/PB17191_c99663245a0265f74d34c6af1499dbb0.jpg not downloaded yet
2026-04-27 08:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/ab/03abd1c7c04d115b07f88c0b3a57ce46/pa/PB17191_bf015b448370adfbd4534f48d88b2402.jpg not downloaded yet
2026-04-27 08:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/ab/03abd1c7c04d115b07f88c0b3a57ce46/pa/PB17191_02d1ea73120d549761b10515c4d1c129.jpg not downloaded yet
2026-04-27 08:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/ab/03abd1c7c04d115b07f88c0b3a57ce46/pa/PB17191_7ac630818ea6707f3de49a66c5b04bf2.jpg not downloaded yet
2026-04-27 08:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/ab/03abd1c7c04d115b07f88c0b3a57ce46/pa/PB17191_48781c708d0e83b68ecc6f9d9ac040ac.jpg not downloaded yet
2026-04-27 08:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/ab/03abd1c7c04d115b07f88c0b3a57ce46/pa/PB17191_c4097a06e409a3b2784d66ed4fcebac1.jpg not downloaded yet
2026-04-27 08:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/ab/03abd1c7c04d115b07f88c0b3a57ce46/pa/PB17191_5cfc610fc1e9b37f63eff0091c6298ce.jpg not downloaded yet
2026-04-27 08:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/ab/03abd1c7c04d115b07f88c0b3a57ce46/pa/PB17191_8cbe657d2d46443a65d6100695a1bf51.jpg not downloaded yet
2026-04-27 08:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/ab/03abd1c7c04d115b07f88c0b3a57ce46/pa/PB17191_ac9a776bfb965724d43645d7b441d498.jpg not downloaded yet
2026-04-27 08:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/ab/03abd1c7c04d115b07f88c0b3a57ce46/pa/PB17191_d8430020e18bc540853a9b5c99a47b24.jpg not downloaded yet
2026-04-27 08:13:08 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 9ffe7cbf-d82b-535d-9573-42fa9d4468f7 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:08 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item 9ffe7cbf-d82b-535d-9573-42fa9d4468f7 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:08 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item 9ffe7cbf-d82b-535d-9573-42fa9d4468f7 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:09 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item 9ffe7cbf-d82b-535d-9573-42fa9d4468f7 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XM15885> (referer: https://www.auto1.com/v1/car-details-view/XM15885/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:09 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item 763bbeea-43ed-55c7-bc6a-7d10eb73f7ed due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:09 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 763bbeea-43ed-55c7-bc6a-7d10eb73f7ed due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:09 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item 763bbeea-43ed-55c7-bc6a-7d10eb73f7ed due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90f5ae0c-f02f-5b69-bce8-60cbf0c64b33 with identifier: XM15885
2026-04-27 08:13:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90f5ae0c-f02f-5b69-bce8-60cbf0c64b33 with scrape type 1
2026-04-27 08:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 90f5ae0c-f02f-5b69-bce8-60cbf0c64b33
2026-04-27 08:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/1f/e31fb4af9d414168ec07bedec552d868/pa/XM15885_5d8a95864f6eb2b81db81bfa012140e2.jpg not downloaded yet
2026-04-27 08:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/1f/e31fb4af9d414168ec07bedec552d868/pa/XM15885_defc9a05cd4b0102bd7bbb95b66d1007.jpg not downloaded yet
2026-04-27 08:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/1f/e31fb4af9d414168ec07bedec552d868/pa/XM15885_04a1e963a3c79ed4b6620160c8ff0e39.jpg not downloaded yet
2026-04-27 08:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/1f/e31fb4af9d414168ec07bedec552d868/pa/XM15885_610ec3187031576dcb9e397e03886bc5.jpg not downloaded yet
2026-04-27 08:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/1f/e31fb4af9d414168ec07bedec552d868/pa/XM15885_37356e383d56714e9503790f69984be3.jpg not downloaded yet
2026-04-27 08:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/1f/e31fb4af9d414168ec07bedec552d868/pa/XM15885_9e43f8196a6bfadf884777db8eb16afc.jpg not downloaded yet
2026-04-27 08:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/1f/e31fb4af9d414168ec07bedec552d868/pa/XM15885_c76ef0d68cb9bce623db4347015bbd80.jpg not downloaded yet
2026-04-27 08:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/1f/e31fb4af9d414168ec07bedec552d868/pa/XM15885_a09e0ef3cf068048a2e3dccd404ed5e3.jpg not downloaded yet
2026-04-27 08:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/1f/e31fb4af9d414168ec07bedec552d868/pa/XM15885_107793dcc02c33d34b1122307adee8d6.jpg not downloaded yet
2026-04-27 08:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/1f/e31fb4af9d414168ec07bedec552d868/pa/XM15885_6c1835810317227b3fcb3a2aabb9665c.jpg not downloaded yet
2026-04-27 08:13:10 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 763bbeea-43ed-55c7-bc6a-7d10eb73f7ed due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:10 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 763bbeea-43ed-55c7-bc6a-7d10eb73f7ed due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:10 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 763bbeea-43ed-55c7-bc6a-7d10eb73f7ed due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:10 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 763bbeea-43ed-55c7-bc6a-7d10eb73f7ed due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:10 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item 763bbeea-43ed-55c7-bc6a-7d10eb73f7ed due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:11 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 90f5ae0c-f02f-5b69-bce8-60cbf0c64b33 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:11 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 90f5ae0c-f02f-5b69-bce8-60cbf0c64b33 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:11 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 90f5ae0c-f02f-5b69-bce8-60cbf0c64b33 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:11 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item 90f5ae0c-f02f-5b69-bce8-60cbf0c64b33 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:11 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 90f5ae0c-f02f-5b69-bce8-60cbf0c64b33 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:12 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 90f5ae0c-f02f-5b69-bce8-60cbf0c64b33 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:12 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item 90f5ae0c-f02f-5b69-bce8-60cbf0c64b33 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:12 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item 90f5ae0c-f02f-5b69-bce8-60cbf0c64b33 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:12 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 90f5ae0c-f02f-5b69-bce8-60cbf0c64b33 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 90f5ae0c-f02f-5b69-bce8-60cbf0c64b33 with identifier: XM15885
2026-04-27 08:13:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 90f5ae0c-f02f-5b69-bce8-60cbf0c64b33 with identifier: XM15885
2026-04-27 08:13:12 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:13:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 90f5ae0c-f02f-5b69-bce8-60cbf0c64b33 with identifier: XM15885 to the API
2026-04-27 08:13:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:13:12 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:13:12 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': 145,
 'category': None,
 'city': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 125,
 'expiration_date': '2026-04-28T15:29:35Z',
 'fuel_type': 'diesel',
 'id': '90f5ae0c-f02f-5b69-bce8-60cbf0c64b33',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XM15885',
 'listing': 'auction',
 'location': 'FR',
 'location_confidence': None,
 'longitude': None,
 'make': 'Opel',
 'model': 'Vivaro',
 'odometer': 202679,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 19,
 'photo_urls': ['https://img-pa.auto1.com/imge3/1f/e31fb4af9d414168ec07bedec552d868/pa/XM15885_5d8a95864f6eb2b81db81bfa012140e2.jpg',
                'https://img-pa.auto1.com/imge3/1f/e31fb4af9d414168ec07bedec552d868/pa/XM15885_defc9a05cd4b0102bd7bbb95b66d1007.jpg',
                'https://img-pa.auto1.com/imge3/1f/e31fb4af9d414168ec07bedec552d868/pa/XM15885_04a1e963a3c79ed4b6620160c8ff0e39.jpg',
                'https://img-pa.auto1.com/imge3/1f/e31fb4af9d414168ec07bedec552d868/pa/XM15885_610ec3187031576dcb9e397e03886bc5.jpg',
                'https://img-pa.auto1.com/imge3/1f/e31fb4af9d414168ec07bedec552d868/pa/XM15885_37356e383d56714e9503790f69984be3.jpg',
                'https://img-pa.auto1.com/imge3/1f/e31fb4af9d414168ec07bedec552d868/pa/XM15885_9e43f8196a6bfadf884777db8eb16afc.jpg',
                'https://img-pa.auto1.com/imge3/1f/e31fb4af9d414168ec07bedec552d868/pa/XM15885_c76ef0d68cb9bce623db4347015bbd80.jpg',
                'https://img-pa.auto1.com/imge3/1f/e31fb4af9d414168ec07bedec552d868/pa/XM15885_a09e0ef3cf068048a2e3dccd404ed5e3.jpg',
                'https://img-pa.auto1.com/imge3/1f/e31fb4af9d414168ec07bedec552d868/pa/XM15885_107793dcc02c33d34b1122307adee8d6.jpg',
                'https://img-pa.auto1.com/imge3/1f/e31fb4af9d414168ec07bedec552d868/pa/XM15885_6c1835810317227b3fcb3a2aabb9665c.jpg'],
 'photos': [],
 'postal_code': None,
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2018-01-17',
 'seats_number': 9,
 'seller_name': None,
 'title': 'Opel Vivaro 1.6 CDTI Biturbo Combi L2H1 2,9t',
 'transmission': 'manual',
 'trim': 'Combi L2H1 2,9t',
 'year': 2018}
2026-04-27 08:13:12 [auto1.fr] INFO: Saving data for XM15885: {'created_time': 1777277592.812987, 'last_price_update_time': 1777277592.812996, 'has_photos': False, 'auction_closing_time': 1777390175.0}
2026-04-27 08:13:12 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 90f5ae0c-f02f-5b69-bce8-60cbf0c64b33 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:13 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 763bbeea-43ed-55c7-bc6a-7d10eb73f7ed due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 763bbeea-43ed-55c7-bc6a-7d10eb73f7ed with identifier: PB17191
2026-04-27 08:13:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 763bbeea-43ed-55c7-bc6a-7d10eb73f7ed with identifier: PB17191
2026-04-27 08:13:13 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:13:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 763bbeea-43ed-55c7-bc6a-7d10eb73f7ed with identifier: PB17191 to the API
2026-04-27 08:13:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:13:13 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:13:13 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'city': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 100,
 'expiration_date': '2026-04-28T15:14:06Z',
 'fuel_type': 'petrol',
 'id': '763bbeea-43ed-55c7-bc6a-7d10eb73f7ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PB17191',
 'listing': 'auction',
 'location': 'FR',
 'location_confidence': None,
 'longitude': None,
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 107178,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 21,
 'photo_urls': ['https://img-pa.auto1.com/img03/ab/03abd1c7c04d115b07f88c0b3a57ce46/pa/PB17191_c99663245a0265f74d34c6af1499dbb0.jpg',
                'https://img-pa.auto1.com/img03/ab/03abd1c7c04d115b07f88c0b3a57ce46/pa/PB17191_bf015b448370adfbd4534f48d88b2402.jpg',
                'https://img-pa.auto1.com/img03/ab/03abd1c7c04d115b07f88c0b3a57ce46/pa/PB17191_02d1ea73120d549761b10515c4d1c129.jpg',
                'https://img-pa.auto1.com/img03/ab/03abd1c7c04d115b07f88c0b3a57ce46/pa/PB17191_7ac630818ea6707f3de49a66c5b04bf2.jpg',
                'https://img-pa.auto1.com/img03/ab/03abd1c7c04d115b07f88c0b3a57ce46/pa/PB17191_48781c708d0e83b68ecc6f9d9ac040ac.jpg',
                'https://img-pa.auto1.com/img03/ab/03abd1c7c04d115b07f88c0b3a57ce46/pa/PB17191_c4097a06e409a3b2784d66ed4fcebac1.jpg',
                'https://img-pa.auto1.com/img03/ab/03abd1c7c04d115b07f88c0b3a57ce46/pa/PB17191_5cfc610fc1e9b37f63eff0091c6298ce.jpg',
                'https://img-pa.auto1.com/img03/ab/03abd1c7c04d115b07f88c0b3a57ce46/pa/PB17191_8cbe657d2d46443a65d6100695a1bf51.jpg',
                'https://img-pa.auto1.com/img03/ab/03abd1c7c04d115b07f88c0b3a57ce46/pa/PB17191_ac9a776bfb965724d43645d7b441d498.jpg',
                'https://img-pa.auto1.com/img03/ab/03abd1c7c04d115b07f88c0b3a57ce46/pa/PB17191_d8430020e18bc540853a9b5c99a47b24.jpg'],
 'photos': [],
 'postal_code': None,
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2012-03-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Astra 1.4 Essentia',
 'transmission': 'manual',
 'trim': 'Essentia',
 'year': 2012}
2026-04-27 08:13:13 [auto1.fr] INFO: Saving data for PB17191: {'created_time': 1777277593.692907, 'last_price_update_time': 1777277593.692917, 'has_photos': False, 'auction_closing_time': 1777389246.0}
2026-04-27 08:13:13 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 763bbeea-43ed-55c7-bc6a-7d10eb73f7ed due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:13 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 9ffe7cbf-d82b-535d-9573-42fa9d4468f7 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 9ffe7cbf-d82b-535d-9573-42fa9d4468f7 with identifier: FK01060
2026-04-27 08:13:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 9ffe7cbf-d82b-535d-9573-42fa9d4468f7 with identifier: FK01060
2026-04-27 08:13:13 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:13:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 9ffe7cbf-d82b-535d-9573-42fa9d4468f7 with identifier: FK01060 to the API
2026-04-27 08:13:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:13:13 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:13:14 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'city': 'Ingrandes sur Vienne',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 100,
 'expiration_date': '2026-04-28T15:57:30Z',
 'fuel_type': 'petrol',
 'id': '9ffe7cbf-d82b-535d-9573-42fa9d4468f7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK01060',
 'listing': 'auction',
 'location': 'FR, Ingrandes sur Vienne',
 'location_confidence': None,
 'longitude': None,
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 183282,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/img9a/23/9a23ff1a7874a12332cc5367c1d57e70/pa/FK01060_da76346fdc01d74afd93fa9489b2fbf3.jpg',
                'https://img-pa.auto1.com/img9a/23/9a23ff1a7874a12332cc5367c1d57e70/pa/FK01060_74c0ae9cdde476ceef12303a387bc07e.jpg',
                'https://img-pa.auto1.com/img9a/23/9a23ff1a7874a12332cc5367c1d57e70/pa/FK01060_40e05b7543c1d8dac2c8a657fda64904.jpg',
                'https://img-pa.auto1.com/img9a/23/9a23ff1a7874a12332cc5367c1d57e70/pa/FK01060_6448a4ced5a50c577a20ad0e6794b02a.jpg',
                'https://img-pa.auto1.com/img9a/23/9a23ff1a7874a12332cc5367c1d57e70/pa/FK01060_044ec8f1a2067afb8579e29c153712e2.jpg',
                'https://img-pa.auto1.com/img9a/23/9a23ff1a7874a12332cc5367c1d57e70/pa/FK01060_1cf9fed3401949928be620845fd51958.jpg'],
 'photos': [],
 'postal_code': None,
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2011-02-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Cosmo',
 'transmission': 'manual',
 'trim': 'Cosmo',
 'year': 2011}
2026-04-27 08:13:14 [auto1.fr] INFO: Saving data for FK01060: {'created_time': 1777277594.066813, 'last_price_update_time': 1777277594.066824, 'has_photos': False, 'auction_closing_time': 1777391850.0}
2026-04-27 08:13:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f7950e0e-3b3e-56bb-a9e6-b063f72c7660 with identifier: HK37982
2026-04-27 08:13:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f7950e0e-3b3e-56bb-a9e6-b063f72c7660 with identifier: HK37982
2026-04-27 08:13:14 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:13:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f7950e0e-3b3e-56bb-a9e6-b063f72c7660 with identifier: HK37982 to the API
2026-04-27 08:13:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:13:14 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:13:14 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'city': 'Quincieux',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-04-28T15:01:21Z',
 'fuel_type': 'petrol',
 'id': 'f7950e0e-3b3e-56bb-a9e6-b063f72c7660',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 45.9137,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HK37982',
 'listing': 'auction',
 'location': 'FR, Quincieux',
 'location_confidence': 'geocoded',
 'longitude': 4.777,
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 142155,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/imgd9/9e/d99e7f34cc7e0b3f5dc56e44d5bd4975/pa/HK37982_b94550666cf8a997145f56645cb0b364.jpg',
                'https://img-pa.auto1.com/imgd9/9e/d99e7f34cc7e0b3f5dc56e44d5bd4975/pa/HK37982_67d66d8862c5c22fea2773c2692e09f7.jpg',
                'https://img-pa.auto1.com/imgd9/9e/d99e7f34cc7e0b3f5dc56e44d5bd4975/pa/HK37982_5fc49423c2343270bb3cb92797358184.jpg',
                'https://img-pa.auto1.com/imgd9/9e/d99e7f34cc7e0b3f5dc56e44d5bd4975/pa/HK37982_67710fd1443c41ddc7b5c6068adf8925.jpg',
                'https://img-pa.auto1.com/imgd9/9e/d99e7f34cc7e0b3f5dc56e44d5bd4975/pa/HK37982_51b9cc15f4c24353cf42a761e345cbdb.jpg',
                'https://img-pa.auto1.com/imgd9/9e/d99e7f34cc7e0b3f5dc56e44d5bd4975/pa/HK37982_7d90f3ea77f868ff9f6ce33bd5ec539e.jpg'],
 'photos': [],
 'postal_code': '69650',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Rhône',
 'province_code': 'FR-69',
 'region': 'Auvergne-Rhône-Alpes',
 'region_code': 'FR-84',
 'registration_date': '2013-08-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 VTi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2013}
2026-04-27 08:13:14 [auto1.fr] INFO: Saving data for HK37982: {'created_time': 1777277594.436399, 'last_price_update_time': 1777277594.436409, 'has_photos': False, 'auction_closing_time': 1777388481.0}
2026-04-27 08:13:14 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 9ffe7cbf-d82b-535d-9573-42fa9d4468f7 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:14 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item f7950e0e-3b3e-56bb-a9e6-b063f72c7660 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PU18987> (referer: https://www.auto1.com/v1/car-details-view/PU18987/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:14 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item c4194d53-9dc6-5c4c-9ae3-65ebbc567e07 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:14 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item c4194d53-9dc6-5c4c-9ae3-65ebbc567e07 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:14 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item c4194d53-9dc6-5c4c-9ae3-65ebbc567e07 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:14 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item c4194d53-9dc6-5c4c-9ae3-65ebbc567e07 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99a29d1d-3f76-5449-ba4d-18e24153c9bc with identifier: PU18987
2026-04-27 08:13:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99a29d1d-3f76-5449-ba4d-18e24153c9bc with scrape type 1
2026-04-27 08:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 99a29d1d-3f76-5449-ba4d-18e24153c9bc
2026-04-27 08:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/73/b37356c28b6a8228a7fad4936cfcbc5d/pa/PU18987_c15f509bb10383c1589063ae982a9976.jpg not downloaded yet
2026-04-27 08:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/73/b37356c28b6a8228a7fad4936cfcbc5d/pa/PU18987_18b833a65674f68b63427caac9208d8c.jpg not downloaded yet
2026-04-27 08:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/73/b37356c28b6a8228a7fad4936cfcbc5d/pa/PU18987_874a1e0063f44a14afa10e3ddb33f0c3.jpg not downloaded yet
2026-04-27 08:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/73/b37356c28b6a8228a7fad4936cfcbc5d/pa/PU18987_ed7ea5ade97bc9f71ee85bf7e8495b61.jpg not downloaded yet
2026-04-27 08:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/73/b37356c28b6a8228a7fad4936cfcbc5d/pa/PU18987_48cbed3689092954498339141c85f4e5.jpg not downloaded yet
2026-04-27 08:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/73/b37356c28b6a8228a7fad4936cfcbc5d/pa/PU18987_1dd0fdf5018a6d9a0cf6e6517ec75f64.jpg not downloaded yet
2026-04-27 08:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/73/b37356c28b6a8228a7fad4936cfcbc5d/pa/PU18987_f03ee5f819c512f47715144dbf95c34e.jpg not downloaded yet
2026-04-27 08:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/73/b37356c28b6a8228a7fad4936cfcbc5d/pa/PU18987_f421524d968a823ae859f8221c2abc70.jpg not downloaded yet
2026-04-27 08:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/73/b37356c28b6a8228a7fad4936cfcbc5d/pa/PU18987_13353a0a7845d1215fb86434a667cb5e.jpg not downloaded yet
2026-04-27 08:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/73/b37356c28b6a8228a7fad4936cfcbc5d/pa/PU18987_7ae44237fc12c94826139aa3a15c75a2.jpg not downloaded yet
2026-04-27 08:13:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UF12899> (referer: https://www.auto1.com/v1/car-details-view/UF12899/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:15 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item c4194d53-9dc6-5c4c-9ae3-65ebbc567e07 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:15 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item c4194d53-9dc6-5c4c-9ae3-65ebbc567e07 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c4194d53-9dc6-5c4c-9ae3-65ebbc567e07 with identifier: FJ22847
2026-04-27 08:13:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c4194d53-9dc6-5c4c-9ae3-65ebbc567e07 with identifier: FJ22847
2026-04-27 08:13:15 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:13:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c4194d53-9dc6-5c4c-9ae3-65ebbc567e07 with identifier: FJ22847 to the API
2026-04-27 08:13:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:13:15 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:13:15 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': 90,
 'category': None,
 'city': 'Marseille',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 100,
 'expiration_date': '2026-04-28T15:18:10Z',
 'fuel_type': 'diesel',
 'id': 'c4194d53-9dc6-5c4c-9ae3-65ebbc567e07',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 43.2969,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FJ22847',
 'listing': 'auction',
 'location': 'FR, Marseille',
 'location_confidence': 'geocoded',
 'longitude': 5.3811,
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 200195,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imga5/08/a508d0eb11d84b9cd3a449371c18cb57/pa/FJ22847_64daa4b19d2094a6be3cb15283767064.jpg',
                'https://img-pa.auto1.com/imga5/08/a508d0eb11d84b9cd3a449371c18cb57/pa/FJ22847_c11bf44ea6b0e659b8ee60ffd4871e98.jpg',
                'https://img-pa.auto1.com/imga5/08/a508d0eb11d84b9cd3a449371c18cb57/pa/FJ22847_8844cd156c85feb5df853bb8fec9eb7c.jpg',
                'https://img-pa.auto1.com/imga5/08/a508d0eb11d84b9cd3a449371c18cb57/pa/FJ22847_577b4baca12436c0803f5f09a270b8fd.jpg',
                'https://img-pa.auto1.com/imga5/08/a508d0eb11d84b9cd3a449371c18cb57/pa/FJ22847_08c89d731f1429ea55f965fad518d140.jpg',
                'https://img-pa.auto1.com/imga5/08/a508d0eb11d84b9cd3a449371c18cb57/pa/FJ22847_f87ac4d982a4936d9617a973ed9afb78.jpg',
                'https://img-pa.auto1.com/imga5/08/a508d0eb11d84b9cd3a449371c18cb57/pa/FJ22847_6e66ea4e0167f4ae3fd231b3a2701138.jpg',
                'https://img-pa.auto1.com/imga5/08/a508d0eb11d84b9cd3a449371c18cb57/pa/FJ22847_a91f4192d5d21e5cc9144d37d6fae0b0.jpg',
                'https://img-pa.auto1.com/imga5/08/a508d0eb11d84b9cd3a449371c18cb57/pa/FJ22847_5dd53cfe1cdd888046f6df6125e47656.jpg',
                'https://img-pa.auto1.com/imga5/08/a508d0eb11d84b9cd3a449371c18cb57/pa/FJ22847_929cd6f9ba150a0a073859ccfc59603d.jpg'],
 'photos': [],
 'postal_code': '13000',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Bouches-du-Rhône',
 'province_code': 'FR-13',
 'region': "Provence-Alpes-Côte d'Azur",
 'region_code': 'FR-93',
 'registration_date': '2017-11-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.6 Blue-HDi Active Business',
 'transmission': 'manual',
 'trim': 'Active Business',
 'year': 2017}
2026-04-27 08:13:15 [auto1.fr] INFO: Saving data for FJ22847: {'created_time': 1777277595.898001, 'last_price_update_time': 1777277595.89801, 'has_photos': False, 'auction_closing_time': 1777389490.0}
2026-04-27 08:13:15 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item c4194d53-9dc6-5c4c-9ae3-65ebbc567e07 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 792fefe9-081c-50d5-a67b-0e5956823255 with identifier: UF12899
2026-04-27 08:13:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 792fefe9-081c-50d5-a67b-0e5956823255 with scrape type 1
2026-04-27 08:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 792fefe9-081c-50d5-a67b-0e5956823255
2026-04-27 08:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/3c/2c3c00aa370cf2ce050ea5f7d87258f0/pa/UF12899_d224f39fe0490cb30aa8a3788d120e9a.jpg not downloaded yet
2026-04-27 08:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/3c/2c3c00aa370cf2ce050ea5f7d87258f0/pa/UF12899_261dccfcfae73ea3b4d2458112ecbd1c.jpg not downloaded yet
2026-04-27 08:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/3c/2c3c00aa370cf2ce050ea5f7d87258f0/pa/UF12899_459416b2d9d7d3a83d9e672c909957f8.jpg not downloaded yet
2026-04-27 08:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/3c/2c3c00aa370cf2ce050ea5f7d87258f0/pa/UF12899_387a0600ce8eee672617c18be3060089.jpg not downloaded yet
2026-04-27 08:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/3c/2c3c00aa370cf2ce050ea5f7d87258f0/pa/UF12899_7f1f383343c9778365126a3d1bcd5020.jpg not downloaded yet
2026-04-27 08:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/3c/2c3c00aa370cf2ce050ea5f7d87258f0/pa/UF12899_e4584af0cb3e181dc4ac645d7b658ccf.jpg not downloaded yet
2026-04-27 08:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/3c/2c3c00aa370cf2ce050ea5f7d87258f0/pa/UF12899_b2a92ced9607df1cec702d84afd7f475.jpg not downloaded yet
2026-04-27 08:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/3c/2c3c00aa370cf2ce050ea5f7d87258f0/pa/UF12899_d0c544752d04a0c8cee3ad729e24560f.jpg not downloaded yet
2026-04-27 08:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/3c/2c3c00aa370cf2ce050ea5f7d87258f0/pa/UF12899_22652dd8a6ce4b1e19e0400440f46428.jpg not downloaded yet
2026-04-27 08:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/3c/2c3c00aa370cf2ce050ea5f7d87258f0/pa/UF12899_613097c64abf389514da08206852a3ef.jpg not downloaded yet
2026-04-27 08:13:16 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 99a29d1d-3f76-5449-ba4d-18e24153c9bc due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:16 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 99a29d1d-3f76-5449-ba4d-18e24153c9bc due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:16 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 99a29d1d-3f76-5449-ba4d-18e24153c9bc due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:16 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 99a29d1d-3f76-5449-ba4d-18e24153c9bc due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VP85790/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CA21668> (referer: https://www.auto1.com/v1/car-details-view/CA21668/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9101148-bd27-5d21-9ece-ff1119c48d65 with identifier: CA21668
2026-04-27 08:13:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9101148-bd27-5d21-9ece-ff1119c48d65 with scrape type 1
2026-04-27 08:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item c9101148-bd27-5d21-9ece-ff1119c48d65
2026-04-27 08:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/22/33228ac5553bb8bc3c046cbead2540fc/pa/CA21668_bc4abac950589f006cdf0bdeeec982f1.jpg not downloaded yet
2026-04-27 08:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/22/33228ac5553bb8bc3c046cbead2540fc/pa/CA21668_d39d7e810bd4c34af1707c44fd0784fc.jpg not downloaded yet
2026-04-27 08:13:17 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 792fefe9-081c-50d5-a67b-0e5956823255 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:17 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 792fefe9-081c-50d5-a67b-0e5956823255 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:17 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 792fefe9-081c-50d5-a67b-0e5956823255 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/22/33228ac5553bb8bc3c046cbead2540fc/pa/CA21668_8ac53c36f27fbd802379523229173e0c.jpg not downloaded yet
2026-04-27 08:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/22/33228ac5553bb8bc3c046cbead2540fc/pa/CA21668_17c24180adfd45313620cc92c0e4d06a.jpg not downloaded yet
2026-04-27 08:13:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GG86597> (referer: https://www.auto1.com/v1/car-details-view/GG86597/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:17 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 792fefe9-081c-50d5-a67b-0e5956823255 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/22/33228ac5553bb8bc3c046cbead2540fc/pa/CA21668_11016e3f655ce327ba5aa1999e11d156.jpg not downloaded yet
2026-04-27 08:13:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/22/33228ac5553bb8bc3c046cbead2540fc/pa/CA21668_57abde0746faa67b4c5b6d11bb7f2890.jpg not downloaded yet
2026-04-27 08:13:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df617c8d-0700-5c63-a573-b7a55c7f11fc with identifier: GG86597
2026-04-27 08:13:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df617c8d-0700-5c63-a573-b7a55c7f11fc with scrape type 1
2026-04-27 08:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item df617c8d-0700-5c63-a573-b7a55c7f11fc
2026-04-27 08:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/ea/c6eab20109284d6c2d5b328ac4d01795/pa/GG86597_ff16b7d88019db2e4c9375f444447c3d.jpg not downloaded yet
2026-04-27 08:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/ea/c6eab20109284d6c2d5b328ac4d01795/pa/GG86597_3340e696f98fd9bbbd930cf9154651bd.jpg not downloaded yet
2026-04-27 08:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/ea/c6eab20109284d6c2d5b328ac4d01795/pa/GG86597_b4b87e4020afe0b3a1bdf2e87ee19aee.jpg not downloaded yet
2026-04-27 08:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/ea/c6eab20109284d6c2d5b328ac4d01795/pa/GG86597_93ad8fba11dc72249af28eeffb68921e.jpg not downloaded yet
2026-04-27 08:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/ea/c6eab20109284d6c2d5b328ac4d01795/pa/GG86597_d1d0189b5eca59ac13f8814ceb1aec0c.jpg not downloaded yet
2026-04-27 08:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/ea/c6eab20109284d6c2d5b328ac4d01795/pa/GG86597_e236b555888c860ec9bfbc27dfea5380.jpg not downloaded yet
2026-04-27 08:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/ea/c6eab20109284d6c2d5b328ac4d01795/pa/GG86597_7b79e9b063f23ef69d5983242640eb38.jpg not downloaded yet
2026-04-27 08:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/ea/c6eab20109284d6c2d5b328ac4d01795/pa/GG86597_18d4477ebd183ae53cc427510e2804a5.jpg not downloaded yet
2026-04-27 08:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/ea/c6eab20109284d6c2d5b328ac4d01795/pa/GG86597_ce5dc7c8af71091a3872b881d3391366.jpg not downloaded yet
2026-04-27 08:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/ea/c6eab20109284d6c2d5b328ac4d01795/pa/GG86597_20f0b9a540eaa5bfe90b047a2e186f9b.jpg not downloaded yet
2026-04-27 08:13:18 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item 792fefe9-081c-50d5-a67b-0e5956823255 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:18 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 792fefe9-081c-50d5-a67b-0e5956823255 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:18 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item 792fefe9-081c-50d5-a67b-0e5956823255 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:18 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item 792fefe9-081c-50d5-a67b-0e5956823255 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:18 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 792fefe9-081c-50d5-a67b-0e5956823255 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BH82136/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:18 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item c9101148-bd27-5d21-9ece-ff1119c48d65 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:19 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item df617c8d-0700-5c63-a573-b7a55c7f11fc due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:19 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item df617c8d-0700-5c63-a573-b7a55c7f11fc due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:19 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item df617c8d-0700-5c63-a573-b7a55c7f11fc due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:19 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item df617c8d-0700-5c63-a573-b7a55c7f11fc due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NB55721> (referer: https://www.auto1.com/v1/car-details-view/NB55721/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:19 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item df617c8d-0700-5c63-a573-b7a55c7f11fc due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 005c3b8b-6e70-5bb0-9229-a68da2df0d9b with identifier: NB55721
2026-04-27 08:13:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 005c3b8b-6e70-5bb0-9229-a68da2df0d9b with scrape type 1
2026-04-27 08:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 005c3b8b-6e70-5bb0-9229-a68da2df0d9b
2026-04-27 08:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/1f/421fb0b915e255e58f53e256fb857136/pa/NB55721_e5671063bdda1cd608a69f0ff2875ff9.jpg not downloaded yet
2026-04-27 08:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/1f/421fb0b915e255e58f53e256fb857136/pa/NB55721_221689c78dfc3cb02a99ba63aaf698fa.jpg not downloaded yet
2026-04-27 08:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/1f/421fb0b915e255e58f53e256fb857136/pa/NB55721_e792dc7dba262985adc0564285fdc9ff.jpg not downloaded yet
2026-04-27 08:13:19 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item df617c8d-0700-5c63-a573-b7a55c7f11fc due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/1f/421fb0b915e255e58f53e256fb857136/pa/NB55721_5fb44e2339c54da5935f00abab652f99.jpg not downloaded yet
2026-04-27 08:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/1f/421fb0b915e255e58f53e256fb857136/pa/NB55721_0c3709843fa21421fc4211dd23100ada.jpg not downloaded yet
2026-04-27 08:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/1f/421fb0b915e255e58f53e256fb857136/pa/NB55721_41a2b8b35fee69815c0bcda305f92f72.jpg not downloaded yet
2026-04-27 08:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/1f/421fb0b915e255e58f53e256fb857136/pa/NB55721_153dc56dfc958933763a3debeb2cf63e.jpg not downloaded yet
2026-04-27 08:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/1f/421fb0b915e255e58f53e256fb857136/pa/NB55721_a9ab4044b918ce58b96b2b74e1300d44.jpg not downloaded yet
2026-04-27 08:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/1f/421fb0b915e255e58f53e256fb857136/pa/NB55721_4e42898872bf099acfdb457927637798.jpg not downloaded yet
2026-04-27 08:13:20 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item df617c8d-0700-5c63-a573-b7a55c7f11fc due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/1f/421fb0b915e255e58f53e256fb857136/pa/NB55721_fbc1deaa268a0f0e2c8758ed12bd986e.jpg not downloaded yet
2026-04-27 08:13:20 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item df617c8d-0700-5c63-a573-b7a55c7f11fc due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:20 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item df617c8d-0700-5c63-a573-b7a55c7f11fc due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: df617c8d-0700-5c63-a573-b7a55c7f11fc with identifier: GG86597
2026-04-27 08:13:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: df617c8d-0700-5c63-a573-b7a55c7f11fc with identifier: GG86597
2026-04-27 08:13:21 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:13:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: df617c8d-0700-5c63-a573-b7a55c7f11fc with identifier: GG86597 to the API
2026-04-27 08:13:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:13:21 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:13:21 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': 189,
 'category': None,
 'city': 'Nanteuil-le-Haudouin',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 173,
 'expiration_date': '2026-04-28T15:00:13Z',
 'fuel_type': 'diesel',
 'id': 'df617c8d-0700-5c63-a573-b7a55c7f11fc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 49.1408,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GG86597',
 'listing': 'auction',
 'location': 'FR, Nanteuil-le-Haudouin',
 'location_confidence': 'geocoded',
 'longitude': 2.8114,
 'make': 'Renault',
 'model': 'Grand Espace',
 'odometer': 173146,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgc6/ea/c6eab20109284d6c2d5b328ac4d01795/pa/GG86597_ff16b7d88019db2e4c9375f444447c3d.jpg',
                'https://img-pa.auto1.com/imgc6/ea/c6eab20109284d6c2d5b328ac4d01795/pa/GG86597_3340e696f98fd9bbbd930cf9154651bd.jpg',
                'https://img-pa.auto1.com/imgc6/ea/c6eab20109284d6c2d5b328ac4d01795/pa/GG86597_b4b87e4020afe0b3a1bdf2e87ee19aee.jpg',
                'https://img-pa.auto1.com/imgc6/ea/c6eab20109284d6c2d5b328ac4d01795/pa/GG86597_93ad8fba11dc72249af28eeffb68921e.jpg',
                'https://img-pa.auto1.com/imgc6/ea/c6eab20109284d6c2d5b328ac4d01795/pa/GG86597_d1d0189b5eca59ac13f8814ceb1aec0c.jpg',
                'https://img-pa.auto1.com/imgc6/ea/c6eab20109284d6c2d5b328ac4d01795/pa/GG86597_e236b555888c860ec9bfbc27dfea5380.jpg',
                'https://img-pa.auto1.com/imgc6/ea/c6eab20109284d6c2d5b328ac4d01795/pa/GG86597_7b79e9b063f23ef69d5983242640eb38.jpg',
                'https://img-pa.auto1.com/imgc6/ea/c6eab20109284d6c2d5b328ac4d01795/pa/GG86597_18d4477ebd183ae53cc427510e2804a5.jpg',
                'https://img-pa.auto1.com/imgc6/ea/c6eab20109284d6c2d5b328ac4d01795/pa/GG86597_ce5dc7c8af71091a3872b881d3391366.jpg',
                'https://img-pa.auto1.com/imgc6/ea/c6eab20109284d6c2d5b328ac4d01795/pa/GG86597_20f0b9a540eaa5bfe90b047a2e186f9b.jpg'],
 'photos': [],
 'postal_code': '60440',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Oise',
 'province_code': 'FR-60',
 'region': 'Hauts-de-France',
 'region_code': 'FR-32',
 'registration_date': '2011-12-05',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Renault Grand Espace 2.0 dCi Espace Initiale',
 'transmission': 'automatic',
 'trim': 'Espace Initiale',
 'year': 2011}
2026-04-27 08:13:21 [auto1.fr] INFO: Saving data for GG86597: {'created_time': 1777277601.273674, 'last_price_update_time': 1777277601.273685, 'has_photos': False, 'auction_closing_time': 1777388413.0}
2026-04-27 08:13:21 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item df617c8d-0700-5c63-a573-b7a55c7f11fc due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:21 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item c9101148-bd27-5d21-9ece-ff1119c48d65 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:21 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item c9101148-bd27-5d21-9ece-ff1119c48d65 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:21 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item c9101148-bd27-5d21-9ece-ff1119c48d65 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:21 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 005c3b8b-6e70-5bb0-9229-a68da2df0d9b due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:21 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 005c3b8b-6e70-5bb0-9229-a68da2df0d9b due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:21 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 005c3b8b-6e70-5bb0-9229-a68da2df0d9b due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:21 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 005c3b8b-6e70-5bb0-9229-a68da2df0d9b due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:21 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 005c3b8b-6e70-5bb0-9229-a68da2df0d9b due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:22 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item 005c3b8b-6e70-5bb0-9229-a68da2df0d9b due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:22 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 005c3b8b-6e70-5bb0-9229-a68da2df0d9b due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:22 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item 005c3b8b-6e70-5bb0-9229-a68da2df0d9b due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:22 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item 005c3b8b-6e70-5bb0-9229-a68da2df0d9b due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 005c3b8b-6e70-5bb0-9229-a68da2df0d9b with identifier: NB55721
2026-04-27 08:13:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 005c3b8b-6e70-5bb0-9229-a68da2df0d9b with identifier: NB55721
2026-04-27 08:13:22 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:13:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 005c3b8b-6e70-5bb0-9229-a68da2df0d9b with identifier: NB55721 to the API
2026-04-27 08:13:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:13:22 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:13:23 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'category': None,
 'city': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 95,
 'expiration_date': '2026-04-28T15:26:15Z',
 'fuel_type': 'diesel',
 'id': '005c3b8b-6e70-5bb0-9229-a68da2df0d9b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NB55721',
 'listing': 'auction',
 'location': 'FR',
 'location_confidence': None,
 'longitude': None,
 'make': 'Fiat',
 'model': 'Doblo',
 'odometer': 223392,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 20,
 'photo_urls': ['https://img-pa.auto1.com/img42/1f/421fb0b915e255e58f53e256fb857136/pa/NB55721_e5671063bdda1cd608a69f0ff2875ff9.jpg',
                'https://img-pa.auto1.com/img42/1f/421fb0b915e255e58f53e256fb857136/pa/NB55721_221689c78dfc3cb02a99ba63aaf698fa.jpg',
                'https://img-pa.auto1.com/img42/1f/421fb0b915e255e58f53e256fb857136/pa/NB55721_e792dc7dba262985adc0564285fdc9ff.jpg',
                'https://img-pa.auto1.com/img42/1f/421fb0b915e255e58f53e256fb857136/pa/NB55721_5fb44e2339c54da5935f00abab652f99.jpg',
                'https://img-pa.auto1.com/img42/1f/421fb0b915e255e58f53e256fb857136/pa/NB55721_0c3709843fa21421fc4211dd23100ada.jpg',
                'https://img-pa.auto1.com/img42/1f/421fb0b915e255e58f53e256fb857136/pa/NB55721_41a2b8b35fee69815c0bcda305f92f72.jpg',
                'https://img-pa.auto1.com/img42/1f/421fb0b915e255e58f53e256fb857136/pa/NB55721_153dc56dfc958933763a3debeb2cf63e.jpg',
                'https://img-pa.auto1.com/img42/1f/421fb0b915e255e58f53e256fb857136/pa/NB55721_a9ab4044b918ce58b96b2b74e1300d44.jpg',
                'https://img-pa.auto1.com/img42/1f/421fb0b915e255e58f53e256fb857136/pa/NB55721_4e42898872bf099acfdb457927637798.jpg',
                'https://img-pa.auto1.com/img42/1f/421fb0b915e255e58f53e256fb857136/pa/NB55721_fbc1deaa268a0f0e2c8758ed12bd986e.jpg'],
 'photos': [],
 'postal_code': None,
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2019-04-16',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Fiat Doblo 1.3 M-Jet SX Maxi Kasten',
 'transmission': 'manual',
 'trim': 'SX Maxi Kasten',
 'year': 2019}
2026-04-27 08:13:23 [auto1.fr] INFO: Saving data for NB55721: {'created_time': 1777277603.10997, 'last_price_update_time': 1777277603.109979, 'has_photos': False, 'auction_closing_time': 1777389975.0}
2026-04-27 08:13:23 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 005c3b8b-6e70-5bb0-9229-a68da2df0d9b due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:23 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item c9101148-bd27-5d21-9ece-ff1119c48d65 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CJ23217> (referer: https://www.auto1.com/v1/car-details-view/CJ23217/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c9101148-bd27-5d21-9ece-ff1119c48d65 with identifier: CA21668
2026-04-27 08:13:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c9101148-bd27-5d21-9ece-ff1119c48d65 with identifier: CA21668
2026-04-27 08:13:23 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:13:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c9101148-bd27-5d21-9ece-ff1119c48d65 with identifier: CA21668 to the API
2026-04-27 08:13:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:13:23 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:13:23 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'city': 'Marseille',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO N\\/A',
 'engine': '1.9L',
 'engine_horse_power': 100,
 'expiration_date': '2026-04-28T15:42:20Z',
 'fuel_type': 'diesel',
 'id': 'c9101148-bd27-5d21-9ece-ff1119c48d65',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 43.2969,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CA21668',
 'listing': 'auction',
 'location': 'FR, Marseille',
 'location_confidence': 'geocoded',
 'longitude': 5.3811,
 'make': 'Renault',
 'model': 'Trafic',
 'odometer': 260438,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/img33/22/33228ac5553bb8bc3c046cbead2540fc/pa/CA21668_bc4abac950589f006cdf0bdeeec982f1.jpg',
                'https://img-pa.auto1.com/img33/22/33228ac5553bb8bc3c046cbead2540fc/pa/CA21668_d39d7e810bd4c34af1707c44fd0784fc.jpg',
                'https://img-pa.auto1.com/img33/22/33228ac5553bb8bc3c046cbead2540fc/pa/CA21668_8ac53c36f27fbd802379523229173e0c.jpg',
                'https://img-pa.auto1.com/img33/22/33228ac5553bb8bc3c046cbead2540fc/pa/CA21668_17c24180adfd45313620cc92c0e4d06a.jpg',
                'https://img-pa.auto1.com/img33/22/33228ac5553bb8bc3c046cbead2540fc/pa/CA21668_11016e3f655ce327ba5aa1999e11d156.jpg',
                'https://img-pa.auto1.com/img33/22/33228ac5553bb8bc3c046cbead2540fc/pa/CA21668_57abde0746faa67b4c5b6d11bb7f2890.jpg'],
 'photos': [],
 'postal_code': '13000',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Bouches-du-Rhône',
 'province_code': 'FR-13',
 'region': "Provence-Alpes-Côte d'Azur",
 'region_code': 'FR-93',
 'registration_date': '2003-04-03',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Renault Trafic 1.9 Diesel L1H1 2,7t teilverglast',
 'transmission': 'manual',
 'trim': 'L1H1 2,7t teilverglast',
 'year': 2003}
2026-04-27 08:13:23 [auto1.fr] INFO: Saving data for CA21668: {'created_time': 1777277603.648807, 'last_price_update_time': 1777277603.648816, 'has_photos': False, 'auction_closing_time': 1777390940.0}
2026-04-27 08:13:23 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item c9101148-bd27-5d21-9ece-ff1119c48d65 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8286f9a-d9f0-565f-bdcc-d53f9d38b2f2 with identifier: CJ23217
2026-04-27 08:13:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8286f9a-d9f0-565f-bdcc-d53f9d38b2f2 with scrape type 1
2026-04-27 08:13:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d8286f9a-d9f0-565f-bdcc-d53f9d38b2f2
2026-04-27 08:13:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/75/a8754d8c571deea0e1582e4f2fbd61ec/pa/CJ23217_3d96def9b35b25921a01acf4cbb7c931.jpg not downloaded yet
2026-04-27 08:13:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/75/a8754d8c571deea0e1582e4f2fbd61ec/pa/CJ23217_3ca333a4a86544f27037c35fdfa38e5e.jpg not downloaded yet
2026-04-27 08:13:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/75/a8754d8c571deea0e1582e4f2fbd61ec/pa/CJ23217_00a3328d73d3b13c077a0b3f2b55923f.jpg not downloaded yet
2026-04-27 08:13:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/75/a8754d8c571deea0e1582e4f2fbd61ec/pa/CJ23217_b3edff6d5e29fa535c927fd002646325.jpg not downloaded yet
2026-04-27 08:13:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 792fefe9-081c-50d5-a67b-0e5956823255 with identifier: UF12899
2026-04-27 08:13:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 792fefe9-081c-50d5-a67b-0e5956823255 with identifier: UF12899
2026-04-27 08:13:23 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:13:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 792fefe9-081c-50d5-a67b-0e5956823255 with identifier: UF12899 to the API
2026-04-27 08:13:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:13:24 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:13:24 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'category': None,
 'city': 'LA CHAPELLE LONGUEVILLE',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 115,
 'expiration_date': '2026-04-28T15:32:26Z',
 'fuel_type': 'petrol',
 'id': '792fefe9-081c-50d5-a67b-0e5956823255',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UF12899',
 'listing': 'auction',
 'location': 'FR, LA CHAPELLE LONGUEVILLE',
 'location_confidence': None,
 'longitude': None,
 'make': 'Renault',
 'model': 'Scenic',
 'odometer': 121133,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img2c/3c/2c3c00aa370cf2ce050ea5f7d87258f0/pa/UF12899_d224f39fe0490cb30aa8a3788d120e9a.jpg',
                'https://img-pa.auto1.com/img2c/3c/2c3c00aa370cf2ce050ea5f7d87258f0/pa/UF12899_261dccfcfae73ea3b4d2458112ecbd1c.jpg',
                'https://img-pa.auto1.com/img2c/3c/2c3c00aa370cf2ce050ea5f7d87258f0/pa/UF12899_459416b2d9d7d3a83d9e672c909957f8.jpg',
                'https://img-pa.auto1.com/img2c/3c/2c3c00aa370cf2ce050ea5f7d87258f0/pa/UF12899_387a0600ce8eee672617c18be3060089.jpg',
                'https://img-pa.auto1.com/img2c/3c/2c3c00aa370cf2ce050ea5f7d87258f0/pa/UF12899_7f1f383343c9778365126a3d1bcd5020.jpg',
                'https://img-pa.auto1.com/img2c/3c/2c3c00aa370cf2ce050ea5f7d87258f0/pa/UF12899_e4584af0cb3e181dc4ac645d7b658ccf.jpg',
                'https://img-pa.auto1.com/img2c/3c/2c3c00aa370cf2ce050ea5f7d87258f0/pa/UF12899_b2a92ced9607df1cec702d84afd7f475.jpg',
                'https://img-pa.auto1.com/img2c/3c/2c3c00aa370cf2ce050ea5f7d87258f0/pa/UF12899_d0c544752d04a0c8cee3ad729e24560f.jpg',
                'https://img-pa.auto1.com/img2c/3c/2c3c00aa370cf2ce050ea5f7d87258f0/pa/UF12899_22652dd8a6ce4b1e19e0400440f46428.jpg',
                'https://img-pa.auto1.com/img2c/3c/2c3c00aa370cf2ce050ea5f7d87258f0/pa/UF12899_613097c64abf389514da08206852a3ef.jpg'],
 'photos': [],
 'postal_code': None,
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2013-02-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Scenic 1.2 Energy',
 'transmission': 'manual',
 'trim': 'Energy',
 'year': 2013}
2026-04-27 08:13:24 [auto1.fr] INFO: Saving data for UF12899: {'created_time': 1777277604.143573, 'last_price_update_time': 1777277604.143582, 'has_photos': False, 'auction_closing_time': 1777390346.0}
2026-04-27 08:13:24 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item 99a29d1d-3f76-5449-ba4d-18e24153c9bc due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:24 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 99a29d1d-3f76-5449-ba4d-18e24153c9bc due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/75/a8754d8c571deea0e1582e4f2fbd61ec/pa/CJ23217_3317799682a9b4cbac97a5d0c2dc8f36.jpg not downloaded yet
2026-04-27 08:13:24 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 792fefe9-081c-50d5-a67b-0e5956823255 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:24 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item 99a29d1d-3f76-5449-ba4d-18e24153c9bc due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:24 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item 99a29d1d-3f76-5449-ba4d-18e24153c9bc due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:24 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 99a29d1d-3f76-5449-ba4d-18e24153c9bc due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/75/a8754d8c571deea0e1582e4f2fbd61ec/pa/CJ23217_dec4ac6269f1453c60b9fcfa1449bf04.jpg not downloaded yet
2026-04-27 08:13:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 99a29d1d-3f76-5449-ba4d-18e24153c9bc with identifier: PU18987
2026-04-27 08:13:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 99a29d1d-3f76-5449-ba4d-18e24153c9bc with identifier: PU18987
2026-04-27 08:13:24 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:13:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 99a29d1d-3f76-5449-ba4d-18e24153c9bc with identifier: PU18987 to the API
2026-04-27 08:13:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:13:24 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:13:24 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': None,
 'city': 'Bourgoin Jallieu',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 180,
 'expiration_date': '2026-04-28T15:24:05Z',
 'fuel_type': 'diesel',
 'id': '99a29d1d-3f76-5449-ba4d-18e24153c9bc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 45.5861,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PU18987',
 'listing': 'auction',
 'location': 'FR, Bourgoin Jallieu',
 'location_confidence': 'geocoded',
 'longitude': 5.2736,
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 341478,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgb3/73/b37356c28b6a8228a7fad4936cfcbc5d/pa/PU18987_c15f509bb10383c1589063ae982a9976.jpg',
                'https://img-pa.auto1.com/imgb3/73/b37356c28b6a8228a7fad4936cfcbc5d/pa/PU18987_18b833a65674f68b63427caac9208d8c.jpg',
                'https://img-pa.auto1.com/imgb3/73/b37356c28b6a8228a7fad4936cfcbc5d/pa/PU18987_874a1e0063f44a14afa10e3ddb33f0c3.jpg',
                'https://img-pa.auto1.com/imgb3/73/b37356c28b6a8228a7fad4936cfcbc5d/pa/PU18987_ed7ea5ade97bc9f71ee85bf7e8495b61.jpg',
                'https://img-pa.auto1.com/imgb3/73/b37356c28b6a8228a7fad4936cfcbc5d/pa/PU18987_48cbed3689092954498339141c85f4e5.jpg',
                'https://img-pa.auto1.com/imgb3/73/b37356c28b6a8228a7fad4936cfcbc5d/pa/PU18987_1dd0fdf5018a6d9a0cf6e6517ec75f64.jpg',
                'https://img-pa.auto1.com/imgb3/73/b37356c28b6a8228a7fad4936cfcbc5d/pa/PU18987_f03ee5f819c512f47715144dbf95c34e.jpg',
                'https://img-pa.auto1.com/imgb3/73/b37356c28b6a8228a7fad4936cfcbc5d/pa/PU18987_f421524d968a823ae859f8221c2abc70.jpg',
                'https://img-pa.auto1.com/imgb3/73/b37356c28b6a8228a7fad4936cfcbc5d/pa/PU18987_13353a0a7845d1215fb86434a667cb5e.jpg',
                'https://img-pa.auto1.com/imgb3/73/b37356c28b6a8228a7fad4936cfcbc5d/pa/PU18987_7ae44237fc12c94826139aa3a15c75a2.jpg'],
 'photos': [],
 'postal_code': '38300',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Isère',
 'province_code': 'FR-38',
 'region': 'Auvergne-Rhône-Alpes',
 'region_code': 'FR-84',
 'registration_date': '2018-05-28',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Peugeot 5008 2.0 Blue-HDi GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2018}
2026-04-27 08:13:24 [auto1.fr] INFO: Saving data for PU18987: {'created_time': 1777277604.829762, 'last_price_update_time': 1777277604.829777, 'has_photos': False, 'auction_closing_time': 1777389845.0}
2026-04-27 08:13:24 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 99a29d1d-3f76-5449-ba4d-18e24153c9bc due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/75/a8754d8c571deea0e1582e4f2fbd61ec/pa/CJ23217_e16cba44ac53dd58f15d12850ab6990b.jpg not downloaded yet
2026-04-27 08:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/75/a8754d8c571deea0e1582e4f2fbd61ec/pa/CJ23217_b14487d0aa7cd619762ea848e6521774.jpg not downloaded yet
2026-04-27 08:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/75/a8754d8c571deea0e1582e4f2fbd61ec/pa/CJ23217_e89e227650ed79d13ca727bee4091ac5.jpg not downloaded yet
2026-04-27 08:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/75/a8754d8c571deea0e1582e4f2fbd61ec/pa/CJ23217_739ceb8900f191706a2de07901557f88.jpg not downloaded yet
2026-04-27 08:13:24 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 43e6b338-6d1e-5d02-b6db-5d195da86e6c due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:24 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 43e6b338-6d1e-5d02-b6db-5d195da86e6c due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:24 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 43e6b338-6d1e-5d02-b6db-5d195da86e6c due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:24 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item d8286f9a-d9f0-565f-bdcc-d53f9d38b2f2 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:25 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item d8286f9a-d9f0-565f-bdcc-d53f9d38b2f2 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:25 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item d8286f9a-d9f0-565f-bdcc-d53f9d38b2f2 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:26 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item 43e6b338-6d1e-5d02-b6db-5d195da86e6c due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:26 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item d8286f9a-d9f0-565f-bdcc-d53f9d38b2f2 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:26 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item d8286f9a-d9f0-565f-bdcc-d53f9d38b2f2 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:26 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item d8286f9a-d9f0-565f-bdcc-d53f9d38b2f2 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:26 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item d8286f9a-d9f0-565f-bdcc-d53f9d38b2f2 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VT02723/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:27 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item d8286f9a-d9f0-565f-bdcc-d53f9d38b2f2 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:27 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item d8286f9a-d9f0-565f-bdcc-d53f9d38b2f2 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:27 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 43e6b338-6d1e-5d02-b6db-5d195da86e6c due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:27 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item 43e6b338-6d1e-5d02-b6db-5d195da86e6c due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d8286f9a-d9f0-565f-bdcc-d53f9d38b2f2 with identifier: CJ23217
2026-04-27 08:13:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d8286f9a-d9f0-565f-bdcc-d53f9d38b2f2 with identifier: CJ23217
2026-04-27 08:13:27 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:13:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: d8286f9a-d9f0-565f-bdcc-d53f9d38b2f2 with identifier: CJ23217 to the API
2026-04-27 08:13:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:13:27 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:13:27 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'category': None,
 'city': 'Villenoy',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-04-28T15:44:24Z',
 'fuel_type': 'diesel',
 'id': 'd8286f9a-d9f0-565f-bdcc-d53f9d38b2f2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.9411,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CJ23217',
 'listing': 'auction',
 'location': 'FR, Villenoy',
 'location_confidence': 'geocoded',
 'longitude': 2.8602,
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 142666,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imga8/75/a8754d8c571deea0e1582e4f2fbd61ec/pa/CJ23217_3d96def9b35b25921a01acf4cbb7c931.jpg',
                'https://img-pa.auto1.com/imga8/75/a8754d8c571deea0e1582e4f2fbd61ec/pa/CJ23217_3ca333a4a86544f27037c35fdfa38e5e.jpg',
                'https://img-pa.auto1.com/imga8/75/a8754d8c571deea0e1582e4f2fbd61ec/pa/CJ23217_00a3328d73d3b13c077a0b3f2b55923f.jpg',
                'https://img-pa.auto1.com/imga8/75/a8754d8c571deea0e1582e4f2fbd61ec/pa/CJ23217_b3edff6d5e29fa535c927fd002646325.jpg',
                'https://img-pa.auto1.com/imga8/75/a8754d8c571deea0e1582e4f2fbd61ec/pa/CJ23217_3317799682a9b4cbac97a5d0c2dc8f36.jpg',
                'https://img-pa.auto1.com/imga8/75/a8754d8c571deea0e1582e4f2fbd61ec/pa/CJ23217_dec4ac6269f1453c60b9fcfa1449bf04.jpg',
                'https://img-pa.auto1.com/imga8/75/a8754d8c571deea0e1582e4f2fbd61ec/pa/CJ23217_e16cba44ac53dd58f15d12850ab6990b.jpg',
                'https://img-pa.auto1.com/imga8/75/a8754d8c571deea0e1582e4f2fbd61ec/pa/CJ23217_b14487d0aa7cd619762ea848e6521774.jpg',
                'https://img-pa.auto1.com/imga8/75/a8754d8c571deea0e1582e4f2fbd61ec/pa/CJ23217_e89e227650ed79d13ca727bee4091ac5.jpg',
                'https://img-pa.auto1.com/imga8/75/a8754d8c571deea0e1582e4f2fbd61ec/pa/CJ23217_739ceb8900f191706a2de07901557f88.jpg'],
 'photos': [],
 'postal_code': '77124',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Seine-et-Marne',
 'province_code': 'FR-77',
 'region': 'Île-de-France',
 'region_code': 'FR-11',
 'registration_date': '2019-04-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Comfortline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2019}
2026-04-27 08:13:27 [auto1.fr] INFO: Saving data for CJ23217: {'created_time': 1777277607.358583, 'last_price_update_time': 1777277607.358595, 'has_photos': False, 'auction_closing_time': 1777391064.0}
2026-04-27 08:13:27 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item d8286f9a-d9f0-565f-bdcc-d53f9d38b2f2 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:27 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item 43e6b338-6d1e-5d02-b6db-5d195da86e6c due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KM50585/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:28 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 43e6b338-6d1e-5d02-b6db-5d195da86e6c due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 43e6b338-6d1e-5d02-b6db-5d195da86e6c with identifier: YT50329
2026-04-27 08:13:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 43e6b338-6d1e-5d02-b6db-5d195da86e6c with identifier: YT50329
2026-04-27 08:13:28 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:13:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 43e6b338-6d1e-5d02-b6db-5d195da86e6c with identifier: YT50329 to the API
2026-04-27 08:13:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:13:28 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:13:28 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': 183,
 'category': None,
 'city': 'Vezin-le-Coquet',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 200,
 'expiration_date': '2026-04-28T15:32:43Z',
 'fuel_type': 'petrol',
 'id': '43e6b338-6d1e-5d02-b6db-5d195da86e6c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.119,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YT50329',
 'listing': 'auction',
 'location': 'FR, Vezin-le-Coquet',
 'location_confidence': 'geocoded',
 'longitude': -1.7563,
 'make': 'Audi',
 'model': 'TT',
 'odometer': 240783,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img04/ed/04ed06ed2cc4a52c91d8e8b8ed89a240/pa/YT50329_7a68dbfadc4a13894345caccce2eb76c.jpg',
                'https://img-pa.auto1.com/img04/ed/04ed06ed2cc4a52c91d8e8b8ed89a240/pa/YT50329_4c6176fdaf24be3354d1aef759c8e5c5.jpg',
                'https://img-pa.auto1.com/img04/ed/04ed06ed2cc4a52c91d8e8b8ed89a240/pa/YT50329_70615151e82fdca351f848b2b7006ce7.jpg',
                'https://img-pa.auto1.com/img04/ed/04ed06ed2cc4a52c91d8e8b8ed89a240/pa/YT50329_fb4aba41ac1feff6dd707e5e3411c624.jpg',
                'https://img-pa.auto1.com/img04/ed/04ed06ed2cc4a52c91d8e8b8ed89a240/pa/YT50329_8da7f4b42830aac2268bf8e3d2e6b170.jpg',
                'https://img-pa.auto1.com/img04/ed/04ed06ed2cc4a52c91d8e8b8ed89a240/pa/YT50329_7e6ab41cb32c74106193a1e7acc19b65.jpg',
                'https://img-pa.auto1.com/img04/ed/04ed06ed2cc4a52c91d8e8b8ed89a240/pa/YT50329_5c962e6d6af6def4f605d506a5841603.jpg',
                'https://img-pa.auto1.com/img04/ed/04ed06ed2cc4a52c91d8e8b8ed89a240/pa/YT50329_60c9fd4ab6ef7b7854afa64e1f7ef814.jpg',
                'https://img-pa.auto1.com/img04/ed/04ed06ed2cc4a52c91d8e8b8ed89a240/pa/YT50329_05980fa99dca9b7499e66e8fa04fd247.jpg',
                'https://img-pa.auto1.com/img04/ed/04ed06ed2cc4a52c91d8e8b8ed89a240/pa/YT50329_9efdbd1bbb31eb113a4f71fac807927d.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_43e6b338-6d1e-5d02-b6db-5d195da86e6c/43e6b338-6d1e-5d02-b6db-5d195da86e6c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72482,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/ed/04ed06ed2cc4a52c91d8e8b8ed89a240/pa/YT50329_9efdbd1bbb31eb113a4f71fac807927d.jpg',
             'Width': 800}],
 'postal_code': '35132',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Ille-et-Vilaine',
 'province_code': 'FR-35',
 'region': 'Bretagne',
 'region_code': 'FR-53',
 'registration_date': '2007-08-22',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Audi TT 2.0 TFSI Coupe',
 'transmission': 'manual',
 'trim': 'Coupe',
 'year': 2007}
2026-04-27 08:13:28 [auto1.fr] INFO: Saving data for YT50329: {'created_time': 1777277608.449613, 'last_price_update_time': 1777277608.449627, 'has_photos': True, 'auction_closing_time': 1777390363.0}
2026-04-27 08:13:28 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 43e6b338-6d1e-5d02-b6db-5d195da86e6c due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RB61201> (referer: https://www.auto1.com/v1/car-details-view/RB61201/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85439da6-18cf-54c0-8d99-9f3f6d8bc211 with identifier: RB61201
2026-04-27 08:13:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85439da6-18cf-54c0-8d99-9f3f6d8bc211 with scrape type 1
2026-04-27 08:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 85439da6-18cf-54c0-8d99-9f3f6d8bc211
2026-04-27 08:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/0e/f70e3b57bf9a143d2e138cb60c2f1402/pa/RB61201_ac89ea022d1b338508bf14d7a1547097.jpg not downloaded yet
2026-04-27 08:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/0e/f70e3b57bf9a143d2e138cb60c2f1402/pa/RB61201_f7d519303e6bfcbe749c2eaaf3710369.jpg not downloaded yet
2026-04-27 08:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/0e/f70e3b57bf9a143d2e138cb60c2f1402/pa/RB61201_bb6871f30798c15c1c8fa73aa2e7ff8c.jpg not downloaded yet
2026-04-27 08:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/0e/f70e3b57bf9a143d2e138cb60c2f1402/pa/RB61201_8e1fde397815309b724dce9ea54cb468.jpg not downloaded yet
2026-04-27 08:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/0e/f70e3b57bf9a143d2e138cb60c2f1402/pa/RB61201_c085c5fc46ce8dd9574f5efd4b727fc6.jpg not downloaded yet
2026-04-27 08:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/0e/f70e3b57bf9a143d2e138cb60c2f1402/pa/RB61201_a05279574aadd87e1198464478265d9e.jpg not downloaded yet
2026-04-27 08:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/0e/f70e3b57bf9a143d2e138cb60c2f1402/pa/RB61201_95cca98b30cecd06f4375fd6c808a927.jpg not downloaded yet
2026-04-27 08:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/0e/f70e3b57bf9a143d2e138cb60c2f1402/pa/RB61201_0e876d01fa02d7e5bbe0776dfc29a373.jpg not downloaded yet
2026-04-27 08:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/0e/f70e3b57bf9a143d2e138cb60c2f1402/pa/RB61201_41d4b23648deea4690af34963c371923.jpg not downloaded yet
2026-04-27 08:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/0e/f70e3b57bf9a143d2e138cb60c2f1402/pa/RB61201_0d0c706351b3ab95f070f465eb5ebe84.jpg not downloaded yet
2026-04-27 08:13:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WT97389/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:31 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 85439da6-18cf-54c0-8d99-9f3f6d8bc211 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:34 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 264.626(s), this was the 2nd time calling it.
2026-04-27 08:13:34 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.926937365891525 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:13:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:34 [auto1.fr] INFO: Channel: 24h | Page: 19 | totalHits: 4799 | hits on page: 40
2026-04-27 08:13:34 [auto1.fr] INFO: Found listing with ID: RB61201
2026-04-27 08:13:34 [auto1.fr] INFO: Found listing with ID: HX54936
2026-04-27 08:13:34 [auto1.fr] INFO: Found listing with ID: XM15885
2026-04-27 08:13:34 [auto1.fr] INFO: Scrape type for XM15885: 0
2026-04-27 08:13:34 [auto1.fr] INFO: Found listing with ID: CA21668
2026-04-27 08:13:34 [auto1.fr] INFO: Scrape type for CA21668: 0
2026-04-27 08:13:34 [auto1.fr] INFO: Found listing with ID: FK01060
2026-04-27 08:13:34 [auto1.fr] INFO: Scrape type for FK01060: 0
2026-04-27 08:13:34 [auto1.fr] INFO: Found listing with ID: HK37982
2026-04-27 08:13:34 [auto1.fr] INFO: Scrape type for HK37982: 0
2026-04-27 08:13:34 [auto1.fr] INFO: Found listing with ID: PU18987
2026-04-27 08:13:34 [auto1.fr] INFO: Scrape type for PU18987: 0
2026-04-27 08:13:34 [auto1.fr] INFO: Found listing with ID: FJ22847
2026-04-27 08:13:34 [auto1.fr] INFO: Scrape type for FJ22847: 0
2026-04-27 08:13:34 [auto1.fr] INFO: Found listing with ID: CS29845
2026-04-27 08:13:34 [auto1.fr] INFO: Scrape type for CS29845: 0
2026-04-27 08:13:34 [auto1.fr] INFO: Found listing with ID: YL63768
2026-04-27 08:13:34 [auto1.fr] INFO: Scrape type for YL63768: 0
2026-04-27 08:13:34 [auto1.fr] INFO: Found listing with ID: UF12899
2026-04-27 08:13:34 [auto1.fr] INFO: Scrape type for UF12899: 0
2026-04-27 08:13:34 [auto1.fr] INFO: Found listing with ID: MJ97326
2026-04-27 08:13:34 [auto1.fr] INFO: Scrape type for MJ97326: 0
2026-04-27 08:13:34 [auto1.fr] INFO: Found listing with ID: DR17814
2026-04-27 08:13:34 [auto1.fr] INFO: Scrape type for DR17814: 0
2026-04-27 08:13:34 [auto1.fr] INFO: Found listing with ID: PP37364
2026-04-27 08:13:34 [auto1.fr] INFO: Scrape type for PP37364: 0
2026-04-27 08:13:34 [auto1.fr] INFO: Found listing with ID: RN15222
2026-04-27 08:13:34 [auto1.fr] INFO: Scrape type for RN15222: 0
2026-04-27 08:13:34 [auto1.fr] INFO: Found listing with ID: XX57600
2026-04-27 08:13:34 [auto1.fr] INFO: Scrape type for XX57600: 0
2026-04-27 08:13:34 [auto1.fr] INFO: Found listing with ID: WH02443
2026-04-27 08:13:34 [auto1.fr] INFO: Scrape type for WH02443: 0
2026-04-27 08:13:34 [auto1.fr] INFO: Found listing with ID: YV37253
2026-04-27 08:13:34 [auto1.fr] INFO: Found listing with ID: XU74860
2026-04-27 08:13:34 [auto1.fr] INFO: Scrape type for XU74860: 0
2026-04-27 08:13:34 [auto1.fr] INFO: Found listing with ID: EG39801
2026-04-27 08:13:34 [auto1.fr] INFO: Scrape type for EG39801: 0
2026-04-27 08:13:34 [auto1.fr] INFO: Found listing with ID: JL62454
2026-04-27 08:13:34 [auto1.fr] INFO: Scrape type for JL62454: 0
2026-04-27 08:13:34 [auto1.fr] INFO: Found listing with ID: ZV54610
2026-04-27 08:13:34 [auto1.fr] INFO: Scrape type for ZV54610: 0
2026-04-27 08:13:34 [auto1.fr] INFO: Found listing with ID: AT94183
2026-04-27 08:13:34 [auto1.fr] INFO: Found listing with ID: PB17191
2026-04-27 08:13:34 [auto1.fr] INFO: Scrape type for PB17191: 0
2026-04-27 08:13:34 [auto1.fr] INFO: Found listing with ID: SY70322
2026-04-27 08:13:34 [auto1.fr] INFO: Scrape type for SY70322: 1
2026-04-27 08:13:34 [auto1.fr] INFO: Found listing with ID: XT54185
2026-04-27 08:13:34 [auto1.fr] INFO: Scrape type for XT54185: 1
2026-04-27 08:13:34 [auto1.fr] INFO: Found listing with ID: SS92656
2026-04-27 08:13:34 [auto1.fr] INFO: Scrape type for SS92656: 1
2026-04-27 08:13:34 [auto1.fr] INFO: Found listing with ID: GX08987
2026-04-27 08:13:34 [auto1.fr] INFO: Scrape type for GX08987: 1
2026-04-27 08:13:34 [auto1.fr] INFO: Found listing with ID: KU72457
2026-04-27 08:13:34 [auto1.fr] INFO: Scrape type for KU72457: 1
2026-04-27 08:13:34 [auto1.fr] INFO: Found listing with ID: HK18550
2026-04-27 08:13:34 [auto1.fr] INFO: Scrape type for HK18550: 1
2026-04-27 08:13:34 [auto1.fr] INFO: Found listing with ID: HW60627
2026-04-27 08:13:34 [auto1.fr] INFO: Scrape type for HW60627: 1
2026-04-27 08:13:34 [auto1.fr] INFO: Found listing with ID: NG43636
2026-04-27 08:13:34 [auto1.fr] INFO: Scrape type for NG43636: 1
2026-04-27 08:13:34 [auto1.fr] INFO: Found listing with ID: CF93028
2026-04-27 08:13:34 [auto1.fr] INFO: Scrape type for CF93028: 2
2026-04-27 08:13:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 515ea13f-126a-51c0-b061-f1294d83e0b4 with identifier: CF93028
2026-04-27 08:13:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 515ea13f-126a-51c0-b061-f1294d83e0b4 with scrape type 2
2026-04-27 08:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 515ea13f-126a-51c0-b061-f1294d83e0b4 with scrape type 2
2026-04-27 08:13:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 515ea13f-126a-51c0-b061-f1294d83e0b4, identifier: CF93028
2026-04-27 08:13:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 515ea13f-126a-51c0-b061-f1294d83e0b4 with identifier: CF93028
2026-04-27 08:13:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 515ea13f-126a-51c0-b061-f1294d83e0b4 with identifier: CF93028
2026-04-27 08:13:35 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:13:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 515ea13f-126a-51c0-b061-f1294d83e0b4 with identifier: CF93028 to the API
2026-04-27 08:13:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:13:35 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:13:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-04-28T15:17:11Z',
 'fuel_type': 'petrol',
 'id': '515ea13f-126a-51c0-b061-f1294d83e0b4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CF93028',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Renault',
 'model': 'Scenic',
 'odometer': 92399,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2016-08-28',
 'seller_name': None,
 'title': 'Renault Scenic 1.2 TCe Energy Limited',
 'transmission': 'manual',
 'trim': 'Limited',
 'year': 2016}
2026-04-27 08:13:35 [auto1.fr] INFO: Saving data for CF93028: {'auction_closing_time': 1777389431.0, 'created_time': 1777019993.726034, 'has_photos': True, 'last_price_update_time': 1777277615.228858}
2026-04-27 08:13:35 [auto1.fr] INFO: Found listing with ID: NV73662
2026-04-27 08:13:35 [auto1.fr] INFO: Scrape type for NV73662: 1
2026-04-27 08:13:35 [auto1.fr] INFO: Found listing with ID: AG15784
2026-04-27 08:13:35 [auto1.fr] INFO: Scrape type for AG15784: 1
2026-04-27 08:13:35 [auto1.fr] INFO: Found listing with ID: NZ76636
2026-04-27 08:13:35 [auto1.fr] INFO: Scrape type for NZ76636: 2
2026-04-27 08:13:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6713fdc-6aad-5945-a7c1-343d0fcadd33 with identifier: NZ76636
2026-04-27 08:13:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6713fdc-6aad-5945-a7c1-343d0fcadd33 with scrape type 2
2026-04-27 08:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c6713fdc-6aad-5945-a7c1-343d0fcadd33 with scrape type 2
2026-04-27 08:13:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c6713fdc-6aad-5945-a7c1-343d0fcadd33, identifier: NZ76636
2026-04-27 08:13:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c6713fdc-6aad-5945-a7c1-343d0fcadd33 with identifier: NZ76636
2026-04-27 08:13:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c6713fdc-6aad-5945-a7c1-343d0fcadd33 with identifier: NZ76636
2026-04-27 08:13:35 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:13:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c6713fdc-6aad-5945-a7c1-343d0fcadd33 with identifier: NZ76636 to the API
2026-04-27 08:13:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:13:35 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:13:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-04-28T15:19:19Z',
 'fuel_type': 'petrol',
 'id': 'c6713fdc-6aad-5945-a7c1-343d0fcadd33',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NZ76636',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Citroen',
 'model': 'C5',
 'odometer': 96692,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2011-01-30',
 'seller_name': None,
 'title': 'Citroen C5 1.6 Exclusive',
 'transmission': 'automatic',
 'trim': 'Exclusive',
 'year': 2011}
2026-04-27 08:13:35 [auto1.fr] INFO: Saving data for NZ76636: {'auction_closing_time': 1777389559.0, 'created_time': 1777019094.218708, 'has_photos': True, 'last_price_update_time': 1777277615.759656}
2026-04-27 08:13:35 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 85439da6-18cf-54c0-8d99-9f3f6d8bc211 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:35 [auto1.fr] INFO: Found listing with ID: JA43345
2026-04-27 08:13:35 [auto1.fr] INFO: Scrape type for JA43345: 2
2026-04-27 08:13:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 583e91cb-5924-5c98-8ec3-f03fec74b7fc with identifier: JA43345
2026-04-27 08:13:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 583e91cb-5924-5c98-8ec3-f03fec74b7fc with scrape type 2
2026-04-27 08:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 583e91cb-5924-5c98-8ec3-f03fec74b7fc with scrape type 2
2026-04-27 08:13:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 583e91cb-5924-5c98-8ec3-f03fec74b7fc, identifier: JA43345
2026-04-27 08:13:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 583e91cb-5924-5c98-8ec3-f03fec74b7fc with identifier: JA43345
2026-04-27 08:13:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 583e91cb-5924-5c98-8ec3-f03fec74b7fc with identifier: JA43345
2026-04-27 08:13:35 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:13:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 583e91cb-5924-5c98-8ec3-f03fec74b7fc with identifier: JA43345 to the API
2026-04-27 08:13:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:13:36 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:13:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-04-28T15:28:27Z',
 'fuel_type': 'diesel',
 'id': '583e91cb-5924-5c98-8ec3-f03fec74b7fc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JA43345',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Peugeot',
 'model': '206',
 'odometer': 111265,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2007-12-27',
 'seller_name': None,
 'title': 'Peugeot 206 1.4 HDi XBOX 360',
 'transmission': 'manual',
 'trim': 'XBOX 360',
 'year': 2007}
2026-04-27 08:13:36 [auto1.fr] INFO: Saving data for JA43345: {'auction_closing_time': 1777390107.0, 'created_time': 1777019408.077848, 'has_photos': True, 'last_price_update_time': 1777277616.176084}
2026-04-27 08:13:36 [auto1.fr] INFO: Found listing with ID: AR06449
2026-04-27 08:13:36 [auto1.fr] INFO: Scrape type for AR06449: 1
2026-04-27 08:13:36 [auto1.fr] INFO: Found listing with ID: MM27216
2026-04-27 08:13:36 [auto1.fr] INFO: Scrape type for MM27216: 1
2026-04-27 08:13:36 [auto1.fr] INFO: Found listing with ID: VU78240
2026-04-27 08:13:36 [auto1.fr] INFO: Scrape type for VU78240: 1
2026-04-27 08:13:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KT65439/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-04-27 08:13:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BK47003/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TT31449/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BU48412/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VT02723> (referer: https://www.auto1.com/v1/car-details-view/VT02723/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa690fbf-7811-51bc-a490-8953cc3bb357 with identifier: VT02723
2026-04-27 08:13:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa690fbf-7811-51bc-a490-8953cc3bb357 with scrape type 1
2026-04-27 08:13:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fa690fbf-7811-51bc-a490-8953cc3bb357
2026-04-27 08:13:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/34/493452e99a42a74600489b969c6dc379/pa/VT02723_e1f71498fcc1e1a02e4627d0f5fac37d.jpg not downloaded yet
2026-04-27 08:13:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/34/493452e99a42a74600489b969c6dc379/pa/VT02723_77fbaa8d5fb1287edd998d46a8882aa6.jpg not downloaded yet
2026-04-27 08:13:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/34/493452e99a42a74600489b969c6dc379/pa/VT02723_e88e0ff3191d6faebb5270ad117033a0.jpg not downloaded yet
2026-04-27 08:13:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/34/493452e99a42a74600489b969c6dc379/pa/VT02723_510d2fe448aa35b683e5760c4b88635c.jpg not downloaded yet
2026-04-27 08:13:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/34/493452e99a42a74600489b969c6dc379/pa/VT02723_c75d0b8d377461141bb6b12f3c7bd583.jpg not downloaded yet
2026-04-27 08:13:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/34/493452e99a42a74600489b969c6dc379/pa/VT02723_98e0e2f63a3a4ce1c328601bc32b905a.jpg not downloaded yet
2026-04-27 08:13:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/34/493452e99a42a74600489b969c6dc379/pa/VT02723_0e425e8ffdaf56a511661775a8c123a0.jpg not downloaded yet
2026-04-27 08:13:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/34/493452e99a42a74600489b969c6dc379/pa/VT02723_5d2d2370e0d9abeb4763e1504e3c3362.jpg not downloaded yet
2026-04-27 08:13:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/34/493452e99a42a74600489b969c6dc379/pa/VT02723_9bb908f3db54d6acb96e819fa919484d.jpg not downloaded yet
2026-04-27 08:13:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/34/493452e99a42a74600489b969c6dc379/pa/VT02723_7b68e1b352fb842271ac7f534594c88a.jpg not downloaded yet
2026-04-27 08:13:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BH82136> (referer: https://www.auto1.com/v1/car-details-view/BH82136/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32ddfd51-ed59-592a-a561-84abb3682440 with identifier: BH82136
2026-04-27 08:13:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32ddfd51-ed59-592a-a561-84abb3682440 with scrape type 1
2026-04-27 08:13:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 32ddfd51-ed59-592a-a561-84abb3682440
2026-04-27 08:13:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/5b/bd5bf84b725e052b40b1cbec1b0c0783/pa/BH82136_be3030342a9421c38ff533bab7ee93b9.jpg not downloaded yet
2026-04-27 08:13:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/5b/bd5bf84b725e052b40b1cbec1b0c0783/pa/BH82136_057ea68ed3eca29c25239860249ff748.jpg not downloaded yet
2026-04-27 08:13:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/5b/bd5bf84b725e052b40b1cbec1b0c0783/pa/BH82136_40554ac170dafdd8abd408969f39aaa7.jpg not downloaded yet
2026-04-27 08:13:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/5b/bd5bf84b725e052b40b1cbec1b0c0783/pa/BH82136_653dba89cad55a5cc6647d40d8ba531b.jpg not downloaded yet
2026-04-27 08:13:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/5b/bd5bf84b725e052b40b1cbec1b0c0783/pa/BH82136_5b0bcc44f3af07830bac66b77f9e7fa5.jpg not downloaded yet
2026-04-27 08:13:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/5b/bd5bf84b725e052b40b1cbec1b0c0783/pa/BH82136_00f4a79fb2dd98c1008e263f028a8a7c.jpg not downloaded yet
2026-04-27 08:13:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/5b/bd5bf84b725e052b40b1cbec1b0c0783/pa/BH82136_ddf6772ea98458755ad1c0c8502c7c32.jpg not downloaded yet
2026-04-27 08:13:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/5b/bd5bf84b725e052b40b1cbec1b0c0783/pa/BH82136_8837ff3545fd047c78fe841f10355c8d.jpg not downloaded yet
2026-04-27 08:13:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/5b/bd5bf84b725e052b40b1cbec1b0c0783/pa/BH82136_56a095c7ce0b9959283309d1f1d36861.jpg not downloaded yet
2026-04-27 08:13:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/5b/bd5bf84b725e052b40b1cbec1b0c0783/pa/BH82136_dd51d774b80dd85897b46b210962d163.jpg not downloaded yet
2026-04-27 08:13:57 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item fa690fbf-7811-51bc-a490-8953cc3bb357 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:58 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 32ddfd51-ed59-592a-a561-84abb3682440 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HX54936/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:59 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 32ddfd51-ed59-592a-a561-84abb3682440 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:59 [scrapy.extensions.logstats] INFO: Crawled 582 pages (at 30 pages/min), scraped 489 items (at 15 items/min)
2026-04-27 08:13:59 [scrapy.extensions.memusage] INFO: Peak memory usage is 373MiB
2026-04-27 08:14:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WT97389> (referer: https://www.auto1.com/v1/car-details-view/WT97389/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:14:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:14:00 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 32ddfd51-ed59-592a-a561-84abb3682440 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:14:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 657ee650-65b1-5862-8714-4ea97182fd69 with identifier: WT97389
2026-04-27 08:14:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 657ee650-65b1-5862-8714-4ea97182fd69 with scrape type 1
2026-04-27 08:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 657ee650-65b1-5862-8714-4ea97182fd69
2026-04-27 08:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/a6/14a6f886d35458029d7f3164938c0cb2/pa/WT97389_500fe1911bd4f077910aff316c9fe0a7.jpg not downloaded yet
2026-04-27 08:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/a6/14a6f886d35458029d7f3164938c0cb2/pa/WT97389_07354c5f45077e338439dd354ba701e6.jpg not downloaded yet
2026-04-27 08:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/a6/14a6f886d35458029d7f3164938c0cb2/pa/WT97389_a3278e4bd278135b9d3fa1d6ffa42978.jpg not downloaded yet
2026-04-27 08:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/a6/14a6f886d35458029d7f3164938c0cb2/pa/WT97389_33a9ac0b43e50e371ea5c6ef1025d01d.jpg not downloaded yet
2026-04-27 08:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/a6/14a6f886d35458029d7f3164938c0cb2/pa/WT97389_8a7501c7cc8419b35d1162022bb44c93.jpg not downloaded yet
2026-04-27 08:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/a6/14a6f886d35458029d7f3164938c0cb2/pa/WT97389_0fc5a28887e39bf3e6b424cb6d178746.jpg not downloaded yet
2026-04-27 08:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/a6/14a6f886d35458029d7f3164938c0cb2/pa/WT97389_8eeb15662867c8f8da667795790fc1fb.jpg not downloaded yet
2026-04-27 08:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/a6/14a6f886d35458029d7f3164938c0cb2/pa/WT97389_29aa88e6c2c806750e4fefd19ca56235.jpg not downloaded yet
2026-04-27 08:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/a6/14a6f886d35458029d7f3164938c0cb2/pa/WT97389_5794427eb7eedce037e843919fd57060.jpg not downloaded yet
2026-04-27 08:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/a6/14a6f886d35458029d7f3164938c0cb2/pa/WT97389_9805dc27d9bc64083010a45f4a5129f8.jpg not downloaded yet
2026-04-27 08:14:01 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 32ddfd51-ed59-592a-a561-84abb3682440 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:14:01 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item 32ddfd51-ed59-592a-a561-84abb3682440 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:14:02 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 657ee650-65b1-5862-8714-4ea97182fd69 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:14:02 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 657ee650-65b1-5862-8714-4ea97182fd69 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:14:03 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 657ee650-65b1-5862-8714-4ea97182fd69 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:14:03 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 657ee650-65b1-5862-8714-4ea97182fd69 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:14:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NU54953/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:14:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:14:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NV73662/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:14:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:14:04 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 657ee650-65b1-5862-8714-4ea97182fd69 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:14:04 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item 657ee650-65b1-5862-8714-4ea97182fd69 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:14:05 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item 657ee650-65b1-5862-8714-4ea97182fd69 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:14:05 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item 657ee650-65b1-5862-8714-4ea97182fd69 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:14:05 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 657ee650-65b1-5862-8714-4ea97182fd69 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:14:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 657ee650-65b1-5862-8714-4ea97182fd69 with identifier: WT97389
2026-04-27 08:14:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 657ee650-65b1-5862-8714-4ea97182fd69 with identifier: WT97389
2026-04-27 08:14:06 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:14:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 657ee650-65b1-5862-8714-4ea97182fd69 with identifier: WT97389 to the API
2026-04-27 08:14:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:14:07 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:14:07 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'category': None,
 'city': 'Marseille',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 122,
 'expiration_date': '2026-04-28T15:57:26Z',
 'fuel_type': 'petrol',
 'id': '657ee650-65b1-5862-8714-4ea97182fd69',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 43.2969,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WT97389',
 'listing': 'auction',
 'location': 'FR, Marseille',
 'location_confidence': 'geocoded',
 'longitude': 5.3811,
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 111366,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img14/a6/14a6f886d35458029d7f3164938c0cb2/pa/WT97389_500fe1911bd4f077910aff316c9fe0a7.jpg',
                'https://img-pa.auto1.com/img14/a6/14a6f886d35458029d7f3164938c0cb2/pa/WT97389_07354c5f45077e338439dd354ba701e6.jpg',
                'https://img-pa.auto1.com/img14/a6/14a6f886d35458029d7f3164938c0cb2/pa/WT97389_a3278e4bd278135b9d3fa1d6ffa42978.jpg',
                'https://img-pa.auto1.com/img14/a6/14a6f886d35458029d7f3164938c0cb2/pa/WT97389_33a9ac0b43e50e371ea5c6ef1025d01d.jpg',
                'https://img-pa.auto1.com/img14/a6/14a6f886d35458029d7f3164938c0cb2/pa/WT97389_8a7501c7cc8419b35d1162022bb44c93.jpg',
                'https://img-pa.auto1.com/img14/a6/14a6f886d35458029d7f3164938c0cb2/pa/WT97389_0fc5a28887e39bf3e6b424cb6d178746.jpg',
                'https://img-pa.auto1.com/img14/a6/14a6f886d35458029d7f3164938c0cb2/pa/WT97389_8eeb15662867c8f8da667795790fc1fb.jpg',
                'https://img-pa.auto1.com/img14/a6/14a6f886d35458029d7f3164938c0cb2/pa/WT97389_29aa88e6c2c806750e4fefd19ca56235.jpg',
                'https://img-pa.auto1.com/img14/a6/14a6f886d35458029d7f3164938c0cb2/pa/WT97389_5794427eb7eedce037e843919fd57060.jpg',
                'https://img-pa.auto1.com/img14/a6/14a6f886d35458029d7f3164938c0cb2/pa/WT97389_9805dc27d9bc64083010a45f4a5129f8.jpg'],
 'photos': [],
 'postal_code': '13000',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Bouches-du-Rhône',
 'province_code': 'FR-13',
 'region': "Provence-Alpes-Côte d'Azur",
 'region_code': 'FR-93',
 'registration_date': '2014-05-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A1 Sportback 1.4 TFSI S line Sportpaket',
 'transmission': 'manual',
 'trim': 'S line Sportpaket',
 'year': 2014}
2026-04-27 08:14:07 [auto1.fr] INFO: Saving data for WT97389: {'created_time': 1777277647.167657, 'last_price_update_time': 1777277647.16767, 'has_photos': False, 'auction_closing_time': 1777391846.0}
2026-04-27 08:14:07 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 657ee650-65b1-5862-8714-4ea97182fd69 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:14:07 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 32ddfd51-ed59-592a-a561-84abb3682440 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:14:07 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item 32ddfd51-ed59-592a-a561-84abb3682440 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:14:07 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item 32ddfd51-ed59-592a-a561-84abb3682440 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:14:08 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 32ddfd51-ed59-592a-a561-84abb3682440 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:14:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 32ddfd51-ed59-592a-a561-84abb3682440 with identifier: BH82136
2026-04-27 08:14:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 32ddfd51-ed59-592a-a561-84abb3682440 with identifier: BH82136
2026-04-27 08:14:09 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:14:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 32ddfd51-ed59-592a-a561-84abb3682440 with identifier: BH82136 to the API
2026-04-27 08:14:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:14:09 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:14:09 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': 108,
 'category': None,
 'city': 'Tarnos',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2026-04-28T15:59:52Z',
 'fuel_type': 'petrol',
 'id': '32ddfd51-ed59-592a-a561-84abb3682440',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 43.5417,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BH82136',
 'listing': 'auction',
 'location': 'FR, Tarnos',
 'location_confidence': 'geocoded',
 'longitude': -1.4628,
 'make': 'Opel',
 'model': 'Crossland X',
 'odometer': 90849,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgbd/5b/bd5bf84b725e052b40b1cbec1b0c0783/pa/BH82136_be3030342a9421c38ff533bab7ee93b9.jpg',
                'https://img-pa.auto1.com/imgbd/5b/bd5bf84b725e052b40b1cbec1b0c0783/pa/BH82136_057ea68ed3eca29c25239860249ff748.jpg',
                'https://img-pa.auto1.com/imgbd/5b/bd5bf84b725e052b40b1cbec1b0c0783/pa/BH82136_40554ac170dafdd8abd408969f39aaa7.jpg',
                'https://img-pa.auto1.com/imgbd/5b/bd5bf84b725e052b40b1cbec1b0c0783/pa/BH82136_653dba89cad55a5cc6647d40d8ba531b.jpg',
                'https://img-pa.auto1.com/imgbd/5b/bd5bf84b725e052b40b1cbec1b0c0783/pa/BH82136_5b0bcc44f3af07830bac66b77f9e7fa5.jpg',
                'https://img-pa.auto1.com/imgbd/5b/bd5bf84b725e052b40b1cbec1b0c0783/pa/BH82136_00f4a79fb2dd98c1008e263f028a8a7c.jpg',
                'https://img-pa.auto1.com/imgbd/5b/bd5bf84b725e052b40b1cbec1b0c0783/pa/BH82136_ddf6772ea98458755ad1c0c8502c7c32.jpg',
                'https://img-pa.auto1.com/imgbd/5b/bd5bf84b725e052b40b1cbec1b0c0783/pa/BH82136_8837ff3545fd047c78fe841f10355c8d.jpg',
                'https://img-pa.auto1.com/imgbd/5b/bd5bf84b725e052b40b1cbec1b0c0783/pa/BH82136_56a095c7ce0b9959283309d1f1d36861.jpg',
                'https://img-pa.auto1.com/imgbd/5b/bd5bf84b725e052b40b1cbec1b0c0783/pa/BH82136_dd51d774b80dd85897b46b210962d163.jpg'],
 'photos': [],
 'postal_code': '40220',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Landes',
 'province_code': 'FR-40',
 'region': 'Nouvelle-Aquitaine',
 'region_code': 'FR-75',
 'registration_date': '2020-06-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Crossland X 1.2 Turbo INNOVATION',
 'transmission': 'automatic',
 'trim': 'INNOVATION',
 'year': 2020}
2026-04-27 08:14:09 [auto1.fr] INFO: Saving data for BH82136: {'created_time': 1777277649.213278, 'last_price_update_time': 1777277649.213288, 'has_photos': False, 'auction_closing_time': 1777391992.0}
2026-04-27 08:14:09 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 32ddfd51-ed59-592a-a561-84abb3682440 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:14:09 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.952(s), this was the 1st time calling it.
2026-04-27 08:14:09 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.6257549381927285 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:14:09 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item fa690fbf-7811-51bc-a490-8953cc3bb357 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:14:09 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item fa690fbf-7811-51bc-a490-8953cc3bb357 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:14:10 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item fa690fbf-7811-51bc-a490-8953cc3bb357 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:14:10 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item fa690fbf-7811-51bc-a490-8953cc3bb357 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:14:12 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item fa690fbf-7811-51bc-a490-8953cc3bb357 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:14:12 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item fa690fbf-7811-51bc-a490-8953cc3bb357 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:14:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/34/493452e99a42a74600489b969c6dc379/pa/VT02723_77fbaa8d5fb1287edd998d46a8882aa6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/34/493452e99a42a74600489b969c6dc379/pa/VT02723_e88e0ff3191d6faebb5270ad117033a0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/34/493452e99a42a74600489b969c6dc379/pa/VT02723_e1f71498fcc1e1a02e4627d0f5fac37d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438dd8650>
2026-04-27 08:14:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:12 [urllib3.connectionpool] DEBUG: Resetting dropped connection: alxdev.blob.core.windows.net
2026-04-27 08:14:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa690fbf-7811-51bc-a490-8953cc3bb357/fa690fbf-7811-51bc-a490-8953cc3bb357_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:14:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/34/493452e99a42a74600489b969c6dc379/pa/VT02723_77fbaa8d5fb1287edd998d46a8882aa6.jpg saved to cache
2026-04-27 08:14:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fa690fbf-7811-51bc-a490-8953cc3bb357
2026-04-27 08:14:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438e02a10>
2026-04-27 08:14:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa690fbf-7811-51bc-a490-8953cc3bb357/fa690fbf-7811-51bc-a490-8953cc3bb357_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:14:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/34/493452e99a42a74600489b969c6dc379/pa/VT02723_e88e0ff3191d6faebb5270ad117033a0.jpg saved to cache
2026-04-27 08:14:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fa690fbf-7811-51bc-a490-8953cc3bb357
2026-04-27 08:14:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380b8e10>
2026-04-27 08:14:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa690fbf-7811-51bc-a490-8953cc3bb357/fa690fbf-7811-51bc-a490-8953cc3bb357_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:14:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/34/493452e99a42a74600489b969c6dc379/pa/VT02723_e1f71498fcc1e1a02e4627d0f5fac37d.jpg saved to cache
2026-04-27 08:14:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fa690fbf-7811-51bc-a490-8953cc3bb357
2026-04-27 08:14:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fa690fbf-7811-51bc-a490-8953cc3bb357, skipping ID generation
2026-04-27 08:14:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa690fbf-7811-51bc-a490-8953cc3bb357 with scrape type 1
2026-04-27 08:14:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fa690fbf-7811-51bc-a490-8953cc3bb357 sending to next pipeline
2026-04-27 08:14:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: fa690fbf-7811-51bc-a490-8953cc3bb357, identifier: VT02723
2026-04-27 08:14:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: fa690fbf-7811-51bc-a490-8953cc3bb357 with identifier: VT02723
2026-04-27 08:14:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: fa690fbf-7811-51bc-a490-8953cc3bb357 with identifier: VT02723
2026-04-27 08:14:12 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:14:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: fa690fbf-7811-51bc-a490-8953cc3bb357 with identifier: VT02723 to the API
2026-04-27 08:14:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:14:12 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:14:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img49/34/493452e99a42a74600489b969c6dc379/pa/VT02723_e1f71498fcc1e1a02e4627d0f5fac37d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 95,
 'category': None,
 'city': 'Villenoy',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-04-28T15:40:57Z',
 'fuel_type': 'diesel',
 'id': 'fa690fbf-7811-51bc-a490-8953cc3bb357',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.9411,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VT02723',
 'listing': 'auction',
 'location': 'FR, Villenoy',
 'location_confidence': 'geocoded',
 'longitude': 2.8602,
 'make': 'Peugeot',
 'model': '308',
 'odometer': 143939,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fa690fbf-7811-51bc-a490-8953cc3bb357/fa690fbf-7811-51bc-a490-8953cc3bb357_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45147,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/34/493452e99a42a74600489b969c6dc379/pa/VT02723_e1f71498fcc1e1a02e4627d0f5fac37d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fa690fbf-7811-51bc-a490-8953cc3bb357/fa690fbf-7811-51bc-a490-8953cc3bb357_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47462,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/34/493452e99a42a74600489b969c6dc379/pa/VT02723_77fbaa8d5fb1287edd998d46a8882aa6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fa690fbf-7811-51bc-a490-8953cc3bb357/fa690fbf-7811-51bc-a490-8953cc3bb357_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43437,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/34/493452e99a42a74600489b969c6dc379/pa/VT02723_e88e0ff3191d6faebb5270ad117033a0.jpg',
             'Width': 800}],
 'postal_code': '77124',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Seine-et-Marne',
 'province_code': 'FR-77',
 'region': 'Île-de-France',
 'region_code': 'FR-11',
 'registration_date': '2018-02-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 308 1.6 Blue-HDi Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2018}
2026-04-27 08:14:12 [auto1.fr] INFO: Saving data for VT02723: {'created_time': 1777277652.956398, 'last_price_update_time': 1777277652.956408, 'has_photos': True, 'auction_closing_time': 1777390857.0}
2026-04-27 08:14:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:14:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YV37253/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:14:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:14:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BK47003> (referer: https://www.auto1.com/v1/car-details-view/BK47003/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:14:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:14:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b469223e-18aa-5e12-8a56-b179d8b97d0d with identifier: BK47003
2026-04-27 08:14:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b469223e-18aa-5e12-8a56-b179d8b97d0d with scrape type 1
2026-04-27 08:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b469223e-18aa-5e12-8a56-b179d8b97d0d
2026-04-27 08:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/8c/d88c910074c7920ddbd9871329872e42/pa/BK47003_5ed9c67c085ee9e67e094dad7b5707cc.jpg not downloaded yet
2026-04-27 08:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/8c/d88c910074c7920ddbd9871329872e42/pa/BK47003_119c5c9ae5c93997189bdbe425b66019.jpg not downloaded yet
2026-04-27 08:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/8c/d88c910074c7920ddbd9871329872e42/pa/BK47003_1c512ccccbb2ff5c29b905ca0616637a.jpg not downloaded yet
2026-04-27 08:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/8c/d88c910074c7920ddbd9871329872e42/pa/BK47003_f3537c899e6d89a966df6dcc8953aff0.jpg not downloaded yet
2026-04-27 08:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/8c/d88c910074c7920ddbd9871329872e42/pa/BK47003_91e5d748714a08b5156a647262e1d3f2.jpg not downloaded yet
2026-04-27 08:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/8c/d88c910074c7920ddbd9871329872e42/pa/BK47003_ee758f5b6cfb3be86b2be72632fd70f6.jpg not downloaded yet
2026-04-27 08:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/8c/d88c910074c7920ddbd9871329872e42/pa/BK47003_27dc5a02972f938da9c896eba5986939.jpg not downloaded yet
2026-04-27 08:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/8c/d88c910074c7920ddbd9871329872e42/pa/BK47003_8b3eb66e636e686922e29050ace5c436.jpg not downloaded yet
2026-04-27 08:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/8c/d88c910074c7920ddbd9871329872e42/pa/BK47003_6aa56b95d47f9d0a7eaec4937d58d873.jpg not downloaded yet
2026-04-27 08:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/8c/d88c910074c7920ddbd9871329872e42/pa/BK47003_f287e883394d6ac930acabaddbcfba58.jpg not downloaded yet
2026-04-27 08:14:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TT31449> (referer: https://www.auto1.com/v1/car-details-view/TT31449/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:14:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:14:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dbb40f49-db17-5f0a-85d4-f07acfd7de25 with identifier: TT31449
2026-04-27 08:14:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dbb40f49-db17-5f0a-85d4-f07acfd7de25 with scrape type 1
2026-04-27 08:14:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dbb40f49-db17-5f0a-85d4-f07acfd7de25
2026-04-27 08:14:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/a1/6ca14f22bfa281d312d3cf607b37fafb/pa/TT31449_bc63d333a9634c01502cfbd778c9988e.jpg not downloaded yet
2026-04-27 08:14:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/8c/d88c910074c7920ddbd9871329872e42/pa/BK47003_f287e883394d6ac930acabaddbcfba58.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/a1/6ca14f22bfa281d312d3cf607b37fafb/pa/TT31449_9a5c11032c5f13dca9810236ac3eeaf7.jpg not downloaded yet
2026-04-27 08:14:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/a1/6ca14f22bfa281d312d3cf607b37fafb/pa/TT31449_7d547337b8d6b2bc19c1499fc9a11336.jpg not downloaded yet
2026-04-27 08:14:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/a1/6ca14f22bfa281d312d3cf607b37fafb/pa/TT31449_3c8a68bb922c9bf41b60a227e4903a24.jpg not downloaded yet
2026-04-27 08:14:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/a1/6ca14f22bfa281d312d3cf607b37fafb/pa/TT31449_1fc365d621dc2518314fdc0fc6320a8a.jpg not downloaded yet
2026-04-27 08:14:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/a1/6ca14f22bfa281d312d3cf607b37fafb/pa/TT31449_0ed46c4ca6326e88c73387990d844f85.jpg not downloaded yet
2026-04-27 08:14:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/a1/6ca14f22bfa281d312d3cf607b37fafb/pa/TT31449_0d534230e86ce7bae141e75e171ae95b.jpg not downloaded yet
2026-04-27 08:14:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/a1/6ca14f22bfa281d312d3cf607b37fafb/pa/TT31449_6b41a3e9b8208553b153271958cfc68c.jpg not downloaded yet
2026-04-27 08:14:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bfb43d0>
2026-04-27 08:14:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b469223e-18aa-5e12-8a56-b179d8b97d0d/b469223e-18aa-5e12-8a56-b179d8b97d0d_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:14:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/8c/d88c910074c7920ddbd9871329872e42/pa/BK47003_f287e883394d6ac930acabaddbcfba58.jpg saved to cache
2026-04-27 08:14:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b469223e-18aa-5e12-8a56-b179d8b97d0d
2026-04-27 08:14:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/a1/6ca14f22bfa281d312d3cf607b37fafb/pa/TT31449_bc63d333a9634c01502cfbd778c9988e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/a1/6ca14f22bfa281d312d3cf607b37fafb/pa/TT31449_713ee98e789199b64baff62a5eb37d30.jpg not downloaded yet
2026-04-27 08:14:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/a1/6ca14f22bfa281d312d3cf607b37fafb/pa/TT31449_9b7626b4b0e5ce15a2e74c46395be70f.jpg not downloaded yet
2026-04-27 08:14:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438bffcd0>
2026-04-27 08:14:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbb40f49-db17-5f0a-85d4-f07acfd7de25/dbb40f49-db17-5f0a-85d4-f07acfd7de25_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:14:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/a1/6ca14f22bfa281d312d3cf607b37fafb/pa/TT31449_bc63d333a9634c01502cfbd778c9988e.jpg saved to cache
2026-04-27 08:14:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dbb40f49-db17-5f0a-85d4-f07acfd7de25
2026-04-27 08:14:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/a1/6ca14f22bfa281d312d3cf607b37fafb/pa/TT31449_6b41a3e9b8208553b153271958cfc68c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ae5610>
2026-04-27 08:14:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbb40f49-db17-5f0a-85d4-f07acfd7de25/dbb40f49-db17-5f0a-85d4-f07acfd7de25_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:14:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/a1/6ca14f22bfa281d312d3cf607b37fafb/pa/TT31449_6b41a3e9b8208553b153271958cfc68c.jpg saved to cache
2026-04-27 08:14:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dbb40f49-db17-5f0a-85d4-f07acfd7de25
2026-04-27 08:14:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/a1/6ca14f22bfa281d312d3cf607b37fafb/pa/TT31449_9b7626b4b0e5ce15a2e74c46395be70f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ceb9d0>
2026-04-27 08:14:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbb40f49-db17-5f0a-85d4-f07acfd7de25/dbb40f49-db17-5f0a-85d4-f07acfd7de25_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:14:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/a1/6ca14f22bfa281d312d3cf607b37fafb/pa/TT31449_9b7626b4b0e5ce15a2e74c46395be70f.jpg saved to cache
2026-04-27 08:14:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item dbb40f49-db17-5f0a-85d4-f07acfd7de25
2026-04-27 08:14:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/a1/6ca14f22bfa281d312d3cf607b37fafb/pa/TT31449_713ee98e789199b64baff62a5eb37d30.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c8c1d0>
2026-04-27 08:14:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbb40f49-db17-5f0a-85d4-f07acfd7de25/dbb40f49-db17-5f0a-85d4-f07acfd7de25_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:14:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/a1/6ca14f22bfa281d312d3cf607b37fafb/pa/TT31449_713ee98e789199b64baff62a5eb37d30.jpg saved to cache
2026-04-27 08:14:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dbb40f49-db17-5f0a-85d4-f07acfd7de25
2026-04-27 08:14:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/a1/6ca14f22bfa281d312d3cf607b37fafb/pa/TT31449_0d534230e86ce7bae141e75e171ae95b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143812f850>
2026-04-27 08:14:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbb40f49-db17-5f0a-85d4-f07acfd7de25/dbb40f49-db17-5f0a-85d4-f07acfd7de25_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:14:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/a1/6ca14f22bfa281d312d3cf607b37fafb/pa/TT31449_0d534230e86ce7bae141e75e171ae95b.jpg saved to cache
2026-04-27 08:14:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dbb40f49-db17-5f0a-85d4-f07acfd7de25
2026-04-27 08:14:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/a1/6ca14f22bfa281d312d3cf607b37fafb/pa/TT31449_0ed46c4ca6326e88c73387990d844f85.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BU48412> (referer: https://www.auto1.com/v1/car-details-view/BU48412/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:14:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:14:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ae55d0>
2026-04-27 08:14:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbb40f49-db17-5f0a-85d4-f07acfd7de25/dbb40f49-db17-5f0a-85d4-f07acfd7de25_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:14:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/a1/6ca14f22bfa281d312d3cf607b37fafb/pa/TT31449_0ed46c4ca6326e88c73387990d844f85.jpg saved to cache
2026-04-27 08:14:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dbb40f49-db17-5f0a-85d4-f07acfd7de25
2026-04-27 08:14:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/a1/6ca14f22bfa281d312d3cf607b37fafb/pa/TT31449_1fc365d621dc2518314fdc0fc6320a8a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1369578-e712-52a7-b4ff-70bca7840aa2 with identifier: BU48412
2026-04-27 08:14:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1369578-e712-52a7-b4ff-70bca7840aa2 with scrape type 1
2026-04-27 08:14:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d1369578-e712-52a7-b4ff-70bca7840aa2
2026-04-27 08:14:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/82/1e82432075c0723c3b1922642b4f21fc/pa/BU48412_5dd420e4aad2fb1a9065377bf97c5396.jpg not downloaded yet
2026-04-27 08:14:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/a1/6ca14f22bfa281d312d3cf607b37fafb/pa/TT31449_7d547337b8d6b2bc19c1499fc9a11336.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/82/1e82432075c0723c3b1922642b4f21fc/pa/BU48412_09a2e68c978b20551d3934f73a32d5b6.jpg not downloaded yet
2026-04-27 08:14:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/82/1e82432075c0723c3b1922642b4f21fc/pa/BU48412_3955d4546593b0b08410195de5d26afa.jpg not downloaded yet
2026-04-27 08:14:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/a1/6ca14f22bfa281d312d3cf607b37fafb/pa/TT31449_3c8a68bb922c9bf41b60a227e4903a24.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/82/1e82432075c0723c3b1922642b4f21fc/pa/BU48412_00f9d58fa15e4db4261b039bbc6f9084.jpg not downloaded yet
2026-04-27 08:14:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438fb20d0>
2026-04-27 08:14:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbb40f49-db17-5f0a-85d4-f07acfd7de25/dbb40f49-db17-5f0a-85d4-f07acfd7de25_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:14:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/a1/6ca14f22bfa281d312d3cf607b37fafb/pa/TT31449_1fc365d621dc2518314fdc0fc6320a8a.jpg saved to cache
2026-04-27 08:14:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dbb40f49-db17-5f0a-85d4-f07acfd7de25
2026-04-27 08:14:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/82/1e82432075c0723c3b1922642b4f21fc/pa/BU48412_b46ff29ca239387ac0537eea7424c501.jpg not downloaded yet
2026-04-27 08:14:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/82/1e82432075c0723c3b1922642b4f21fc/pa/BU48412_5dd420e4aad2fb1a9065377bf97c5396.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/82/1e82432075c0723c3b1922642b4f21fc/pa/BU48412_080a2211ca4dd498a20a17389258c247.jpg not downloaded yet
2026-04-27 08:14:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/82/1e82432075c0723c3b1922642b4f21fc/pa/BU48412_926e3dc2b798fa1ae3efb1776a94097a.jpg not downloaded yet
2026-04-27 08:14:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bfd3610>
2026-04-27 08:14:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbb40f49-db17-5f0a-85d4-f07acfd7de25/dbb40f49-db17-5f0a-85d4-f07acfd7de25_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:14:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/a1/6ca14f22bfa281d312d3cf607b37fafb/pa/TT31449_7d547337b8d6b2bc19c1499fc9a11336.jpg saved to cache
2026-04-27 08:14:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dbb40f49-db17-5f0a-85d4-f07acfd7de25
2026-04-27 08:14:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438189ad0>
2026-04-27 08:14:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbb40f49-db17-5f0a-85d4-f07acfd7de25/dbb40f49-db17-5f0a-85d4-f07acfd7de25_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/a1/6ca14f22bfa281d312d3cf607b37fafb/pa/TT31449_3c8a68bb922c9bf41b60a227e4903a24.jpg saved to cache
2026-04-27 08:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dbb40f49-db17-5f0a-85d4-f07acfd7de25
2026-04-27 08:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/82/1e82432075c0723c3b1922642b4f21fc/pa/BU48412_7f295620f86f2b362a9767ebe759d1c0.jpg not downloaded yet
2026-04-27 08:14:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BD26378/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:14:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:14:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/82/1e82432075c0723c3b1922642b4f21fc/pa/BU48412_3955d4546593b0b08410195de5d26afa.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/82/1e82432075c0723c3b1922642b4f21fc/pa/BU48412_36482a75b53cb96a62e0ee31a1151e40.jpg not downloaded yet
2026-04-27 08:14:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438fb5650>
2026-04-27 08:14:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1369578-e712-52a7-b4ff-70bca7840aa2/d1369578-e712-52a7-b4ff-70bca7840aa2_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/82/1e82432075c0723c3b1922642b4f21fc/pa/BU48412_5dd420e4aad2fb1a9065377bf97c5396.jpg saved to cache
2026-04-27 08:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d1369578-e712-52a7-b4ff-70bca7840aa2
2026-04-27 08:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/82/1e82432075c0723c3b1922642b4f21fc/pa/BU48412_26ec1d84cbdd33fbf27f7553380de2ec.jpg not downloaded yet
2026-04-27 08:14:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/82/1e82432075c0723c3b1922642b4f21fc/pa/BU48412_b46ff29ca239387ac0537eea7424c501.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b29f50>
2026-04-27 08:14:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1369578-e712-52a7-b4ff-70bca7840aa2/d1369578-e712-52a7-b4ff-70bca7840aa2_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/82/1e82432075c0723c3b1922642b4f21fc/pa/BU48412_3955d4546593b0b08410195de5d26afa.jpg saved to cache
2026-04-27 08:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d1369578-e712-52a7-b4ff-70bca7840aa2
2026-04-27 08:14:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/82/1e82432075c0723c3b1922642b4f21fc/pa/BU48412_7f295620f86f2b362a9767ebe759d1c0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/82/1e82432075c0723c3b1922642b4f21fc/pa/BU48412_26ec1d84cbdd33fbf27f7553380de2ec.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438eb5dd0>
2026-04-27 08:14:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1369578-e712-52a7-b4ff-70bca7840aa2/d1369578-e712-52a7-b4ff-70bca7840aa2_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/82/1e82432075c0723c3b1922642b4f21fc/pa/BU48412_b46ff29ca239387ac0537eea7424c501.jpg saved to cache
2026-04-27 08:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d1369578-e712-52a7-b4ff-70bca7840aa2
2026-04-27 08:14:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bf18b50>
2026-04-27 08:14:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1369578-e712-52a7-b4ff-70bca7840aa2/d1369578-e712-52a7-b4ff-70bca7840aa2_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/82/1e82432075c0723c3b1922642b4f21fc/pa/BU48412_7f295620f86f2b362a9767ebe759d1c0.jpg saved to cache
2026-04-27 08:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d1369578-e712-52a7-b4ff-70bca7840aa2
2026-04-27 08:14:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14381dd410>
2026-04-27 08:14:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1369578-e712-52a7-b4ff-70bca7840aa2/d1369578-e712-52a7-b4ff-70bca7840aa2_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/82/1e82432075c0723c3b1922642b4f21fc/pa/BU48412_26ec1d84cbdd33fbf27f7553380de2ec.jpg saved to cache
2026-04-27 08:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d1369578-e712-52a7-b4ff-70bca7840aa2
2026-04-27 08:14:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/82/1e82432075c0723c3b1922642b4f21fc/pa/BU48412_926e3dc2b798fa1ae3efb1776a94097a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/82/1e82432075c0723c3b1922642b4f21fc/pa/BU48412_36482a75b53cb96a62e0ee31a1151e40.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14381dc790>
2026-04-27 08:14:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1369578-e712-52a7-b4ff-70bca7840aa2/d1369578-e712-52a7-b4ff-70bca7840aa2_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/82/1e82432075c0723c3b1922642b4f21fc/pa/BU48412_926e3dc2b798fa1ae3efb1776a94097a.jpg saved to cache
2026-04-27 08:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d1369578-e712-52a7-b4ff-70bca7840aa2
2026-04-27 08:14:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438054a90>
2026-04-27 08:14:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1369578-e712-52a7-b4ff-70bca7840aa2/d1369578-e712-52a7-b4ff-70bca7840aa2_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/82/1e82432075c0723c3b1922642b4f21fc/pa/BU48412_36482a75b53cb96a62e0ee31a1151e40.jpg saved to cache
2026-04-27 08:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d1369578-e712-52a7-b4ff-70bca7840aa2
2026-04-27 08:14:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/82/1e82432075c0723c3b1922642b4f21fc/pa/BU48412_080a2211ca4dd498a20a17389258c247.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/82/1e82432075c0723c3b1922642b4f21fc/pa/BU48412_09a2e68c978b20551d3934f73a32d5b6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f144750f8d0>
2026-04-27 08:14:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1369578-e712-52a7-b4ff-70bca7840aa2/d1369578-e712-52a7-b4ff-70bca7840aa2_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/82/1e82432075c0723c3b1922642b4f21fc/pa/BU48412_080a2211ca4dd498a20a17389258c247.jpg saved to cache
2026-04-27 08:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d1369578-e712-52a7-b4ff-70bca7840aa2
2026-04-27 08:14:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/82/1e82432075c0723c3b1922642b4f21fc/pa/BU48412_00f9d58fa15e4db4261b039bbc6f9084.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bfb4850>
2026-04-27 08:14:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1369578-e712-52a7-b4ff-70bca7840aa2/d1369578-e712-52a7-b4ff-70bca7840aa2_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/82/1e82432075c0723c3b1922642b4f21fc/pa/BU48412_09a2e68c978b20551d3934f73a32d5b6.jpg saved to cache
2026-04-27 08:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d1369578-e712-52a7-b4ff-70bca7840aa2
2026-04-27 08:14:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/a1/6ca14f22bfa281d312d3cf607b37fafb/pa/TT31449_9a5c11032c5f13dca9810236ac3eeaf7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/8c/d88c910074c7920ddbd9871329872e42/pa/BK47003_6aa56b95d47f9d0a7eaec4937d58d873.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c8df90>
2026-04-27 08:14:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1369578-e712-52a7-b4ff-70bca7840aa2/d1369578-e712-52a7-b4ff-70bca7840aa2_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/82/1e82432075c0723c3b1922642b4f21fc/pa/BU48412_00f9d58fa15e4db4261b039bbc6f9084.jpg saved to cache
2026-04-27 08:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d1369578-e712-52a7-b4ff-70bca7840aa2
2026-04-27 08:14:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d1369578-e712-52a7-b4ff-70bca7840aa2, skipping ID generation
2026-04-27 08:14:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1369578-e712-52a7-b4ff-70bca7840aa2 with scrape type 1
2026-04-27 08:14:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d1369578-e712-52a7-b4ff-70bca7840aa2 sending to next pipeline
2026-04-27 08:14:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d1369578-e712-52a7-b4ff-70bca7840aa2, identifier: BU48412
2026-04-27 08:14:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d1369578-e712-52a7-b4ff-70bca7840aa2 with identifier: BU48412
2026-04-27 08:14:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d1369578-e712-52a7-b4ff-70bca7840aa2 with identifier: BU48412
2026-04-27 08:14:27 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:14:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: d1369578-e712-52a7-b4ff-70bca7840aa2 with identifier: BU48412 to the API
2026-04-27 08:14:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:14:27 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:14:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1e/82/1e82432075c0723c3b1922642b4f21fc/pa/BU48412_00f9d58fa15e4db4261b039bbc6f9084.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 94,
 'category': None,
 'city': 'Ambarès-et-Lagrave',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 100,
 'expiration_date': '2026-04-28T15:28:37Z',
 'fuel_type': 'diesel',
 'id': 'd1369578-e712-52a7-b4ff-70bca7840aa2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 44.9274,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BU48412',
 'listing': 'auction',
 'location': 'FR, Ambarès-et-Lagrave',
 'location_confidence': 'geocoded',
 'longitude': -0.4914,
 'make': 'Peugeot',
 'model': '308',
 'odometer': 157223,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d1369578-e712-52a7-b4ff-70bca7840aa2/d1369578-e712-52a7-b4ff-70bca7840aa2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 124763,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/82/1e82432075c0723c3b1922642b4f21fc/pa/BU48412_5dd420e4aad2fb1a9065377bf97c5396.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d1369578-e712-52a7-b4ff-70bca7840aa2/d1369578-e712-52a7-b4ff-70bca7840aa2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 124546,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/82/1e82432075c0723c3b1922642b4f21fc/pa/BU48412_09a2e68c978b20551d3934f73a32d5b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d1369578-e712-52a7-b4ff-70bca7840aa2/d1369578-e712-52a7-b4ff-70bca7840aa2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 123550,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/82/1e82432075c0723c3b1922642b4f21fc/pa/BU48412_3955d4546593b0b08410195de5d26afa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d1369578-e712-52a7-b4ff-70bca7840aa2/d1369578-e712-52a7-b4ff-70bca7840aa2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102987,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/82/1e82432075c0723c3b1922642b4f21fc/pa/BU48412_00f9d58fa15e4db4261b039bbc6f9084.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d1369578-e712-52a7-b4ff-70bca7840aa2/d1369578-e712-52a7-b4ff-70bca7840aa2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107071,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/82/1e82432075c0723c3b1922642b4f21fc/pa/BU48412_b46ff29ca239387ac0537eea7424c501.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d1369578-e712-52a7-b4ff-70bca7840aa2/d1369578-e712-52a7-b4ff-70bca7840aa2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101861,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/82/1e82432075c0723c3b1922642b4f21fc/pa/BU48412_080a2211ca4dd498a20a17389258c247.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d1369578-e712-52a7-b4ff-70bca7840aa2/d1369578-e712-52a7-b4ff-70bca7840aa2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 121132,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/82/1e82432075c0723c3b1922642b4f21fc/pa/BU48412_926e3dc2b798fa1ae3efb1776a94097a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d1369578-e712-52a7-b4ff-70bca7840aa2/d1369578-e712-52a7-b4ff-70bca7840aa2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117623,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/82/1e82432075c0723c3b1922642b4f21fc/pa/BU48412_7f295620f86f2b362a9767ebe759d1c0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d1369578-e712-52a7-b4ff-70bca7840aa2/d1369578-e712-52a7-b4ff-70bca7840aa2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90571,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/82/1e82432075c0723c3b1922642b4f21fc/pa/BU48412_36482a75b53cb96a62e0ee31a1151e40.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d1369578-e712-52a7-b4ff-70bca7840aa2/d1369578-e712-52a7-b4ff-70bca7840aa2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72467,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/82/1e82432075c0723c3b1922642b4f21fc/pa/BU48412_26ec1d84cbdd33fbf27f7553380de2ec.jpg',
             'Width': 800}],
 'postal_code': '33440',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Gironde',
 'province_code': 'FR-33',
 'region': 'Nouvelle-Aquitaine',
 'region_code': 'FR-75',
 'registration_date': '2018-04-08',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Peugeot 308 1.6 Blue-HDi Premium Pack',
 'transmission': 'manual',
 'trim': 'Premium Pack',
 'year': 2018}
2026-04-27 08:14:27 [auto1.fr] INFO: Saving data for BU48412: {'created_time': 1777277667.581501, 'last_price_update_time': 1777277667.58151, 'has_photos': True, 'auction_closing_time': 1777390117.0}
2026-04-27 08:14:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/8c/d88c910074c7920ddbd9871329872e42/pa/BK47003_8b3eb66e636e686922e29050ace5c436.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/8c/d88c910074c7920ddbd9871329872e42/pa/BK47003_27dc5a02972f938da9c896eba5986939.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438074650>
2026-04-27 08:14:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbb40f49-db17-5f0a-85d4-f07acfd7de25/dbb40f49-db17-5f0a-85d4-f07acfd7de25_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/a1/6ca14f22bfa281d312d3cf607b37fafb/pa/TT31449_9a5c11032c5f13dca9810236ac3eeaf7.jpg saved to cache
2026-04-27 08:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dbb40f49-db17-5f0a-85d4-f07acfd7de25
2026-04-27 08:14:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dbb40f49-db17-5f0a-85d4-f07acfd7de25, skipping ID generation
2026-04-27 08:14:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dbb40f49-db17-5f0a-85d4-f07acfd7de25 with scrape type 1
2026-04-27 08:14:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dbb40f49-db17-5f0a-85d4-f07acfd7de25 sending to next pipeline
2026-04-27 08:14:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: dbb40f49-db17-5f0a-85d4-f07acfd7de25, identifier: TT31449
2026-04-27 08:14:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d2f4d0>
2026-04-27 08:14:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b469223e-18aa-5e12-8a56-b179d8b97d0d/b469223e-18aa-5e12-8a56-b179d8b97d0d_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/8c/d88c910074c7920ddbd9871329872e42/pa/BK47003_6aa56b95d47f9d0a7eaec4937d58d873.jpg saved to cache
2026-04-27 08:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b469223e-18aa-5e12-8a56-b179d8b97d0d
2026-04-27 08:14:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: dbb40f49-db17-5f0a-85d4-f07acfd7de25 with identifier: TT31449
2026-04-27 08:14:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: dbb40f49-db17-5f0a-85d4-f07acfd7de25 with identifier: TT31449
2026-04-27 08:14:27 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:14:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: dbb40f49-db17-5f0a-85d4-f07acfd7de25 with identifier: TT31449 to the API
2026-04-27 08:14:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:14:28 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:14:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6c/a1/6ca14f22bfa281d312d3cf607b37fafb/pa/TT31449_9a5c11032c5f13dca9810236ac3eeaf7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'category': None,
 'city': 'Caudan',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2026-04-28T15:39:26Z',
 'fuel_type': 'petrol',
 'id': 'dbb40f49-db17-5f0a-85d4-f07acfd7de25',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 47.8099,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TT31449',
 'listing': 'auction',
 'location': 'FR, Caudan',
 'location_confidence': 'geocoded',
 'longitude': -3.3426,
 'make': 'Citroen',
 'model': 'C4 Cactus',
 'odometer': 145455,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dbb40f49-db17-5f0a-85d4-f07acfd7de25/dbb40f49-db17-5f0a-85d4-f07acfd7de25_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62976,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/a1/6ca14f22bfa281d312d3cf607b37fafb/pa/TT31449_bc63d333a9634c01502cfbd778c9988e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dbb40f49-db17-5f0a-85d4-f07acfd7de25/dbb40f49-db17-5f0a-85d4-f07acfd7de25_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65154,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/a1/6ca14f22bfa281d312d3cf607b37fafb/pa/TT31449_9a5c11032c5f13dca9810236ac3eeaf7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dbb40f49-db17-5f0a-85d4-f07acfd7de25/dbb40f49-db17-5f0a-85d4-f07acfd7de25_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59441,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/a1/6ca14f22bfa281d312d3cf607b37fafb/pa/TT31449_7d547337b8d6b2bc19c1499fc9a11336.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dbb40f49-db17-5f0a-85d4-f07acfd7de25/dbb40f49-db17-5f0a-85d4-f07acfd7de25_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50429,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/a1/6ca14f22bfa281d312d3cf607b37fafb/pa/TT31449_3c8a68bb922c9bf41b60a227e4903a24.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dbb40f49-db17-5f0a-85d4-f07acfd7de25/dbb40f49-db17-5f0a-85d4-f07acfd7de25_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58458,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/a1/6ca14f22bfa281d312d3cf607b37fafb/pa/TT31449_1fc365d621dc2518314fdc0fc6320a8a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dbb40f49-db17-5f0a-85d4-f07acfd7de25/dbb40f49-db17-5f0a-85d4-f07acfd7de25_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58201,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/a1/6ca14f22bfa281d312d3cf607b37fafb/pa/TT31449_0ed46c4ca6326e88c73387990d844f85.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dbb40f49-db17-5f0a-85d4-f07acfd7de25/dbb40f49-db17-5f0a-85d4-f07acfd7de25_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54781,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/a1/6ca14f22bfa281d312d3cf607b37fafb/pa/TT31449_0d534230e86ce7bae141e75e171ae95b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dbb40f49-db17-5f0a-85d4-f07acfd7de25/dbb40f49-db17-5f0a-85d4-f07acfd7de25_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66563,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/a1/6ca14f22bfa281d312d3cf607b37fafb/pa/TT31449_6b41a3e9b8208553b153271958cfc68c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dbb40f49-db17-5f0a-85d4-f07acfd7de25/dbb40f49-db17-5f0a-85d4-f07acfd7de25_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61516,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/a1/6ca14f22bfa281d312d3cf607b37fafb/pa/TT31449_713ee98e789199b64baff62a5eb37d30.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dbb40f49-db17-5f0a-85d4-f07acfd7de25/dbb40f49-db17-5f0a-85d4-f07acfd7de25_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63671,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/a1/6ca14f22bfa281d312d3cf607b37fafb/pa/TT31449_9b7626b4b0e5ce15a2e74c46395be70f.jpg',
             'Width': 800}],
 'postal_code': '56850',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Morbihan',
 'province_code': 'FR-56',
 'region': 'Bretagne',
 'region_code': 'FR-53',
 'registration_date': '2019-09-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C4 Cactus 1.2 e-THP Feel',
 'transmission': 'manual',
 'trim': 'Feel',
 'year': 2019}
2026-04-27 08:14:28 [auto1.fr] INFO: Saving data for TT31449: {'created_time': 1777277668.160957, 'last_price_update_time': 1777277668.160965, 'has_photos': True, 'auction_closing_time': 1777390766.0}
2026-04-27 08:14:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/8c/d88c910074c7920ddbd9871329872e42/pa/BK47003_ee758f5b6cfb3be86b2be72632fd70f6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d27d90>
2026-04-27 08:14:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b469223e-18aa-5e12-8a56-b179d8b97d0d/b469223e-18aa-5e12-8a56-b179d8b97d0d_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:14:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/8c/d88c910074c7920ddbd9871329872e42/pa/BK47003_8b3eb66e636e686922e29050ace5c436.jpg saved to cache
2026-04-27 08:14:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b469223e-18aa-5e12-8a56-b179d8b97d0d
2026-04-27 08:14:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438dd8810>
2026-04-27 08:14:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b469223e-18aa-5e12-8a56-b179d8b97d0d/b469223e-18aa-5e12-8a56-b179d8b97d0d_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:14:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/8c/d88c910074c7920ddbd9871329872e42/pa/BK47003_27dc5a02972f938da9c896eba5986939.jpg saved to cache
2026-04-27 08:14:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b469223e-18aa-5e12-8a56-b179d8b97d0d
2026-04-27 08:14:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/8c/d88c910074c7920ddbd9871329872e42/pa/BK47003_91e5d748714a08b5156a647262e1d3f2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438085810>
2026-04-27 08:14:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b469223e-18aa-5e12-8a56-b179d8b97d0d/b469223e-18aa-5e12-8a56-b179d8b97d0d_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:14:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/8c/d88c910074c7920ddbd9871329872e42/pa/BK47003_ee758f5b6cfb3be86b2be72632fd70f6.jpg saved to cache
2026-04-27 08:14:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b469223e-18aa-5e12-8a56-b179d8b97d0d
2026-04-27 08:14:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/8c/d88c910074c7920ddbd9871329872e42/pa/BK47003_f3537c899e6d89a966df6dcc8953aff0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d348d0>
2026-04-27 08:14:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b469223e-18aa-5e12-8a56-b179d8b97d0d/b469223e-18aa-5e12-8a56-b179d8b97d0d_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:14:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/8c/d88c910074c7920ddbd9871329872e42/pa/BK47003_91e5d748714a08b5156a647262e1d3f2.jpg saved to cache
2026-04-27 08:14:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b469223e-18aa-5e12-8a56-b179d8b97d0d
2026-04-27 08:14:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438085c50>
2026-04-27 08:14:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b469223e-18aa-5e12-8a56-b179d8b97d0d/b469223e-18aa-5e12-8a56-b179d8b97d0d_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:14:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/8c/d88c910074c7920ddbd9871329872e42/pa/BK47003_f3537c899e6d89a966df6dcc8953aff0.jpg saved to cache
2026-04-27 08:14:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b469223e-18aa-5e12-8a56-b179d8b97d0d
2026-04-27 08:14:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/8c/d88c910074c7920ddbd9871329872e42/pa/BK47003_1c512ccccbb2ff5c29b905ca0616637a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/8c/d88c910074c7920ddbd9871329872e42/pa/BK47003_119c5c9ae5c93997189bdbe425b66019.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/8c/d88c910074c7920ddbd9871329872e42/pa/BK47003_5ed9c67c085ee9e67e094dad7b5707cc.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438a61150>
2026-04-27 08:14:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b469223e-18aa-5e12-8a56-b179d8b97d0d/b469223e-18aa-5e12-8a56-b179d8b97d0d_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:14:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/8c/d88c910074c7920ddbd9871329872e42/pa/BK47003_1c512ccccbb2ff5c29b905ca0616637a.jpg saved to cache
2026-04-27 08:14:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b469223e-18aa-5e12-8a56-b179d8b97d0d
2026-04-27 08:14:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438cce2d0>
2026-04-27 08:14:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b469223e-18aa-5e12-8a56-b179d8b97d0d/b469223e-18aa-5e12-8a56-b179d8b97d0d_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:14:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/8c/d88c910074c7920ddbd9871329872e42/pa/BK47003_119c5c9ae5c93997189bdbe425b66019.jpg saved to cache
2026-04-27 08:14:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b469223e-18aa-5e12-8a56-b179d8b97d0d
2026-04-27 08:14:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438f938d0>
2026-04-27 08:14:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b469223e-18aa-5e12-8a56-b179d8b97d0d/b469223e-18aa-5e12-8a56-b179d8b97d0d_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:14:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/8c/d88c910074c7920ddbd9871329872e42/pa/BK47003_5ed9c67c085ee9e67e094dad7b5707cc.jpg saved to cache
2026-04-27 08:14:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b469223e-18aa-5e12-8a56-b179d8b97d0d
2026-04-27 08:14:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b469223e-18aa-5e12-8a56-b179d8b97d0d, skipping ID generation
2026-04-27 08:14:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b469223e-18aa-5e12-8a56-b179d8b97d0d with scrape type 1
2026-04-27 08:14:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b469223e-18aa-5e12-8a56-b179d8b97d0d sending to next pipeline
2026-04-27 08:14:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b469223e-18aa-5e12-8a56-b179d8b97d0d, identifier: BK47003
2026-04-27 08:14:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b469223e-18aa-5e12-8a56-b179d8b97d0d with identifier: BK47003
2026-04-27 08:14:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b469223e-18aa-5e12-8a56-b179d8b97d0d with identifier: BK47003
2026-04-27 08:14:28 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:14:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b469223e-18aa-5e12-8a56-b179d8b97d0d with identifier: BK47003 to the API
2026-04-27 08:14:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:14:28 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:14:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd8/8c/d88c910074c7920ddbd9871329872e42/pa/BK47003_5ed9c67c085ee9e67e094dad7b5707cc.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'city': 'Marckolsheim',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.9L',
 'engine_horse_power': 194,
 'expiration_date': '2026-04-28T15:22:05Z',
 'fuel_type': 'diesel',
 'id': 'b469223e-18aa-5e12-8a56-b179d8b97d0d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.1647,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BK47003',
 'listing': 'auction',
 'location': 'FR, Marckolsheim',
 'location_confidence': 'geocoded',
 'longitude': 7.544,
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 187033,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b469223e-18aa-5e12-8a56-b179d8b97d0d/b469223e-18aa-5e12-8a56-b179d8b97d0d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109946,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/8c/d88c910074c7920ddbd9871329872e42/pa/BK47003_5ed9c67c085ee9e67e094dad7b5707cc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b469223e-18aa-5e12-8a56-b179d8b97d0d/b469223e-18aa-5e12-8a56-b179d8b97d0d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114180,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/8c/d88c910074c7920ddbd9871329872e42/pa/BK47003_119c5c9ae5c93997189bdbe425b66019.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b469223e-18aa-5e12-8a56-b179d8b97d0d/b469223e-18aa-5e12-8a56-b179d8b97d0d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112883,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/8c/d88c910074c7920ddbd9871329872e42/pa/BK47003_1c512ccccbb2ff5c29b905ca0616637a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b469223e-18aa-5e12-8a56-b179d8b97d0d/b469223e-18aa-5e12-8a56-b179d8b97d0d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84382,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/8c/d88c910074c7920ddbd9871329872e42/pa/BK47003_f3537c899e6d89a966df6dcc8953aff0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b469223e-18aa-5e12-8a56-b179d8b97d0d/b469223e-18aa-5e12-8a56-b179d8b97d0d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95596,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/8c/d88c910074c7920ddbd9871329872e42/pa/BK47003_91e5d748714a08b5156a647262e1d3f2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b469223e-18aa-5e12-8a56-b179d8b97d0d/b469223e-18aa-5e12-8a56-b179d8b97d0d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105804,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/8c/d88c910074c7920ddbd9871329872e42/pa/BK47003_ee758f5b6cfb3be86b2be72632fd70f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b469223e-18aa-5e12-8a56-b179d8b97d0d/b469223e-18aa-5e12-8a56-b179d8b97d0d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71943,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/8c/d88c910074c7920ddbd9871329872e42/pa/BK47003_27dc5a02972f938da9c896eba5986939.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b469223e-18aa-5e12-8a56-b179d8b97d0d/b469223e-18aa-5e12-8a56-b179d8b97d0d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100042,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/8c/d88c910074c7920ddbd9871329872e42/pa/BK47003_8b3eb66e636e686922e29050ace5c436.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b469223e-18aa-5e12-8a56-b179d8b97d0d/b469223e-18aa-5e12-8a56-b179d8b97d0d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99959,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/8c/d88c910074c7920ddbd9871329872e42/pa/BK47003_6aa56b95d47f9d0a7eaec4937d58d873.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b469223e-18aa-5e12-8a56-b179d8b97d0d/b469223e-18aa-5e12-8a56-b179d8b97d0d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45573,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/8c/d88c910074c7920ddbd9871329872e42/pa/BK47003_f287e883394d6ac930acabaddbcfba58.jpg',
             'Width': 600}],
 'postal_code': '67390',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Bas-Rhin',
 'province_code': 'FR-67',
 'region': 'Grand Est',
 'region_code': 'FR-44',
 'registration_date': '2019-09-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 220 d 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2019}
2026-04-27 08:14:29 [auto1.fr] INFO: Saving data for BK47003: {'created_time': 1777277669.097518, 'last_price_update_time': 1777277669.09753, 'has_photos': True, 'auction_closing_time': 1777389725.0}
2026-04-27 08:14:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NU54953> (referer: https://www.auto1.com/v1/car-details-view/NU54953/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:14:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:14:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5df25f34-929f-5287-a422-1b04183d064d with identifier: NU54953
2026-04-27 08:14:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5df25f34-929f-5287-a422-1b04183d064d with scrape type 1
2026-04-27 08:14:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 5df25f34-929f-5287-a422-1b04183d064d
2026-04-27 08:14:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/48/5648f20f4efc8b3485a0e990ecad5a84/pa/NU54953_73f39231127b24e45451e7b3de996937.jpg not downloaded yet
2026-04-27 08:14:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/48/5648f20f4efc8b3485a0e990ecad5a84/pa/NU54953_c6d4bd89ead05729bae6d055bd4e3a88.jpg not downloaded yet
2026-04-27 08:14:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/48/5648f20f4efc8b3485a0e990ecad5a84/pa/NU54953_b278c865f4315e095123cd7ace8d5f40.jpg not downloaded yet
2026-04-27 08:14:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/48/5648f20f4efc8b3485a0e990ecad5a84/pa/NU54953_b17ca49afa889b4518932b9526d63577.jpg not downloaded yet
2026-04-27 08:14:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/48/5648f20f4efc8b3485a0e990ecad5a84/pa/NU54953_f4f828b1d8f4a04fb60e7a04ce9b3dc7.jpg not downloaded yet
2026-04-27 08:14:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/48/5648f20f4efc8b3485a0e990ecad5a84/pa/NU54953_9629435b646e913a5f7f8f5c57a80898.jpg not downloaded yet
2026-04-27 08:14:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HX54936> (referer: https://www.auto1.com/v1/car-details-view/HX54936/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:14:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:14:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NV73662> (referer: https://www.auto1.com/v1/car-details-view/NV73662/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:14:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:14:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/48/5648f20f4efc8b3485a0e990ecad5a84/pa/NU54953_9629435b646e913a5f7f8f5c57a80898.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ab2ac7a-cac8-53b1-be4f-bc5867753471 with identifier: HX54936
2026-04-27 08:14:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ab2ac7a-cac8-53b1-be4f-bc5867753471 with scrape type 1
2026-04-27 08:14:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8ab2ac7a-cac8-53b1-be4f-bc5867753471
2026-04-27 08:14:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/0c/550c3b5acad9cb1ca199bcf846fa805a/pa/HX54936_ebc4476051d09dbf9a6f8a9fd7394536.jpg not downloaded yet
2026-04-27 08:14:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/0c/550c3b5acad9cb1ca199bcf846fa805a/pa/HX54936_c84a3d0d184b4b47a6d1d349b1176eb7.jpg not downloaded yet
2026-04-27 08:14:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/0c/550c3b5acad9cb1ca199bcf846fa805a/pa/HX54936_4f6cbf4bd59ff9f7ae87803ddfde0468.jpg not downloaded yet
2026-04-27 08:14:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/48/5648f20f4efc8b3485a0e990ecad5a84/pa/NU54953_b17ca49afa889b4518932b9526d63577.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/0c/550c3b5acad9cb1ca199bcf846fa805a/pa/HX54936_1358df3d88e9b97a8401ba1ebbef0ca6.jpg not downloaded yet
2026-04-27 08:14:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1bb80e7f-541b-5bb4-92db-7b69a027c13b with identifier: NV73662
2026-04-27 08:14:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1bb80e7f-541b-5bb4-92db-7b69a027c13b with scrape type 1
2026-04-27 08:14:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 1bb80e7f-541b-5bb4-92db-7b69a027c13b
2026-04-27 08:14:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/0a/fc0a9e24d5d12aff93fdd274094152c0/pa/NV73662_75041efe62e43f8abbd133bc34161b8e.jpg not downloaded yet
2026-04-27 08:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/0c/550c3b5acad9cb1ca199bcf846fa805a/pa/HX54936_edd6414b7bda4dde96be108aadd8138b.jpg not downloaded yet
2026-04-27 08:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/0a/fc0a9e24d5d12aff93fdd274094152c0/pa/NV73662_e2fd2f303bf1b23e757c13e094056780.jpg not downloaded yet
2026-04-27 08:14:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/48/5648f20f4efc8b3485a0e990ecad5a84/pa/NU54953_f4f828b1d8f4a04fb60e7a04ce9b3dc7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/0c/550c3b5acad9cb1ca199bcf846fa805a/pa/HX54936_7859f327fc7b9ad57eb59037d6e6b1c0.jpg not downloaded yet
2026-04-27 08:14:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143801d810>
2026-04-27 08:14:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5df25f34-929f-5287-a422-1b04183d064d/5df25f34-929f-5287-a422-1b04183d064d_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/48/5648f20f4efc8b3485a0e990ecad5a84/pa/NU54953_9629435b646e913a5f7f8f5c57a80898.jpg saved to cache
2026-04-27 08:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5df25f34-929f-5287-a422-1b04183d064d
2026-04-27 08:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/0a/fc0a9e24d5d12aff93fdd274094152c0/pa/NV73662_d6e3c58333da9600496250e8032c4b7c.jpg not downloaded yet
2026-04-27 08:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/0c/550c3b5acad9cb1ca199bcf846fa805a/pa/HX54936_3d61400ccc1245540ae0ae063d45cb74.jpg not downloaded yet
2026-04-27 08:14:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/0c/550c3b5acad9cb1ca199bcf846fa805a/pa/HX54936_4f6cbf4bd59ff9f7ae87803ddfde0468.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/0a/fc0a9e24d5d12aff93fdd274094152c0/pa/NV73662_f4d0c4200c79679ce531852f3fab4f2f.jpg not downloaded yet
2026-04-27 08:14:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438bf3fd0>
2026-04-27 08:14:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5df25f34-929f-5287-a422-1b04183d064d/5df25f34-929f-5287-a422-1b04183d064d_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/48/5648f20f4efc8b3485a0e990ecad5a84/pa/NU54953_b17ca49afa889b4518932b9526d63577.jpg saved to cache
2026-04-27 08:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5df25f34-929f-5287-a422-1b04183d064d
2026-04-27 08:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/0c/550c3b5acad9cb1ca199bcf846fa805a/pa/HX54936_c300bc664d49d616c3453cf2e71d67fb.jpg not downloaded yet
2026-04-27 08:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/0a/fc0a9e24d5d12aff93fdd274094152c0/pa/NV73662_dd158a887950758a107367cb2b6f908d.jpg not downloaded yet
2026-04-27 08:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/0c/550c3b5acad9cb1ca199bcf846fa805a/pa/HX54936_022d2099ecbc769ba34f97243c25ab7b.jpg not downloaded yet
2026-04-27 08:14:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143801f450>
2026-04-27 08:14:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5df25f34-929f-5287-a422-1b04183d064d/5df25f34-929f-5287-a422-1b04183d064d_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/48/5648f20f4efc8b3485a0e990ecad5a84/pa/NU54953_f4f828b1d8f4a04fb60e7a04ce9b3dc7.jpg saved to cache
2026-04-27 08:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5df25f34-929f-5287-a422-1b04183d064d
2026-04-27 08:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/0a/fc0a9e24d5d12aff93fdd274094152c0/pa/NV73662_662b809e7a189bd7dfb246ebe7d30e73.jpg not downloaded yet
2026-04-27 08:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/0c/550c3b5acad9cb1ca199bcf846fa805a/pa/HX54936_1146fd4911119d8e38022e9f2c7f4aea.jpg not downloaded yet
2026-04-27 08:14:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142be05ed0>
2026-04-27 08:14:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ab2ac7a-cac8-53b1-be4f-bc5867753471/8ab2ac7a-cac8-53b1-be4f-bc5867753471_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/0c/550c3b5acad9cb1ca199bcf846fa805a/pa/HX54936_4f6cbf4bd59ff9f7ae87803ddfde0468.jpg saved to cache
2026-04-27 08:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8ab2ac7a-cac8-53b1-be4f-bc5867753471
2026-04-27 08:14:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/0a/fc0a9e24d5d12aff93fdd274094152c0/pa/NV73662_d6e3c58333da9600496250e8032c4b7c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/0c/550c3b5acad9cb1ca199bcf846fa805a/pa/HX54936_edd6414b7bda4dde96be108aadd8138b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143817ee90>
2026-04-27 08:14:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1bb80e7f-541b-5bb4-92db-7b69a027c13b/1bb80e7f-541b-5bb4-92db-7b69a027c13b_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/0a/fc0a9e24d5d12aff93fdd274094152c0/pa/NV73662_d6e3c58333da9600496250e8032c4b7c.jpg saved to cache
2026-04-27 08:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1bb80e7f-541b-5bb4-92db-7b69a027c13b
2026-04-27 08:14:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14381deed0>
2026-04-27 08:14:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ab2ac7a-cac8-53b1-be4f-bc5867753471/8ab2ac7a-cac8-53b1-be4f-bc5867753471_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/0c/550c3b5acad9cb1ca199bcf846fa805a/pa/HX54936_edd6414b7bda4dde96be108aadd8138b.jpg saved to cache
2026-04-27 08:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8ab2ac7a-cac8-53b1-be4f-bc5867753471
2026-04-27 08:14:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/0c/550c3b5acad9cb1ca199bcf846fa805a/pa/HX54936_1146fd4911119d8e38022e9f2c7f4aea.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/0a/fc0a9e24d5d12aff93fdd274094152c0/pa/NV73662_662b809e7a189bd7dfb246ebe7d30e73.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380e2b90>
2026-04-27 08:14:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ab2ac7a-cac8-53b1-be4f-bc5867753471/8ab2ac7a-cac8-53b1-be4f-bc5867753471_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/0c/550c3b5acad9cb1ca199bcf846fa805a/pa/HX54936_1146fd4911119d8e38022e9f2c7f4aea.jpg saved to cache
2026-04-27 08:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8ab2ac7a-cac8-53b1-be4f-bc5867753471
2026-04-27 08:14:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438e7ff50>
2026-04-27 08:14:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1bb80e7f-541b-5bb4-92db-7b69a027c13b/1bb80e7f-541b-5bb4-92db-7b69a027c13b_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/0a/fc0a9e24d5d12aff93fdd274094152c0/pa/NV73662_662b809e7a189bd7dfb246ebe7d30e73.jpg saved to cache
2026-04-27 08:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1bb80e7f-541b-5bb4-92db-7b69a027c13b
2026-04-27 08:14:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/0c/550c3b5acad9cb1ca199bcf846fa805a/pa/HX54936_022d2099ecbc769ba34f97243c25ab7b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/0a/fc0a9e24d5d12aff93fdd274094152c0/pa/NV73662_dd158a887950758a107367cb2b6f908d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142be0e1d0>
2026-04-27 08:14:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ab2ac7a-cac8-53b1-be4f-bc5867753471/8ab2ac7a-cac8-53b1-be4f-bc5867753471_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/0c/550c3b5acad9cb1ca199bcf846fa805a/pa/HX54936_022d2099ecbc769ba34f97243c25ab7b.jpg saved to cache
2026-04-27 08:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8ab2ac7a-cac8-53b1-be4f-bc5867753471
2026-04-27 08:14:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438edba10>
2026-04-27 08:14:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1bb80e7f-541b-5bb4-92db-7b69a027c13b/1bb80e7f-541b-5bb4-92db-7b69a027c13b_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/0a/fc0a9e24d5d12aff93fdd274094152c0/pa/NV73662_dd158a887950758a107367cb2b6f908d.jpg saved to cache
2026-04-27 08:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1bb80e7f-541b-5bb4-92db-7b69a027c13b
2026-04-27 08:14:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/0a/fc0a9e24d5d12aff93fdd274094152c0/pa/NV73662_f4d0c4200c79679ce531852f3fab4f2f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/0c/550c3b5acad9cb1ca199bcf846fa805a/pa/HX54936_c300bc664d49d616c3453cf2e71d67fb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/0c/550c3b5acad9cb1ca199bcf846fa805a/pa/HX54936_7859f327fc7b9ad57eb59037d6e6b1c0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/0c/550c3b5acad9cb1ca199bcf846fa805a/pa/HX54936_3d61400ccc1245540ae0ae063d45cb74.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/0a/fc0a9e24d5d12aff93fdd274094152c0/pa/NV73662_75041efe62e43f8abbd133bc34161b8e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438015050>
2026-04-27 08:14:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1bb80e7f-541b-5bb4-92db-7b69a027c13b/1bb80e7f-541b-5bb4-92db-7b69a027c13b_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:14:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/0a/fc0a9e24d5d12aff93fdd274094152c0/pa/NV73662_f4d0c4200c79679ce531852f3fab4f2f.jpg saved to cache
2026-04-27 08:14:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1bb80e7f-541b-5bb4-92db-7b69a027c13b
2026-04-27 08:14:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438fbff10>
2026-04-27 08:14:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ab2ac7a-cac8-53b1-be4f-bc5867753471/8ab2ac7a-cac8-53b1-be4f-bc5867753471_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:14:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/0c/550c3b5acad9cb1ca199bcf846fa805a/pa/HX54936_c300bc664d49d616c3453cf2e71d67fb.jpg saved to cache
2026-04-27 08:14:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8ab2ac7a-cac8-53b1-be4f-bc5867753471
2026-04-27 08:14:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/0a/fc0a9e24d5d12aff93fdd274094152c0/pa/NV73662_e2fd2f303bf1b23e757c13e094056780.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c8c250>
2026-04-27 08:14:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ab2ac7a-cac8-53b1-be4f-bc5867753471/8ab2ac7a-cac8-53b1-be4f-bc5867753471_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:14:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/0c/550c3b5acad9cb1ca199bcf846fa805a/pa/HX54936_7859f327fc7b9ad57eb59037d6e6b1c0.jpg saved to cache
2026-04-27 08:14:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8ab2ac7a-cac8-53b1-be4f-bc5867753471
2026-04-27 08:14:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438182190>
2026-04-27 08:14:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ab2ac7a-cac8-53b1-be4f-bc5867753471/8ab2ac7a-cac8-53b1-be4f-bc5867753471_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:14:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/0c/550c3b5acad9cb1ca199bcf846fa805a/pa/HX54936_3d61400ccc1245540ae0ae063d45cb74.jpg saved to cache
2026-04-27 08:14:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8ab2ac7a-cac8-53b1-be4f-bc5867753471
2026-04-27 08:14:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/0c/550c3b5acad9cb1ca199bcf846fa805a/pa/HX54936_c84a3d0d184b4b47a6d1d349b1176eb7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c2e210>
2026-04-27 08:14:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1bb80e7f-541b-5bb4-92db-7b69a027c13b/1bb80e7f-541b-5bb4-92db-7b69a027c13b_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:14:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/0a/fc0a9e24d5d12aff93fdd274094152c0/pa/NV73662_75041efe62e43f8abbd133bc34161b8e.jpg saved to cache
2026-04-27 08:14:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1bb80e7f-541b-5bb4-92db-7b69a027c13b
2026-04-27 08:14:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/0c/550c3b5acad9cb1ca199bcf846fa805a/pa/HX54936_1358df3d88e9b97a8401ba1ebbef0ca6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d7d090>
2026-04-27 08:14:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1bb80e7f-541b-5bb4-92db-7b69a027c13b/1bb80e7f-541b-5bb4-92db-7b69a027c13b_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:14:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/0a/fc0a9e24d5d12aff93fdd274094152c0/pa/NV73662_e2fd2f303bf1b23e757c13e094056780.jpg saved to cache
2026-04-27 08:14:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1bb80e7f-541b-5bb4-92db-7b69a027c13b
2026-04-27 08:14:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1bb80e7f-541b-5bb4-92db-7b69a027c13b, skipping ID generation
2026-04-27 08:14:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1bb80e7f-541b-5bb4-92db-7b69a027c13b with scrape type 1
2026-04-27 08:14:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1bb80e7f-541b-5bb4-92db-7b69a027c13b sending to next pipeline
2026-04-27 08:14:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 1bb80e7f-541b-5bb4-92db-7b69a027c13b, identifier: NV73662
2026-04-27 08:14:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 1bb80e7f-541b-5bb4-92db-7b69a027c13b with identifier: NV73662
2026-04-27 08:14:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 1bb80e7f-541b-5bb4-92db-7b69a027c13b with identifier: NV73662
2026-04-27 08:14:34 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:14:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 1bb80e7f-541b-5bb4-92db-7b69a027c13b with identifier: NV73662 to the API
2026-04-27 08:14:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:14:34 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:14:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgfc/0a/fc0a9e24d5d12aff93fdd274094152c0/pa/NV73662_e2fd2f303bf1b23e757c13e094056780.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'city': 'Quincieux',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-04-28T15:44:12Z',
 'fuel_type': 'petrol',
 'id': '1bb80e7f-541b-5bb4-92db-7b69a027c13b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 45.9137,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV73662',
 'listing': 'auction',
 'location': 'FR, Quincieux',
 'location_confidence': 'geocoded',
 'longitude': 4.777,
 'make': 'Lancia',
 'model': 'Ypsilon',
 'odometer': 141204,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1bb80e7f-541b-5bb4-92db-7b69a027c13b/1bb80e7f-541b-5bb4-92db-7b69a027c13b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84827,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/0a/fc0a9e24d5d12aff93fdd274094152c0/pa/NV73662_75041efe62e43f8abbd133bc34161b8e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1bb80e7f-541b-5bb4-92db-7b69a027c13b/1bb80e7f-541b-5bb4-92db-7b69a027c13b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85365,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/0a/fc0a9e24d5d12aff93fdd274094152c0/pa/NV73662_e2fd2f303bf1b23e757c13e094056780.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1bb80e7f-541b-5bb4-92db-7b69a027c13b/1bb80e7f-541b-5bb4-92db-7b69a027c13b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57889,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/0a/fc0a9e24d5d12aff93fdd274094152c0/pa/NV73662_d6e3c58333da9600496250e8032c4b7c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1bb80e7f-541b-5bb4-92db-7b69a027c13b/1bb80e7f-541b-5bb4-92db-7b69a027c13b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70855,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/0a/fc0a9e24d5d12aff93fdd274094152c0/pa/NV73662_f4d0c4200c79679ce531852f3fab4f2f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1bb80e7f-541b-5bb4-92db-7b69a027c13b/1bb80e7f-541b-5bb4-92db-7b69a027c13b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110137,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/0a/fc0a9e24d5d12aff93fdd274094152c0/pa/NV73662_dd158a887950758a107367cb2b6f908d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1bb80e7f-541b-5bb4-92db-7b69a027c13b/1bb80e7f-541b-5bb4-92db-7b69a027c13b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38950,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/0a/fc0a9e24d5d12aff93fdd274094152c0/pa/NV73662_662b809e7a189bd7dfb246ebe7d30e73.jpg',
             'Width': 800}],
 'postal_code': '69650',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Rhône',
 'province_code': 'FR-69',
 'region': 'Auvergne-Rhône-Alpes',
 'region_code': 'FR-84',
 'registration_date': '2012-06-24',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Lancia Ypsilon 1.2 Black & Red',
 'transmission': 'manual',
 'trim': 'Black & Red',
 'year': 2012}
2026-04-27 08:14:34 [auto1.fr] INFO: Saving data for NV73662: {'created_time': 1777277674.881433, 'last_price_update_time': 1777277674.881443, 'has_photos': True, 'auction_closing_time': 1777391052.0}
2026-04-27 08:14:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/0c/550c3b5acad9cb1ca199bcf846fa805a/pa/HX54936_ebc4476051d09dbf9a6f8a9fd7394536.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/48/5648f20f4efc8b3485a0e990ecad5a84/pa/NU54953_b278c865f4315e095123cd7ace8d5f40.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b1b2d0>
2026-04-27 08:14:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ab2ac7a-cac8-53b1-be4f-bc5867753471/8ab2ac7a-cac8-53b1-be4f-bc5867753471_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:14:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/0c/550c3b5acad9cb1ca199bcf846fa805a/pa/HX54936_c84a3d0d184b4b47a6d1d349b1176eb7.jpg saved to cache
2026-04-27 08:14:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8ab2ac7a-cac8-53b1-be4f-bc5867753471
2026-04-27 08:14:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d60a90>
2026-04-27 08:14:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ab2ac7a-cac8-53b1-be4f-bc5867753471/8ab2ac7a-cac8-53b1-be4f-bc5867753471_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:14:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/0c/550c3b5acad9cb1ca199bcf846fa805a/pa/HX54936_1358df3d88e9b97a8401ba1ebbef0ca6.jpg saved to cache
2026-04-27 08:14:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8ab2ac7a-cac8-53b1-be4f-bc5867753471
2026-04-27 08:14:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438e02890>
2026-04-27 08:14:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ab2ac7a-cac8-53b1-be4f-bc5867753471/8ab2ac7a-cac8-53b1-be4f-bc5867753471_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/0c/550c3b5acad9cb1ca199bcf846fa805a/pa/HX54936_ebc4476051d09dbf9a6f8a9fd7394536.jpg saved to cache
2026-04-27 08:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8ab2ac7a-cac8-53b1-be4f-bc5867753471
2026-04-27 08:14:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8ab2ac7a-cac8-53b1-be4f-bc5867753471, skipping ID generation
2026-04-27 08:14:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ab2ac7a-cac8-53b1-be4f-bc5867753471 with scrape type 1
2026-04-27 08:14:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8ab2ac7a-cac8-53b1-be4f-bc5867753471 sending to next pipeline
2026-04-27 08:14:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8ab2ac7a-cac8-53b1-be4f-bc5867753471, identifier: HX54936
2026-04-27 08:14:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8ab2ac7a-cac8-53b1-be4f-bc5867753471 with identifier: HX54936
2026-04-27 08:14:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8ab2ac7a-cac8-53b1-be4f-bc5867753471 with identifier: HX54936
2026-04-27 08:14:35 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:14:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 8ab2ac7a-cac8-53b1-be4f-bc5867753471 with identifier: HX54936 to the API
2026-04-27 08:14:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:14:35 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:14:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img55/0c/550c3b5acad9cb1ca199bcf846fa805a/pa/HX54936_ebc4476051d09dbf9a6f8a9fd7394536.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 170,
 'category': None,
 'city': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2026-04-28T15:51:33Z',
 'fuel_type': 'diesel',
 'id': '8ab2ac7a-cac8-53b1-be4f-bc5867753471',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HX54936',
 'listing': 'auction',
 'location': 'FR',
 'location_confidence': None,
 'longitude': None,
 'make': 'Opel',
 'model': 'Vivaro',
 'odometer': 203406,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8ab2ac7a-cac8-53b1-be4f-bc5867753471/8ab2ac7a-cac8-53b1-be4f-bc5867753471_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78333,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/0c/550c3b5acad9cb1ca199bcf846fa805a/pa/HX54936_ebc4476051d09dbf9a6f8a9fd7394536.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8ab2ac7a-cac8-53b1-be4f-bc5867753471/8ab2ac7a-cac8-53b1-be4f-bc5867753471_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78191,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/0c/550c3b5acad9cb1ca199bcf846fa805a/pa/HX54936_c84a3d0d184b4b47a6d1d349b1176eb7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8ab2ac7a-cac8-53b1-be4f-bc5867753471/8ab2ac7a-cac8-53b1-be4f-bc5867753471_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84473,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/0c/550c3b5acad9cb1ca199bcf846fa805a/pa/HX54936_4f6cbf4bd59ff9f7ae87803ddfde0468.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8ab2ac7a-cac8-53b1-be4f-bc5867753471/8ab2ac7a-cac8-53b1-be4f-bc5867753471_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75054,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/0c/550c3b5acad9cb1ca199bcf846fa805a/pa/HX54936_1358df3d88e9b97a8401ba1ebbef0ca6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8ab2ac7a-cac8-53b1-be4f-bc5867753471/8ab2ac7a-cac8-53b1-be4f-bc5867753471_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83767,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/0c/550c3b5acad9cb1ca199bcf846fa805a/pa/HX54936_edd6414b7bda4dde96be108aadd8138b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8ab2ac7a-cac8-53b1-be4f-bc5867753471/8ab2ac7a-cac8-53b1-be4f-bc5867753471_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99601,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/0c/550c3b5acad9cb1ca199bcf846fa805a/pa/HX54936_7859f327fc7b9ad57eb59037d6e6b1c0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8ab2ac7a-cac8-53b1-be4f-bc5867753471/8ab2ac7a-cac8-53b1-be4f-bc5867753471_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92497,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/0c/550c3b5acad9cb1ca199bcf846fa805a/pa/HX54936_3d61400ccc1245540ae0ae063d45cb74.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8ab2ac7a-cac8-53b1-be4f-bc5867753471/8ab2ac7a-cac8-53b1-be4f-bc5867753471_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98276,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/0c/550c3b5acad9cb1ca199bcf846fa805a/pa/HX54936_c300bc664d49d616c3453cf2e71d67fb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8ab2ac7a-cac8-53b1-be4f-bc5867753471/8ab2ac7a-cac8-53b1-be4f-bc5867753471_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91889,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/0c/550c3b5acad9cb1ca199bcf846fa805a/pa/HX54936_022d2099ecbc769ba34f97243c25ab7b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8ab2ac7a-cac8-53b1-be4f-bc5867753471/8ab2ac7a-cac8-53b1-be4f-bc5867753471_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71515,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/0c/550c3b5acad9cb1ca199bcf846fa805a/pa/HX54936_1146fd4911119d8e38022e9f2c7f4aea.jpg',
             'Width': 800}],
 'postal_code': None,
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2016-10-18',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Opel Vivaro 1.6 CDTI Kasten L1H1 2,7t',
 'transmission': 'manual',
 'trim': 'Kasten L1H1 2,7t',
 'year': 2016}
2026-04-27 08:14:35 [auto1.fr] INFO: Saving data for HX54936: {'created_time': 1777277675.533578, 'last_price_update_time': 1777277675.533588, 'has_photos': True, 'auction_closing_time': 1777391493.0}
2026-04-27 08:14:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/48/5648f20f4efc8b3485a0e990ecad5a84/pa/NU54953_73f39231127b24e45451e7b3de996937.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/48/5648f20f4efc8b3485a0e990ecad5a84/pa/NU54953_c6d4bd89ead05729bae6d055bd4e3a88.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bfd13d0>
2026-04-27 08:14:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5df25f34-929f-5287-a422-1b04183d064d/5df25f34-929f-5287-a422-1b04183d064d_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/48/5648f20f4efc8b3485a0e990ecad5a84/pa/NU54953_b278c865f4315e095123cd7ace8d5f40.jpg saved to cache
2026-04-27 08:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5df25f34-929f-5287-a422-1b04183d064d
2026-04-27 08:14:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438e00f50>
2026-04-27 08:14:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5df25f34-929f-5287-a422-1b04183d064d/5df25f34-929f-5287-a422-1b04183d064d_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/48/5648f20f4efc8b3485a0e990ecad5a84/pa/NU54953_73f39231127b24e45451e7b3de996937.jpg saved to cache
2026-04-27 08:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5df25f34-929f-5287-a422-1b04183d064d
2026-04-27 08:14:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380e1f10>
2026-04-27 08:14:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5df25f34-929f-5287-a422-1b04183d064d/5df25f34-929f-5287-a422-1b04183d064d_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/48/5648f20f4efc8b3485a0e990ecad5a84/pa/NU54953_c6d4bd89ead05729bae6d055bd4e3a88.jpg saved to cache
2026-04-27 08:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5df25f34-929f-5287-a422-1b04183d064d
2026-04-27 08:14:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5df25f34-929f-5287-a422-1b04183d064d, skipping ID generation
2026-04-27 08:14:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5df25f34-929f-5287-a422-1b04183d064d with scrape type 1
2026-04-27 08:14:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5df25f34-929f-5287-a422-1b04183d064d sending to next pipeline
2026-04-27 08:14:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5df25f34-929f-5287-a422-1b04183d064d, identifier: NU54953
2026-04-27 08:14:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5df25f34-929f-5287-a422-1b04183d064d with identifier: NU54953
2026-04-27 08:14:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5df25f34-929f-5287-a422-1b04183d064d with identifier: NU54953
2026-04-27 08:14:35 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:14:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 5df25f34-929f-5287-a422-1b04183d064d with identifier: NU54953 to the API
2026-04-27 08:14:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:14:36 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:14:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img56/48/5648f20f4efc8b3485a0e990ecad5a84/pa/NU54953_c6d4bd89ead05729bae6d055bd4e3a88.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'city': 'Bourg-en-Bresse',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO N\\/A',
 'engine': '1.0L',
 'engine_horse_power': 68,
 'expiration_date': '2026-04-28T15:52:11Z',
 'fuel_type': 'petrol',
 'id': '5df25f34-929f-5287-a422-1b04183d064d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 46.2057,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NU54953',
 'listing': 'auction',
 'location': 'FR, Bourg-en-Bresse',
 'location_confidence': 'geocoded',
 'longitude': 5.2258,
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 150876,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5df25f34-929f-5287-a422-1b04183d064d/5df25f34-929f-5287-a422-1b04183d064d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97750,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/48/5648f20f4efc8b3485a0e990ecad5a84/pa/NU54953_73f39231127b24e45451e7b3de996937.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5df25f34-929f-5287-a422-1b04183d064d/5df25f34-929f-5287-a422-1b04183d064d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94220,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/48/5648f20f4efc8b3485a0e990ecad5a84/pa/NU54953_c6d4bd89ead05729bae6d055bd4e3a88.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5df25f34-929f-5287-a422-1b04183d064d/5df25f34-929f-5287-a422-1b04183d064d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68019,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/48/5648f20f4efc8b3485a0e990ecad5a84/pa/NU54953_b278c865f4315e095123cd7ace8d5f40.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5df25f34-929f-5287-a422-1b04183d064d/5df25f34-929f-5287-a422-1b04183d064d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52180,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/48/5648f20f4efc8b3485a0e990ecad5a84/pa/NU54953_b17ca49afa889b4518932b9526d63577.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5df25f34-929f-5287-a422-1b04183d064d/5df25f34-929f-5287-a422-1b04183d064d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 166994,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/48/5648f20f4efc8b3485a0e990ecad5a84/pa/NU54953_f4f828b1d8f4a04fb60e7a04ce9b3dc7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5df25f34-929f-5287-a422-1b04183d064d/5df25f34-929f-5287-a422-1b04183d064d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60723,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/48/5648f20f4efc8b3485a0e990ecad5a84/pa/NU54953_9629435b646e913a5f7f8f5c57a80898.jpg',
             'Width': 800}],
 'postal_code': '01000',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Ain',
 'province_code': 'FR-01',
 'region': 'Auvergne-Rhône-Alpes',
 'region_code': 'FR-84',
 'registration_date': '2003-01-28',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Toyota Yaris 1.0 VVT-i Wanadoo',
 'transmission': 'manual',
 'trim': 'Wanadoo',
 'year': 2003}
2026-04-27 08:14:36 [auto1.fr] INFO: Saving data for NU54953: {'created_time': 1777277676.200335, 'last_price_update_time': 1777277676.200344, 'has_photos': True, 'auction_closing_time': 1777391531.0}
2026-04-27 08:14:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AR06449/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:14:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:14:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AG15784/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:14:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:14:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YV37253> (referer: https://www.auto1.com/v1/car-details-view/YV37253/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:14:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:14:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fcfddb73-f3ef-5668-a941-441d4191032f with identifier: YV37253
2026-04-27 08:14:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fcfddb73-f3ef-5668-a941-441d4191032f with scrape type 1
2026-04-27 08:14:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fcfddb73-f3ef-5668-a941-441d4191032f
2026-04-27 08:14:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/cf/e3cf307c9a2770ec664d1ce27df58ab3/pa/YV37253_5f6b1ec5a166389e7dcaac881f29485d.jpg not downloaded yet
2026-04-27 08:14:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/cf/e3cf307c9a2770ec664d1ce27df58ab3/pa/YV37253_6378bb63d06bbeab09ca24c19c296825.jpg not downloaded yet
2026-04-27 08:14:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/cf/e3cf307c9a2770ec664d1ce27df58ab3/pa/YV37253_7bfe4ec65c5ac77d74d9873965a02aa5.jpg not downloaded yet
2026-04-27 08:14:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/cf/e3cf307c9a2770ec664d1ce27df58ab3/pa/YV37253_2616f135a9ef9e1ebbf8ae00e9e9b574.jpg not downloaded yet
2026-04-27 08:14:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/cf/e3cf307c9a2770ec664d1ce27df58ab3/pa/YV37253_9e0df511cfc4a4ef0d905062cc1cc26c.jpg not downloaded yet
2026-04-27 08:14:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/cf/e3cf307c9a2770ec664d1ce27df58ab3/pa/YV37253_00a4a09245b3290b887cc707ea8d5936.jpg not downloaded yet
2026-04-27 08:14:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/cf/e3cf307c9a2770ec664d1ce27df58ab3/pa/YV37253_1ec0fdb02e968832d1ccdec852ee16b5.jpg not downloaded yet
2026-04-27 08:14:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/cf/e3cf307c9a2770ec664d1ce27df58ab3/pa/YV37253_38e5fde7e34fba7044b64a22480d50b8.jpg not downloaded yet
2026-04-27 08:14:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/cf/e3cf307c9a2770ec664d1ce27df58ab3/pa/YV37253_5cc17631cd2b3664e2fba3f129d6081b.jpg not downloaded yet
2026-04-27 08:14:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/cf/e3cf307c9a2770ec664d1ce27df58ab3/pa/YV37253_e4d5e3e6c45971eddd5e3bea8e14a02f.jpg not downloaded yet
2026-04-27 08:14:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BD26378> (referer: https://www.auto1.com/v1/car-details-view/BD26378/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:14:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:14:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d63776bf-4832-5c4a-8d3c-6317dfae1ded with identifier: BD26378
2026-04-27 08:14:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d63776bf-4832-5c4a-8d3c-6317dfae1ded with scrape type 1
2026-04-27 08:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d63776bf-4832-5c4a-8d3c-6317dfae1ded
2026-04-27 08:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/d2/a0d2829f32d25e80bbf1d698e0ca32b7/pa/BD26378_258e92c442d85b644f792ae627994681.jpg not downloaded yet
2026-04-27 08:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/d2/a0d2829f32d25e80bbf1d698e0ca32b7/pa/BD26378_7877d246552c0937536b5a1858935d6e.jpg not downloaded yet
2026-04-27 08:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/d2/a0d2829f32d25e80bbf1d698e0ca32b7/pa/BD26378_a00b5d8741b93299c90c5b1baeb90db1.jpg not downloaded yet
2026-04-27 08:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/d2/a0d2829f32d25e80bbf1d698e0ca32b7/pa/BD26378_5d7d33977bf03c4e3be47f4865d1cd28.jpg not downloaded yet
2026-04-27 08:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/d2/a0d2829f32d25e80bbf1d698e0ca32b7/pa/BD26378_e918ae683e2d726877439363402ce537.jpg not downloaded yet
2026-04-27 08:14:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/cf/e3cf307c9a2770ec664d1ce27df58ab3/pa/YV37253_e4d5e3e6c45971eddd5e3bea8e14a02f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/d2/a0d2829f32d25e80bbf1d698e0ca32b7/pa/BD26378_261ac192749de3e262fd3f8484e123b2.jpg not downloaded yet
2026-04-27 08:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/d2/a0d2829f32d25e80bbf1d698e0ca32b7/pa/BD26378_9f375c4b72927a84d8426ca318a8566d.jpg not downloaded yet
2026-04-27 08:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/d2/a0d2829f32d25e80bbf1d698e0ca32b7/pa/BD26378_d26f14821663e2516b649bfd2a0a0c22.jpg not downloaded yet
2026-04-27 08:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/d2/a0d2829f32d25e80bbf1d698e0ca32b7/pa/BD26378_784b354100943c9c26ce1fc1b97d27a8.jpg not downloaded yet
2026-04-27 08:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/d2/a0d2829f32d25e80bbf1d698e0ca32b7/pa/BD26378_ba9f99123a7861784d946b50377c6e5f.jpg not downloaded yet
2026-04-27 08:14:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/d2/a0d2829f32d25e80bbf1d698e0ca32b7/pa/BD26378_5d7d33977bf03c4e3be47f4865d1cd28.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380bf690>
2026-04-27 08:14:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcfddb73-f3ef-5668-a941-441d4191032f/fcfddb73-f3ef-5668-a941-441d4191032f_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/cf/e3cf307c9a2770ec664d1ce27df58ab3/pa/YV37253_e4d5e3e6c45971eddd5e3bea8e14a02f.jpg saved to cache
2026-04-27 08:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fcfddb73-f3ef-5668-a941-441d4191032f
2026-04-27 08:14:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/d2/a0d2829f32d25e80bbf1d698e0ca32b7/pa/BD26378_ba9f99123a7861784d946b50377c6e5f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438027610>
2026-04-27 08:14:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d63776bf-4832-5c4a-8d3c-6317dfae1ded/d63776bf-4832-5c4a-8d3c-6317dfae1ded_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/d2/a0d2829f32d25e80bbf1d698e0ca32b7/pa/BD26378_5d7d33977bf03c4e3be47f4865d1cd28.jpg saved to cache
2026-04-27 08:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d63776bf-4832-5c4a-8d3c-6317dfae1ded
2026-04-27 08:14:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c86dd0>
2026-04-27 08:14:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d63776bf-4832-5c4a-8d3c-6317dfae1ded/d63776bf-4832-5c4a-8d3c-6317dfae1ded_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/d2/a0d2829f32d25e80bbf1d698e0ca32b7/pa/BD26378_ba9f99123a7861784d946b50377c6e5f.jpg saved to cache
2026-04-27 08:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d63776bf-4832-5c4a-8d3c-6317dfae1ded
2026-04-27 08:14:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/d2/a0d2829f32d25e80bbf1d698e0ca32b7/pa/BD26378_784b354100943c9c26ce1fc1b97d27a8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/d2/a0d2829f32d25e80bbf1d698e0ca32b7/pa/BD26378_d26f14821663e2516b649bfd2a0a0c22.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380bf9d0>
2026-04-27 08:14:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d63776bf-4832-5c4a-8d3c-6317dfae1ded/d63776bf-4832-5c4a-8d3c-6317dfae1ded_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/d2/a0d2829f32d25e80bbf1d698e0ca32b7/pa/BD26378_784b354100943c9c26ce1fc1b97d27a8.jpg saved to cache
2026-04-27 08:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d63776bf-4832-5c4a-8d3c-6317dfae1ded
2026-04-27 08:14:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/d2/a0d2829f32d25e80bbf1d698e0ca32b7/pa/BD26378_9f375c4b72927a84d8426ca318a8566d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438f90a10>
2026-04-27 08:14:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d63776bf-4832-5c4a-8d3c-6317dfae1ded/d63776bf-4832-5c4a-8d3c-6317dfae1ded_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/d2/a0d2829f32d25e80bbf1d698e0ca32b7/pa/BD26378_d26f14821663e2516b649bfd2a0a0c22.jpg saved to cache
2026-04-27 08:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d63776bf-4832-5c4a-8d3c-6317dfae1ded
2026-04-27 08:14:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/d2/a0d2829f32d25e80bbf1d698e0ca32b7/pa/BD26378_261ac192749de3e262fd3f8484e123b2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ff24d0>
2026-04-27 08:14:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d63776bf-4832-5c4a-8d3c-6317dfae1ded/d63776bf-4832-5c4a-8d3c-6317dfae1ded_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/d2/a0d2829f32d25e80bbf1d698e0ca32b7/pa/BD26378_9f375c4b72927a84d8426ca318a8566d.jpg saved to cache
2026-04-27 08:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d63776bf-4832-5c4a-8d3c-6317dfae1ded
2026-04-27 08:14:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/d2/a0d2829f32d25e80bbf1d698e0ca32b7/pa/BD26378_e918ae683e2d726877439363402ce537.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438024650>
2026-04-27 08:14:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d63776bf-4832-5c4a-8d3c-6317dfae1ded/d63776bf-4832-5c4a-8d3c-6317dfae1ded_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/d2/a0d2829f32d25e80bbf1d698e0ca32b7/pa/BD26378_261ac192749de3e262fd3f8484e123b2.jpg saved to cache
2026-04-27 08:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d63776bf-4832-5c4a-8d3c-6317dfae1ded
2026-04-27 08:14:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/d2/a0d2829f32d25e80bbf1d698e0ca32b7/pa/BD26378_a00b5d8741b93299c90c5b1baeb90db1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d90ed0>
2026-04-27 08:14:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d63776bf-4832-5c4a-8d3c-6317dfae1ded/d63776bf-4832-5c4a-8d3c-6317dfae1ded_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/d2/a0d2829f32d25e80bbf1d698e0ca32b7/pa/BD26378_e918ae683e2d726877439363402ce537.jpg saved to cache
2026-04-27 08:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d63776bf-4832-5c4a-8d3c-6317dfae1ded
2026-04-27 08:14:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/d2/a0d2829f32d25e80bbf1d698e0ca32b7/pa/BD26378_7877d246552c0937536b5a1858935d6e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438fbe550>
2026-04-27 08:14:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d63776bf-4832-5c4a-8d3c-6317dfae1ded/d63776bf-4832-5c4a-8d3c-6317dfae1ded_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/d2/a0d2829f32d25e80bbf1d698e0ca32b7/pa/BD26378_a00b5d8741b93299c90c5b1baeb90db1.jpg saved to cache
2026-04-27 08:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d63776bf-4832-5c4a-8d3c-6317dfae1ded
2026-04-27 08:14:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/d2/a0d2829f32d25e80bbf1d698e0ca32b7/pa/BD26378_258e92c442d85b644f792ae627994681.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142be0c710>
2026-04-27 08:14:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d63776bf-4832-5c4a-8d3c-6317dfae1ded/d63776bf-4832-5c4a-8d3c-6317dfae1ded_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/d2/a0d2829f32d25e80bbf1d698e0ca32b7/pa/BD26378_7877d246552c0937536b5a1858935d6e.jpg saved to cache
2026-04-27 08:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d63776bf-4832-5c4a-8d3c-6317dfae1ded
2026-04-27 08:14:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438016690>
2026-04-27 08:14:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d63776bf-4832-5c4a-8d3c-6317dfae1ded/d63776bf-4832-5c4a-8d3c-6317dfae1ded_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:14:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/d2/a0d2829f32d25e80bbf1d698e0ca32b7/pa/BD26378_258e92c442d85b644f792ae627994681.jpg saved to cache
2026-04-27 08:14:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d63776bf-4832-5c4a-8d3c-6317dfae1ded
2026-04-27 08:14:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d63776bf-4832-5c4a-8d3c-6317dfae1ded, skipping ID generation
2026-04-27 08:14:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d63776bf-4832-5c4a-8d3c-6317dfae1ded with scrape type 1
2026-04-27 08:14:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d63776bf-4832-5c4a-8d3c-6317dfae1ded sending to next pipeline
2026-04-27 08:14:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d63776bf-4832-5c4a-8d3c-6317dfae1ded, identifier: BD26378
2026-04-27 08:14:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d63776bf-4832-5c4a-8d3c-6317dfae1ded with identifier: BD26378
2026-04-27 08:14:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d63776bf-4832-5c4a-8d3c-6317dfae1ded with identifier: BD26378
2026-04-27 08:14:52 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:14:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: d63776bf-4832-5c4a-8d3c-6317dfae1ded with identifier: BD26378 to the API
2026-04-27 08:14:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:14:52 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:14:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga0/d2/a0d2829f32d25e80bbf1d698e0ca32b7/pa/BD26378_258e92c442d85b644f792ae627994681.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 97,
 'category': None,
 'city': 'Warluis',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 99,
 'expiration_date': '2026-04-28T15:57:20Z',
 'fuel_type': 'diesel',
 'id': 'd63776bf-4832-5c4a-8d3c-6317dfae1ded',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 49.3887,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BD26378',
 'listing': 'auction',
 'location': 'FR, Warluis',
 'location_confidence': 'geocoded',
 'longitude': 2.1422,
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 124601,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d63776bf-4832-5c4a-8d3c-6317dfae1ded/d63776bf-4832-5c4a-8d3c-6317dfae1ded_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49286,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/d2/a0d2829f32d25e80bbf1d698e0ca32b7/pa/BD26378_258e92c442d85b644f792ae627994681.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d63776bf-4832-5c4a-8d3c-6317dfae1ded/d63776bf-4832-5c4a-8d3c-6317dfae1ded_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50979,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/d2/a0d2829f32d25e80bbf1d698e0ca32b7/pa/BD26378_7877d246552c0937536b5a1858935d6e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d63776bf-4832-5c4a-8d3c-6317dfae1ded/d63776bf-4832-5c4a-8d3c-6317dfae1ded_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 123835,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/d2/a0d2829f32d25e80bbf1d698e0ca32b7/pa/BD26378_a00b5d8741b93299c90c5b1baeb90db1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d63776bf-4832-5c4a-8d3c-6317dfae1ded/d63776bf-4832-5c4a-8d3c-6317dfae1ded_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113012,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/d2/a0d2829f32d25e80bbf1d698e0ca32b7/pa/BD26378_5d7d33977bf03c4e3be47f4865d1cd28.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d63776bf-4832-5c4a-8d3c-6317dfae1ded/d63776bf-4832-5c4a-8d3c-6317dfae1ded_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110532,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/d2/a0d2829f32d25e80bbf1d698e0ca32b7/pa/BD26378_e918ae683e2d726877439363402ce537.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d63776bf-4832-5c4a-8d3c-6317dfae1ded/d63776bf-4832-5c4a-8d3c-6317dfae1ded_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51329,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/d2/a0d2829f32d25e80bbf1d698e0ca32b7/pa/BD26378_261ac192749de3e262fd3f8484e123b2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d63776bf-4832-5c4a-8d3c-6317dfae1ded/d63776bf-4832-5c4a-8d3c-6317dfae1ded_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46152,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/d2/a0d2829f32d25e80bbf1d698e0ca32b7/pa/BD26378_9f375c4b72927a84d8426ca318a8566d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d63776bf-4832-5c4a-8d3c-6317dfae1ded/d63776bf-4832-5c4a-8d3c-6317dfae1ded_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110663,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/d2/a0d2829f32d25e80bbf1d698e0ca32b7/pa/BD26378_d26f14821663e2516b649bfd2a0a0c22.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d63776bf-4832-5c4a-8d3c-6317dfae1ded/d63776bf-4832-5c4a-8d3c-6317dfae1ded_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95334,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/d2/a0d2829f32d25e80bbf1d698e0ca32b7/pa/BD26378_784b354100943c9c26ce1fc1b97d27a8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d63776bf-4832-5c4a-8d3c-6317dfae1ded/d63776bf-4832-5c4a-8d3c-6317dfae1ded_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80176,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/d2/a0d2829f32d25e80bbf1d698e0ca32b7/pa/BD26378_ba9f99123a7861784d946b50377c6e5f.jpg',
             'Width': 800}],
 'postal_code': '60430',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Oise',
 'province_code': 'FR-60',
 'region': 'Hauts-de-France',
 'region_code': 'FR-32',
 'registration_date': '2016-09-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.6 Blue-HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2016}
2026-04-27 08:14:52 [auto1.fr] INFO: Saving data for BD26378: {'created_time': 1777277692.684613, 'last_price_update_time': 1777277692.684622, 'has_photos': True, 'auction_closing_time': 1777391840.0}
2026-04-27 08:14:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/cf/e3cf307c9a2770ec664d1ce27df58ab3/pa/YV37253_5cc17631cd2b3664e2fba3f129d6081b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143801f190>
2026-04-27 08:14:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcfddb73-f3ef-5668-a941-441d4191032f/fcfddb73-f3ef-5668-a941-441d4191032f_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:14:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/cf/e3cf307c9a2770ec664d1ce27df58ab3/pa/YV37253_5cc17631cd2b3664e2fba3f129d6081b.jpg saved to cache
2026-04-27 08:14:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fcfddb73-f3ef-5668-a941-441d4191032f
2026-04-27 08:14:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/cf/e3cf307c9a2770ec664d1ce27df58ab3/pa/YV37253_38e5fde7e34fba7044b64a22480d50b8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d46590>
2026-04-27 08:14:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcfddb73-f3ef-5668-a941-441d4191032f/fcfddb73-f3ef-5668-a941-441d4191032f_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/cf/e3cf307c9a2770ec664d1ce27df58ab3/pa/YV37253_38e5fde7e34fba7044b64a22480d50b8.jpg saved to cache
2026-04-27 08:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fcfddb73-f3ef-5668-a941-441d4191032f
2026-04-27 08:14:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/cf/e3cf307c9a2770ec664d1ce27df58ab3/pa/YV37253_1ec0fdb02e968832d1ccdec852ee16b5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ed8890>
2026-04-27 08:14:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcfddb73-f3ef-5668-a941-441d4191032f/fcfddb73-f3ef-5668-a941-441d4191032f_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/cf/e3cf307c9a2770ec664d1ce27df58ab3/pa/YV37253_1ec0fdb02e968832d1ccdec852ee16b5.jpg saved to cache
2026-04-27 08:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fcfddb73-f3ef-5668-a941-441d4191032f
2026-04-27 08:14:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/cf/e3cf307c9a2770ec664d1ce27df58ab3/pa/YV37253_00a4a09245b3290b887cc707ea8d5936.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d304d0>
2026-04-27 08:14:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcfddb73-f3ef-5668-a941-441d4191032f/fcfddb73-f3ef-5668-a941-441d4191032f_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/cf/e3cf307c9a2770ec664d1ce27df58ab3/pa/YV37253_00a4a09245b3290b887cc707ea8d5936.jpg saved to cache
2026-04-27 08:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fcfddb73-f3ef-5668-a941-441d4191032f
2026-04-27 08:14:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/cf/e3cf307c9a2770ec664d1ce27df58ab3/pa/YV37253_9e0df511cfc4a4ef0d905062cc1cc26c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c540d0>
2026-04-27 08:14:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcfddb73-f3ef-5668-a941-441d4191032f/fcfddb73-f3ef-5668-a941-441d4191032f_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/cf/e3cf307c9a2770ec664d1ce27df58ab3/pa/YV37253_9e0df511cfc4a4ef0d905062cc1cc26c.jpg saved to cache
2026-04-27 08:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fcfddb73-f3ef-5668-a941-441d4191032f
2026-04-27 08:14:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/cf/e3cf307c9a2770ec664d1ce27df58ab3/pa/YV37253_2616f135a9ef9e1ebbf8ae00e9e9b574.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HL76122/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:14:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:14:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380e3290>
2026-04-27 08:14:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcfddb73-f3ef-5668-a941-441d4191032f/fcfddb73-f3ef-5668-a941-441d4191032f_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/cf/e3cf307c9a2770ec664d1ce27df58ab3/pa/YV37253_2616f135a9ef9e1ebbf8ae00e9e9b574.jpg saved to cache
2026-04-27 08:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fcfddb73-f3ef-5668-a941-441d4191032f
2026-04-27 08:14:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/cf/e3cf307c9a2770ec664d1ce27df58ab3/pa/YV37253_7bfe4ec65c5ac77d74d9873965a02aa5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/cf/e3cf307c9a2770ec664d1ce27df58ab3/pa/YV37253_6378bb63d06bbeab09ca24c19c296825.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438055250>
2026-04-27 08:14:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcfddb73-f3ef-5668-a941-441d4191032f/fcfddb73-f3ef-5668-a941-441d4191032f_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:14:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/cf/e3cf307c9a2770ec664d1ce27df58ab3/pa/YV37253_7bfe4ec65c5ac77d74d9873965a02aa5.jpg saved to cache
2026-04-27 08:14:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fcfddb73-f3ef-5668-a941-441d4191032f
2026-04-27 08:14:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/cf/e3cf307c9a2770ec664d1ce27df58ab3/pa/YV37253_5f6b1ec5a166389e7dcaac881f29485d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bffe850>
2026-04-27 08:14:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcfddb73-f3ef-5668-a941-441d4191032f/fcfddb73-f3ef-5668-a941-441d4191032f_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:14:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/cf/e3cf307c9a2770ec664d1ce27df58ab3/pa/YV37253_6378bb63d06bbeab09ca24c19c296825.jpg saved to cache
2026-04-27 08:14:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fcfddb73-f3ef-5668-a941-441d4191032f
2026-04-27 08:14:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438e7f5d0>
2026-04-27 08:14:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcfddb73-f3ef-5668-a941-441d4191032f/fcfddb73-f3ef-5668-a941-441d4191032f_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:14:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/cf/e3cf307c9a2770ec664d1ce27df58ab3/pa/YV37253_5f6b1ec5a166389e7dcaac881f29485d.jpg saved to cache
2026-04-27 08:14:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fcfddb73-f3ef-5668-a941-441d4191032f
2026-04-27 08:14:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fcfddb73-f3ef-5668-a941-441d4191032f, skipping ID generation
2026-04-27 08:14:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fcfddb73-f3ef-5668-a941-441d4191032f with scrape type 1
2026-04-27 08:14:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fcfddb73-f3ef-5668-a941-441d4191032f sending to next pipeline
2026-04-27 08:14:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: fcfddb73-f3ef-5668-a941-441d4191032f, identifier: YV37253
2026-04-27 08:14:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: fcfddb73-f3ef-5668-a941-441d4191032f with identifier: YV37253
2026-04-27 08:14:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: fcfddb73-f3ef-5668-a941-441d4191032f with identifier: YV37253
2026-04-27 08:14:54 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:14:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: fcfddb73-f3ef-5668-a941-441d4191032f with identifier: YV37253 to the API
2026-04-27 08:14:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:14:54 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:14:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge3/cf/e3cf307c9a2770ec664d1ce27df58ab3/pa/YV37253_5f6b1ec5a166389e7dcaac881f29485d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'category': None,
 'city': 'Houécourt',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 67,
 'expiration_date': '2026-04-28T15:14:32Z',
 'fuel_type': 'petrol',
 'id': 'fcfddb73-f3ef-5668-a941-441d4191032f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.2985,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YV37253',
 'listing': 'auction',
 'location': 'FR, Houecourt',
 'location_confidence': 'geocoded',
 'longitude': 5.8931,
 'make': 'Kia',
 'model': 'Picanto',
 'odometer': 29083,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fcfddb73-f3ef-5668-a941-441d4191032f/fcfddb73-f3ef-5668-a941-441d4191032f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68466,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/cf/e3cf307c9a2770ec664d1ce27df58ab3/pa/YV37253_5f6b1ec5a166389e7dcaac881f29485d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fcfddb73-f3ef-5668-a941-441d4191032f/fcfddb73-f3ef-5668-a941-441d4191032f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73379,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/cf/e3cf307c9a2770ec664d1ce27df58ab3/pa/YV37253_6378bb63d06bbeab09ca24c19c296825.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fcfddb73-f3ef-5668-a941-441d4191032f/fcfddb73-f3ef-5668-a941-441d4191032f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70030,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/cf/e3cf307c9a2770ec664d1ce27df58ab3/pa/YV37253_7bfe4ec65c5ac77d74d9873965a02aa5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fcfddb73-f3ef-5668-a941-441d4191032f/fcfddb73-f3ef-5668-a941-441d4191032f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55134,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/cf/e3cf307c9a2770ec664d1ce27df58ab3/pa/YV37253_2616f135a9ef9e1ebbf8ae00e9e9b574.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fcfddb73-f3ef-5668-a941-441d4191032f/fcfddb73-f3ef-5668-a941-441d4191032f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55438,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/cf/e3cf307c9a2770ec664d1ce27df58ab3/pa/YV37253_9e0df511cfc4a4ef0d905062cc1cc26c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fcfddb73-f3ef-5668-a941-441d4191032f/fcfddb73-f3ef-5668-a941-441d4191032f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65683,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/cf/e3cf307c9a2770ec664d1ce27df58ab3/pa/YV37253_00a4a09245b3290b887cc707ea8d5936.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fcfddb73-f3ef-5668-a941-441d4191032f/fcfddb73-f3ef-5668-a941-441d4191032f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59468,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/cf/e3cf307c9a2770ec664d1ce27df58ab3/pa/YV37253_1ec0fdb02e968832d1ccdec852ee16b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fcfddb73-f3ef-5668-a941-441d4191032f/fcfddb73-f3ef-5668-a941-441d4191032f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65434,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/cf/e3cf307c9a2770ec664d1ce27df58ab3/pa/YV37253_38e5fde7e34fba7044b64a22480d50b8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fcfddb73-f3ef-5668-a941-441d4191032f/fcfddb73-f3ef-5668-a941-441d4191032f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81847,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/cf/e3cf307c9a2770ec664d1ce27df58ab3/pa/YV37253_5cc17631cd2b3664e2fba3f129d6081b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fcfddb73-f3ef-5668-a941-441d4191032f/fcfddb73-f3ef-5668-a941-441d4191032f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62416,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/cf/e3cf307c9a2770ec664d1ce27df58ab3/pa/YV37253_e4d5e3e6c45971eddd5e3bea8e14a02f.jpg',
             'Width': 800}],
 'postal_code': '88170',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Vosges',
 'province_code': 'FR-88',
 'region': 'Grand Est',
 'region_code': 'FR-44',
 'registration_date': '2020-06-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Picanto 1.0 Design',
 'transmission': 'manual',
 'trim': 'Design',
 'year': 2020}
2026-04-27 08:14:54 [auto1.fr] INFO: Saving data for YV37253: {'created_time': 1777277694.60087, 'last_price_update_time': 1777277694.600883, 'has_photos': True, 'auction_closing_time': 1777389272.0}
2026-04-27 08:14:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NG43636/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:14:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:14:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HK18550/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:14:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:14:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HW60627/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:14:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:14:59 [scrapy.extensions.logstats] INFO: Crawled 601 pages (at 19 pages/min), scraped 500 items (at 11 items/min)
2026-04-27 08:14:59 [scrapy.extensions.memusage] INFO: Peak memory usage is 373MiB
2026-04-27 08:15:02 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 265.585(s), this was the 2nd time calling it.
2026-04-27 08:15:02 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.556222789178918 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:15:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KU72457/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:15:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:15:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SS92656/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:15:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:15:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AR06449> (referer: https://www.auto1.com/v1/car-details-view/AR06449/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:15:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:15:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b7ba185-e91d-5495-9a56-a8fc58bee339 with identifier: AR06449
2026-04-27 08:15:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b7ba185-e91d-5495-9a56-a8fc58bee339 with scrape type 1
2026-04-27 08:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 6b7ba185-e91d-5495-9a56-a8fc58bee339
2026-04-27 08:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/9a/d19ad78e937d16b10486f50ff4659b01/pa/AR06449_1b9efd0baaa3c6456445c7ac8234de97.jpg not downloaded yet
2026-04-27 08:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/9a/d19ad78e937d16b10486f50ff4659b01/pa/AR06449_9acd0ed011cd681d50014a2bd1438785.jpg not downloaded yet
2026-04-27 08:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/9a/d19ad78e937d16b10486f50ff4659b01/pa/AR06449_d73a6998d9b5ee5c726cd3949ea9f357.jpg not downloaded yet
2026-04-27 08:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/9a/d19ad78e937d16b10486f50ff4659b01/pa/AR06449_ee7ecf75d1335ff0d86cdc5035ee031b.jpg not downloaded yet
2026-04-27 08:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/9a/d19ad78e937d16b10486f50ff4659b01/pa/AR06449_94f861f965f881c10d845b5ff82f276c.jpg not downloaded yet
2026-04-27 08:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/9a/d19ad78e937d16b10486f50ff4659b01/pa/AR06449_b5eac99c4dc5aabe0eb5bf3d9a0f844d.jpg not downloaded yet
2026-04-27 08:15:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-04-27 08:15:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AT94183> (referer: https://www.auto1.com/v1/car-details-view/AT94183/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:15:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:15:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4beb7bd9-1390-5a1e-a56c-dc80ae4143d0 with identifier: AT94183
2026-04-27 08:15:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4beb7bd9-1390-5a1e-a56c-dc80ae4143d0 with scrape type 1
2026-04-27 08:15:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4beb7bd9-1390-5a1e-a56c-dc80ae4143d0
2026-04-27 08:15:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/d7/59d73d18e4cf7bc5f7df209fb2669c08/pa/AT94183_6aaab86300c142a57a4518f30cefbae7.jpg not downloaded yet
2026-04-27 08:15:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/d7/59d73d18e4cf7bc5f7df209fb2669c08/pa/AT94183_42bb82a451f6bc4aa964d66d691cadb5.jpg not downloaded yet
2026-04-27 08:15:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/d7/59d73d18e4cf7bc5f7df209fb2669c08/pa/AT94183_b95073f313913a18a9556a435807e473.jpg not downloaded yet
2026-04-27 08:15:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/d7/59d73d18e4cf7bc5f7df209fb2669c08/pa/AT94183_ad23f0549db6a1bc8f049ae5d5bced33.jpg not downloaded yet
2026-04-27 08:15:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/d7/59d73d18e4cf7bc5f7df209fb2669c08/pa/AT94183_642f05dc945a0793fc7a744a320abe2d.jpg not downloaded yet
2026-04-27 08:15:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/d7/59d73d18e4cf7bc5f7df209fb2669c08/pa/AT94183_8b8822c0046602797c393050f62317ee.jpg not downloaded yet
2026-04-27 08:15:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/d7/59d73d18e4cf7bc5f7df209fb2669c08/pa/AT94183_cc6216935b19a450fe911f4ae82d4c05.jpg not downloaded yet
2026-04-27 08:15:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/9a/d19ad78e937d16b10486f50ff4659b01/pa/AR06449_b5eac99c4dc5aabe0eb5bf3d9a0f844d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/d7/59d73d18e4cf7bc5f7df209fb2669c08/pa/AT94183_559ac99a41bc5098d4a0dc8a9ad5019a.jpg not downloaded yet
2026-04-27 08:15:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/d7/59d73d18e4cf7bc5f7df209fb2669c08/pa/AT94183_55a61b8bd10fe597a10c41f77e73553f.jpg not downloaded yet
2026-04-27 08:15:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/d7/59d73d18e4cf7bc5f7df209fb2669c08/pa/AT94183_290de261d221ac421dd138259226afc3.jpg not downloaded yet
2026-04-27 08:15:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/d7/59d73d18e4cf7bc5f7df209fb2669c08/pa/AT94183_cc6216935b19a450fe911f4ae82d4c05.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438eda790>
2026-04-27 08:15:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b7ba185-e91d-5495-9a56-a8fc58bee339/6b7ba185-e91d-5495-9a56-a8fc58bee339_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:15:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/9a/d19ad78e937d16b10486f50ff4659b01/pa/AR06449_b5eac99c4dc5aabe0eb5bf3d9a0f844d.jpg saved to cache
2026-04-27 08:15:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6b7ba185-e91d-5495-9a56-a8fc58bee339
2026-04-27 08:15:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/d7/59d73d18e4cf7bc5f7df209fb2669c08/pa/AT94183_290de261d221ac421dd138259226afc3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14478cc490>
2026-04-27 08:15:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4beb7bd9-1390-5a1e-a56c-dc80ae4143d0/4beb7bd9-1390-5a1e-a56c-dc80ae4143d0_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:15:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/d7/59d73d18e4cf7bc5f7df209fb2669c08/pa/AT94183_cc6216935b19a450fe911f4ae82d4c05.jpg saved to cache
2026-04-27 08:15:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4beb7bd9-1390-5a1e-a56c-dc80ae4143d0
2026-04-27 08:15:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/d7/59d73d18e4cf7bc5f7df209fb2669c08/pa/AT94183_55a61b8bd10fe597a10c41f77e73553f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143adb23d0>
2026-04-27 08:15:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4beb7bd9-1390-5a1e-a56c-dc80ae4143d0/4beb7bd9-1390-5a1e-a56c-dc80ae4143d0_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:15:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/d7/59d73d18e4cf7bc5f7df209fb2669c08/pa/AT94183_290de261d221ac421dd138259226afc3.jpg saved to cache
2026-04-27 08:15:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4beb7bd9-1390-5a1e-a56c-dc80ae4143d0
2026-04-27 08:15:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/d7/59d73d18e4cf7bc5f7df209fb2669c08/pa/AT94183_559ac99a41bc5098d4a0dc8a9ad5019a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d628d0>
2026-04-27 08:15:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4beb7bd9-1390-5a1e-a56c-dc80ae4143d0/4beb7bd9-1390-5a1e-a56c-dc80ae4143d0_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:15:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/d7/59d73d18e4cf7bc5f7df209fb2669c08/pa/AT94183_55a61b8bd10fe597a10c41f77e73553f.jpg saved to cache
2026-04-27 08:15:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4beb7bd9-1390-5a1e-a56c-dc80ae4143d0
2026-04-27 08:15:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/d7/59d73d18e4cf7bc5f7df209fb2669c08/pa/AT94183_8b8822c0046602797c393050f62317ee.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d7e8d0>
2026-04-27 08:15:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4beb7bd9-1390-5a1e-a56c-dc80ae4143d0/4beb7bd9-1390-5a1e-a56c-dc80ae4143d0_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:15:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/d7/59d73d18e4cf7bc5f7df209fb2669c08/pa/AT94183_559ac99a41bc5098d4a0dc8a9ad5019a.jpg saved to cache
2026-04-27 08:15:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4beb7bd9-1390-5a1e-a56c-dc80ae4143d0
2026-04-27 08:15:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/d7/59d73d18e4cf7bc5f7df209fb2669c08/pa/AT94183_642f05dc945a0793fc7a744a320abe2d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143801c490>
2026-04-27 08:15:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4beb7bd9-1390-5a1e-a56c-dc80ae4143d0/4beb7bd9-1390-5a1e-a56c-dc80ae4143d0_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:15:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/d7/59d73d18e4cf7bc5f7df209fb2669c08/pa/AT94183_8b8822c0046602797c393050f62317ee.jpg saved to cache
2026-04-27 08:15:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4beb7bd9-1390-5a1e-a56c-dc80ae4143d0
2026-04-27 08:15:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/d7/59d73d18e4cf7bc5f7df209fb2669c08/pa/AT94183_ad23f0549db6a1bc8f049ae5d5bced33.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bfd1ed0>
2026-04-27 08:15:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4beb7bd9-1390-5a1e-a56c-dc80ae4143d0/4beb7bd9-1390-5a1e-a56c-dc80ae4143d0_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:15:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/d7/59d73d18e4cf7bc5f7df209fb2669c08/pa/AT94183_642f05dc945a0793fc7a744a320abe2d.jpg saved to cache
2026-04-27 08:15:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4beb7bd9-1390-5a1e-a56c-dc80ae4143d0
2026-04-27 08:15:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/d7/59d73d18e4cf7bc5f7df209fb2669c08/pa/AT94183_b95073f313913a18a9556a435807e473.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HL76122> (referer: https://www.auto1.com/v1/car-details-view/HL76122/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:15:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:15:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bfd22d0>
2026-04-27 08:15:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4beb7bd9-1390-5a1e-a56c-dc80ae4143d0/4beb7bd9-1390-5a1e-a56c-dc80ae4143d0_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:15:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/d7/59d73d18e4cf7bc5f7df209fb2669c08/pa/AT94183_ad23f0549db6a1bc8f049ae5d5bced33.jpg saved to cache
2026-04-27 08:15:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4beb7bd9-1390-5a1e-a56c-dc80ae4143d0
2026-04-27 08:15:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/d7/59d73d18e4cf7bc5f7df209fb2669c08/pa/AT94183_6aaab86300c142a57a4518f30cefbae7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/d7/59d73d18e4cf7bc5f7df209fb2669c08/pa/AT94183_42bb82a451f6bc4aa964d66d691cadb5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438e003d0>
2026-04-27 08:15:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4beb7bd9-1390-5a1e-a56c-dc80ae4143d0/4beb7bd9-1390-5a1e-a56c-dc80ae4143d0_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:15:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/d7/59d73d18e4cf7bc5f7df209fb2669c08/pa/AT94183_b95073f313913a18a9556a435807e473.jpg saved to cache
2026-04-27 08:15:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4beb7bd9-1390-5a1e-a56c-dc80ae4143d0
2026-04-27 08:15:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0da2f3fe-39d8-5ca1-87d6-fdd97d1a5cc1 with identifier: HL76122
2026-04-27 08:15:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0da2f3fe-39d8-5ca1-87d6-fdd97d1a5cc1 with scrape type 1
2026-04-27 08:15:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0da2f3fe-39d8-5ca1-87d6-fdd97d1a5cc1
2026-04-27 08:15:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/4a/654a2cc4a7f17d42396f30345a537256/pa/HL76122_c1b60c1902e311161a6b3ffc03615158.jpg not downloaded yet
2026-04-27 08:15:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/9a/d19ad78e937d16b10486f50ff4659b01/pa/AR06449_ee7ecf75d1335ff0d86cdc5035ee031b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/4a/654a2cc4a7f17d42396f30345a537256/pa/HL76122_b3cbb79de499dca4f503910cf18191a8.jpg not downloaded yet
2026-04-27 08:15:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/4a/654a2cc4a7f17d42396f30345a537256/pa/HL76122_4402f118db913086d7941926903f7e4f.jpg not downloaded yet
2026-04-27 08:15:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/4a/654a2cc4a7f17d42396f30345a537256/pa/HL76122_88320289d50f24e11dfeef6beb8e9021.jpg not downloaded yet
2026-04-27 08:15:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14551992d0>
2026-04-27 08:15:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4beb7bd9-1390-5a1e-a56c-dc80ae4143d0/4beb7bd9-1390-5a1e-a56c-dc80ae4143d0_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:15:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/d7/59d73d18e4cf7bc5f7df209fb2669c08/pa/AT94183_6aaab86300c142a57a4518f30cefbae7.jpg saved to cache
2026-04-27 08:15:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4beb7bd9-1390-5a1e-a56c-dc80ae4143d0
2026-04-27 08:15:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438085310>
2026-04-27 08:15:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4beb7bd9-1390-5a1e-a56c-dc80ae4143d0/4beb7bd9-1390-5a1e-a56c-dc80ae4143d0_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:15:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/d7/59d73d18e4cf7bc5f7df209fb2669c08/pa/AT94183_42bb82a451f6bc4aa964d66d691cadb5.jpg saved to cache
2026-04-27 08:15:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4beb7bd9-1390-5a1e-a56c-dc80ae4143d0
2026-04-27 08:15:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4beb7bd9-1390-5a1e-a56c-dc80ae4143d0, skipping ID generation
2026-04-27 08:15:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4beb7bd9-1390-5a1e-a56c-dc80ae4143d0 with scrape type 1
2026-04-27 08:15:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4beb7bd9-1390-5a1e-a56c-dc80ae4143d0 sending to next pipeline
2026-04-27 08:15:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4beb7bd9-1390-5a1e-a56c-dc80ae4143d0, identifier: AT94183
2026-04-27 08:15:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4beb7bd9-1390-5a1e-a56c-dc80ae4143d0 with identifier: AT94183
2026-04-27 08:15:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4beb7bd9-1390-5a1e-a56c-dc80ae4143d0 with identifier: AT94183
2026-04-27 08:15:17 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:15:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 4beb7bd9-1390-5a1e-a56c-dc80ae4143d0 with identifier: AT94183 to the API
2026-04-27 08:15:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:15:17 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:15:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img59/d7/59d73d18e4cf7bc5f7df209fb2669c08/pa/AT94183_42bb82a451f6bc4aa964d66d691cadb5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 98,
 'category': None,
 'city': 'Allennes-les-Marais',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-04-28T15:14:52Z',
 'fuel_type': 'diesel',
 'id': '4beb7bd9-1390-5a1e-a56c-dc80ae4143d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 50.5375,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AT94183',
 'listing': 'auction',
 'location': 'FR, Allennes-les-Marais',
 'location_confidence': 'geocoded',
 'longitude': 2.9536,
 'make': 'Citroen',
 'model': 'C4 Spacetourer',
 'odometer': 254208,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4beb7bd9-1390-5a1e-a56c-dc80ae4143d0/4beb7bd9-1390-5a1e-a56c-dc80ae4143d0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63871,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/d7/59d73d18e4cf7bc5f7df209fb2669c08/pa/AT94183_6aaab86300c142a57a4518f30cefbae7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4beb7bd9-1390-5a1e-a56c-dc80ae4143d0/4beb7bd9-1390-5a1e-a56c-dc80ae4143d0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65784,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/d7/59d73d18e4cf7bc5f7df209fb2669c08/pa/AT94183_42bb82a451f6bc4aa964d66d691cadb5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4beb7bd9-1390-5a1e-a56c-dc80ae4143d0/4beb7bd9-1390-5a1e-a56c-dc80ae4143d0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72161,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/d7/59d73d18e4cf7bc5f7df209fb2669c08/pa/AT94183_b95073f313913a18a9556a435807e473.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4beb7bd9-1390-5a1e-a56c-dc80ae4143d0/4beb7bd9-1390-5a1e-a56c-dc80ae4143d0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47715,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/d7/59d73d18e4cf7bc5f7df209fb2669c08/pa/AT94183_ad23f0549db6a1bc8f049ae5d5bced33.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4beb7bd9-1390-5a1e-a56c-dc80ae4143d0/4beb7bd9-1390-5a1e-a56c-dc80ae4143d0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63733,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/d7/59d73d18e4cf7bc5f7df209fb2669c08/pa/AT94183_642f05dc945a0793fc7a744a320abe2d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4beb7bd9-1390-5a1e-a56c-dc80ae4143d0/4beb7bd9-1390-5a1e-a56c-dc80ae4143d0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71696,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/d7/59d73d18e4cf7bc5f7df209fb2669c08/pa/AT94183_8b8822c0046602797c393050f62317ee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4beb7bd9-1390-5a1e-a56c-dc80ae4143d0/4beb7bd9-1390-5a1e-a56c-dc80ae4143d0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51605,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/d7/59d73d18e4cf7bc5f7df209fb2669c08/pa/AT94183_cc6216935b19a450fe911f4ae82d4c05.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4beb7bd9-1390-5a1e-a56c-dc80ae4143d0/4beb7bd9-1390-5a1e-a56c-dc80ae4143d0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70368,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/d7/59d73d18e4cf7bc5f7df209fb2669c08/pa/AT94183_559ac99a41bc5098d4a0dc8a9ad5019a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4beb7bd9-1390-5a1e-a56c-dc80ae4143d0/4beb7bd9-1390-5a1e-a56c-dc80ae4143d0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66448,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/d7/59d73d18e4cf7bc5f7df209fb2669c08/pa/AT94183_55a61b8bd10fe597a10c41f77e73553f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4beb7bd9-1390-5a1e-a56c-dc80ae4143d0/4beb7bd9-1390-5a1e-a56c-dc80ae4143d0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59903,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/d7/59d73d18e4cf7bc5f7df209fb2669c08/pa/AT94183_290de261d221ac421dd138259226afc3.jpg',
             'Width': 800}],
 'postal_code': '59251',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Nord',
 'province_code': 'FR-59',
 'region': 'Hauts-de-France',
 'region_code': 'FR-32',
 'registration_date': '2020-05-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C4 Spacetourer 1.5 Blue-HDi Feel',
 'transmission': 'automatic',
 'trim': 'Feel',
 'year': 2020}
2026-04-27 08:15:17 [auto1.fr] INFO: Saving data for AT94183: {'created_time': 1777277717.72054, 'last_price_update_time': 1777277717.720551, 'has_photos': True, 'auction_closing_time': 1777389292.0}
2026-04-27 08:15:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/4a/654a2cc4a7f17d42396f30345a537256/pa/HL76122_1026e3e8e1c47ef3d36c5f2b88b5b780.jpg not downloaded yet
2026-04-27 08:15:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/9a/d19ad78e937d16b10486f50ff4659b01/pa/AR06449_94f861f965f881c10d845b5ff82f276c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/4a/654a2cc4a7f17d42396f30345a537256/pa/HL76122_c1b60c1902e311161a6b3ffc03615158.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/4a/654a2cc4a7f17d42396f30345a537256/pa/HL76122_86b8a4d4ae02213332f2824009f387bc.jpg not downloaded yet
2026-04-27 08:15:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GX08987/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:15:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438bffd50>
2026-04-27 08:15:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b7ba185-e91d-5495-9a56-a8fc58bee339/6b7ba185-e91d-5495-9a56-a8fc58bee339_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:15:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/9a/d19ad78e937d16b10486f50ff4659b01/pa/AR06449_ee7ecf75d1335ff0d86cdc5035ee031b.jpg saved to cache
2026-04-27 08:15:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6b7ba185-e91d-5495-9a56-a8fc58bee339
2026-04-27 08:15:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:15:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/4a/654a2cc4a7f17d42396f30345a537256/pa/HL76122_5289c37d8b29319d5a6f120aa7a4eff7.jpg not downloaded yet
2026-04-27 08:15:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/4a/654a2cc4a7f17d42396f30345a537256/pa/HL76122_0887c1a98ce8685e13699f818d326c86.jpg not downloaded yet
2026-04-27 08:15:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/4a/654a2cc4a7f17d42396f30345a537256/pa/HL76122_cc0f93cbf7b036bc45018292c1ee6575.jpg not downloaded yet
2026-04-27 08:15:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/4a/654a2cc4a7f17d42396f30345a537256/pa/HL76122_8e4c33e53717de89aac2df4bb8f6ea8d.jpg not downloaded yet
2026-04-27 08:15:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438df9390>
2026-04-27 08:15:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b7ba185-e91d-5495-9a56-a8fc58bee339/6b7ba185-e91d-5495-9a56-a8fc58bee339_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:15:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/9a/d19ad78e937d16b10486f50ff4659b01/pa/AR06449_94f861f965f881c10d845b5ff82f276c.jpg saved to cache
2026-04-27 08:15:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6b7ba185-e91d-5495-9a56-a8fc58bee339
2026-04-27 08:15:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438fbe650>
2026-04-27 08:15:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0da2f3fe-39d8-5ca1-87d6-fdd97d1a5cc1/0da2f3fe-39d8-5ca1-87d6-fdd97d1a5cc1_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:15:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/4a/654a2cc4a7f17d42396f30345a537256/pa/HL76122_c1b60c1902e311161a6b3ffc03615158.jpg saved to cache
2026-04-27 08:15:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0da2f3fe-39d8-5ca1-87d6-fdd97d1a5cc1
2026-04-27 08:15:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/4a/654a2cc4a7f17d42396f30345a537256/pa/HL76122_88320289d50f24e11dfeef6beb8e9021.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/4a/654a2cc4a7f17d42396f30345a537256/pa/HL76122_1026e3e8e1c47ef3d36c5f2b88b5b780.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/4a/654a2cc4a7f17d42396f30345a537256/pa/HL76122_4402f118db913086d7941926903f7e4f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b28650>
2026-04-27 08:15:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0da2f3fe-39d8-5ca1-87d6-fdd97d1a5cc1/0da2f3fe-39d8-5ca1-87d6-fdd97d1a5cc1_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:15:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/4a/654a2cc4a7f17d42396f30345a537256/pa/HL76122_88320289d50f24e11dfeef6beb8e9021.jpg saved to cache
2026-04-27 08:15:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0da2f3fe-39d8-5ca1-87d6-fdd97d1a5cc1
2026-04-27 08:15:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/4a/654a2cc4a7f17d42396f30345a537256/pa/HL76122_cc0f93cbf7b036bc45018292c1ee6575.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14478e2d90>
2026-04-27 08:15:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0da2f3fe-39d8-5ca1-87d6-fdd97d1a5cc1/0da2f3fe-39d8-5ca1-87d6-fdd97d1a5cc1_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:15:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/4a/654a2cc4a7f17d42396f30345a537256/pa/HL76122_1026e3e8e1c47ef3d36c5f2b88b5b780.jpg saved to cache
2026-04-27 08:15:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0da2f3fe-39d8-5ca1-87d6-fdd97d1a5cc1
2026-04-27 08:15:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438fb89d0>
2026-04-27 08:15:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0da2f3fe-39d8-5ca1-87d6-fdd97d1a5cc1/0da2f3fe-39d8-5ca1-87d6-fdd97d1a5cc1_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:15:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/4a/654a2cc4a7f17d42396f30345a537256/pa/HL76122_4402f118db913086d7941926903f7e4f.jpg saved to cache
2026-04-27 08:15:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0da2f3fe-39d8-5ca1-87d6-fdd97d1a5cc1
2026-04-27 08:15:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/4a/654a2cc4a7f17d42396f30345a537256/pa/HL76122_0887c1a98ce8685e13699f818d326c86.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/4a/654a2cc4a7f17d42396f30345a537256/pa/HL76122_8e4c33e53717de89aac2df4bb8f6ea8d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438cb8850>
2026-04-27 08:15:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0da2f3fe-39d8-5ca1-87d6-fdd97d1a5cc1/0da2f3fe-39d8-5ca1-87d6-fdd97d1a5cc1_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:15:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/4a/654a2cc4a7f17d42396f30345a537256/pa/HL76122_cc0f93cbf7b036bc45018292c1ee6575.jpg saved to cache
2026-04-27 08:15:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0da2f3fe-39d8-5ca1-87d6-fdd97d1a5cc1
2026-04-27 08:15:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c54990>
2026-04-27 08:15:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0da2f3fe-39d8-5ca1-87d6-fdd97d1a5cc1/0da2f3fe-39d8-5ca1-87d6-fdd97d1a5cc1_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:15:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/4a/654a2cc4a7f17d42396f30345a537256/pa/HL76122_0887c1a98ce8685e13699f818d326c86.jpg saved to cache
2026-04-27 08:15:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0da2f3fe-39d8-5ca1-87d6-fdd97d1a5cc1
2026-04-27 08:15:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438188450>
2026-04-27 08:15:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0da2f3fe-39d8-5ca1-87d6-fdd97d1a5cc1/0da2f3fe-39d8-5ca1-87d6-fdd97d1a5cc1_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:15:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/4a/654a2cc4a7f17d42396f30345a537256/pa/HL76122_8e4c33e53717de89aac2df4bb8f6ea8d.jpg saved to cache
2026-04-27 08:15:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0da2f3fe-39d8-5ca1-87d6-fdd97d1a5cc1
2026-04-27 08:15:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/4a/654a2cc4a7f17d42396f30345a537256/pa/HL76122_86b8a4d4ae02213332f2824009f387bc.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/4a/654a2cc4a7f17d42396f30345a537256/pa/HL76122_5289c37d8b29319d5a6f120aa7a4eff7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/4a/654a2cc4a7f17d42396f30345a537256/pa/HL76122_b3cbb79de499dca4f503910cf18191a8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380a6d50>
2026-04-27 08:15:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0da2f3fe-39d8-5ca1-87d6-fdd97d1a5cc1/0da2f3fe-39d8-5ca1-87d6-fdd97d1a5cc1_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:15:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/4a/654a2cc4a7f17d42396f30345a537256/pa/HL76122_86b8a4d4ae02213332f2824009f387bc.jpg saved to cache
2026-04-27 08:15:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0da2f3fe-39d8-5ca1-87d6-fdd97d1a5cc1
2026-04-27 08:15:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438016dd0>
2026-04-27 08:15:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0da2f3fe-39d8-5ca1-87d6-fdd97d1a5cc1/0da2f3fe-39d8-5ca1-87d6-fdd97d1a5cc1_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:15:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/4a/654a2cc4a7f17d42396f30345a537256/pa/HL76122_5289c37d8b29319d5a6f120aa7a4eff7.jpg saved to cache
2026-04-27 08:15:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0da2f3fe-39d8-5ca1-87d6-fdd97d1a5cc1
2026-04-27 08:15:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bfd18d0>
2026-04-27 08:15:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0da2f3fe-39d8-5ca1-87d6-fdd97d1a5cc1/0da2f3fe-39d8-5ca1-87d6-fdd97d1a5cc1_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:15:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/4a/654a2cc4a7f17d42396f30345a537256/pa/HL76122_b3cbb79de499dca4f503910cf18191a8.jpg saved to cache
2026-04-27 08:15:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0da2f3fe-39d8-5ca1-87d6-fdd97d1a5cc1
2026-04-27 08:15:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0da2f3fe-39d8-5ca1-87d6-fdd97d1a5cc1, skipping ID generation
2026-04-27 08:15:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0da2f3fe-39d8-5ca1-87d6-fdd97d1a5cc1 with scrape type 1
2026-04-27 08:15:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0da2f3fe-39d8-5ca1-87d6-fdd97d1a5cc1 sending to next pipeline
2026-04-27 08:15:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0da2f3fe-39d8-5ca1-87d6-fdd97d1a5cc1, identifier: HL76122
2026-04-27 08:15:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0da2f3fe-39d8-5ca1-87d6-fdd97d1a5cc1 with identifier: HL76122
2026-04-27 08:15:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0da2f3fe-39d8-5ca1-87d6-fdd97d1a5cc1 with identifier: HL76122
2026-04-27 08:15:18 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:15:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 0da2f3fe-39d8-5ca1-87d6-fdd97d1a5cc1 with identifier: HL76122 to the API
2026-04-27 08:15:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:15:19 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:15:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img65/4a/654a2cc4a7f17d42396f30345a537256/pa/HL76122_b3cbb79de499dca4f503910cf18191a8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'city': 'Épinal',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-04-28T15:06:34Z',
 'fuel_type': 'petrol',
 'id': '0da2f3fe-39d8-5ca1-87d6-fdd97d1a5cc1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.1832,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HL76122',
 'listing': 'auction',
 'location': 'FR, Epinal',
 'location_confidence': 'geocoded',
 'longitude': 6.453,
 'make': 'Fiat',
 'model': '500',
 'odometer': 101261,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0da2f3fe-39d8-5ca1-87d6-fdd97d1a5cc1/0da2f3fe-39d8-5ca1-87d6-fdd97d1a5cc1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107492,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/4a/654a2cc4a7f17d42396f30345a537256/pa/HL76122_c1b60c1902e311161a6b3ffc03615158.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0da2f3fe-39d8-5ca1-87d6-fdd97d1a5cc1/0da2f3fe-39d8-5ca1-87d6-fdd97d1a5cc1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102318,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/4a/654a2cc4a7f17d42396f30345a537256/pa/HL76122_b3cbb79de499dca4f503910cf18191a8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0da2f3fe-39d8-5ca1-87d6-fdd97d1a5cc1/0da2f3fe-39d8-5ca1-87d6-fdd97d1a5cc1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98203,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/4a/654a2cc4a7f17d42396f30345a537256/pa/HL76122_4402f118db913086d7941926903f7e4f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0da2f3fe-39d8-5ca1-87d6-fdd97d1a5cc1/0da2f3fe-39d8-5ca1-87d6-fdd97d1a5cc1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88405,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/4a/654a2cc4a7f17d42396f30345a537256/pa/HL76122_88320289d50f24e11dfeef6beb8e9021.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0da2f3fe-39d8-5ca1-87d6-fdd97d1a5cc1/0da2f3fe-39d8-5ca1-87d6-fdd97d1a5cc1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112919,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/4a/654a2cc4a7f17d42396f30345a537256/pa/HL76122_1026e3e8e1c47ef3d36c5f2b88b5b780.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0da2f3fe-39d8-5ca1-87d6-fdd97d1a5cc1/0da2f3fe-39d8-5ca1-87d6-fdd97d1a5cc1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108739,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/4a/654a2cc4a7f17d42396f30345a537256/pa/HL76122_86b8a4d4ae02213332f2824009f387bc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0da2f3fe-39d8-5ca1-87d6-fdd97d1a5cc1/0da2f3fe-39d8-5ca1-87d6-fdd97d1a5cc1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86406,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/4a/654a2cc4a7f17d42396f30345a537256/pa/HL76122_5289c37d8b29319d5a6f120aa7a4eff7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0da2f3fe-39d8-5ca1-87d6-fdd97d1a5cc1/0da2f3fe-39d8-5ca1-87d6-fdd97d1a5cc1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101098,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/4a/654a2cc4a7f17d42396f30345a537256/pa/HL76122_0887c1a98ce8685e13699f818d326c86.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0da2f3fe-39d8-5ca1-87d6-fdd97d1a5cc1/0da2f3fe-39d8-5ca1-87d6-fdd97d1a5cc1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94983,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/4a/654a2cc4a7f17d42396f30345a537256/pa/HL76122_cc0f93cbf7b036bc45018292c1ee6575.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0da2f3fe-39d8-5ca1-87d6-fdd97d1a5cc1/0da2f3fe-39d8-5ca1-87d6-fdd97d1a5cc1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102831,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/4a/654a2cc4a7f17d42396f30345a537256/pa/HL76122_8e4c33e53717de89aac2df4bb8f6ea8d.jpg',
             'Width': 800}],
 'postal_code': '88000',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Vosges',
 'province_code': 'FR-88',
 'region': 'Grand Est',
 'region_code': 'FR-44',
 'registration_date': '2017-10-03',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat 500 1.2 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2017}
2026-04-27 08:15:19 [auto1.fr] INFO: Saving data for HL76122: {'created_time': 1777277719.165577, 'last_price_update_time': 1777277719.165586, 'has_photos': True, 'auction_closing_time': 1777388794.0}
2026-04-27 08:15:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/9a/d19ad78e937d16b10486f50ff4659b01/pa/AR06449_d73a6998d9b5ee5c726cd3949ea9f357.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/9a/d19ad78e937d16b10486f50ff4659b01/pa/AR06449_9acd0ed011cd681d50014a2bd1438785.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/9a/d19ad78e937d16b10486f50ff4659b01/pa/AR06449_1b9efd0baaa3c6456445c7ac8234de97.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143ad8dcd0>
2026-04-27 08:15:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b7ba185-e91d-5495-9a56-a8fc58bee339/6b7ba185-e91d-5495-9a56-a8fc58bee339_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:15:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/9a/d19ad78e937d16b10486f50ff4659b01/pa/AR06449_d73a6998d9b5ee5c726cd3949ea9f357.jpg saved to cache
2026-04-27 08:15:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6b7ba185-e91d-5495-9a56-a8fc58bee339
2026-04-27 08:15:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bffeb90>
2026-04-27 08:15:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b7ba185-e91d-5495-9a56-a8fc58bee339/6b7ba185-e91d-5495-9a56-a8fc58bee339_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:15:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/9a/d19ad78e937d16b10486f50ff4659b01/pa/AR06449_9acd0ed011cd681d50014a2bd1438785.jpg saved to cache
2026-04-27 08:15:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6b7ba185-e91d-5495-9a56-a8fc58bee339
2026-04-27 08:15:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438bfcb90>
2026-04-27 08:15:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b7ba185-e91d-5495-9a56-a8fc58bee339/6b7ba185-e91d-5495-9a56-a8fc58bee339_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:15:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/9a/d19ad78e937d16b10486f50ff4659b01/pa/AR06449_1b9efd0baaa3c6456445c7ac8234de97.jpg saved to cache
2026-04-27 08:15:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6b7ba185-e91d-5495-9a56-a8fc58bee339
2026-04-27 08:15:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6b7ba185-e91d-5495-9a56-a8fc58bee339, skipping ID generation
2026-04-27 08:15:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b7ba185-e91d-5495-9a56-a8fc58bee339 with scrape type 1
2026-04-27 08:15:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6b7ba185-e91d-5495-9a56-a8fc58bee339 sending to next pipeline
2026-04-27 08:15:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6b7ba185-e91d-5495-9a56-a8fc58bee339, identifier: AR06449
2026-04-27 08:15:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6b7ba185-e91d-5495-9a56-a8fc58bee339 with identifier: AR06449
2026-04-27 08:15:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6b7ba185-e91d-5495-9a56-a8fc58bee339 with identifier: AR06449
2026-04-27 08:15:19 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:15:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6b7ba185-e91d-5495-9a56-a8fc58bee339 with identifier: AR06449 to the API
2026-04-27 08:15:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:15:19 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:15:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd1/9a/d19ad78e937d16b10486f50ff4659b01/pa/AR06449_1b9efd0baaa3c6456445c7ac8234de97.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'category': None,
 'city': 'Villenoy',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 68,
 'expiration_date': '2026-04-28T15:33:31Z',
 'fuel_type': 'diesel',
 'id': '6b7ba185-e91d-5495-9a56-a8fc58bee339',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.9411,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AR06449',
 'listing': 'auction',
 'location': 'FR, Villenoy',
 'location_confidence': 'geocoded',
 'longitude': 2.8602,
 'make': 'Citroen',
 'model': 'C2',
 'odometer': 138659,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6b7ba185-e91d-5495-9a56-a8fc58bee339/6b7ba185-e91d-5495-9a56-a8fc58bee339_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99292,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/9a/d19ad78e937d16b10486f50ff4659b01/pa/AR06449_1b9efd0baaa3c6456445c7ac8234de97.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6b7ba185-e91d-5495-9a56-a8fc58bee339/6b7ba185-e91d-5495-9a56-a8fc58bee339_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68782,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/9a/d19ad78e937d16b10486f50ff4659b01/pa/AR06449_9acd0ed011cd681d50014a2bd1438785.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6b7ba185-e91d-5495-9a56-a8fc58bee339/6b7ba185-e91d-5495-9a56-a8fc58bee339_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54045,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/9a/d19ad78e937d16b10486f50ff4659b01/pa/AR06449_d73a6998d9b5ee5c726cd3949ea9f357.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6b7ba185-e91d-5495-9a56-a8fc58bee339/6b7ba185-e91d-5495-9a56-a8fc58bee339_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53437,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/9a/d19ad78e937d16b10486f50ff4659b01/pa/AR06449_ee7ecf75d1335ff0d86cdc5035ee031b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6b7ba185-e91d-5495-9a56-a8fc58bee339/6b7ba185-e91d-5495-9a56-a8fc58bee339_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100184,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/9a/d19ad78e937d16b10486f50ff4659b01/pa/AR06449_94f861f965f881c10d845b5ff82f276c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6b7ba185-e91d-5495-9a56-a8fc58bee339/6b7ba185-e91d-5495-9a56-a8fc58bee339_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48283,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/9a/d19ad78e937d16b10486f50ff4659b01/pa/AR06449_b5eac99c4dc5aabe0eb5bf3d9a0f844d.jpg',
             'Width': 800}],
 'postal_code': '77124',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Seine-et-Marne',
 'province_code': 'FR-77',
 'region': 'Île-de-France',
 'region_code': 'FR-11',
 'registration_date': '2007-12-12',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Citroen C2 1.4 HDi VirginMega',
 'transmission': 'manual',
 'trim': 'VirginMega',
 'year': 2007}
2026-04-27 08:15:19 [auto1.fr] INFO: Saving data for AR06449: {'created_time': 1777277719.848268, 'last_price_update_time': 1777277719.848282, 'has_photos': True, 'auction_closing_time': 1777390411.0}
2026-04-27 08:15:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/0e/f70e3b57bf9a143d2e138cb60c2f1402/pa/RB61201_0e876d01fa02d7e5bbe0776dfc29a373.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/0e/f70e3b57bf9a143d2e138cb60c2f1402/pa/RB61201_95cca98b30cecd06f4375fd6c808a927.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438cebf90>
2026-04-27 08:15:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85439da6-18cf-54c0-8d99-9f3f6d8bc211/85439da6-18cf-54c0-8d99-9f3f6d8bc211_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:15:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/0e/f70e3b57bf9a143d2e138cb60c2f1402/pa/RB61201_0e876d01fa02d7e5bbe0776dfc29a373.jpg saved to cache
2026-04-27 08:15:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 85439da6-18cf-54c0-8d99-9f3f6d8bc211
2026-04-27 08:15:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/0e/f70e3b57bf9a143d2e138cb60c2f1402/pa/RB61201_a05279574aadd87e1198464478265d9e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438cddbd0>
2026-04-27 08:15:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85439da6-18cf-54c0-8d99-9f3f6d8bc211/85439da6-18cf-54c0-8d99-9f3f6d8bc211_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:15:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/0e/f70e3b57bf9a143d2e138cb60c2f1402/pa/RB61201_95cca98b30cecd06f4375fd6c808a927.jpg saved to cache
2026-04-27 08:15:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 85439da6-18cf-54c0-8d99-9f3f6d8bc211
2026-04-27 08:15:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/0e/f70e3b57bf9a143d2e138cb60c2f1402/pa/RB61201_c085c5fc46ce8dd9574f5efd4b727fc6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438bfe750>
2026-04-27 08:15:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85439da6-18cf-54c0-8d99-9f3f6d8bc211/85439da6-18cf-54c0-8d99-9f3f6d8bc211_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:15:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/0e/f70e3b57bf9a143d2e138cb60c2f1402/pa/RB61201_a05279574aadd87e1198464478265d9e.jpg saved to cache
2026-04-27 08:15:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 85439da6-18cf-54c0-8d99-9f3f6d8bc211
2026-04-27 08:15:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438180a90>
2026-04-27 08:15:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85439da6-18cf-54c0-8d99-9f3f6d8bc211/85439da6-18cf-54c0-8d99-9f3f6d8bc211_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:15:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/0e/f70e3b57bf9a143d2e138cb60c2f1402/pa/RB61201_c085c5fc46ce8dd9574f5efd4b727fc6.jpg saved to cache
2026-04-27 08:15:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 85439da6-18cf-54c0-8d99-9f3f6d8bc211
2026-04-27 08:15:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/0e/f70e3b57bf9a143d2e138cb60c2f1402/pa/RB61201_8e1fde397815309b724dce9ea54cb468.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 08:15:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14478cf110>
2026-04-27 08:15:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85439da6-18cf-54c0-8d99-9f3f6d8bc211/85439da6-18cf-54c0-8d99-9f3f6d8bc211_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:15:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/0e/f70e3b57bf9a143d2e138cb60c2f1402/pa/RB61201_8e1fde397815309b724dce9ea54cb468.jpg saved to cache
2026-04-27 08:15:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 85439da6-18cf-54c0-8d99-9f3f6d8bc211
2026-04-27 08:15:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/0e/f70e3b57bf9a143d2e138cb60c2f1402/pa/RB61201_bb6871f30798c15c1c8fa73aa2e7ff8c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/0e/f70e3b57bf9a143d2e138cb60c2f1402/pa/RB61201_f7d519303e6bfcbe749c2eaaf3710369.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c9b550>
2026-04-27 08:15:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85439da6-18cf-54c0-8d99-9f3f6d8bc211/85439da6-18cf-54c0-8d99-9f3f6d8bc211_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:15:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/0e/f70e3b57bf9a143d2e138cb60c2f1402/pa/RB61201_bb6871f30798c15c1c8fa73aa2e7ff8c.jpg saved to cache
2026-04-27 08:15:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 85439da6-18cf-54c0-8d99-9f3f6d8bc211
2026-04-27 08:15:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ff0550>
2026-04-27 08:15:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85439da6-18cf-54c0-8d99-9f3f6d8bc211/85439da6-18cf-54c0-8d99-9f3f6d8bc211_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:15:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/0e/f70e3b57bf9a143d2e138cb60c2f1402/pa/RB61201_f7d519303e6bfcbe749c2eaaf3710369.jpg saved to cache
2026-04-27 08:15:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 85439da6-18cf-54c0-8d99-9f3f6d8bc211
2026-04-27 08:15:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/0e/f70e3b57bf9a143d2e138cb60c2f1402/pa/RB61201_ac89ea022d1b338508bf14d7a1547097.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 08:15:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438189e50>
2026-04-27 08:15:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85439da6-18cf-54c0-8d99-9f3f6d8bc211/85439da6-18cf-54c0-8d99-9f3f6d8bc211_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:15:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/0e/f70e3b57bf9a143d2e138cb60c2f1402/pa/RB61201_ac89ea022d1b338508bf14d7a1547097.jpg saved to cache
2026-04-27 08:15:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 85439da6-18cf-54c0-8d99-9f3f6d8bc211
2026-04-27 08:15:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 85439da6-18cf-54c0-8d99-9f3f6d8bc211, skipping ID generation
2026-04-27 08:15:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85439da6-18cf-54c0-8d99-9f3f6d8bc211 with scrape type 1
2026-04-27 08:15:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 85439da6-18cf-54c0-8d99-9f3f6d8bc211 sending to next pipeline
2026-04-27 08:15:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 85439da6-18cf-54c0-8d99-9f3f6d8bc211, identifier: RB61201
2026-04-27 08:15:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 85439da6-18cf-54c0-8d99-9f3f6d8bc211 with identifier: RB61201
2026-04-27 08:15:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 85439da6-18cf-54c0-8d99-9f3f6d8bc211 with identifier: RB61201
2026-04-27 08:15:21 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:15:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 85439da6-18cf-54c0-8d99-9f3f6d8bc211 with identifier: RB61201 to the API
2026-04-27 08:15:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:15:21 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:15:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf7/0e/f70e3b57bf9a143d2e138cb60c2f1402/pa/RB61201_ac89ea022d1b338508bf14d7a1547097.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 179,
 'category': None,
 'city': 'Sarreguemines',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '3.0L',
 'engine_horse_power': 313,
 'expiration_date': '2026-04-28T15:50:43Z',
 'fuel_type': 'diesel',
 'id': '85439da6-18cf-54c0-8d99-9f3f6d8bc211',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 49.11,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RB61201',
 'listing': 'auction',
 'location': 'FR, Sarreguemines',
 'location_confidence': 'geocoded',
 'longitude': 7.0675,
 'make': 'Audi',
 'model': 'SQ5',
 'odometer': 308698,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_85439da6-18cf-54c0-8d99-9f3f6d8bc211/85439da6-18cf-54c0-8d99-9f3f6d8bc211_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3377849,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/0e/f70e3b57bf9a143d2e138cb60c2f1402/pa/RB61201_ac89ea022d1b338508bf14d7a1547097.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_85439da6-18cf-54c0-8d99-9f3f6d8bc211/85439da6-18cf-54c0-8d99-9f3f6d8bc211_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109660,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/0e/f70e3b57bf9a143d2e138cb60c2f1402/pa/RB61201_f7d519303e6bfcbe749c2eaaf3710369.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_85439da6-18cf-54c0-8d99-9f3f6d8bc211/85439da6-18cf-54c0-8d99-9f3f6d8bc211_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92556,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/0e/f70e3b57bf9a143d2e138cb60c2f1402/pa/RB61201_bb6871f30798c15c1c8fa73aa2e7ff8c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_85439da6-18cf-54c0-8d99-9f3f6d8bc211/85439da6-18cf-54c0-8d99-9f3f6d8bc211_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2840646,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/0e/f70e3b57bf9a143d2e138cb60c2f1402/pa/RB61201_8e1fde397815309b724dce9ea54cb468.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_85439da6-18cf-54c0-8d99-9f3f6d8bc211/85439da6-18cf-54c0-8d99-9f3f6d8bc211_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82601,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/0e/f70e3b57bf9a143d2e138cb60c2f1402/pa/RB61201_c085c5fc46ce8dd9574f5efd4b727fc6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_85439da6-18cf-54c0-8d99-9f3f6d8bc211/85439da6-18cf-54c0-8d99-9f3f6d8bc211_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79384,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/0e/f70e3b57bf9a143d2e138cb60c2f1402/pa/RB61201_a05279574aadd87e1198464478265d9e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_85439da6-18cf-54c0-8d99-9f3f6d8bc211/85439da6-18cf-54c0-8d99-9f3f6d8bc211_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89586,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/0e/f70e3b57bf9a143d2e138cb60c2f1402/pa/RB61201_95cca98b30cecd06f4375fd6c808a927.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_85439da6-18cf-54c0-8d99-9f3f6d8bc211/85439da6-18cf-54c0-8d99-9f3f6d8bc211_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100411,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/0e/f70e3b57bf9a143d2e138cb60c2f1402/pa/RB61201_0e876d01fa02d7e5bbe0776dfc29a373.jpg',
             'Width': 800}],
 'postal_code': '57200',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Moselle',
 'province_code': 'FR-57',
 'region': 'Grand Est',
 'region_code': 'FR-44',
 'registration_date': '2015-01-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi SQ5 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2015}
2026-04-27 08:15:21 [auto1.fr] INFO: Saving data for RB61201: {'created_time': 1777277721.252454, 'last_price_update_time': 1777277721.25247, 'has_photos': True, 'auction_closing_time': 1777391443.0}
2026-04-27 08:15:28 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.210(s), this was the 1st time calling it.
2026-04-27 08:15:28 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.7030484371634875 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:15:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XT54185/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:15:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:15:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:15:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MM27216/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:15:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:15:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HK18550> (referer: https://www.auto1.com/v1/car-details-view/HK18550/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:15:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:15:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4064542b-4b78-56bb-8616-2f1ab788a0b9 with identifier: HK18550
2026-04-27 08:15:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4064542b-4b78-56bb-8616-2f1ab788a0b9 with scrape type 1
2026-04-27 08:15:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 4064542b-4b78-56bb-8616-2f1ab788a0b9
2026-04-27 08:15:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/fc/6cfcc1b2433a826f9bfd5f207aae071a/pa/HK18550_7398b964a3c8fe6f52c50c1c3a21096e.jpg not downloaded yet
2026-04-27 08:15:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/fc/6cfcc1b2433a826f9bfd5f207aae071a/pa/HK18550_d5b6fa6aba5bc5f74fef60b54ea0b824.jpg not downloaded yet
2026-04-27 08:15:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/fc/6cfcc1b2433a826f9bfd5f207aae071a/pa/HK18550_96aeeb1a6b8a914f109b82ce0705ef61.jpg not downloaded yet
2026-04-27 08:15:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/fc/6cfcc1b2433a826f9bfd5f207aae071a/pa/HK18550_f911df0660e25d7b64866c69e25110a4.jpg not downloaded yet
2026-04-27 08:15:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/fc/6cfcc1b2433a826f9bfd5f207aae071a/pa/HK18550_2837eaa569e4a07c518ec195e41872f8.jpg not downloaded yet
2026-04-27 08:15:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/fc/6cfcc1b2433a826f9bfd5f207aae071a/pa/HK18550_bcb6dce626a43b498252eaea9b74a31a.jpg not downloaded yet
2026-04-27 08:15:49 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.796(s), this was the 1st time calling it.
2026-04-27 08:15:49 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.6870739403816835 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:15:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VP85790> (referer: https://www.auto1.com/v1/car-details-view/VP85790/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:15:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:15:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d848203-3812-55c3-9617-66b94da4de99 with identifier: VP85790
2026-04-27 08:15:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d848203-3812-55c3-9617-66b94da4de99 with scrape type 1
2026-04-27 08:15:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2d848203-3812-55c3-9617-66b94da4de99
2026-04-27 08:15:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/79/ee7917264e6841ecc747ab36f60278c6/pa/VP85790_03dc73ecfc56f8913cbbb8dd932cda46.jpg not downloaded yet
2026-04-27 08:15:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/79/ee7917264e6841ecc747ab36f60278c6/pa/VP85790_223258dbbef6e55302f9a0454cf763b2.jpg not downloaded yet
2026-04-27 08:15:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/79/ee7917264e6841ecc747ab36f60278c6/pa/VP85790_29caa9dbaedb4c7c5c8361c0c054bc0b.jpg not downloaded yet
2026-04-27 08:15:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/79/ee7917264e6841ecc747ab36f60278c6/pa/VP85790_2d2ffb2a811e4db79d3d16ad07043525.jpg not downloaded yet
2026-04-27 08:15:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/79/ee7917264e6841ecc747ab36f60278c6/pa/VP85790_69978d0ddef3e895eacf48fa30cff1b4.jpg not downloaded yet
2026-04-27 08:15:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/79/ee7917264e6841ecc747ab36f60278c6/pa/VP85790_f6f9c7011af776af21a2f4630e713e1b.jpg not downloaded yet
2026-04-27 08:15:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/79/ee7917264e6841ecc747ab36f60278c6/pa/VP85790_6ca2cd1a37b297c3091322d254f13c28.jpg not downloaded yet
2026-04-27 08:15:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/fc/6cfcc1b2433a826f9bfd5f207aae071a/pa/HK18550_bcb6dce626a43b498252eaea9b74a31a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/79/ee7917264e6841ecc747ab36f60278c6/pa/VP85790_29c7a153b4f183b83c0f3c6c131f11c6.jpg not downloaded yet
2026-04-27 08:15:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/79/ee7917264e6841ecc747ab36f60278c6/pa/VP85790_d376fb94369114dc5cb3c1be0be98ec4.jpg not downloaded yet
2026-04-27 08:15:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/79/ee7917264e6841ecc747ab36f60278c6/pa/VP85790_e61cb2669ebadd881c4921f954e96fda.jpg not downloaded yet
2026-04-27 08:15:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b29a50>
2026-04-27 08:15:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4064542b-4b78-56bb-8616-2f1ab788a0b9/4064542b-4b78-56bb-8616-2f1ab788a0b9_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:15:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/fc/6cfcc1b2433a826f9bfd5f207aae071a/pa/HK18550_bcb6dce626a43b498252eaea9b74a31a.jpg saved to cache
2026-04-27 08:15:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4064542b-4b78-56bb-8616-2f1ab788a0b9
2026-04-27 08:15:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/79/ee7917264e6841ecc747ab36f60278c6/pa/VP85790_6ca2cd1a37b297c3091322d254f13c28.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143817eb90>
2026-04-27 08:15:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d848203-3812-55c3-9617-66b94da4de99/2d848203-3812-55c3-9617-66b94da4de99_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:15:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/79/ee7917264e6841ecc747ab36f60278c6/pa/VP85790_6ca2cd1a37b297c3091322d254f13c28.jpg saved to cache
2026-04-27 08:15:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2d848203-3812-55c3-9617-66b94da4de99
2026-04-27 08:15:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/79/ee7917264e6841ecc747ab36f60278c6/pa/VP85790_e61cb2669ebadd881c4921f954e96fda.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c9a610>
2026-04-27 08:15:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d848203-3812-55c3-9617-66b94da4de99/2d848203-3812-55c3-9617-66b94da4de99_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:15:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/79/ee7917264e6841ecc747ab36f60278c6/pa/VP85790_e61cb2669ebadd881c4921f954e96fda.jpg saved to cache
2026-04-27 08:15:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2d848203-3812-55c3-9617-66b94da4de99
2026-04-27 08:15:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/79/ee7917264e6841ecc747ab36f60278c6/pa/VP85790_d376fb94369114dc5cb3c1be0be98ec4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d605d0>
2026-04-27 08:15:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d848203-3812-55c3-9617-66b94da4de99/2d848203-3812-55c3-9617-66b94da4de99_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:15:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/79/ee7917264e6841ecc747ab36f60278c6/pa/VP85790_d376fb94369114dc5cb3c1be0be98ec4.jpg saved to cache
2026-04-27 08:15:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2d848203-3812-55c3-9617-66b94da4de99
2026-04-27 08:15:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/79/ee7917264e6841ecc747ab36f60278c6/pa/VP85790_29c7a153b4f183b83c0f3c6c131f11c6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c9aed0>
2026-04-27 08:15:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d848203-3812-55c3-9617-66b94da4de99/2d848203-3812-55c3-9617-66b94da4de99_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:15:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/79/ee7917264e6841ecc747ab36f60278c6/pa/VP85790_29c7a153b4f183b83c0f3c6c131f11c6.jpg saved to cache
2026-04-27 08:15:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2d848203-3812-55c3-9617-66b94da4de99
2026-04-27 08:15:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/79/ee7917264e6841ecc747ab36f60278c6/pa/VP85790_f6f9c7011af776af21a2f4630e713e1b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438d442d0>
2026-04-27 08:15:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d848203-3812-55c3-9617-66b94da4de99/2d848203-3812-55c3-9617-66b94da4de99_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:15:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/79/ee7917264e6841ecc747ab36f60278c6/pa/VP85790_f6f9c7011af776af21a2f4630e713e1b.jpg saved to cache
2026-04-27 08:15:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2d848203-3812-55c3-9617-66b94da4de99
2026-04-27 08:15:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/79/ee7917264e6841ecc747ab36f60278c6/pa/VP85790_69978d0ddef3e895eacf48fa30cff1b4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438e00d90>
2026-04-27 08:15:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d848203-3812-55c3-9617-66b94da4de99/2d848203-3812-55c3-9617-66b94da4de99_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:15:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/79/ee7917264e6841ecc747ab36f60278c6/pa/VP85790_69978d0ddef3e895eacf48fa30cff1b4.jpg saved to cache
2026-04-27 08:15:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2d848203-3812-55c3-9617-66b94da4de99
2026-04-27 08:15:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/79/ee7917264e6841ecc747ab36f60278c6/pa/VP85790_2d2ffb2a811e4db79d3d16ad07043525.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f143817c4d0>
2026-04-27 08:15:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d848203-3812-55c3-9617-66b94da4de99/2d848203-3812-55c3-9617-66b94da4de99_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:15:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/79/ee7917264e6841ecc747ab36f60278c6/pa/VP85790_2d2ffb2a811e4db79d3d16ad07043525.jpg saved to cache
2026-04-27 08:15:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2d848203-3812-55c3-9617-66b94da4de99
2026-04-27 08:15:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/79/ee7917264e6841ecc747ab36f60278c6/pa/VP85790_29caa9dbaedb4c7c5c8361c0c054bc0b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14380a4b10>
2026-04-27 08:15:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d848203-3812-55c3-9617-66b94da4de99/2d848203-3812-55c3-9617-66b94da4de99_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:15:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/79/ee7917264e6841ecc747ab36f60278c6/pa/VP85790_29caa9dbaedb4c7c5c8361c0c054bc0b.jpg saved to cache
2026-04-27 08:15:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2d848203-3812-55c3-9617-66b94da4de99
2026-04-27 08:15:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/79/ee7917264e6841ecc747ab36f60278c6/pa/VP85790_223258dbbef6e55302f9a0454cf763b2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/79/ee7917264e6841ecc747ab36f60278c6/pa/VP85790_03dc73ecfc56f8913cbbb8dd932cda46.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bfff590>
2026-04-27 08:15:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d848203-3812-55c3-9617-66b94da4de99/2d848203-3812-55c3-9617-66b94da4de99_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:15:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/79/ee7917264e6841ecc747ab36f60278c6/pa/VP85790_223258dbbef6e55302f9a0454cf763b2.jpg saved to cache
2026-04-27 08:15:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2d848203-3812-55c3-9617-66b94da4de99
2026-04-27 08:15:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438172ed0>
2026-04-27 08:15:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d848203-3812-55c3-9617-66b94da4de99/2d848203-3812-55c3-9617-66b94da4de99_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:15:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/79/ee7917264e6841ecc747ab36f60278c6/pa/VP85790_03dc73ecfc56f8913cbbb8dd932cda46.jpg saved to cache
2026-04-27 08:15:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2d848203-3812-55c3-9617-66b94da4de99
2026-04-27 08:15:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2d848203-3812-55c3-9617-66b94da4de99, skipping ID generation
2026-04-27 08:15:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d848203-3812-55c3-9617-66b94da4de99 with scrape type 1
2026-04-27 08:15:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2d848203-3812-55c3-9617-66b94da4de99 sending to next pipeline
2026-04-27 08:15:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2d848203-3812-55c3-9617-66b94da4de99, identifier: VP85790
2026-04-27 08:15:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2d848203-3812-55c3-9617-66b94da4de99 with identifier: VP85790
2026-04-27 08:15:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2d848203-3812-55c3-9617-66b94da4de99 with identifier: VP85790
2026-04-27 08:15:54 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:15:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2d848203-3812-55c3-9617-66b94da4de99 with identifier: VP85790 to the API
2026-04-27 08:15:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:15:54 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:15:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgee/79/ee7917264e6841ecc747ab36f60278c6/pa/VP85790_03dc73ecfc56f8913cbbb8dd932cda46.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'category': None,
 'city': 'Loyettes',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 125,
 'expiration_date': '2026-04-28T15:10:36Z',
 'fuel_type': 'petrol',
 'id': '2d848203-3812-55c3-9617-66b94da4de99',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 45.7766,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VP85790',
 'listing': 'auction',
 'location': 'FR, Loyettes',
 'location_confidence': 'geocoded',
 'longitude': 5.2069,
 'make': 'Audi',
 'model': 'A3 Limousine',
 'odometer': 110236,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2d848203-3812-55c3-9617-66b94da4de99/2d848203-3812-55c3-9617-66b94da4de99_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62461,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/79/ee7917264e6841ecc747ab36f60278c6/pa/VP85790_03dc73ecfc56f8913cbbb8dd932cda46.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2d848203-3812-55c3-9617-66b94da4de99/2d848203-3812-55c3-9617-66b94da4de99_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61155,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/79/ee7917264e6841ecc747ab36f60278c6/pa/VP85790_223258dbbef6e55302f9a0454cf763b2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2d848203-3812-55c3-9617-66b94da4de99/2d848203-3812-55c3-9617-66b94da4de99_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57897,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/79/ee7917264e6841ecc747ab36f60278c6/pa/VP85790_29caa9dbaedb4c7c5c8361c0c054bc0b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2d848203-3812-55c3-9617-66b94da4de99/2d848203-3812-55c3-9617-66b94da4de99_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51372,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/79/ee7917264e6841ecc747ab36f60278c6/pa/VP85790_2d2ffb2a811e4db79d3d16ad07043525.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2d848203-3812-55c3-9617-66b94da4de99/2d848203-3812-55c3-9617-66b94da4de99_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50005,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/79/ee7917264e6841ecc747ab36f60278c6/pa/VP85790_69978d0ddef3e895eacf48fa30cff1b4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2d848203-3812-55c3-9617-66b94da4de99/2d848203-3812-55c3-9617-66b94da4de99_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63046,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/79/ee7917264e6841ecc747ab36f60278c6/pa/VP85790_f6f9c7011af776af21a2f4630e713e1b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2d848203-3812-55c3-9617-66b94da4de99/2d848203-3812-55c3-9617-66b94da4de99_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54599,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/79/ee7917264e6841ecc747ab36f60278c6/pa/VP85790_6ca2cd1a37b297c3091322d254f13c28.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2d848203-3812-55c3-9617-66b94da4de99/2d848203-3812-55c3-9617-66b94da4de99_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69756,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/79/ee7917264e6841ecc747ab36f60278c6/pa/VP85790_29c7a153b4f183b83c0f3c6c131f11c6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2d848203-3812-55c3-9617-66b94da4de99/2d848203-3812-55c3-9617-66b94da4de99_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66861,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/79/ee7917264e6841ecc747ab36f60278c6/pa/VP85790_d376fb94369114dc5cb3c1be0be98ec4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2d848203-3812-55c3-9617-66b94da4de99/2d848203-3812-55c3-9617-66b94da4de99_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44270,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/79/ee7917264e6841ecc747ab36f60278c6/pa/VP85790_e61cb2669ebadd881c4921f954e96fda.jpg',
             'Width': 800}],
 'postal_code': '01360',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Ain',
 'province_code': 'FR-01',
 'region': 'Auvergne-Rhône-Alpes',
 'region_code': 'FR-84',
 'registration_date': '2016-02-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A3 Limousine 1.4 TFSI Ambiente',
 'transmission': 'automatic',
 'trim': 'Ambiente',
 'year': 2016}
2026-04-27 08:15:54 [auto1.fr] INFO: Saving data for VP85790: {'created_time': 1777277754.665184, 'last_price_update_time': 1777277754.665194, 'has_photos': True, 'auction_closing_time': 1777389036.0}
2026-04-27 08:15:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/fc/6cfcc1b2433a826f9bfd5f207aae071a/pa/HK18550_2837eaa569e4a07c518ec195e41872f8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438ceb790>
2026-04-27 08:15:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4064542b-4b78-56bb-8616-2f1ab788a0b9/4064542b-4b78-56bb-8616-2f1ab788a0b9_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:15:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/fc/6cfcc1b2433a826f9bfd5f207aae071a/pa/HK18550_2837eaa569e4a07c518ec195e41872f8.jpg saved to cache
2026-04-27 08:15:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4064542b-4b78-56bb-8616-2f1ab788a0b9
2026-04-27 08:15:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/fc/6cfcc1b2433a826f9bfd5f207aae071a/pa/HK18550_f911df0660e25d7b64866c69e25110a4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f142bfb7f90>
2026-04-27 08:15:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4064542b-4b78-56bb-8616-2f1ab788a0b9/4064542b-4b78-56bb-8616-2f1ab788a0b9_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:15:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/fc/6cfcc1b2433a826f9bfd5f207aae071a/pa/HK18550_f911df0660e25d7b64866c69e25110a4.jpg saved to cache
2026-04-27 08:15:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4064542b-4b78-56bb-8616-2f1ab788a0b9
2026-04-27 08:15:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/fc/6cfcc1b2433a826f9bfd5f207aae071a/pa/HK18550_96aeeb1a6b8a914f109b82ce0705ef61.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438cb8210>
2026-04-27 08:15:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4064542b-4b78-56bb-8616-2f1ab788a0b9/4064542b-4b78-56bb-8616-2f1ab788a0b9_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:15:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/fc/6cfcc1b2433a826f9bfd5f207aae071a/pa/HK18550_96aeeb1a6b8a914f109b82ce0705ef61.jpg saved to cache
2026-04-27 08:15:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4064542b-4b78-56bb-8616-2f1ab788a0b9
2026-04-27 08:15:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/fc/6cfcc1b2433a826f9bfd5f207aae071a/pa/HK18550_d5b6fa6aba5bc5f74fef60b54ea0b824.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/fc/6cfcc1b2433a826f9bfd5f207aae071a/pa/HK18550_7398b964a3c8fe6f52c50c1c3a21096e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438c9be90>
2026-04-27 08:15:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4064542b-4b78-56bb-8616-2f1ab788a0b9/4064542b-4b78-56bb-8616-2f1ab788a0b9_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:15:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/fc/6cfcc1b2433a826f9bfd5f207aae071a/pa/HK18550_d5b6fa6aba5bc5f74fef60b54ea0b824.jpg saved to cache
2026-04-27 08:15:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4064542b-4b78-56bb-8616-2f1ab788a0b9
2026-04-27 08:15:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1438b2af10>
2026-04-27 08:15:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4064542b-4b78-56bb-8616-2f1ab788a0b9/4064542b-4b78-56bb-8616-2f1ab788a0b9_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:15:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/fc/6cfcc1b2433a826f9bfd5f207aae071a/pa/HK18550_7398b964a3c8fe6f52c50c1c3a21096e.jpg saved to cache
2026-04-27 08:15:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4064542b-4b78-56bb-8616-2f1ab788a0b9
2026-04-27 08:15:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4064542b-4b78-56bb-8616-2f1ab788a0b9, skipping ID generation
2026-04-27 08:15:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4064542b-4b78-56bb-8616-2f1ab788a0b9 with scrape type 1
2026-04-27 08:15:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4064542b-4b78-56bb-8616-2f1ab788a0b9 sending to next pipeline
2026-04-27 08:15:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4064542b-4b78-56bb-8616-2f1ab788a0b9, identifier: HK18550
2026-04-27 08:15:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4064542b-4b78-56bb-8616-2f1ab788a0b9 with identifier: HK18550
2026-04-27 08:15:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4064542b-4b78-56bb-8616-2f1ab788a0b9 with identifier: HK18550
2026-04-27 08:15:55 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:15:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 4064542b-4b78-56bb-8616-2f1ab788a0b9 with identifier: HK18550 to the API
2026-04-27 08:15:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:15:56 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:15:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6c/fc/6cfcc1b2433a826f9bfd5f207aae071a/pa/HK18550_7398b964a3c8fe6f52c50c1c3a21096e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'category': None,
 'city': 'Beaucaire',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 110,
 'expiration_date': '2026-04-28T15:26:10Z',
 'fuel_type': 'diesel',
 'id': '4064542b-4b78-56bb-8616-2f1ab788a0b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 43.8081,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HK18550',
 'listing': 'auction',
 'location': 'FR, Beaucaire',
 'location_confidence': 'geocoded',
 'longitude': 4.6442,
 'make': 'Citroen',
 'model': 'C4 Grand Picasso',
 'odometer': 171510,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4064542b-4b78-56bb-8616-2f1ab788a0b9/4064542b-4b78-56bb-8616-2f1ab788a0b9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93102,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/fc/6cfcc1b2433a826f9bfd5f207aae071a/pa/HK18550_7398b964a3c8fe6f52c50c1c3a21096e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4064542b-4b78-56bb-8616-2f1ab788a0b9/4064542b-4b78-56bb-8616-2f1ab788a0b9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104202,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/fc/6cfcc1b2433a826f9bfd5f207aae071a/pa/HK18550_d5b6fa6aba5bc5f74fef60b54ea0b824.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4064542b-4b78-56bb-8616-2f1ab788a0b9/4064542b-4b78-56bb-8616-2f1ab788a0b9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91675,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/fc/6cfcc1b2433a826f9bfd5f207aae071a/pa/HK18550_96aeeb1a6b8a914f109b82ce0705ef61.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4064542b-4b78-56bb-8616-2f1ab788a0b9/4064542b-4b78-56bb-8616-2f1ab788a0b9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81892,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/fc/6cfcc1b2433a826f9bfd5f207aae071a/pa/HK18550_f911df0660e25d7b64866c69e25110a4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4064542b-4b78-56bb-8616-2f1ab788a0b9/4064542b-4b78-56bb-8616-2f1ab788a0b9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 129099,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/fc/6cfcc1b2433a826f9bfd5f207aae071a/pa/HK18550_2837eaa569e4a07c518ec195e41872f8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4064542b-4b78-56bb-8616-2f1ab788a0b9/4064542b-4b78-56bb-8616-2f1ab788a0b9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38480,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/fc/6cfcc1b2433a826f9bfd5f207aae071a/pa/HK18550_bcb6dce626a43b498252eaea9b74a31a.jpg',
             'Width': 800}],
 'postal_code': '30300',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Gard',
 'province_code': 'FR-30',
 'region': 'Occitanie',
 'region_code': 'FR-76',
 'registration_date': '2010-06-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C4 Grand Picasso 1.6 HDi Airplay',
 'transmission': 'automatic',
 'trim': 'Airplay',
 'year': 2010}
2026-04-27 08:15:56 [auto1.fr] INFO: Saving data for HK18550: {'created_time': 1777277756.138964, 'last_price_update_time': 1777277756.138975, 'has_photos': True, 'auction_closing_time': 1777389970.0}
2026-04-27 08:15:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:15:59 [scrapy.extensions.logstats] INFO: Crawled 611 pages (at 10 pages/min), scraped 506 items (at 6 items/min)
2026-04-27 08:15:59 [scrapy.extensions.memusage] INFO: Peak memory usage is 373MiB